My personal preference for the caving experiences is from the mainland, basing myself at Ian Anderson's Cave Branch, but that;s just me.
http://cavesbranch.com/ Rocky Point, snorkeling, beach BBQ makes a great day too.
Or, you could consider booking a day trip to Caye Caulker, combing snorkeling & sailing!