Check out Banana Beach, 15 min walk to town down the beach, not a lot of traffic on the beach like at the Yacht Club, has a great in house resturant, the breakfast they furnish with the room is good, its clean, friendly and accessable.
Its also resonable. We had a beach view for 7 days at less than $1000. Victoria House looked great but its pricey and another 10 mins to town by foot.