I will second the opinion for Brianna's! My husband & I stayed there from May 8-16 and it was fabulous. Mary & Judy at Caye Management are a delight to work with. They anwsered all my questions promptly and handled our inter-island air reservations.
The house is great: 2 bedrooms, living room, full kitchen, bath w/shower only. There's a front porch to sit on and watch the tide roll in and two bikes in the shed out back that will get you all around town in a jiffy.
If you have more questions, feel free to ask.