We spent two weeks at the Phoenix last May for our 25th anniversary. Never heard any crying babies. We highly recommend it. The service, amenities, and condos are all first-rate. We found the food at Red Ginger delightful, if a bit pricey. The nice thing about the Phoenix that tipped the balance for us (we were also choosing between it and Victoria House) was that we could walk to eat so many places. We like to try a variety of different spots on vacation and so enjoyed our morning and evening walks to various restaurants -- we never even bothered going far enough away to take a water taxi.
We did take a few long walks down south and saw Victoria House, and it was lovely, but we were very happy with the choice of the Phoenix. No complaints whatsoever!