I'l probably get blasted for this reply. Since it seems I'm being overly American. Funny, never felt that way.
Well,being out of the town is good and bad, depends on what you like to do.
I do not know how accessible the Caribe is to town. But if one of the things you really like to do on vacation is sit and "be" with the locals, then you would want to be in town. We unfortunately were not in town, so all we got of local "developing" country life was the Canadians who owned the resort.
So, find out how easy it is to get into town. If it is a boat trip, then it is not as easy as it sounds.
If one of the things you like to do is be by yourself on a beautiful island, with all the tours accessibleby pier, then out of town is for you.
Really it is a personal decision.