While still in the rainy season, those months actually aren't that bad. There are days when I found I welcomed the cooling rain.
The season is also less "touristy" but the popularity of the island is changing that somewhat. No matter when you go, you will love the island. Just go and have fun!