Victoria House is an amazing place! We stayed there last month. The grounds were nicely kept up, the pool was gorgeous, the beach was gorgeous and the restaurant was awesome, with wonderful service and food. They also have a cute little bar on the beach. I would suggest eating in the restaurant on a Friday evening when they have a guitar player inside. It adds to the experience.
Our room (the Rainforest Suite) was beautiful. We met some others who were staying in the main building and they said their room was great too. I would say that the resort offers luxury accommodations throughout.
I don't believe VH has a spa there, but I do know that they will schedule services for you. Depending on which room you have, you might even be able to have the massage on your verandah. You can ask them at the front desk. They will take care of just about everything for you.
As for the golf cart ride, it wasn't too far at all. We had a golf cart for the entire week and went into town often. It only took about 10 minutes to get there...not bad at all. The VH, in my opinion, was in the perfect location. It was just far enough to feel like you were isolated, but it was close enough to go into town whenever you wanted to (without the need for a water taxi or ferry)
You will love the VH. It was an amazing place! I am looking forward to going back next year.