I would add Rainbow Hotel and Tropical Paradise to your list. Rainbow is north from the water taxi dock on the left side of Front St. Tropical is south on Front St. all the way at the end (you cannot miss it).
As for making reservations, for a 2 night stay, you probably won't need one. Most hotels/houses/rooms do require a deposit on stays for a week or longer.