Pedro's Inn is a budget friendly place. Hostel la Vista has private rooms right in the heart of town, affordable.
Ak Bol is north, near good fishing. They have some very budget friendly rooms. Friendly neighborhood bar on site, with affordable food and cheap beer.
Might want to check into Harriette's Birdland.
If self-catering means with a kitchen..... Might want check into Blue Tang.
DYI fly-fishing is excellent in the flats north of Journey's End.