You can find fresh fish at the crack of dawn down by the lagoon in back where the fishermen clean their catch.
OR you can sleep in a bit and go to a little shop across from Caye Supplies on back street. It doesnt look like a fish market so if you need help finding it, just ask. You can also follow your nose, as you can usually smell the fish from the curb ....