Although chances are you would not be bothered whatsoever, you are not really supposed to be drinking out of glass bottles in public. But really is only enforced at night, and even that is rare unless you are causing trouble.
A cup or insulated mug would avoid any issue, especially if you want to walk. Beers in an ice chest are no problem.
Out of town, you can pretty much do anything.