You don't need your passport if you have a voters ID card I suppose, or a social security card. If you are wearing a camera around your neck and a loud hawaiian shirt will they know you are just visiting?
I'm a citizen and am asked for my passport regularly. I went to get my new utility meter last week and they asked for it. I open a bank account and they ask for it. I want internet service added and they ask for it. I registered the title to my property and they want copies of it. I always say its a travel document and I'm not traveling! It offends me because i'm a white guy they think i'm a tourist! Jessy may be your never asked because you never go anywhere but Canooks!