Toronto is one of the few places I've seen people wearing kilts casually on, as far as I know, non-event days.
So you're not alone.

But then you're going to see anything on Queen, aren't you?