I always feel comfortable, basically in any situation except perhaps airports.
I personally go to the airport looking like a homeless person, because I think people will leave me alone. But I dress myself with my luggage - all my luggage matches.