I always wear mine tucked in, even tshirts. I believe you can still be neat, even when dressed casually.

If I wear a sweater or sweatshirt, I will leave it untucked. Be careful with this though. If the tail is too long, the look is just wrong.