I know I'll be called a Pharisee and a legalist for this, but I believe we should dress for church as if we're going to church.
There are 168 hours in a week and some people can't even dress for two hours in such a way that shows that they're participating in something that is different from the other 168 hours.
What about people that wear a suit and tie to work every day? Also, was this also true back when people wore ties even to their neighbors house(think "I Love Lucy") or even when men wore suits to baseball games. Gasp, men used to wear the same thing to church that they wore to a ball game.
As I mentioned earlier, dress what you believe is appropriate. It has nothing to do with you spiritually. Saying we have to dress differently from other activities shows a major lack of the history of dress. We worship God(or we should be) every day in "non-Sunday" dress. God isn't displeased with that.