“Ehrlicha Yidden always wear, barring extenuating circumstances…” Tell that to people in Israel who don’t always. Seems to me that wearing a hat and jacket doesn’t make you “ehrlich”. There is a difference between frum (religious) and ehrlich.
What about a man who doesn’t wear a white shirt and black jacket to work (i.e. a repair man or electrician)? If he makes time from his busy day to daven with a minyan, do you want him to go home to change into clothing that would make him look more like you in order to daven? Or do you concider a man who does blue collar labor not really an ehrlich frum Yid anyway?
Like many people here said, keep your eyes in your siddur. What kind of kavana do you all have when your eyes are busy checking out who is frum enough. Your clothes may make you look frum, but when this is what is bothering you, I don’t concider you very ehrlich.