Just visiting is in the right place. The shailoh is not about gartels, but about low self esteem that someone from one tradition wants to pickup a different tradition because, presumably, it look frummer.
Just visiting suggests other ways to enhance your religiosity. To my taste, this list is a little self centered, especially schlepping your own siddur and shtender. I prefer to use same shul siddur, especially old worn ones that people from previous generation used. You can also buy some shtenders for the shul if it needs them. Also try to attend a shul that is struggling with getting a minyan and come on days where problem is the biggest. Also, path legally near the shul and leave space for pedestrians to walk buy, do not stand in hot shul blocking cols air.