Dear Akuperma,
Anyone and everyone was allowed to enter the Beis Hamikdash. Even just to see it. There is no obligation to only come with a korban besides for a regel. The Beis Hamikdash was not some private social club masquerading as a shul, that your only tolerated if we approve of how you daven.