The origin of refering to political/religious positions as “left” or “right” comes from the French Parliament where the radicals sat to the left of the dais and the conservative representatives sat to the right. The avodah in the Beis Hamqidash has nothing to do with it.
