They may be haters they are, but it may also be a fact that some groups pay less than others. Answering “Because they pay taxes and income tax according to the law” is a dishonest misdirection.
How do you bring sholom between these worrying parties?
Either you need to convince the chilonim that your spiritual contribution is worthy his tax contribution or simply reduce taxes for everyone, use private contributions to maintain your society. In both cases, you can then hope to bring other Israelis closer to the Torah.