Key word being “prayer”.Pooja is also just a prayer ritual performed to reconnect with god and express devotion.
It is no more "taking over" than a "iftar".
Hindus do not have to give any undue consideration for muslim intolerance over this issue.
Prayers are associated with temples or mosques.. iftar is associated with restaurants now more than any other place.