I would probably be careful about taking it up with the guy making the remarks. You don't want to give him any reason to complain about you.
Hopefully your boss could be objective about enforcing rules against harassment and not let his religion get in the way.
Maybe you could post reminders of what constitutes workplace harassment where the offender is sure to see it?
