http://en.wikipedia.org/wiki/Kielce_pogrom
http://en.wikipedia.org/wiki/Anti-Jewish_violence_in_Poland,_1944-1946
The view that local populations were just surviving and had no ill will against the Jews is simplistic and ignores how willing and happy local populations were to take advantage of the Jewish plight. In fact, where you see anti Jewish violence the most from local populations is AFTER the war, when Jews tried to reclaim their property. Local populations sometimes resorted to violence, and more often gladly accepted Jewish property which was never returned in many cases.
In addition, the idea that non-Jews could not have saved a substantial portion their Jewish populations is flat wrong. Allied States like Bulgaria and Occupied states like Denmark and even to some extent Axis Italy defied Nazi demands to round up Jews and saved nearly their entire populations.
To give Europe a pass for the holocaust is wrong. Some countries (not Germany) are more culpable than others, Greece, the Soviet Union, and Poland really had no choice. However, others, like Hungary, gladly rounded up its Jews to send them to Germany for extermination despite the fact that Germany had little power to compel them to do so.
In the end, animosity toward the Jews greased the wheels toward extermination throughout Europe. Can you truly see the reich able to gas Catholics to the same extent that they did Jews? Jews were expendable, they were isolated, they were weak, and to the majority they were an acceptable sacrifice to appease the Nazis..