Maybe this sign is helpful. Most drivers interpret it thusly:
Glare at pedestrians. Imply you WILL NOT STOP
If they insist on entering crosswalk, JAM ON BRAKES
Glare at the "Peds" who have caused you such pain.
Pedestrians can use the sign afterwards, however. When you stop in front of the simmering driver and yell back, you can point at the sign while gesticulating. The angry driver may glare, but he cannot return your gestures unless he either:
Puts down his Latte, or
Hangs up his cell phone