Neutrinos don't have a zero chance of interacting with normal matter, they just have an extremely low chance (otherwise, we wouldn't be able to detect them). I'm guessing that at a high enough concentration, even with the low odds, that enough interact with atoms in your body to cause problems. But that's just my guess.

__________________
At night the stars put on a show for free (Carole King)

One Earth, One Sky - IYA 2009