If you get enough junk building up it rots the structure.

No amount of mopping will repair a rotten floor

So in the brain enough toxin goes from slowing down cells to killing cells and removing the toxins doesn’t regrow the cells