Muggles have little to no defense against even the simplest of spells. While there are laws to protect Muggles, wizards have gotten away with a lot.