That doesn’t follow. “Harm” doesn’t necessarily mean “kill”, and even people who believe in that sort of thing don’t claim that all or even most ghosts are malevolent.