One reason was that the government didn't like the people using the the psychedelics in the first place, and drugs were a convenient justification for going after those people. Marijuana prohibition in the US is the same story.