In my opinion the paper shouldn’t be take down. Instead a note should be added noting the concerns with the pre-print and that’s it’s likely fraudulent.
Edit: Since the paper has been cited, others may still need to reference the paper to determine if it materially affects a paper citing it. If the paper is removed it’s just a void.
That's what happens when a paper is withdrawn [1], and MIT requested to withdraw the paper [2]. This news title saying that they requested to take down the paper is subtly incorrect.
I agree, the offense should have a public trail. But there should be safeguards to prevent any citing of fraudulent paper, not allowing for bits and pieces to outlive the offense. Citing papers should be marked with a warning until resolved by their authors.
Edit: Since the paper has been cited, others may still need to reference the paper to determine if it materially affects a paper citing it. If the paper is removed it’s just a void.