Publish fake stats, get cited in LLMs
Researchers have demonstrated that fabricated statistical data can be incorporated into the training sets of large language models, leading the models to reproduce and cite the false figures as factual. The experiment highlights vulnerabilities in AI text generation, where unverified sources can influence outputs, underscoring the need for stricter data validation and provenance checks to prevent the spread of misinformation.