DETECTING FACTUAL ERRORS AND FABRICATED SCIENTIFIC REFERENCES IN GENERATIVE AI RESPONSES: THEORETICAL FOUNDATIONS AND RESEARCH PROSPECTS AMONG UNIVERSITY STUDENTS IN UZBEKISTAN

Authors

  • Rakhimkhonova Diyora M., Sayfullayeva Shirin B. Student, Namangan Branch of KIUT, Namangan, Uzbekistan Author

Keywords:

generative artificial intelligence, AI hallucinations, fabricated references, information literacy, critical thinking, higher education, medical education, academic integrity.

Abstract

Generative artificial intelligence (AI) tools are increasingly used by university students to obtain explanations, summarise literature, prepare assignments and search for scientific sources. However, these systems can produce, in a fluent and convincing style, incorrect facts, inaccurate bibliographic details and references to publications that do not exist. Drawing on literature on AI hallucinations, information literacy, evidence-based practice and cognitive psychology, this article analyses the theoretical foundations of detecting factual errors and fabricated references in generative AI output. Empirical studies show that a substantial proportion of references generated by large language models are fabricated or inaccurate, and that even medical trainees do not reliably recognise such errors. The article proposes a conceptual framework for studying students' ability to distinguish accurate from inaccurate information and genuine from fabricated references, a multicentre study design for universities in Uzbekistan, and a six-step educational model for improving AI literacy.

References

1.Association of College and Research Libraries. (2016). Framework for Information Literacy for Higher Education. American Library Association. https://www.ala.org/acrl/standards/ilframework

2.Alkaissi, H., & McFarlane, S. I. (2023). Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus, 15(2), e35179. https://doi.org/10.7759/cureus.35179

3.Athaluri, S. A., Manthena, S. V., Kesapragada, V. S. R. K. M., Yarlagadda, V., Dave, T., & Duddumpudi, R. T. S. (2023). Exploring the boundaries of reality: Investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus, 15(4), e37432. https://doi.org/10.7759/cureus.37432

4.Bhattacharyya, M., Miller, V. M., Bhattacharyya, D., & Miller, L. E. (2023). High rates of fabricated and inaccurate references in ChatGPT-generated medical content. Cureus, 15(5), e39238. https://doi.org/10.7759/cureus.39238

5.Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., & FitzGerald, W. T. (2024). The Craft of Research (5th ed.). University of Chicago Press.

6.Chelli, M., Descamps, J., Lavoué, V., Trojani, C., Azar, M., Deckert, M., Raynier, J.-L., Clowez, G., Boileau, P., & Ruetsch-Chelli, C. (2024). Hallucination rates and reference accuracy of ChatGPT and Bard for systematic reviews: Comparative analysis. Journal of Medical Internet Research, 26, e53164. https://doi.org/10.2196/53164

7.Creswell, J. W., & Creswell, J. D. (2022). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (6th ed.). SAGE Publications.

8.Gravel, J., D'Amours-Gravel, M., & Osmanlliu, E. (2023). Learning to fake it: Limited responses and fabricated references provided by ChatGPT for medical questions. Mayo Clinic Proceedings: Digital Health, 1(3), 226–234. https://doi.org/10.1016/j.mcpdig.2023.05.004

9.Greenhalgh, T., & Dijkstra, P. (2024). How to Read a Paper: The Basics of Evidence-Based Healthcare (7th ed.). Wiley. https://doi.org/10.1002/9781394206933

10.Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), Article 248, 1–38. https://doi.org/10.1145/3571730

11.Kahneman, D. (2011). Thinking, Fast and Slow. Farrar, Straus and Giroux.

12.Kasneci, E., Sessler, K., Küchemann, S., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

13.Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134. https://doi.org/10.1037/0022-3514.77.6.1121

14.Kung, T. H., Cheatham, M., Medenilla, A., et al. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digital Health, 2(2), e0000198. https://doi.org/10.1371/journal.pdig.0000198

15.Miao, F., & Holmes, W. (2023). Guidance for Generative AI in Education and Research. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000386693

16.O'zbekiston Respublikasi Prezidentining 2024-yil 14-oktabrdagi PQ-358-son "2030-yilgacha sun'iy intellekt texnologiyalarini rivojlantirish strategiyasini tasdiqlash to'g'risida"gi qarori. https://lex.uz/docs/7159258

17.Pennycook, G., & Rand, D. G. (2019). Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition, 188, 39–50. https://doi.org/10.1016/j.cognition.2018.06.011

18.Pratama, H. (2025). Training students to identify and correct fabricated references in ChatGPT-generated literature reviews. Conference on English Language Teaching (CELTI) Proceedings, 25–36. https://doi.org/10.24090/celti.2025.1335

19.Russell, S. J., & Norvig, P. (2020). Artificial Intelligence: A Modern Approach (4th ed.). Pearson.

20.Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887. https://doi.org/10.3390/healthcare11060887

21.Walters, W. H., & Wilder, E. I. (2023). Fabrication and errors in the bibliographic citations generated by ChatGPT. Scientific Reports, 13, 14045. https://doi.org/10.1038/s41598-023-41032-5

22.Zhou, J., Zhang, J., Wan, R., Cui, X., Liu, Q., Guo, H., et al. (2025). Integrating AI into clinical education: Evaluating general practice trainees' proficiency in distinguishing AI-generated hallucinations and impacting factors. BMC Medical Education, 25, Article 406. https://doi.org/10.1186/s12909-025-06916-2

Downloads

Published

2026-11-01