Examining the Benefits of Using ChatGPT in Preparing Interview Questions

Authors

  • Şevval Nur Şen İnönü Üniversitesi
  • Mert Şen
  • Oktay Bektaş

DOI:

https://doi.org/10.14689/enad.42.2059

Keywords:

artificial intelligence, ChatGPT, qualitative research, interview

Abstract

The number of studies on using ChatGPT in scientific and qualitative research is increasing daily. This study investigates the usability of ChatGPT in the interview question preparation phase of qualitative research by taking into account its features such as text generation, ease of use, and being trained with a large data set. In the study, the researchers prepared interview questions for the research problem they identified and compared them with the questions prepared by ChatGPT. The study results show that ChatGPT can generate the variety and depth of questions that researchers need by using its large data set and various features.  As a result, we determined that ChatGPT can provide valuable support to researchers in the interview question preparation stages. This support will allow researchers to use their time more effectively, develop their questions more comprehensively and in-depth, and improve the quality of the data obtained from the research.

References

Ali, R., Tang, O. Y., Connolly, I. D., Fridley, J. S., Shin, J. H., Sullivan, P. L., . . . Asaad, W. F. (2022). Performance of ChatGPT, GPT-4, and Google Bard on a neurosurgery oral boards preparation question bank. Neurosurgery, 93(5), 1090-1098. doi:10.1227/neu.0000000000002551

AlZu’bi, S., Mughaid, A., Quiam, F., & Hendawi, S. (2024). Exploring the capabilities and limitations of ChatGPT and alternative big language models. In Artificial Intelligence and Applications, 2(1), 28-37. doi: https://doi.org/10.47852/bonviewAIA3202820

Ballena, C. T. (2021). Qualitative research interviewing: Typology of graduate students’ interview questions. Philippine Social Science Journal, 4(3), 96-112. doi:https://doi.org/10.52006/main.v4i3.376

Brett, B. M., & Wheeler, K. (2021). How to Do Qualitative Interviewing. SAGE.

Brinkmann, S. (2021). Görüşme. N. K. Denzin, & Y. S. Lincoln (Ed.). SAGE Nitel Araştırmalar Kılavuz Kitabi (S. Yeşilçınar, & G. Ekici, Trans.). Vizetek.

Brinkmann, S., & Kvale, S. (2014). InterViews: Learning the Craft of Qualitative Research Interviewing (3 b.). SAGE.

ChatGPT (2024). ChatGPT nedir?. Available at: https://chat.openai.com/chat (accesed 9 January 2024)

Costa, A. P. (2023). Qualitative research methods: Do digital tools open promising trends? Revista Lusófona de Educação(59), 67-76. doi:10.24140/issn.1645-7250.rle59.04

Creswell , J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE Publications.

de Winter, J. (2023). Can ChatGPT pass high school exams on English language comprehension? International Journal of Artificial Intelligence in Education. doi:https://doi.org/10.1007/s40593-023-00372-z

Dengel, A., Gehrlein, R., Fernes, D., Görlich, S., Maurer, J., Pham, H. H., . . . Eisermann, N. D. (2023). Qualitative research methods for large language models: Conducting semi-structured interviews with ChatGPT and BARD on computer science education. Informatics, 10(4), 78. doi:https://doi.org/10.3390/informatics10040078

Ezberci-Çevik, E. (2023). Görüşme (Mülakat). O. Bektaş, & T. G. Şahin (Ed.), Nitel Araştırma Süreci ve Uygulamaları. Asos Yayınları.

Fleming, S. L., Morse, K., Kumar, A. M., Chiang, C. C., Patel, B., Brunskill, E. P., & Shah, N. (2023). Assessing the Potential of USMLE-Like Exam Questions Generated by GPT-4. medRxiv. https://doi.org/10.1101/2023.04.25.23288588

Gill, S. S., & Kaur, R. (2023). ChatGPT: Vision and challenges. Internet of Things and Cyber-Physical Systems 3(3), 262-271. doi:https://doi.org/10.1016/j.iotcps.2023.05.004

Given, L. M. (2021). 100 Soruda Nitel Araştırma. (A. Bakla , & İ. Çakır, Trans.) Anı Yayıncılık.

Hà, T. A., & Nguyễn, M. Q. (2023). Research on making interview questions among Vietnamese students: difficulties, reflection, and solutions – a perspective of learning by doing. Reflective Practice, 25(1), 40-57. doi:https://doi.org/10.1080/14623943.2023.2284324

Hamilton, L., Elliot, D., Quick, A., Smith, S., & Choplin, V. (2023). Exploring the use of AI in qualitative analysis: A comparative study of guaranteed income data. International Journal of Qualitative Methods(22). doi:https://doi.org/10.1177/16094069231201504

Handa, P., Chhabra, D., Goel, N., & Krishnan, S. (2023). Exploring the role of ChatGPT in medical image analysis. Biomedical Signal Processing and Control(86). doi:https://doi.org/10.1016/j.bspc.2023.105292

Hill-Yardin, E. L., Hutchinson, M. R., Laycock, R., & Spencer, S. J. (2023). A Chat(GPT) about the future of scientific publishing. Brain, Behavior, and Immunity(110), 152-154. doi:https://doi.org/10.1016/j.bbi.2023.02.022

Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res, 13(4), 1148–1154. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/ adresinden alındı

Khlaif, Z. N., Mousa, A., Hattab, M. K., Itmazi, J., Hassan, A. A., Sanmugam, M., & Ayyoub, A. (2023). The potential and concerns of using AI in scientific research: ChatGPT performance evaluation. JMIR Medical Education, 9, e47049. doi:10.2196/47049

Kızıldağ, H. (2023). Can artificial intelligence become a fairy tale creator/narrator? Chatgpt tales. Turkish Studies - Language and Literature, 18(3), 1759-1775. doi:http://dx.doi.org/10.7827/TurkishStudies.71763

Lee, S., & Park, G. (2023). Exploring the impact of ChatGPT literacy on user satisfaction: The mediating role of user motivations. Cyberpsychology, Behavior, and Social Networking, 26(12), 913-918. doi:http://doi.org/10.1089/cyber.2023.0312

Lee, U., Jung, H., Jeon, Y., Sohn, Y., Hwang, W., Moon, J., & Kim, H. (2023). Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in English education. Education and Information Technologies. doi:https://doi.org/10.1007/s10639-023-12249-8

Lewandowski, M., Łukowicz, P., Świetlik, D., & Barańska-Rybak, W. (2023). An original study of ChatGPT-3.5 and ChatGPT-4 dermatological knowledge level based on the dermatology specialty certificate examinations. Clinical and Experimental Dermatology, llad255. https://doi.org/10.1093/ced/llad255

Lund, B. D., & Wnag, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News, 40(3), 26-29. doi:10.1108/LHTN-01-2023-0009

Merriam, S. B. (2018). Nitel araştırma desen ve uygulama için bir rehber. (S. Turhan, Trans.). Nobel Yayıncılık.

Morgan, D. L. (2023). Exploring the use of artificial intelligence for qualitative data analysis: The Case of ChatGPT. International Journal of Qualitative Methods(22). doi:https://doi.org/10.1177/16094069231211248

Nacaroğlu, O., & Eroğlu, S. (2023). Bireysel Araştırma. O. Bektaş, & T. G. Şahin (Ed). Nitel Araştırma Süreci ve Uygulamaları (s. 135-156). Asos Yayınları.

Obaid, O. I., Ali, A. H., & Yaseen, M. G. (2023). Impact of Chat GPT on scientific research: Opportunities, risks, limitations, and ethical issues. Iraqi Journal for Computer Science and Mathematics, 4(4), 13-17. doi:https://doi.org/ 10.52866/ijcsm.2023.04.04.002

OpenAI. (2024). GPT-4. Available at: https://openai.com/: https://openai.com/research/gpt-4 (accessed 11 January 2024).

Patton, M. Q. (2018). Nitel araştırma ve değerlendirme yöntemleri. (M. Bütün, & S. B. Demir, Trans.) Pegem Akademi.

Qasem, F. (2023). ChatGPT in scientific and academic research: future fears and reassurances. Library Hi Tech News, 40(3), 30-32. Available at: https://www.emerald.com/insight/content/doi/10.1108/LHTN-03-2023-0043/full/html

Rahaman, M. S., Ahsan, M. T., Anjum, N., Tereno, H. J., & Rahman, M. M. (2023). From ChatGPT-3 to GPT-4: A Significant Advancement in AI-Driven NLP Tools. Journal of Engineering and Emerging Technologies, 2(1), 1-11. doi:10.52631/jeet.v2i1.188

Ray, P. P. (2023). ChatGPT: A comprehensive review of background, applications, key challenges, bias, ethics, limitations, and future scope. Internet of Things and Cyber-Physical Systems, 3, 121-154. doi:https://doi.org/10.1016/j.iotcps.2023.04.003

Rice, S., Crouse, S. R., Winter, S. R., & Rice, C. (2024). The advantages and limitations of using ChatGPT to enhance technological research. Technology in Society, 76, 102426. doi:https://doi.org/10.1016/j.techsoc.2023.102426

Roberts, R. E. (2020). Qualitative interview questions: Guidance for novice researchers. The Qualitative Report, 25(9), 3185-3203.

Siiman, L. A., Rannastu-Avalos, M., Pöysä-Tarhonen, J., Häkkinen, P., & Pedaste, M. (2023). Opportunities and challenges for AI-assisted qualitative data analysis: An example from collaborative problem-solving discourse data. Innovative Technologies and Learning(14099), 87-96. doi:https://doi.org/10.1007/978-3-031-40113-8_9

Staller, K. M. (2022). Confusing questions in qualitative inquiry: Research, interview, and analysis. Qualitative Social Work, 21(1), 227-234. doi:https://doi.org/10.1177/14733250221080533

Sun, H. (2023). Ethical consideration of the use of generative artificial intelligence, including ChatGPT in writing a nursing article. Child Health Nurs Research, 29(4), 249-251. doi:https://doi.org/10.4094/chnr.2023.29.4.249

Şen, M., Şahin, T. G., Bektaş, O., & Aydemir, H. (2023). Veri Toplama Aracı Olarak Yaratıcı Dramayı Kullanmak: Fenodrama. O. Bektaş, & T. G. Şahin (Ed.). Nitel Araştırma Süreci ve Uygulamaları (s. 255-298). Asos Yayınları.

Şen, M., Şen, Ş. N., & Şahin, T. G. (2023). A new era for data analysis in qualitative research: ChatGPT! Shanlax International Journal of Education, 11(1), 1-15. doi:https://doi.org/10.34293/education.v11iS1-Oct.6683

Tang, A., Li, K. K., Kwok, K. O., Cao, L., Luong, S., & Tam, W. (2023). The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing. Journal of Nursing Scholarship, 1-5. doi:https://doi.org/10.1111/jnu.12938

Taylor, ZW. (2023). Using Chat GPT to Clean Interview Transcriptions: A Usability and Feasibility Analysis. Available at SSRN: https://ssrn.com/abstract=4437272 or http://dx.doi.org/10.2139/ssrn.4437272

Wang, X., Anwer, N., Dai, Y., & Liu, A. (2023). ChatGPT for design, manufacturing, and education. Procedia CIRP, 119, 7-14. doi:https://doi.org/10.1016/j.procir.2023.04.001

Xiou, Y., & Zhi, Y. (2023). An exploratory study of EFL learners’ use of ChatGPT for language learning tasks: Experience and perceptions. Languages, 8(3), 212. doi:https://doi.org/10.3390/languages8030212

Yücel, A. G., & Kızkapan, O. (2023). Nitel Araştırmanın Temelleri. O. Bektaş, & T. G. Şahin (Ed.). Nİtel Araştırma Süreci ve Uygulamaları (s. 21-42). Asos Yayınları.

Downloads

Published

2025-04-30

How to Cite

Şen, Şevval N., Şen, M., & Bektaş, O. (2025). Examining the Benefits of Using ChatGPT in Preparing Interview Questions. Journal of Qualitative Research in Education, (42), 69–102. https://doi.org/10.14689/enad.42.2059