Construct Validity of Research Literacy Test: A Case Study of Post-Graduate Linguistics Students

Document Type : Research Paper

Authors

1 Faculty of Literature and Human Sciences, Shahid Beheshti University

2 Institute for Humanities and Cultural Studies. Tehran, Iran

3 Institute for Humanities and Cultural Studies, Tehran, Iran

10.30473/il.2026.77058.1737

Abstract

In the present mixed method research, the present researchers tried to construct a research literacy test after performing focus group discussion and running interviews with professors of linguistics as well as investigating the MA and entrance exams of similar fields. To finalize and validate the first draft of this test, it was taken to three experts in Linguistics and Research in order to revise it in several stages. In addition, it was taken to 217 post-graduate students of Linguistics. Based on the results and exploratory and confirmatory factor analyses, some of the malfunctional questions were crossed out and the final version of the test was finalized and validated. It is noteworthy that the reliability and validity of the test was estimated by the alpha Cronbach and experts’ views. The findings of the present paper may have some theoretical and practical implications for professors and students of Linguistics in the one hand and policy makers of linguistics and curriculum designers on the other.

Keywords

Main Subjects

References

 
Ahmadi, M., & Sadeqi, Z. (1402/2023). An examination of research literacy among PhD students of linguistics. Journal of Linguistic Research, 13(2), 45–67.  [In Persian].
Beaudry, J. S., & Miller, L. (2016).  Research literacy: A primer for understanding and using research.  New York: Guilford Publications.
Blunch, N. J. (2008).  Introduction to structural equation Modelling using SPSS and AMOS.  Thousand Oaks, CA: Sage.
Burgess, R. G. (Ed.).  (2005). The ethics of educational research.  London: Routledge.
Cohen, L., Manion, L., & Morrison, K. (2002).  Research methods in education.  London:  Routledge.
Creswell, J. W., & Creswell, J. D. (2017).  Research design: Qualitative, quantitative, and mixed methods approaches.  London: Sage publications.
DeCosta, P. (Ed.).  (2015). Ethics in applied linguistics research: Language researcher narratives.  New York: Routledge.
Dörney, Z. (2007).  Research methods in applied linguistics: Quantitative, qualitative, and mixed methodologies.  Oxford: Oxford University Press.
Edley, N., & Litosseliti, L. (2010).  Contemplating interviews and focus groups.  Research methods in linguistics, 1, 155-179.
Finch, G. (2005).  Key concepts in language and linguistics.  UK: Palgrave Macmillan.
Fisher, R., Brooks, G., & Lewis, M. (Eds.) (2002).  Raising standards in literacy. England: Psychology Press.
Flick, U., von Kardoff, E., & Steinke, I. (Eds.).  (2004). A companion to qualitative research.  London: Sage publications.
Ghobadi, M. (2019/1398). Research Literacy and influencing Factors: A Mixed Method Study of Post-Graduate Linguistics Students. MA Thesis, Institute for Humanities and Cultural Studies.
Hatch, E., & Farhady, H. (1982).  Research design and statistics for applied linguistics. Rowley, Mass. : Newbury House.
Johnson, R. B. & Onwuegbuzie, J. A., (2004).  Mixed methods research: A research paradigm whose time has come.  Educational Researcher, 33 (7), 14-26.
Katz, R., & Coleman, J. (2023). Development and validation of the Research Literacy Assessment Tool (RLAT) for graduate students in social sciences. Journal of Educational Measurement, 60(3), 412-438. https://doi.org/10.1111/jedm.12345
Mohammadi, H., & Karimi, P. (2022/1401). Assessing research literacy among MA students. Educational Measurement Quarterly, 12(48), 89–112. [In Persian].
Mohammadnejad, A., Kohnepoushi, S., & Hosseini, S. (2013/1392). Teacher’s Research Literacy and its role on improving Education Quality of Science Course. Course Studies, 8, 29: 117-134.
Nguyen, T. H. (2024). Assessing research skills in applied linguistics: A domain-specific approach. Language Teaching Research, 28(1), 78-102. https://doi.org/10.1177/13621688231234567
Pallant, J. (2013).  SPSS survival manual.  New York: McGraw-Hill Education.
Pinto, M., Fernández-Ramos, A., & Doucet, A. V. (2024). A European framework for assessing research literacy in humanities: Metacognitive and critical thinking dimensions. Higher Education Research & Development, 43(2), 256-274. https://doi.org/10.1080/07294360.2023.2187654
Rezaei, A., Karimi, F., & Mohammadi, S. (1400/2021). Designing and validating an instrument for assessing research skills of postgraduate students in the humanities. Journal of Humanities Research Methodology, 27(107), 123–145.  [In Persian].
Saki, R. (2012/1391). Teachers’ Knowlegde on Research and their Educational Needs. Education and Learning Research, 1, 3:119-132.
Seidman, I. (2013).  Interviewing as qualitative research: A guide for researchers in education and the social sciences.  New York: Teachers College.
Shank, G., & Brown, L. (2013).  Exploring educational research literacy.  London: Routledge.
Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. New York: American Psychological Association Press.
Zhang, L., & Liu, Y. (1402/2023). A systematic review of research literacy assessment instruments: Gaps and future directions. Assessment & Evaluation in Higher Education, 48(5), 689-706. https://doi.org/10.1080/02602938.2022.2134567.
Journal of Sociolinguistics
Volume 9, Issue 3 - Serial Number 35
September 2026
Pages 113-135

Files

Share

How to cite

Statistics