International Journal of Emerging Research in Engineering, Science, and Management
Vol. 4, Issue 2, pp. 68-76, Apr-Jun 2025.
https://doi.org/10.58482/ijeresm.v4i2.9

Assessing Computer Science Teachers' Competence in Constructing Essay Test Items: A Comparative Study of Lower and Higher Order Thinking Skills in Junior Secondary Schools in Benue State

Aegiri Isaiah Agama

Akong Anthony Agboro

School of Sciences, Department of Computer Science, Federal College of Education, Odugbo, Benue State, Nigeria.

Abstract: This study assessed the competence of junior secondary school Computer Science teachers in Benue State, Nigeria, in constructing essay test items based on Bloom’s Taxonomy, comparing the LOTS and HOTS. Adopting a descriptive survey design, the study was guided by two research questions and a hypothesis. The scope targeted junior secondary school Computer Science teachers in the state, and stratified disproportionate random sampling was used to select 105 teachers. Data was collected using the Computer Science Teachers’ Essay Test Item Construction Competency Test (CSTETICCT), a validated 30-item instrument covering all six cognitive levels of Bloom’s Taxonomy. Instrument reliability was confirmed through a pilot test involving 20 respondents, yielding a KR-20 coefficient of 0.85. Descriptive statistics (frequencies, percentages, means, and standard deviations) and visual aids (charts and graphs via Microsoft Excel) were used for data presentation. Inferential statistics, including t-test, ANOVA, and post hoc analysis, were conducted using SPSS Version 20. Findings, among others, revealed that teachers demonstrated high competence in constructing items for lower-order thinking skills (knowledge and comprehension), moderate ability at the application level, and low competence in higher-order thinking skills (analysis, synthesis, and evaluation), these different competency levels in constructing items that assess LOTS and HOTS were found to be significant. The study concludes that while teachers are proficient in evaluating lower-order cognitive skills, there is a notable gap in their ability to develop higher-order assessment items. It recommends continuous professional development, curriculum revision to include specialised Computer Science training, optional certification in assessment design, and mentorship programs to enhance teachers’ assessment competencies across all cognitive levels.

Keywords: Assessment, Construction Competency, Essay Tests, Teachers’ Characteristics.

References: 

  1. A. Saludo, “M1L3_Introduction to Classroom Assessment,” Scribd. https://www.scribd.com/presentation/535877836/M1L3-Introduction-to-Classroom-Assessment
  2. Gichuru Francis Maina, “Classroom Assessment Practices in Kenyan Secondary Schools: Teacher Perspective,” University of Nairobi Research Archive, 2014.
  3. Benjamin Samuel Bloom, Taxonomy of Educational Objectives: The Classification of Educational Goals. Longmans, Green, 1956.
  4. Lorin Anderson et al., Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives, Abridged Edition. New York: Longman, 2001.
  5. “Supporting teacher competence development for better learning outcomes | European School Education Platform,” Nov. 12, 2014. https://school-education.ec.europa.eu/en/discover/publications/supporting-teacher-competence-development-better-learning-outcomes
  6. L. S. Shulman, “Those who understand: Knowledge growth in teaching,” Educational Researcher, vol. 15, no. 2, pp. 4–14, Feb. 1986, doi: 10.3102/0013189×015002004.
  7. M. Yang, Z. Yan, L. Yang, and Y. Zhan, “Using self-assessment to develop student assessment literacy,” in Springer briefs in education, 2025, pp. 41–49. doi: 10.1007/978-981-97-9484-3_3.
  8. A. J. Nitko, and S. M. Brookhart, Educational Assessment of Students. Pearson, 2014.
  9. Lussy Dwiutami Wahyuni, Gumgum Gumela and Herdiyan Maulana, “Interrater Reliability: Comparison of essay’s tests and scoring rubrics,” Journal of Physics Conference Series, 2020, doi: 10.1088/17426596/1933/1/012081
  10. F. Leite-Mendes, L. Delgado, A. Ferreira, and M. Severo, “The effect of the attitude towards risk/ambiguity on examination grades: cross-sectional study in a Portuguese medical school,” Advances in Health Sciences Education, vol. 29, no. 4, pp. 1309–1321, Jan. 2024, doi: 10.1007/s10459-023-10305-z.
  11. J. M. V. Mitana, M. Giacomazzi, and M. F. Abad, “The role of assessment practices in fostering higher order thinking skills: The case of Uganda Certificate of Education,” American Journal of Educational Research, vol. 9, no. 10, pp. 612–620, Oct. 2021, doi: 10.12691/education-9-10-2.
  12. N. E. Sinaga, N. D. R. Simanjuntak, N. C. Saragih, N. E. Manurung, and N. B. L. Siahaan, “The effect of Higher Order Thinking Skills (HOTS) questions on student writing Skills at SMA Negeri 3 Pematangsiantar,” Indonesian Journal of Applied and Industrial Sciences (ESA), vol. 2, no. 2, pp. 175–206, Mar. 2023, doi: 10.55927/esa.v2i2.3303.
  13. M. Shalihah, D. Dzulfikri, and M. Mustofa, “Analyzing higher order thinking skills (HOTS) questions of reading essay tasks in senior high school English textbook,” English Education Journal, vol. 13, no. 1, pp. 106–121, Mar. 2022, doi: 10.24815/eej.v13i1.23956.
  14. L. O. Wilson, “Anderson and Krathwohl’s Taxonomy – The Revised Bloom’s Taxonomy,” The Second Principle, 2020. Retrieved from https://thesecondprinciple.com/teaching-essentials/beyond-bloom-cognitive-taxonomy-revised/
  15. P. Armstrong, “Bloom’s Taxonomy,” Vanderbilt University Center for Teaching, 2016. Retrieved from: https://cft.vanderbilt.edu/guides-sub-pages/blooms-taxonomy/
  16. Thomas M. Haladyna, Michael C. Rodriguez, Developing and Validating Test Items. Routledge, 2013.
  17. Anderson, R. (2022). Effective Assessment for Deeper Learning: A Guide for Educators. Routledge.
  18. Drljača Margić, B., & Šiško, J. (2020). Teacher perceptions of cognitive levels in assessment tasks: A study based on revised Bloom’s taxonomy. Center for Educational Policy Studies Journal, 10(2), 53–74. https://doi.org/10.26529/cepsj.643
  19. J. W. Pellegrino, “Assessment as a positive influence on 21st century teaching and learning: A systems approach to progress,” Psicologí a Educativa, vol. 20, no. 2, pp. 65–77, Dec. 2014, doi: 10.1016/j.pse.2014.11.002.
  20. S. L. Wise, S. Im, and J. Lee, “The impact of disengaged test taking on a state’s accountability test results,” Educational Assessment, vol. 26, no. 3, pp. 163–174, Jul. 2021, doi: 10.1080/10627197.2021.1956897.
  21. S. Volet, “Extending, broadening and rethinking existing research on transfer of training,” Educational Research Review, vol. 8, pp. 90–95, Dec. 2012, doi: 10.1016/j.edurev.2012.11.005.
  22. C. Gichuhi, “Teachers’ competence in tests construction within blooms taxonomy for effective learning assessment: a case study of Kikuyu district, Kiambu county,” 2014. https://erepository.uonbi.ac.ke/handle/11295/76048
  23. B. S. Plake, J. C. Impara, and J. J. Fager, “Assessment Competencies of Teachers: a national survey,” Educational Measurement Issues and Practice, vol. 12, no. 4, pp. 10–12, Dec. 1993, doi: 10.1111/j.1745-3992.1993.tb00548.x.
  24. Lake Bedilu, “Secondary School Teachers’ Competence in Educational Assessment of Students in Bahir Dar Town,” Bahir Dar Journal of Education, vol. 14, no. 2, pp. 54-63, 2014, doi: 10.4314/bdje.v14i2.
  25. M. O. Aduloju, C.I. Agi, “Assessment of Basic Science Teachers’ Competency in item Construction and item analysis in Junior Secondary School in Nasarawa State,” African Journal of Theory and Practice of Educational Assessment, vol. 2, no. 1, 2015.
  26. A. Tagele and L. Bedilu, “Teachers competence in the educational assessment of students: The case of secondary school teachers in the Amhara National Regional State,” The Ethiopian Journal of Education, vol. 35, no. 2, pp. 163–191, 2015, [Online]. Available: https://www.jstor.org/stable/48815860
  27. P. Kissi, D. Baidoo-Anu, E. Anane, and R. K. Annan-Brew, “Teachers’ test construction competencies in examination-oriented educational system: Exploring teachers’ multiple-choice test construction competence,” Frontiers in Education, vol. 8, Apr. 2023, doi: 10.3389/feduc.2023.1154592.
  28. Amna Saleem, Rani Gul, and Adnan Ahmad Dogar, “Effectiveness of Continuous Professional Development Program as Perceived by Primary Level Teachers,” Ilkogretim Online – Elementary Education Online, 20, no. 3, pp. 53-72, 2021, doi: 10.17051/ilkonline.2021.03.06.
  29. Michael Karlin,  Conrad Oh-Young, Swati Mehta, and Mahya Minaiy, “Integrating Computer Science into Preservice Special Education Coursework: Exploring Faculty Perspectives and Practices,” CITE Journal, 24, no. 4, 2024.