Assessment task analysis: review of foreign approaches


Cite item

Full Text

Abstract

The assessment task is one of the key factors in achieving an accurate, reliable and valid assessment. The effectiveness of assessment is directly dependent on the characteristics of the task and its compliance with the requirements. The analysis of foreign theoretical sources made it possible to identify various analytical procedures used by researchers and practitioners to identify certain aspects of the assessment task. At the same time, we draw attention to the lack of their systematization. This narrows the possibilities of identifying the qualitative parameters of the assessment task, which results in a decrease in the assessment reliability. The purpose of the study is to identify approaches to the analysis of the assessment task proposed by foreign researchers and to streamline them based on the differentiation of the focus of the analysis. The study was carried out by continuous search of theoretical sources in international scientific databases of full-text publications based on thematic keywords. As a result, 18 publications were selected, which reflect different analytical procedures used to determine the quality of the assessment task as a didactic category. The study of publications allowed to identify the following approaches: integrative, authentic, didactic, cognitive, linguistic and an approach based on the theory of educational assessment. Each approach reflects specific parameters related directly to operations, activities, characteristics, etc., necessary for the effective assessment procedure. Approaches to task analysis are focused on identifying the internal parameters of the task (compliance with the requirements of real life situations; consistency with the psychological and pedagogical patterns of organizing educational activities; taking into account language characteristics in task instructions; correlation of cognitive operations necessary to complete the task with the requirements of complexity, accessibility, expediency, etc.; compliance with the requirements of valid, reliable and fair assessment activities), and its potential in the context of the educational process as a means of influencing the student and the educational process itself. The systematization of the approaches to the assessment task becomes a factor in the development of practical tools that ensure quality of the assessment task for the effective organization of the educational process.

About the authors

Marina Alekseevna Bodony

Kuban State University, Krasnodar

Author for correspondence.
Email: m.bodony@mail.ru
ORCID iD: 0000-0002-1182-0587

PhD (Pedagogy), Associate Professor, Head of Chair of Applied Linguistics and New Informational Technologies

Russian Federation

References

  1. Jonassen D.H., Tessmer M., Hannum W.H. Task Analysis Methods for Instructional Design. New Jersey, Lawrence Erlbaum Associates Publ., 1999. 284 p.
  2. Rieu A., Leuders T., Loibl K. Teachers’ diagnostic judgments on tasks as information processing – The role of pedagogical content knowledge for task diagnosis. Teaching and Teacher Education, 2022, vol. 111, article number 103621. doi: 10.1016/j.tate.2021.103621.
  3. Binder K., Krauss S., Hilbert S., Brunner M., Anders Y., Kunter M. Diagnostic skills of mathematics teachers in the COACTIV study. Mathematics Teacher Education. Diagnostic competence of mathematics teachers: Unpacking a complex construct in teacher education and teacher practice. Cham, Springer International Publ., 2018, vol. 11, pp. 33–53. doi: 10.1007/978-3-319-66327-2_2.
  4. Ostermann A., Leuders T., Nückles M. Improving the judgment of task difficulties: Prospective teachers’ diagnostic competence in the area of functions and graphs. Journal of Mathematics Teacher Education, 2018, vol. 21, no. 6, pp. 579–605. doi: 10.1007/s10857-017-9369-z.
  5. Ibarra-Sáiz M.S., Rodríguez-Gómez G., Boud D. The quality of assessment tasks as a determinant of learning. Assessment & Evaluation in Higher Education, 2021, vol. 46, no. 6, pp. 943–955. doi: 10.1080/02602938.2020.1828268.
  6. Carless D. Exploring learning-oriented assessment processes. High Education, 2015, vol. 69, pp. 963–976. doi: 10.1007/s10734-014-9816-z.
  7. Raymond J.E., Homer C.S.E., Smith R., Gray J.E. Learning through authentic assessment: An evaluation of a new development in the undergraduate midwifery curriculum. Nurse Education in Practice, 2013, vol. 13, no. 5, pp. 471–476. doi: 10.1016/j.nepr.2012.10.006.
  8. Bosco A., Ferns S. Embedding of authentic assessment in work-integrated learning curriculum. Asia-Pacific Journal of Cooperative Education, 2014, vol. 15, no. 4, pp. 281–290.
  9. Herrington J.A., Oliver R.G., Reeves T. Patterns of engagement in authentic online learning environments. Australian Journal of Educational Technology, 2002, vol. 19, no. 1, pp. 279–286. doi: 10.14742/ajet.1701.
  10. Villarroel V., Bloxham S., Bruna D., Bruna C., Herrera-Seda C. Authentic assessment: creating a blueprint for course design. Assessment & Evaluation in Higher Education, 2017, vol. 43, no. 5, pp. 840–854. doi: 10.1080/02602938.2017.1412396.
  11. Berge H., Ramaekers S., Pilot A. The design of authentic tasks that promote higher-order learning. EARLI-SIG Higher Education/IKIT-conference. 2004. URL: https://www.researchgate.net/publication/46650134_The_design_of_authentic_tasks_that_promote_higher-order_learning.
  12. Agustiningsih R., Rahdiyanta D. Implementation of an authentic assessment model to improve the quality of learning assessment. Journal Pendidikan Teknologi dan Kejuruan, 2019, vol. 25, no. 1, pp. 103–115. doi: 10.21831/jptk.v25i1.20072.
  13. Brown B.L. Task Analysis Strategies and Practices. Practice Application Brief. Columbus, Ohio: ERIC Clearinghouse on Adult, Career, and Vocational Education. 1997. 4 p. URL: https://archive.org/details/ERIC_ED404571/mode/2up.
  14. Doyle W., Carter K. Academic Tasks in Classrooms. Curriculum Inquiry, 1984, vol. 14, no. 2, pp. 129–149. doi: 10.1080/03626784.1984.11075917.
  15. Krause U., Budke A., Maier V. Understanding of Developing and Setting Tasks in Geography Lessons by German and Dutch Student Teachers. Education Sciences, 2021, vol. 11, no. 2, article number 63. doi: 10.3390/educsci11020063.
  16. Roelofs E. A Framework for Improving the Accessibility of Assessment Tasks. Theoretical and Practical Advances in Computer-based Educational Measurement. Springer, Cham Publ., 2019, pp. 21–45. doi: 10.1007/978-3-030-18480-3_2.
  17. Jonassen D.H., Hannum W.H. Analysis of Task Procedures. Journal of instructional development, 1986, vol. 9, no. 2, pp. 2–12. doi: 10.1007/BF02905208.
  18. Pallotti G. An Approach to Assessing the Linguistic Difficulty of Tasks. Journal of the European Second Language Association, 2019, vol. 3, no. 1, pp. 58–70. doi: 10.22599/jesla.61.
  19. Abedi J., Lord C. The Language Factor in Mathematics. Tests, Applied Measurement in Education, 2001, vol. 14, no. 3, pp. 219–234. doi: 10.1207/S15324818AME1403_2.
  20. Wray D., Janan D. Exploring the Readability of Assessment Tasks: The Influence of Text and Reader Factors. Multidisciplinary Journal of Educational Research, 2013, vol. 3, no. 1, pp. 69–95. doi: 10.4471/remie.2013.04.
  21. Tomanek D., Talanquer V., Novodvorsky I. What Do Science Teachers Consider When Selecting Formative Assessment Tasks? Journal of research in science teaching, 2008, vol. 45, no. 10, pp. 1113–1130. doi: 10.1002/tea.20247.
  22. Bachman L.F. Some reflections on task-based language performance assessment. Language Testing, 2002, vol. 19, no. 4, pp. 453–476. doi: 10.1191/0265532202lt240oa.
  23. Bachman L.F., Palmer A.S. Language testing in practice: designing and developing useful language tests. Oxford, Oxford University Press Publ., 1996. 384 p.

Supplementary files

Supplementary Files
Action
1. JATS XML

Copyright (c)



This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies