<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE root>
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ali="http://www.niso.org/schemas/ali/1.0/" article-type="other" dtd-version="1.2" xml:lang="en"><front><journal-meta><journal-id journal-id-type="publisher-id">Evidence-based education studies</journal-id><journal-title-group><journal-title xml:lang="en">Evidence-based education studies</journal-title><trans-title-group xml:lang="ru"><trans-title>Доказательная педагогика, психология</trans-title></trans-title-group></journal-title-group><issn publication-format="print">3034-2996</issn><issn publication-format="electronic">3034-4220</issn><publisher><publisher-name xml:lang="en">Togliatti State University</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="publisher-id">844</article-id><article-id pub-id-type="doi">10.18323/2221-5662-2023-1-9-17</article-id><article-categories><subj-group subj-group-type="toc-heading" xml:lang="en"><subject>Pedagogical Sciences</subject></subj-group><subj-group subj-group-type="toc-heading" xml:lang="ru"><subject>Педагогические науки</subject></subj-group><subj-group subj-group-type="article-type"><subject></subject></subj-group></article-categories><title-group><article-title xml:lang="en">Assessment task analysis: review of foreign approaches</article-title><trans-title-group xml:lang="ru"><trans-title>Анализ оценочного задания: обзор зарубежных подходов</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-1182-0587</contrib-id><name-alternatives><name xml:lang="en"><surname>Bodony</surname><given-names>Marina Alekseevna</given-names></name><name xml:lang="ru"><surname>Бодоньи</surname><given-names>Марина Алексеевна</given-names></name></name-alternatives><address><country country="RU">Russian Federation</country></address><bio xml:lang="en"><p>PhD (Pedagogy), Associate Professor, Head of Chair of Applied Linguistics and New Informational Technologies</p></bio><bio xml:lang="ru"><p>кандидат педагогических наук, доцент, заведующий кафедрой прикладной лингвистики и новых информационных технологий</p></bio><email>m.bodony@mail.ru</email><xref ref-type="aff" rid="aff1"/></contrib></contrib-group><aff-alternatives id="aff1"><aff><institution xml:lang="en">Kuban State University, Krasnodar</institution></aff><aff><institution xml:lang="ru">Кубанский государственный университет, Краснодар</institution></aff></aff-alternatives><pub-date date-type="pub" iso-8601-date="2023-03-31" publication-format="electronic"><day>31</day><month>03</month><year>2023</year></pub-date><issue>1</issue><issue-title xml:lang="en"/><issue-title xml:lang="ru"/><fpage>9</fpage><lpage>17</lpage><history><date date-type="received" iso-8601-date="2023-03-23"><day>23</day><month>03</month><year>2023</year></date></history><permissions><copyright-statement xml:lang="en">Copyright ©; 2023, Bodony M.A.</copyright-statement><copyright-statement xml:lang="ru">Copyright ©; 2023, Бодоньи М.А.</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="en">Bodony M.A.</copyright-holder><copyright-holder xml:lang="ru">Бодоньи М.А.</copyright-holder><ali:free_to_read xmlns:ali="http://www.niso.org/schemas/ali/1.0/"/><license><ali:license_ref xmlns:ali="http://www.niso.org/schemas/ali/1.0/">https://creativecommons.org/licenses/by/4.0</ali:license_ref></license></permissions><self-uri xlink:href="https://vektornaukipedagogika.ru/jour/article/view/844">https://vektornaukipedagogika.ru/jour/article/view/844</self-uri><abstract xml:lang="en"><p>The assessment task is one of the key factors in achieving an accurate, reliable and valid assessment. The effectiveness of assessment is directly dependent on the characteristics of the task and its compliance with the requirements. The analysis of foreign theoretical sources made it possible to identify various analytical procedures used by researchers and practitioners to identify certain aspects of the assessment task. At the same time, we draw attention to the lack of their systematization. This narrows the possibilities of identifying the qualitative parameters of the assessment task, which results in a decrease in the assessment reliability. The purpose of the study is to identify approaches to the analysis of the assessment task proposed by foreign researchers and to streamline them based on the differentiation of the focus of the analysis. The study was carried out by continuous search of theoretical sources in international scientific databases of full-text publications based on thematic keywords. As a result, 18 publications were selected, which reflect different analytical procedures used to determine the quality of the assessment task as a didactic category. The study of publications allowed to identify the following approaches: integrative, authentic, didactic, cognitive, linguistic and an approach based on the theory of educational assessment. Each approach reflects specific parameters related directly to operations, activities, characteristics, etc., necessary for the effective assessment procedure. Approaches to task analysis are focused on identifying the internal parameters of the task (compliance with the requirements of real life situations; consistency with the psychological and pedagogical patterns of organizing educational activities; taking into account language characteristics in task instructions; correlation of cognitive operations necessary to complete the task with the requirements of complexity, accessibility, expediency, etc.; compliance with the requirements of valid, reliable and fair assessment activities), and its potential in the context of the educational process as a means of influencing the student and the educational process itself. The systematization of the approaches to the assessment task becomes a factor in the development of practical tools that ensure quality of the assessment task for the effective organization of the educational process.</p></abstract><trans-abstract xml:lang="ru"><p>Оценочное задание является одним из факторов достижения точной, надежной и валидной оценки. Эффективность оценивания находится в непосредственной зависимости от характеристик задания и его соответствия требованиям. Анализ зарубежных теоретических источников позволил выявить различные аналитические процедуры, используемые исследователями и практиками для выявления отдельных аспектов оценочного задания. Вместе с тем мы обращаем внимание на отсутствие систематизации подходов к анализу. Это сужает возможности выявления качественных параметров оценочного задания, следствием чего становится снижение надежности оценки. Цель исследования – выявить подходы к анализу оценочного задания, предлагаемые зарубежными исследователями, и упорядочить их на основе разграничения направленности анализа. Исследование проводилось путем сплошного поиска теоретических источников в международных наукометрических базах полнотекстовых публикаций на основе ключевых слов. В результате было отобрано 18 публикаций, отражающих разные аналитические процедуры, которые используются для определения качества оценочного задания как дидактической категории. Изучение публикаций позволило выделить интегративный, аутентичный, дидактический, когнитивный, лингвистический подходы и подход, основанный на теории дидактической оценки. Каждый подход отражает специфические параметры, касающиеся непосредственно операций, видов деятельности, характеристик и т. п., необходимых для эффективной организации оценивания. Подходы к анализу задания ориентированы на выявление как внутренних параметров задания (соответствие требованиям реалистичности, ситуативности, проблемности; согласованность с психолого-педагогическими закономерностями организации учебной деятельности; учет языковых характеристик в формулировках задания; соотношение когнитивных операций, необходимых для выполнения задания, с требованиями сложности, доступности, целесообразности и т. п.; соответствие требованиям валидной, надежной и справедливой оценочной деятельности), так и его потенциала в контексте целостного учебного процесса как средства влияния на обучающегося и учебный процесс. Систематизация подходов к оценочному заданию становится фактором разработки практического инструментария, обеспечивающего установление качества оценочного задания для эффективной организации учебного процесса. </p></trans-abstract><kwd-group xml:lang="en"><kwd>assessment</kwd><kwd>evaluation</kwd><kwd>assessment task</kwd><kwd>assessment task analysis</kwd><kwd>approaches to the assessment task analysis</kwd></kwd-group><kwd-group xml:lang="ru"><kwd>оценка</kwd><kwd>оценивание</kwd><kwd>оценочное задание</kwd><kwd>анализ оценочного задания</kwd><kwd>подходы к анализу оценочного задания</kwd></kwd-group><funding-group><funding-statement xml:lang="en">The publication is a part of the project implemented by the grant winner of the charitable program “Vladimir Potanin’s Scholarship Program” of the Vladimir Potanin’s Charitable Foundation (project No. GSGC-0131/21 “Authentic assessment of developing competencies: technologies and tools”).</funding-statement><funding-statement xml:lang="ru">Публикация подготовлена в рамках проекта, реализуемого победителем конкурса на предоставление грантов преподавателям магистратуры благотворительной программы «Стипендиальная программа Владимира Потанина» Благотворительного фонда Владимира Потанина (проект № ГСГК-0131/21 «Аутентичная оценка формируемых компетенций: технологии и инструменты»).</funding-statement></funding-group></article-meta></front><body></body><back><ref-list><ref id="B1"><label>1.</label><citation-alternatives><mixed-citation xml:lang="en">Jonassen D.H., Tessmer M., Hannum W.H. Task Analysis Methods for Instructional Design. New Jersey, Lawrence Erlbaum Associates Publ., 1999. 284 p.</mixed-citation><mixed-citation xml:lang="ru">Jonassen D.H., Tessmer M., Hannum W.H. Task Analysis Methods for Instructional Design. New Jersey: Lawrence Erlbaum Associates, 1999. 284 p.</mixed-citation></citation-alternatives></ref><ref id="B2"><label>2.</label><citation-alternatives><mixed-citation xml:lang="en">Rieu A., Leuders T., Loibl K. Teachers’ diagnostic judgments on tasks as information processing – The role of pedagogical content knowledge for task diagnosis. Teaching and Teacher Education, 2022, vol. 111, article number 103621. DOI: 10.1016/j.tate.2021.103621.</mixed-citation><mixed-citation xml:lang="ru">Rieu A., Leuders T., Loibl K. Teachers’ diagnostic judgments on tasks as information processing – The role of pedagogical content knowledge for task diagnosis // Teaching and Teacher Education. 2022. Vol. 111. Article number 103621. DOI: 10.1016/j.tate.2021.103621.</mixed-citation></citation-alternatives></ref><ref id="B3"><label>3.</label><citation-alternatives><mixed-citation xml:lang="en">Binder K., Krauss S., Hilbert S., Brunner M., Anders Y., Kunter M. Diagnostic skills of mathematics teachers in the COACTIV study. Mathematics Teacher Education. Diagnostic competence of mathematics teachers: Unpacking a complex construct in teacher education and teacher practice. Cham, Springer International Publ., 2018, vol. 11, pp. 33–53. DOI: 10.1007/978-3-319-66327-2_2.</mixed-citation><mixed-citation xml:lang="ru">Binder K., Krauss S., Hilbert S., Brunner M., Anders Y., Kunter M. Diagnostic skills of mathematics teachers in the COACTIV study // Mathematics Teacher Education. Diagnostic competence of mathematics teachers: Unpacking a complex construct in teacher education and teacher practice. Cham: Springer International Publishing, 2018. Vol. 11. P. 33–53. DOI: 10.1007/978-3-319-66327-2_2.</mixed-citation></citation-alternatives></ref><ref id="B4"><label>4.</label><citation-alternatives><mixed-citation xml:lang="en">Ostermann A., Leuders T., Nückles M. Improving the judgment of task difficulties: Prospective teachers’ diagnostic competence in the area of functions and graphs. Journal of Mathematics Teacher Education, 2018, vol. 21, no. 6, pp. 579–605. DOI: 10.1007/s10857-017-9369-z.</mixed-citation><mixed-citation xml:lang="ru">Ostermann A., Leuders T., Nückles M. Improving the judgment of task difficulties: Prospective teachers’ diagnostic competence in the area of functions and graphs // Journal of Mathematics Teacher Education. 2018. Vol. 21. № 6. P. 579–605. DOI: 10.1007/s10857-017-9369-z.</mixed-citation></citation-alternatives></ref><ref id="B5"><label>5.</label><citation-alternatives><mixed-citation xml:lang="en">Ibarra-Sáiz M.S., Rodríguez-Gómez G., Boud D. The quality of assessment tasks as a determinant of learning. Assessment &amp; Evaluation in Higher Education, 2021, vol. 46, no. 6, pp. 943–955. DOI: 10.1080/02602938.2020.1828268.</mixed-citation><mixed-citation xml:lang="ru">Ibarra-Sáiz M.S., Rodríguez-Gómez G., Boud D. The quality of assessment tasks as a determinant of learning // Assessment &amp; Evaluation in Higher Education. 2021. Vol. 46. № 6. P. 943–955. DOI: 10.1080/02602938.2020.1828268.</mixed-citation></citation-alternatives></ref><ref id="B6"><label>6.</label><citation-alternatives><mixed-citation xml:lang="en">Carless D. Exploring learning-oriented assessment processes. High Education, 2015, vol. 69, pp. 963–976. DOI: 10.1007/s10734-014-9816-z.</mixed-citation><mixed-citation xml:lang="ru">Carless D. Exploring learning-oriented assessment processes // High Education. 2015. Vol. 69. P. 963–976. DOI: 10.1007/s10734-014-9816-z.</mixed-citation></citation-alternatives></ref><ref id="B7"><label>7.</label><citation-alternatives><mixed-citation xml:lang="en">Raymond J.E., Homer C.S.E., Smith R., Gray J.E. Learning through authentic assessment: An evaluation of a new development in the undergraduate midwifery curriculum. Nurse Education in Practice, 2013, vol. 13, no. 5, pp. 471–476. DOI: 10.1016/j.nepr.2012.10.006.</mixed-citation><mixed-citation xml:lang="ru">Raymond J.E., Homer C.S.E., Smith R., Gray J.E. Learning through authentic assessment: An evaluation of a new development in the undergraduate midwifery curriculum // Nurse Education in Practice. 2013. Vol. 13. № 5. P. 471–476. DOI: 10.1016/j.nepr.2012.10.006.</mixed-citation></citation-alternatives></ref><ref id="B8"><label>8.</label><citation-alternatives><mixed-citation xml:lang="en">Bosco A., Ferns S. Embedding of authentic assessment in work-integrated learning curriculum. Asia-Pacific Journal of Cooperative Education, 2014, vol. 15, no. 4, pp. 281–290.</mixed-citation><mixed-citation xml:lang="ru">Bosco A., Ferns S. Embedding of authentic assessment in work-integrated learning curriculum // Asia-Pacific Journal of Cooperative Education. 2014. Vol. 15. № 4. P. 281–290.</mixed-citation></citation-alternatives></ref><ref id="B9"><label>9.</label><citation-alternatives><mixed-citation xml:lang="en">Herrington J.A., Oliver R.G., Reeves T. Patterns of engagement in authentic online learning environments. Australian Journal of Educational Technology, 2002, vol. 19, no. 1, pp. 279–286. DOI: 10.14742/ajet.1701.</mixed-citation><mixed-citation xml:lang="ru">Herrington J.A., Oliver R.G., Reeves T. Patterns of engagement in authentic online learning environments // Australian Journal of Educational Technology. 2002. Vol. 19. № 1. P. 279–286. DOI: 10.14742/ajet.1701.</mixed-citation></citation-alternatives></ref><ref id="B10"><label>10.</label><citation-alternatives><mixed-citation xml:lang="en">Villarroel V., Bloxham S., Bruna D., Bruna C., Herrera-Seda C. Authentic assessment: creating a blueprint for course design. Assessment &amp; Evaluation in Higher Education, 2017, vol. 43, no. 5, pp. 840–854. DOI: 10.1080/02602938.2017.1412396.</mixed-citation><mixed-citation xml:lang="ru">Villarroel V., Bloxham S., Bruna D., Bruna C., Herrera-Seda C. Authentic assessment: creating a blueprint for course design // Assessment &amp; Evaluation in Higher Education. 2017. Vol. 43. № 5. P. 840–854. DOI: 10.1080/02602938.2017.1412396.</mixed-citation></citation-alternatives></ref><ref id="B11"><label>11.</label><citation-alternatives><mixed-citation xml:lang="en">Berge H., Ramaekers S., Pilot A. The design of authentic tasks that promote higher-order learning. EARLI-SIG Higher Education/IKIT-conference. 2004. URL: https://www.researchgate.net/publication/46650134_The_design_of_authentic_tasks_that_promote_higher-order_learning.</mixed-citation><mixed-citation xml:lang="ru">Berge H., Ramaekers S., Pilot A. The design of authentic tasks that promote higher-order learning // EARLI-SIG Higher Education/IKIT-conference. 2004. URL: https://www.researchgate.net/publication/46650134_The_design_of_authentic_tasks_that_promote_higher-order_learning.</mixed-citation></citation-alternatives></ref><ref id="B12"><label>12.</label><citation-alternatives><mixed-citation xml:lang="en">Agustiningsih R., Rahdiyanta D. Implementation of an authentic assessment model to improve the quality of learning assessment. Journal Pendidikan Teknologi dan Kejuruan, 2019, vol. 25, no. 1, pp. 103–115. DOI: 10.21831/jptk.v25i1.20072.</mixed-citation><mixed-citation xml:lang="ru">Agustiningsih R., Rahdiyanta D. Implementation of an authentic assessment model to improve the quality of learning assessment // Journal Pendidikan Teknologi dan Kejuruan. 2019. Vol. 25. № 1. P. 103–115. DOI: 10.21831/jptk.v25i1.20072.</mixed-citation></citation-alternatives></ref><ref id="B13"><label>13.</label><citation-alternatives><mixed-citation xml:lang="en">Brown B.L. Task Analysis Strategies and Practices. Practice Application Brief. Columbus, Ohio: ERIC Clearinghouse on Adult, Career, and Vocational Education. 1997. 4 p. URL: https://archive.org/details/ERIC_ED404571/mode/2up.</mixed-citation><mixed-citation xml:lang="ru">Brown B.L. Task Analysis Strategies and Practices // Practice Application Brief. Columbus, Ohio: ERIC Clearinghouse on Adult, Career, and Vocational Education. 1997. 4 p. URL: https://archive.org/details/ERIC_ED404571/mode/2up.</mixed-citation></citation-alternatives></ref><ref id="B14"><label>14.</label><citation-alternatives><mixed-citation xml:lang="en">Doyle W., Carter K. Academic Tasks in Classrooms. Curriculum Inquiry, 1984, vol. 14, no. 2, pp. 129–149. DOI: 10.1080/03626784.1984.11075917.</mixed-citation><mixed-citation xml:lang="ru">Doyle W., Carter K. Academic Tasks in Classrooms // Curriculum Inquiry. 1984. Vol. 14. № 2. P. 129–149. DOI: 10.1080/03626784.1984.11075917.</mixed-citation></citation-alternatives></ref><ref id="B15"><label>15.</label><citation-alternatives><mixed-citation xml:lang="en">Krause U., Budke A., Maier V. Understanding of Developing and Setting Tasks in Geography Lessons by German and Dutch Student Teachers. Education Sciences, 2021, vol. 11, no. 2, article number 63. DOI: 10.3390/educsci11020063.</mixed-citation><mixed-citation xml:lang="ru">Krause U., Budke A., Maier V. Understanding of Developing and Setting Tasks in Geography Lessons by German and Dutch Student Teachers // Education Sciences. 2021. Vol. 11. № 2. Article number 63. DOI: 10.3390/educsci11020063.</mixed-citation></citation-alternatives></ref><ref id="B16"><label>16.</label><citation-alternatives><mixed-citation xml:lang="en">Roelofs E. A Framework for Improving the Accessibility of Assessment Tasks. Theoretical and Practical Advances in Computer-based Educational Measurement. Springer, Cham Publ., 2019, pp. 21–45. DOI: 10.1007/978-3-030-18480-3_2.</mixed-citation><mixed-citation xml:lang="ru">Roelofs E. A Framework for Improving the Accessibility of Assessment Tasks // Theoretical and Practical Advances in Computer-based Educational Measurement. Springer: Cham, 2019. P. 21–45. DOI: 10.1007/978-3-030-18480-3_2.</mixed-citation></citation-alternatives></ref><ref id="B17"><label>17.</label><citation-alternatives><mixed-citation xml:lang="en">Jonassen D.H., Hannum W.H. Analysis of Task Procedures. Journal of instructional development, 1986, vol. 9, no. 2, pp. 2–12. DOI: 10.1007/BF02905208.</mixed-citation><mixed-citation xml:lang="ru">Jonassen D.H., Hannum W.H. Analysis of Task Procedures // Journal of instructional development. 1986. Vol. 9. № 2. P. 2–12. DOI: 10.1007/BF02905208.</mixed-citation></citation-alternatives></ref><ref id="B18"><label>18.</label><citation-alternatives><mixed-citation xml:lang="en">Pallotti G. An Approach to Assessing the Linguistic Difficulty of Tasks. Journal of the European Second Language Association, 2019, vol. 3, no. 1, pp. 58–70. DOI: 10.22599/jesla.61.</mixed-citation><mixed-citation xml:lang="ru">Pallotti G. An Approach to Assessing the Linguistic Difficulty of Tasks // Journal of the European Second Language Association. 2019. Vol. 3. № 1. P. 58–70. DOI: 10.22599/jesla.61.</mixed-citation></citation-alternatives></ref><ref id="B19"><label>19.</label><citation-alternatives><mixed-citation xml:lang="en">Abedi J., Lord C. The Language Factor in Mathematics. Tests, Applied Measurement in Education, 2001, vol. 14, no. 3, pp. 219–234. DOI: 10.1207/S15324818AME1403_2.</mixed-citation><mixed-citation xml:lang="ru">Abedi J., Lord C. The Language Factor in Mathematics // Tests, Applied Measurement in Education. 2001. Vol. 14. № 3. P. 219–234. DOI: 10.1207/S15324818AME1403_2.</mixed-citation></citation-alternatives></ref><ref id="B20"><label>20.</label><citation-alternatives><mixed-citation xml:lang="en">Wray D., Janan D. Exploring the Readability of Assessment Tasks: The Influence of Text and Reader Factors. Multidisciplinary Journal of Educational Research, 2013, vol. 3, no. 1, pp. 69–95. DOI: 10.4471/remie.2013.04.</mixed-citation><mixed-citation xml:lang="ru">Wray D., Janan D. Exploring the Readability of Assessment Tasks: The Influence of Text and Reader Factors // Multidisciplinary Journal of Educational Research. 2013. Vol. 3. № 1. P. 69–95. DOI: 10.4471/remie.2013.04.</mixed-citation></citation-alternatives></ref><ref id="B21"><label>21.</label><citation-alternatives><mixed-citation xml:lang="en">Tomanek D., Talanquer V., Novodvorsky I. What Do Science Teachers Consider When Selecting Formative Assessment Tasks? Journal of research in science teaching, 2008, vol. 45, no. 10, pp. 1113–1130. DOI: 10.1002/tea.20247.</mixed-citation><mixed-citation xml:lang="ru">Tomanek D., Talanquer V., Novodvorsky I. What Do Science Teachers Consider When Selecting Formative Assessment Tasks? // Journal of research in science teaching. 2008. Vol. 45. № 10. P. 1113–1130. DOI: 10.1002/tea.20247.</mixed-citation></citation-alternatives></ref><ref id="B22"><label>22.</label><citation-alternatives><mixed-citation xml:lang="en">Bachman L.F. Some reflections on task-based language performance assessment. Language Testing, 2002, vol. 19, no. 4, pp. 453–476. DOI: 10.1191/0265532202lt240oa.</mixed-citation><mixed-citation xml:lang="ru">Bachman L.F. Some reflections on task-based language performance assessment // Language Testing. 2002. Vol. 19. № 4. P. 453–476. DOI: 10.1191/0265532202lt240oa.</mixed-citation></citation-alternatives></ref><ref id="B23"><label>23.</label><citation-alternatives><mixed-citation xml:lang="en">Bachman L.F., Palmer A.S. Language testing in practice: designing and developing useful language tests. Oxford, Oxford University Press Publ., 1996. 384 p.</mixed-citation><mixed-citation xml:lang="ru">Bachman L.F., Palmer A.S. Language testing in practice: designing and developing useful language tests. Oxford: Oxford University Press, 1996. 384 p.</mixed-citation></citation-alternatives></ref></ref-list></back></article>
