9
views
0
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Estudio psicométrico de las pruebas MIR de 2020 y 2021 Translated title: Psychometric study of the MIR tests of 2020 and 2021

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Introducción. En España, el ejercicio de cualquier especialidad médica exige disponer del título de especialista. El acceso a la formación como especialista se realiza a través de la prueba MIR. Esta prueba es obligatoria para poder optar a una plaza de formación en cualquier especialidad médica. El presente artículo realiza un estudio psicométrico tanto a través de la teoría clásica de los test como de la teoría de la respuesta al ítem de las pruebas MIR de 2020 y 2021 (de 175 y 200 preguntas, respectivamente). Material y métodos. La base de datos utilizada en el presente trabajo contiene las respuestas de un total de 4.810 opositores que se examinaron en 2020 y 3.888 que lo hicieron en 2021. La información disponible se analizó haciendo uso de indicadores como el alfa de Cronbach, la fórmula número 21 de Kuder y Richardson, el índice de dificultad, el índice de dificultad con corrección de los efectos del azar, el índice de discriminación, el índice de correlación biserial puntual, así como los índices de dificultad y discriminación según la teoría de respuesta al ítem. Resultados. Las pruebas MIR de 2020 y 2021 presentan una alta fiabilidad, con variaciones pequeñas de un año a otro en el comportamiento de las distintas asignaturas y bloques de preguntas en lo relativo a los índices utilizados en el presente estudio. Conclusiones. Los resultados obtenidos en el presente estudio permiten afirmar que el examen MIR es un examen objetivo, de dificultad y discriminación adecuadas, así como estable de una convocatoria a otra.

          Translated abstract

          Introduction. In Spain, in order to practise any medical speciality, it is necessary to have qualified as a specialist. Access to training as a specialist is gained through the MIR test. This test is mandatory to qualify for a training position in any medical specialty. This article carries out a psychometric study of the 2020 and 2021 MIR tests (with 175 and 200 questions, respectively) through both the classical test theory and the item response theory. Material and methods. The database used in this study contains the responses from a total of 4,810 individuals who took the exam in 2020 and 3,888 who did so in 2021. The information available was analysed using indicators such as Cronbach's alpha, the formula number 21 of Kuder and Richardson, the difficulty index, the difficulty index corrected for random effects, the discrimination index and the point biserial correlation index. The difficulty and discrimination indices were also used, according to item response theory. Results. The MIR tests of 2020 and 2021 present high reliability, with only slight variations from one year to another in the behaviour of the different subjects and question blocks in terms of the indices used in the present study. Conclusions. The results obtained in the present study allow us to affirm that the MIR exam is objective, of appropriate difficulty and discrimination, as well as stable from one year to another.

          Related collections

          Most cited references19

          • Record: found
          • Abstract: found
          • Book: not found

          Applications of Item Response Theory to Practical Testing Problems

          Published in 1980, Applications of Item Response Theory To Practical Testing Problems is a valuable contribution to the field of Education.
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            Ley 44/2003, de 21 de noviembre, de ordenación de las profesiones sanitarias

            (2003)
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Technical flaws in multiple-choice questions in the access exam to medical specialties (“examen MIR”) in Spain (2009–2013)

              Background The main factor that determines the selection of a medical specialty in Spain after obtaining a medical degree is the MIR (“médico interno residente”, internal medical resident) exam. This exam consists of 235 multiple-choice questions with five options, some of which include images provided in a separate booklet. The aim of this study was to analyze the technical quality of the multiple-choice questions included in the MIR exam over the last five years. Methods All the questions included in the exams from 2009 to 2013 were analyzed. We studied the proportion of questions including clinical vignettes, the number of items related to an image and the presence of technical flaws in the questions. For the analysis of technical flaws, we adapted the National Board of Medical Examiners (NBME) guidelines. We looked for 18 different issues included in the manual, grouped into two categories: issues related to testwiseness and issues related to irrelevant difficulties. Results The final number of questions analyzed was 1,143. The percentage of items based on clinical vignettes increased from 50 % in 2009 to 56-58 % in the following years (2010–2013). The percentage of items based on an image increased progressively from 10 % in 2009 to 15 % in 2012 and 2013. The percentage of items with at least one technical flaw varied between 68 and 72 %. We observed a decrease in the percentage of items with flaws related to testwiseness, from 30 % in 2009 to 20 % in 2012 and 2013. While most of these issues decreased dramatically or even disappeared (such as the imbalance in the correct option numbers), the presence of non-plausible options remained frequent. With regard to technical flaws related to irrelevant difficulties, no improvement was observed; this is especially true with respect to negative stem questions and “hinged” questions. Conclusion The formal quality of the MIR exam items has improved over the last five years with regard to testwiseness. A more detailed revision of the items submitted, checking systematically for the presence of technical flaws, could improve the validity and discriminatory power of the exam, without increasing its difficulty.
                Bookmark

                Author and article information

                Journal
                fem
                FEM: Revista de la Fundación Educación Médica
                FEM (Ed. impresa)
                Fundación Educación Médica y Viguera Editores, S.L. (Barcelona, Barcelona, Spain )
                2014-9832
                2014-9840
                2023
                : 26
                : 1
                : 19-28
                Affiliations
                [3] Oviedo orgnameHospital Universitario Central de Asturias orgdiv1ISPA orgdiv2Servicio de Oncología Médica España
                [6] Avilés orgnameClínica Oftalmológica Villacampa España
                [2] Oviedo Asturias orgnameUniversidad de Oviedo orgdiv1Facultad de Ciencias orgdiv2Departamento de Matemáticas Spain
                [4] Oviedo Madrid orgnameUniversidad Francisco de Vitoria orgdiv1Facultad de Medicina Spain
                [1] Oviedo orgnameMIR Asturias España
                [5] Pozuelo de Alarcón Madrid orgnameUniversidad Francisco de Vitoria orgdiv1Facultad de Psicología Spain
                Article
                S2014-98322023000100004 S2014-9832(23)02600100004
                10.33588/fem.261.1256
                80ab6f72-4ea6-4bdb-97b4-988925e8f50d

                This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

                History
                : 01 February 2023
                : 24 November 2022
                Page count
                Figures: 0, Tables: 0, Equations: 0, References: 19, Pages: 10
                Product

                SciELO Spain

                Categories
                Originales

                Estadísticas,Estudiantes de medicina,Mediciones educativas,Prueba MIR,Psicometría,Rendimiento académico,Academic performance,Educational measurements,Medicine students,MIR exam,Psychometrics,Statistics

                Comments

                Comment on this article