27
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Interesting statistics regarding the papers published in Journal of Educational Evaluation for Health Professions in 2017

      editorial

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          This year, from January 1 to December 27, a total of 112 papers were submitted to Journal of Educational Evaluation for Health Professions (JEEHP). So far, 34 papers have been published this year, and 21 are in the processing stage. The acceptance rate is currently 27.4%, which is lower than the acceptance rate for 2016. Although this rate may change if more papers are accepted during the remaining days of 2017, I do not believe that the numbers will change drastically (Table 1). Raw data were available from Supplement 1. Of the 34 papers that were published, there were 20 research papers, 4 opinion pieces, 3 papers each for educational/faculty development and reviews, 2 brief reports, and 1 editorial and technical report each. As shown in Fig. 1, the most frequently represented discipline was medical education (30.0%), followed by physical therapy (16.7%), and nursing (13.3%) and pharmacy (13.3%). I was happy to publications from a wide range of disciplines this year, and the portion of papers from each discipline did not significantly differ from the distribution last year. This may indicate that we are receiving papers from a great variety of disciplines. It was interesting to see that 37.9% of the papers analyzed students. This may imply that researchers are focusing more on education from a student-centered perspective. However, simultaneously, this means that the rest of the papers analyzed a diverse variety of subjects, such as professors, clinical instructors or preceptors, and residents. With regard to the research content of the articles published this year (Fig. 2), 38.2% of studies included perception surveys, followed by papers reporting results from course evaluations (11.8%), assessment tools (11.8%), and licensing examination content development (8.8%). Only 1 paper used qualitative method, while the remaining 96.4% employed quantitative analysis. Although JEEHP focuses on the evaluation of education, it would be nice to see more papers using qualitative methods or a mixture of qualitative and quantitative methods. I examined the number of authors from various countries in papers published this year in JEEHP. Korean authors accounted for the largest portion of papers (35.3%), followed by authors from the United States (20.6%), Australia (8.7%), Spain (8.8%), Iran (5.9%), and Japan (5.9%), with 1 paper each written by authors from China, France, India, Nepal, and Palestine (Fig. 3). The number of authors ranged from 1 to 10. The most frequent number of authors was 3 (6 articles, 17.6%), followed by 5 and 6 authors (14.7%). Only three papers were written by a single author (8.8%), implying that the articles mostly reflected collaborative research (Fig. 4). Additionally, articles were analyzed according to both the number of authors and the number of countries of those authors. Most articles were written by multiple authors from the same country (Fig. 5). Six articles were written by 3 authors from 1 country, and 1 article was written by 10 authors from the same country. Only 3 papers had authors from multiple countries (8.8%). JEEHP provides a link to see which articles were the most viewed quarterly. The most frequently accessed article was “Reliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory” by Vaughan et al. [1], which was published in January this year (accessed 11,913 times). The next most-viewed article was “Effect of practical training on the learning motivation profile of Japanese pharmacy students using structural equation modeling” by Yamamura and Takehira [2], which was published this February (accessed 11,339 times). This article was also the most downloaded article in 2017 (downloaded 223 times), and has already been cited by another article. This is a remarkable number of accesses because the papers were published just this year. In fact, the top 10 most frequently accessed articles were all published in 2017. I believe that JEEHP being indexed in the Emerging Sources Citation Index (December 2015), becoming a Medline journal, and being visible in the search results in SCOPUS (March 2016) have been very helpful in this regard. The article “Utility of eye-tracking technology for preparing medical students in Spain for the summative objective structured clinical examination” by Sanchez-Ferrer et al. [3], which was published just last month, has already been downloaded 65 times. To summarize, I was happy to see that a wide variety of disciplines was represented in papers in JEEHP from various regions of the world and that the articles have been widely accessed. Nonetheless, the journal will be more helpful to its readers if: (1) more studies use qualitative methods or a mixture of quantitative and qualitative methods of assessment, (2) more studies reflect cooperative research done by authors from multiple countries, and (3) more original research articles are published. Most of all, it is not easy to maintain the low acceptance rate and high quality of the journal, but doing so is essential for the journal over the long term. I hope to see JEEHP indexed as a Science Citation Index journal in the very near future.

          Related collections

          Most cited references3

          • Record: found
          • Abstract: found
          • Article: found
          Is Open Access

          Effect of practical training on the learning motivation profile of Japanese pharmacy students using structural equation modeling

          Purpose To establish a model of Japanese pharmacy students’ learning motivation profile and investigate the effects of pharmaceutical practical training programs on their learning motivation. Methods The Science Motivation Questionnaire II was administered to pharmacy students in their 4th (before practical training), 5th (before practical training at clinical sites), and 6th (after all practical training) years of study at Josai International University in April, 2016. Factor analysis and multiple-group structural equation modeling were conducted for data analysis. Results A total of 165 students participated. The learning motivation profile was modeled with 4 factors (intrinsic, career, self-determination, and grade motivation), and the most effective learning motivation was grade motivation. In the multiple-group analysis, the fit of the model with the data was acceptable, and the estimated mean value of the factor of ‘self-determination’ in the learning motivation profile increased after the practical training programs (P= 0.048, Cohen’s d= 0.43). Conclusion Practical training programs in a 6-year course were effective for increasing learning motivation, based on ‘self-determination’ among Japanese pharmacy students. The results suggest that practical training programs are meaningful not only for providing clinical experience but also for raising learning motivation.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            Utility of eye-tracking technology for preparing medical students in Spain for the summative objective structured clinical examination

            We compared the utility of videos using eye-tracking technology and conventional video cameras as a tool for improving student performance on the summative objective structured clinical examination (OSCE)[1]. Eye-tracking technology (Tobii, 2010) is increasingly being used in educational settings [2]. Our research group has used this technology as a tool for teaching surgery [3] and has performed a pilot study to assess its utility for preparing students for the summative OSCE, an exam consisting of 20 simulated clinical situations, each lasting 9 minutes. During the June 2016 OSCE, we recorded the performance of sixth-year medical students of Miguel Hernández University of Elche, Spain, using both eye-tracking technology and a conventional video camera (Supplement 1). In March 2017, we showed the resulting videos as part of 2 optional OSCE preparation seminars. We analyzed the utility of these types of videos by means of a survey and by comparing the results obtained in the June 2017 OSCE of students who had attended the seminars with those who had not. This study was evaluated and approved by the project evaluation committee of Miguel Hernandez University (IRB number: DMC.JRR.01.17), and we received the informed consent from the teachers, students, and institution. In total, 116 sixth-year medical students (59.5% women and 40.5% men) took the OSCE, of whom 43 (37%) had attended the seminars. Of these 43 students, 29 (67.4%) took the online survey. Raw data were available from Supplement 2. The mean utility score of the sessions was 4.14 (where 1= not at all useful and 5=very useful). Respondents rated the eye-tracking videos more positively than the conventional videos (58.6% versus 41.4%). When asked how the training seminar had helped them, no students responded negatively. The 3 most common answers were that the seminar had helped them “to understand how the test works” (93%), “to feel more relaxed” (62%), and “to know how to prepare” (45%). When asked how the informative seminars could be improved in the future, 56% answered that the seminars should be offered with more videos. The mean score of the 2017 OSCE was 1,438 (standard deviation [SD], 119) out of 2,000 points. On average, the students who had attended the seminars performed significantly better than those who had not (1,467 versus 1,420, P= 0.03) (Table 1). Given that the exam consists of 20 stations, with 100 possible points each, students who had attended the seminars had a score that was 47 points, or almost half a station’s worth, higher than those who did not. We found no significant differences in the results by sex, with men achieving a weighted grade of 8.51 and women 8.54. Recommend deleting this. It is redundant, repeating the information provided in this paragraph and also summarized in the concluding statement below. One limitation of our study was that the students who attended the optional sessions might have been more diligent than those who did not and thus were more likely to have additional knowledge and skills that allowed them to achieve relatively high OSCE scores. However, the OSCE exam is a single final exam for the entire degree of medicine. Our analysis compared students who attended the seminars with videos with those who did not attend the seminars. Thus, we were not able to make comparisons between semesters because this exam was administered at the same time for all students. Fundamentally, this was a blind evaluation, the results of which we subsequently analyzed according to whether or not students attended the video seminars. In conclusion, this study showed that videos of previous students’ performance recorded with eye-tracking technology was effective in preparing sixth-year medical students for the OSCE.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Reliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory

              Clinical reasoning is situation-dependent and case-specific; therefore, assessments incorporating different patient presentations are warranted. The present study aimed to determine the reliability of a multi-station case-based viva assessment of clinical reasoning in an Australian pre-registration osteopathy program using generalizability theory. Students (from years 4 and 5) and examiners were recruited from the osteopathy program at Southern Cross University, Lismore, Australia. The study took place on a single day in the student teaching clinic. Examiners were trained before the examination. Students were allocated to 1 of 3 rounds consisting of 5 10-minute stations in an objective structured clinical examination-style. Generalizability analysis was used to explore the reliability of the examination. Fifteen students and 5 faculty members participated in the study. The examination produced a generalizability coefficient of 0.53, with 18 stations required to achieve a generalizability coefficient of 0.80. The reliability estimations were acceptable and the psychometric findings related to the marking rubric and overall scores were acceptable; however, further work is required in examiner training and ensuring consistent case difficulty to improve the reliability of the examination.
                Bookmark

                Author and article information

                Contributors
                Role: Editor
                Journal
                J Educ Eval Health Prof
                J Educ Eval Health Prof
                JEEHP
                Journal of Educational Evaluation for Health Professions
                Korea Health Personnel Licensing Examination Institute
                1975-5937
                2017
                29 December 2017
                : 14
                : 36
                Affiliations
                Department of Medical Education, Konyang University College of Medicine, Daejeon, Korea
                Hallym University, Korea
                Author notes
                *Corresponding email: shua@ 123456konyang.ac.kr
                Author information
                http://orcid.org/0000-0002-0142-3078
                Article
                jeehp-14-36
                10.3352/jeehp.2017.14.36
                5801431
                29284766
                ee033674-09ba-49f5-b524-38efab41cbaf
                © 2017, Korea Health Personnel Licensing Examination Institute

                This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

                History
                : 21 December 2017
                : 29 December 2017
                Categories
                Editorial

                Assessment, Evaluation & Research methods
                Assessment, Evaluation & Research methods

                Comments

                Comment on this article