377
views
0
recommends
+1 Recommend
1 collections
    0
    shares

      One-Click Submission System Now Available for SO Preprints, learn more on how this works in our blog post and don't forget to check the video, too!

      scite_
       
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Evaluation of Google Bard on Vietna mese High School Biology Examination

      Preprint
      In review
      research-article

            Abstract

            This paper presents an evaluation of the performance of Google Bard on the biology test of the Vietnamese National High School Graduation Examination (VNHSGE). The study aims to assess the accuracy and effectiveness of Google Bard in solving biology problems commonly encountered in the Vietnamese curriculum. To facilitate the evaluation, the VNHSGE dataset was translated from Vietnamese to English, as Google Bard currently lacks support for the Vietnamese language. The findings reveal that Google Bard achieved a performance rate of 49.5%, trailing behind competing models such as ChatGPT and BingChat, which achieved relatively higher scores of 58% and 69%, respectively. Notably, the translation process from Vietnamese to English might have impacted Bard's performance. Therefore, it is not recommended for Vietnamese students to solely depend on Google Bard for solving biology problems, especially if the Vietnamese language is not supported. Students should consider using language models explicitly designed for biology, such as ChatGPT or BingChat.

            Content

            Author and article information

            Journal
            ScienceOpen Preprints
            ScienceOpen
            25 August 2023
            Affiliations
            [1 ] Bee AI;
            Author notes
            Author information
            https://orcid.org/0009-0001-3305-6444
            Article
            10.14293/PR2199.000327.v1
            dd988f3c-6747-400f-8e31-9e4e9471faeb

            This work has been published open access under Creative Commons Attribution License CC BY 4.0 , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Conditions, terms of use and publishing policy can be found at www.scienceopen.com .

            History
            : 25 August 2023
            Categories

            The data that support the findings of this study are available from https://github.com/Xdao85/VNHSGE but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of https://github.com/Xdao85/VNHSGE.
            Education,Computer science
            ChatGPT,Bard,BingChat,large language model

            Comments

            Comment on this article