- Record: found
- Abstract: found
- Article: found
Tools for Change: Measuring Student Conceptual Understanding Across Undergraduate Biology Programs Using Bio-MAPS Assessments
research-article
Author(s):
Michelle K. Smith
1 ,
Sara E. Brownell
2 ,
Alison J. Crowe
3 ,
N.G. Holmes
4 ,
Jennifer K. Knight
5 ,
Katharine Semsar
6 ,
Mindi M. Summers
7 ,
Cole Walsh
4 ,
Christian D. Wright
2 ,
Brian A. Couch
8
,
*
Publication date (Electronic):
30 August 2019
Publisher:
American Society of Microbiology
Read this article at
There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.
Abstract
Assessing learning across a biology major can help departments monitor achievement of broader program-level goals and identify opportunities for curricular improvement. However, biology departments have lacked suitable tools to measure learning at the program scale. To address this need, we developed four freely available assessments—called Biology-Measuring Achievement and Progression in Science or Bio-MAPS—for general biology, molecular biology, ecology/evolution, and physiology programs. When administered at multiple time points in a curriculum, these instruments can provide departments with information on how student conceptual understanding changes across a major and help guide curricular modifications to enhance learning.
Related collections
Most cited references19
- Record: found
- Abstract: not found
- Article: not found
Development and Validation of Instruments to Measure Learning of Expert‐Like Thinking
Carl E. Wieman, Wendy K. Adams (2011)
- Record: found
- Abstract: found
- Article: not found
BioCore Guide: A Tool for Interpreting the Core Concepts of Vision and Change for Biology Majors
Sara E. Brownell, Scott Freeman, Mary Pat Wenderoth … (2014)
The intent of the Vision and Change conversations and national conference was to move toward a consensus framework in the biology community that would be broadly adaptable, given the unique structures, capacities, and constraints of individual life sciences programs … We pose these core concepts … as a resource and starting point based on the collective experience and wisdom of a broad national community of biological scientists and educators. Vision and Change (AAAS, 2011, p. 11) Biology is without question the most diverse of the science, technology, engineering, and mathematics (STEM) disciplines. What began as an observational science has blossomed into a wide-ranging set of subdisciplines, each with its own set of key concepts, experimental techniques, and approaches to the study of life. The discipline is currently so segmented that biologists who work in particular subdisciplines attend separate scientific meetings, publish in specialty journals, and are sometimes housed in different departments. The rapid expansion and increased diversity of the field has greatly expanded the scope and impact of biological discoveries but creates a challenge for instructors. The exponential rate of discovery in biology makes it difficult to decide what to teach in a 4-yr undergraduate curriculum. Given that we cannot teach everything, can we reach consensus about what is most important to teach? IDENTIFICATION OF CORE CONCEPTS IN UNDERGRADUATE BIOLOGY In an effort to consolidate the ever-expanding volume of biological knowledge to a more manageable set of ideas, several groups have outlined the “big ideas” in biology (Table 1). Some of these efforts are focused on biology as a whole, whereas others are targeted to specific subdisciplines. Collectively, this literature has laid a strong foundation for articulating the most important aspects of biology and several common “big ideas” have emerged. While these efforts have enhanced awareness, many lack large-scale validation, which may explain why few have gained significant traction in the wider community. The most notable exception to this is the framework for K–12 education, which has recently been adopted as a set of scientific standards for elementary and secondary schools, but the focus of this set of recommendations is on K–12 and not undergraduate biology. Table 1. Previous efforts to define the core ideas of biology Report/title Date Big ideas of biology Audience Citation BIO2010 2003 Eighteen one- to two-sentence concepts for undergraduate biology curriculum General undergraduate biology NRC, 2003, pp. 32–33 Biology Concept Framework (BCF) 2004 Hierarchical, cross-referenced concepts related to genetics and molecular biology Subdiscipline undergraduate biology Khodor et al., 2004 Core ideas in pathogen–host interactions 2007 Identified common anchor organisms and six topic areas that would be integrated across all courses in a series of courses Subdiscipline undergraduate biology Marbach-Ad et al., 2007 Core ideas in biochemistry 2011 Used conceptual lens to demonstrate how core ideas in biochemistry fit under Vision and Change core concepts Subdiscipline undergraduate biology Rowland et al., 2011 Big ideas in physiology 2009–2011 Unpacked five most important core principles in physiology, including cell membranes, homeostasis, cell-to-cell communications, interdependence, and flow-down gradients. Subdiscipline undergraduate biology Michael et al., 2009; Michael and McFarland, 2011 Editorial 2001 Evolution should be overarching framework of biology General undergraduate biology Alles, 2001 Editorial 2010 Three core conceptual foundations of modern biology are evolutionary thinking, molecular foundations, and network behavior General undergraduate biology Klymkowsky, 2010 Editorial 2010 Conceptual framework for biology that includes five general theories: cells, organisms, genetics, ecology, and evolution General undergraduate biology Scheiner, 2010 A framework for Advanced Placement Biology 2002–2009 College Board's revision of the AP Biology curriculum around four “big ideas” and seven science practices AP Biology Wood, 2009 http://apcentral.collegeboard.com/apc/public/courses/teachers_corner/2117.html A framework for K–12 science education 2011 Crosscutting concepts that unify the study of science; scientific and engineering practices; and disciplinary core ideas General K–12 biology Quinn et al., 2011 Vision and Change in Undergraduate Biology Education: A Call to Action 2011 Identified five core concepts of biology General undergraduate biology AAAS, 2011 At the undergraduate level, the most extensive effort has come from a collaboration between the National Science Foundation (NSF) and the American Association for the Advancement in Science (AAAS), which culminated in the report Vision and Change in Undergraduate Biology Education: A Call to Action (AAAS, 2011). Through a series of conversations at regional and national meetings, more than 500 biologists and biology educators discussed the need to reform undergraduate biology education and provided a set of unifying recommendations. Specifically, Vision and Change outlined five core concepts that are important for undergraduate biology majors to understand by the time they graduate (Table 2). Table 2. Core concepts outlined in Vision and Change: A Call to Action (AAAS, 2011) 1. Evolution 2. Structure and function 3. Information flow, exchange, and storage 4. Pathways and transformations of energy and matter 5. Systems While it successfully distilled the complexity of biology down to only five core concepts, the recommendations set forth in Vision and Change were intentionally broad. They were meant to serve as “a resource and starting point” (AAAS, 2011, p. 11) for further delineation into subconcepts. The challenge is to elaborate the core concepts, so faculty members have a better grasp on how to teach them. Taking the next step, the Society for Microbiology (Merkel, 2012), the American Society for Biochemistry and Molecular Biology (Tansey et al., 2013), and the American Society of Plant Biologists and Botanical Society of America (American Society of Plant Biologists, 2012) have outlined how the core concepts of Vision and Change could be interpreted in each of their subdisciplines. While these society-specific efforts have been useful in making the core concepts more concrete for instructors teaching courses in these subdisciplines, their statements are often too specific for general biology majors, who are tasked with gaining a conceptual understanding of the discipline as a whole. To build on the important work coming out of the subdisciplines, we set out to interpret what the core concepts of Vision and Change mean for a general biology curriculum. TARGET AUDIENCE FOR BIOCORE GUIDE: GRADUATING GENERAL BIOLOGY MAJORS Although a unified curriculum for all undergraduate biology majors has not been established (Cheesman et al., 2007), there have been efforts focused on identifying both a common set of courses (Heppner et al., 1990; Marocco, 2000; National Research Council [NRC], 2003; Cheesman et al., 2007; Labov et al., 2010) and a common set of essential topics (Ledbetter and Campbell, 2005; Timmerman et al., 2008; AAAS, 2011; Gregory et al., 2011). However, in line with the increased specialization of biology, curricula have also been recommended for biochemistry (Voet et al., 2003), zoology (Russell, 2009), physiology (Silverthorn, 2003), and neuroscience (Wiertelak and Ramirez, 2008). Would the biology community as a whole benefit more from recommendations for general biology majors or for subdiscipline-specific majors? To answer this question, we examined the structure of biology departments and majors at a randomly selected sample of 183 institutions throughout the United States (see Supplemental Material for methodology). As the data in Table 3 indicate, the vast majority of colleges and universities in our sample have general biology departments and confer a general biology degree. On the basis of these results, we concluded that the most useful approach for most institutions would be to articulate what the Vision and Change core concepts mean to faculty and students in a general biology program. Table 3 Prevalence of general biology departments and general biology degreesa Institution type by highest degree granted Percentage of institutions with a general biology department Percentage of institutions that confer a general biology degree Bachelor 74.1 96.3 Master's 87.5 95.8 Doctorate 90 93.3 aOut of a random sample of 10% of the total number of Carnegie-classified institutions that confer bachelor's, master's, and doctoral degrees (n = 183 institutions), the majority has general biology departments and confer a general biology degree. CONCEPTUAL FRAMEWORK: CREATING THE BIOCORE GUIDE FOR VISION AND CHANGE’S CORE CONCEPTS With the core concepts of Vision and Change as a guide, we delineated a set of general principles for each concept. These principles are cross-disciplinary elaborations of each larger core concept intended to illustrate central themes that can be applied to different subdisciplines of biology. We also outlined a set of statements that were more specific interpretations of each of the core concepts within the three major subdisciplines of biology: molecular/cellular/developmental biology, physiology, and ecology/evolution. Although artificial—the three subdivisions do not exist as separate entities in organisms—they do represent the typical components of an introductory biology curriculum and span the scale of biology, from molecules to ecosystems. Thus, we used these subdisciplines as an attempt to sample the diversity of biology. Collectively, we refer to the principles and statements as the Vision and Change BioCore Guide. Figure 1 summarizes the relationship between the different BioCore Guide elements and how the BioCore Guide itself relates to the broader goals of Vision and Change. We expect that the organization of core concepts, principles, and statements will be useful to the biology community as departments strive to adhere to the recommendations of Vision and Change. For example, test questions could be written that assess student understanding of each statement, and by extension, each principle and core concept. Figure 1. Conceptual framework for interpreting the core concepts of Vision and Change. Based on the core concepts of Vision and Change, the BioCore Guide consists of two levels: principles and statements. Specific questions based on the statements can be developed to assess student understanding of these concepts. A GRASSROOTS APPROACH TO DEVELOPING THE VISION AND CHANGE BIOCORE GUIDE To develop a tool that biology faculty would use and endorse, we involved biology faculty at each step of the process. This bottom-up, grassroots approach differs from more traditional efforts that rely on small working groups, often composed of faculty members who are on education committees and/or engaged in education research, to investigate an issue, write a report summarizing their findings, and then disseminate these “best practices” to the broader academic community. Despite the popularity of these top-down methods, they have not been shown to be particularly effective for catalyzing faculty and institutional change (Henderson et al., 2010, 2011). Although we incorporated feedback from biology education researchers who have been policy makers at specific points in the development process, the goal of our “faculty-first” approach was to produce a tool that would resonate with instructors and thereby encourage implementation. An overview of our process is shown in Figure 2. Figure 2. The development process for the BioCore Guide. In this two-phase process, we began developing the BioCore Guide by soliciting input from faculty at the University of Washington. We then obtained feedback from biologists and biology educators nationally. In total, the BioCore Guide was iteratively revised six times. Phase I. Home Institution Development and Review As a first step, we obtained input from biology faculty at the University of Washington. Specifically, we engaged faculty members with Vision and Change by having them consider whether the five core concepts of Vision and Change were important for graduating biology majors to understand. Using an online survey, we found strong alignment between the national goals of Vision and Change and faculty goals in this department; all of the core concepts of Vision and Change were judged to be as important or more important than previously established departmental learning goals. Our next step was to begin operationalizing the core concepts of Vision and Change into specific statements for each of the three major subdisciplines of biology. We did this by recruiting faculty to join one of three different focus groups with expertise in 1) molecular/cellular/developmental biology, 2) physiology, and 3) ecology/evolution. Faculty groups, each composed of three faculty members, independently brainstormed ideas for how each of the Vision and Change core concepts could be interpreted for their subdiscipline. They then refined their ideas to produce two to three statements for each of the core concepts, with each statement intended to capture features of their subdiscipline that they wanted general biology majors to master before graduation. We then assembled all the statements into a first-draft BioCore Guide. The “local” phase of the development process closed after three iterative revisions, based on discussions with the University of Washington (UW) Biology Education Research Group (n = 4), the Undergraduate Curriculum Committee (n = 11), and attendees at departmental faculty meetings (n ∼ 25). Phase II. National Review and Validation In the second phase of developing the BioCore Guide, we solicited feedback on the initial draft from biologists and biology educators with different subdiscipline expertise in biology at a diverse set of national institutions. Using a convenience-sampling approach, we identified biology faculty members who were content experts and asked them to evaluate each statement and provide feedback on: 1) its scientific accuracy/wording and 2) its importance in terms of what a general biology major should understand by the time he or she graduates. We encouraged respondents to provide written edits of each statement and also asked them to identify additional or missing concepts. Participants were reminded to focus on the level of understanding expected of a general biology major, not a specialist from one of the subdisciplines. Twenty-five biologists (nine ecologists/evolutionary biologists, seven physiologists, and nine molecular/cellular biologists) provided written feedback. We then summarized their suggestions, identified consensus ideas, and modified the BioCore Guide accordingly. While we did not incorporate all of the suggestions, we did discuss each contribution and weighed its relevance in relationship to other suggestions. Using the newly revised version of the BioCore Guide, we then solicited feedback from the biology education research community in two ways. We organized a focus group composed of five biology education researchers at the national meeting of the Society for Advancement in Biology Education (SABER) and asked participants to comment on the “big picture” organization of the document. This discussion resulted in two major changes to the BioCore Guide: 1) we developed broader principles under each concept, as a way to better organize the specific statements and see commonalities among subdisciplines; and 2) the biologically artificial boundaries among the subdisciplines were supplemented by a biologically relevant scale of molecules to ecosystems. In addition, we requested feedback on the BioCore Guide from professionals at SABER's national meeting whose work focused on instruction and discipline-based education research. Ten additional participants provided written comments on the accuracy of the statements and their importance for a graduating general biology major; these comments were used to further modify the BioCore Guide. As a final step, we sought national validation of the BioCore Guide. We administered an anonymous online survey, distributed through mailing lists of a diverse group of scientific societies and education research groups (for a list of the organizations contacted, see the Supplemental Material). The voluntary survey asked reviewers to rate on a 4-point Likert scale ranging from “strongly disagree” to “strongly agree” whether each principle and statement in the BioCore Guide was 1) scientifically accurate and 2) important for a graduating biology major to understand. We intentionally did not provide reviewers will the option of a “neutral” response, because we wanted the reviewers to take a stance on each statement and felt that practicing biologists should be comfortable with all the topics required of a general biology major. Reviewers were also given the opportunity to provide specific edits or comments, including whether any major topics were missing from the BioCore Guide. We obtained feedback from 184 participants, who varied by subdiscipline expertise and type of institution (Table 4). Table 4. Demographics of survey respondents for national validation (n = 184) Institution type Research university 40.2% Comprehensive university 26.6% Small liberal arts college 19.0% Community college 11.4% Other 2.7% Position Assistant/associate/full professor 67.9% Lecturer/instructor 18.5% Postdoctoral scholar 4.3% Graduate student 3.3% Other 6.0% Subdiscipline expertise Molecular/cellular/developmental biology 41.85% Physiology 16.3% Ecology/evolutionary biology 41.85% In sum, we collected individual written feedback from 244 biologists and biology educators. The comments and edits were extensive, indicating that respondents took the time to provide a thorough and thoughtful review of the BioCore Guide. The large number of written responses supports the claim that the BioCore Guide represents the most extensive and systematic collection of faculty opinion on the core concepts of Vision and Change to date. VISION AND CHANGE BIOCORE GUIDE OF CORE CONCEPTS FOR GENERAL BIOLOGY MAJORS Through our national validation, we received input on whether the principles and statements achieved scientific accuracy and whether they were important for a graduating general biology major to know. Table 5 summarizes the validation data for the five principles and 40 statements in the BioCore Guide by showing average percent agreement for each section. Table 5. Percentage of national agreement with BioCore Guide principles and statementsa Principles Statements Scientific accuracy Important for graduating biology major to know Scientific accuracy Important for graduating biology major to know Evolution 96% 98% Mol/Cell 96% 99% Phys 91% 95% Eco/Evo 95% 97% Information flow 97% 99% Mol/Cell 98% 97% Phys 98% 97% Eco/Evo 98% 99% Structure function 91% 97% Mol/Cell 97% 96% Phys 96% 93% Eco/Evo 95% 94% Transformations of energy and matter 89% 95% Mol/Cell 99% 96% Phys 98% 94% Eco/Evo 97% 95% Systems 94% 97% Mol/Cell 99% 93% Phys 98% 95% Eco/Evo 95% 96% aData shown are average percentage agreement for each principle and for all the statements for each subdiscipline from 184 respondents. More than 95% of respondents agreed that each of the principles was important for a general biology major to master before graduation (Table 5). In addition, more than 89% of respondents agreed with the scientific accuracy of each of the principles. Because reviewers had an opportunity to provide specific feedback on the principles, we were able to modify each principle to reflect the consensus feedback; the revised principles appear in Figure 3. Figure 3. BioCore Guide: a nationally validated tool for interpreting the core concepts of Vision and Change. We present the principles and statements that encompass the BioCore Guide, which have been built by more than 200 people in the biology community. The columns represent the three major subdisciplines of biology (molecular/cellular/developmental biology, physiology, and ecology/evolutionary biology), which are also depicted on a biological scale from the molecular to the ecosystem level. Each concept is represented by a separate box, with a set of overarching principles that cross subdisciplinary boundaries at the top and then two to three statements for each of the subdisciplines. (Continued on next page) In the national validation of the statements, respondents agreed that all 40 of the statements were important for a graduating general biology major to know, with average agreement for each section being more than 93% (Table 5). Reviewers also rated the scientific accuracy of the 40 statements highly; average agreement for scientific accuracy was more than 90% for each section. Reviewers suggested minor modifications to some statements. If at least three people in the national validation made the same suggestion, the alterations were incorporated into the BioCore Guide; the revisions are shown in Figure 3. We gave reviewers the opportunity to recommend other concepts that may be important to include for a general biology major that we had not included on the BioCore Guide. No concepts were suggested by more than 5% of our sample, which we interpreted to mean that reviewers did not think that the BioCore Guide was missing any critically important statements. However, we do provide a list of these additional ideas in Supplemental Table S1, organized by core concept. Although these suggestions have not been validated, they could serve as a resource for biologists interested in incorporating a greater number of ideas into the BioCore Guide. In addition to providing the version of the BioCore Guide that was sent for national validation, Supplemental Figure S1 indicates which principles and statements were modified to produce Figure 3 and reports the averages on the Likert scale of 1–4 (1 = strongly disagree; 4 = strongly agree) and percentages of agreement for importance and scientific accuracy for each statement and principle based on the national survey. The final Vision and Change BioCore Guide of core concepts, shown in Figure 3, has been built by 244 members of the biology community and iteratively revised a total of six times. For each core concept, the BioCore Guide consists of a set of cross-disciplinary principles and two to three statements for each subdiscipline. WHERE DO THE CORE COMPETENCIES OF VISION AND CHANGE FIT IN? Vision and Change outlined a set of core competencies in addition to the five core concepts. These include the ability to: 1) apply the process of science, 2) use quantitative reasoning, 3) use modeling and simulation, 4) tap into the interdisciplinary nature of science, 5) communicate and collaborate with other disciplines, and 6) understand the relationship between science and society. We chose to focus on explicating the core concepts of biology rather than the core competencies, simply because we found the concepts to be more controversial with faculty—we observed much lower consensus among faculty members regarding what the five core concepts mean for their subdiscipline. Although this essay focuses solely on the core concepts, it is not because the competencies are less important. In our view, it is essential to address both core concepts and competencies as we work toward undergraduate biology reform. THE BIOCORE GUIDE SPANS A 4-YR UNDERGRADUATE BIOLOGY CURRICULUM Although many of the BioCore Guide statements are addressed in introductory biology courses because of their fundamental importance, some may be more appropriately taught in advanced courses. We did not determine at what level each statement should be taught, but emphasize that the BioCore Guide is intended to be used beyond introductory biology. We strongly encourage its use across the curriculum in ways that will promote an emphasis on the core concepts—even in upper-level courses with highly specialized topics. We hope that the BioCore Guide will promote dialogue about when each of these statements should be taught and how basic concepts can be elaborated on and reinforced in upper-level courses. Students need multiple opportunities to work with an idea to help them understand it at a deeper level. Additionally, engaging with the same concepts across the curriculum will help students understand the importance of using these core concepts as a way to structure their thinking about biology. Outlining how topics could be taught across the curriculum could help us develop learning progressions for these concepts in undergraduate biology (Duncan and Rivet, 2013). It may be important to reinforce statements that are introduced early in an undergraduate's career—restating and reminding, but perhaps also elaborating. An increasingly sophisticated understanding might focus on the complexity of biological interactions and processes, helping students move from thinking about single molecules, signal transduction pathways, or communities to analyzing the complex interactions that exist among these different entities. Further, while general or canonical examples might be presented in introductory courses, upper-level classes could explore important exceptions, delve into the primary literature, or challenge students to engage more with the Vision and Change core competencies. Consider a BioCore Guide statement from the information flow concept under molecular/cellular biology: “In most cases, genetic information flows from DNA to mRNA to protein, but there are important exceptions.” We imagine that most introductory courses cover the basic ideas of transcription and translation but may not address the exceptions to the DNA → mRNA → protein pathway or how the flow of genetic information is controlled. In upper-level molecular biology courses, more of the details and exceptions will likely be introduced. For example, students may be asked to explore the role of microRNAs in gene regulation or to analyze examples of successive reduction in genome size in somatic cells during development in organisms such as Tetrahymena or lamprey. Finally, upper-level courses may have students read primary literature or interpret data that either support or refute a given statement related to this core idea. USING THE BIOCORE GUIDE TO IMPROVE THE UNDERGRADUATE CURRICULUM We envision at least five major purposes for this BioCore Guide, which we outline below. Strengthening Connections between Course-Specific Learning Goals and the Core Concepts from Vision and Change There are few guidelines for faculty to use when developing course goals and learning outcomes. The BioCore Guide furnishes a nationally validated guideline for identifying student learning objectives and other course outcomes. If a faculty member aligns course goals with statements from the BioCore Guide, that instructor, along with other faculty teaching in the department, should gain a better understanding of how specific course activities can help students reach nationally validated goals for biology majors. In addition, students may be able to see which courses target the same statements and better appreciate common themes among courses or how course sequences build on each other. Aligning a Curriculum with the BioCore Guide to Identify Gaps Most departments strive to offer a cohesive curriculum for general biology majors. But currently, faculty members who teach upper-level courses are often unaware of what their colleagues are teaching in introductory courses. If so, courses and curricula can become disconnected from one another. Identifying which concepts are addressed in which courses—by mapping a suite of required courses onto the BioCore Guide—could allow departments to identify gaps in their curriculum (e.g., statements not targeted by any courses) and assess whether prerequisite courses introduce the core concepts that upper-level courses build upon. Help Undergraduates See the “Big Picture” of Biology Undergraduate majors frequently wrestle with how the details they are learning in various courses fit into a larger, synthetic view of biology. Faculty advisors could use the BioCore Guide to help students see how their required biology and non–biology courses fit together and how courses with differences in subject matter (e.g., ecology and molecular biology) have common underlying principles. Accreditation and Certification Department chairs, committee heads, and deans could use the BioCore Guide during the accreditation process to articulate larger curricular goals. In addition, work has begun on developing a certification program for departments that align their programs with the goals of Vision and Change. The Partnership for Undergraduate Life Sciences Education (PULSE) is a collaborative effort developed and funded by the National Institute of General Medical Sciences of the National Institutes of Health and the Howard Hughes Medical Institute to catalyze the adoption of the goals outlined in the Vision and Change report. The PULSE organization has started the process by creating rubrics for departments to use in assessing alignment (PULSE Community, 2014). The BioCore Guide could be used in conjunction with the PULSE rubrics as a way for departments to self-assess their current status at meeting curricular learning outcomes aligned with the core concepts. Use the BioCore Guide as a Basis for Diagnostic Programmatic Assessments The biology community is largely in agreement that undergraduate biology majors should master the core concepts outlined in Vision and Change by the time they graduate. We now need a way of assessing whether they have achieved that understanding. There are a number of different approaches for testing student understanding of fundamental concepts (e.g., Nehm and Schonfeld, 2008; Shi et al., 2010; Hartley et al., 2011; Smith et al., 2013), each with its own strengths. However, the community currently lacks a test that could be easily administered to thousands of students to serve the needs of biology departments interested in assessing general biology majors’ understanding of the core concepts spanning the subdisciplines. Thus, as part of a multi-institution team (University of Washington, University of Maine, University of Colorado–Boulder, Arizona State University, and University of Nebraska–Lincoln), we are using this BioCore Guide to develop a restricted-response programmatic assessment that will track undergraduate biology majors’ understanding of core concepts as they progress through the major. As our goal is to produce a test that could be used at the departmental or programmatic level—not the individual course level—we are proposing that it be administered to students at multiple time points in a curriculum: 1) before introductory biology, to assess students’ incoming knowledge; 2) after completion of an introductory biology series, to gauge students’ intermediate progress; and 3) before graduation, to determine the summative impact of the biology curriculum. Collecting baseline scores for students will allow institutions that have students transferring in at different points in the curriculum or students entering with different abilities to see the specific impact of their program on student understanding of the core concepts. We are intentionally structuring questions to target both introductory and advanced levels of thinking so that we can monitor improvement of student thinking as students progress through the curriculum. Success with the advanced-level questions would require higher-order cognitive understanding of one topic and/or across-discipline thinking that requires students to think broadly about biological concepts. Taking an integrative approach, focused on assessing student learning of diverse topics in biology at multiple stages of a general biology curriculum, will make this test distinct from previously developed concept inventories, capstone assessments, and subdiscipline-specific efforts. We are currently developing questions for this diagnostic tool, each of which will be aligned with the BioCore Guide, and thus Vision and Change, with the goal of producing a general biology test that would be available to interested institutions in the next few years. Departments could then use this programmatic assessment to monitor student learning and make evidence-based revisions to their curricula. ADAPTING THE BIOCORE GUIDE FOR USE AT YOUR OWN INSTITUTION We offer this BioCore Guide as a starting point for the five applications listed above and acknowledge that the goals of undergraduate biology education will evolve as the field of biology changes. Thus, the framework is not intended to be static; it will need to be modified and updated over time. Departments may even wish to adapt this BioCore Guide immediately, so that it conforms more closely to their interests, needs, and departmental culture. Although a departmentally modified BioCore Guide will not have national validation, it may be more effective in terms of promoting faculty acceptance and institutional change. In addition, the BioCore Guide is not meant to be prescriptive. The statements should not be viewed as a checklist for faculty instruction or be used to constrain what biology faculty teaches. Much of what excites us and our students lies in the details of our fields: a rare genetic disease, the crystal structure of a G protein–coupled receptor, the impact of climate change on salamander populations, the relationship between stress and Alzheimer's disease. Far from pushing faculty away from a personalized view of biology, our goal is to give instructors an organizing framework to position specific examples, moving the focus away from a collection of facts and toward a more cohesive picture of our science. This BioCore Guide, implemented in conjunction with the PULSE community's rubrics and ultimately with our programmatic assessment, could help departments incorporate the Vision and Change call to action into their institutional culture. We envision this BioCore Guide as an agent of change to help us complete this journey. Supplementary Material Supplemental Material
- Record: found
- Abstract: found
- Article: not found
The Molecular Biology Capstone Assessment: A Concept Assessment for Upper-Division Molecular Biology Students
Brian A. Couch, William B. Wood, Jennifer Knight (2015)
This article describes the development of the Molecular Biology Capstone Assessment, a multiple-true/false concept assessment targeted to upper-division students. This assessment is intended to help pinpoint areas of conceptual difficulty among graduating majors in order to facilitate curricular change at the departmental level.
Author and article information
Journal
Journal ID (nlm-ta): J Microbiol Biol Educ
Journal ID (iso-abbrev): J Microbiol Biol Educ
Journal ID (publisher-id): JMBE
Title:
Journal of Microbiology & Biology Education
Publisher:
American Society of Microbiology
ISSN
(Print):
1935-7877
ISSN
(Electronic):
1935-7885
Publication date Collection: 2019
Publication date
(Electronic):
30
August
2019
Volume: 20
Issue: 2
Electronic Location Identifier: 20.2.41
Affiliations
Author notes
[*
]Corresponding author. Mailing address: School of Biological Sciences, University of
Nebraska, 204 Manter, Lincoln, NE 68588-0118. Phone: 402-472-8130. Fax: 402-472-2083.
E-mail:
bcouch2@
123456unl.edu
.
Article
Publisher ID: jmbe-20-41DOI: 10.1128/jmbe.v20i2.1787
PMC ID: 6713482
SO-VID: a9317c4c-0853-4d3b-b2d8-2b9af9fe2b46
Copyright © ©2019 Author(s). Published by the American Society for Microbiology
License:
This is an Open Access article distributed under the terms of the Creative Commons Attribution-Noncommercial-NoDerivatives 4.0 International license ( https://creativecommons.org/licenses/by-nc-nd/4.0/ and https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode), which grants the public the nonexclusive right to copy, distribute, or display the published work.
History
Date
received
: 12
March
2019
Date
accepted
: 18
May
2019
Categories
Subject:
Perspectives
Data availability: