Evaluation of the BioQuest Academy’s success
Although inquiry-related teaching has been shown to be effective in fostering science literacy, relatively limited research has been conducted to quantify the impact of inquiry-based science programs on student achievement. In response to this challenge, BioQuest has structured its evaluation plan to investigate the program’s impact on student achievement in science at multiple moments in the programmatic and academic progression of the participants.
Educational researchers use a variety of methods to investigate student achievement, but experimental research is the only type of research that can truly test hypotheses concerning cause and effect relationships. Key problems with designing experiments include (1) controlling for extraneous variables and (2) establishing a suitable comparison group. Since Academy students are not chosen at random, the evaluation uses quasi-experimental methods of pre/post testing and comparison to a nationally administered standardized test. The specific evaluation methods include:
Student Demographics—To track participation of targeted teens, demographic questions pertaining to race, ethnicity, and gender will be included on the student Pre Test. Results will be compared to program targets and recruitment will be adjusted accordingly to maintain representation of underserved teens.
Student Pre/Post Tests—Quality of materials and experiences should be assessed through investigation of student learning outcomes, therefore, students will be asked to complete pre and post tests at the Academy. Questions will pertain to the direct benefits of the program (i.e., acquisition of a range of skills and knowledge; confidence in sharing new knowledge; and interest in a career in biomedical research or a related field). Analysis of variance will be used to check for comparable outcomes for diverse teens. Please contact us if you would like a copy of our evaluation tools!
Student Interviews—Students will be interviewed mid-year of their first year of college. Using data from interviews, students can communicate descriptive information and narrative stories of their transformation as they move from high school juniors and seniors to college students. Students will be able to describe specific abilities acquired by participating in the Academy. Information gathered through student interviews will be useful for not only understanding program outcomes, but also as a means of improving Academy design.
Student tracking—BioQuest programmatic staff stay in contact with students and graduates long after they leave us. All students are encouraged to join the BioQuest Academy Facebook group to stay informed of valuable upcoming activities and opportunities. Likewise, we utlize social media as a valuable way for students to relay their academic and vocational progress in global health. A summary of the student progress of our 2005-09 students can be found at PLoS.
