{"id":"https://openalex.org/W2005494107","doi":"https://doi.org/10.1002/j.2168-9830.2009.tb01031.x","title":"A Research Synthesis of the Effectiveness, Replicability, and Generality of the VaNTH Challenge\u2010based Instructional Modules in Bioengineering","display_name":"A Research Synthesis of the Effectiveness, Replicability, and Generality of the VaNTH Challenge\u2010based Instructional Modules in Bioengineering","publication_year":2009,"publication_date":"2009-10-01","ids":{"openalex":"https://openalex.org/W2005494107","doi":"https://doi.org/10.1002/j.2168-9830.2009.tb01031.x","mag":"2005494107"},"language":"en","primary_location":{"id":"doi:10.1002/j.2168-9830.2009.tb01031.x","doi":"https://doi.org/10.1002/j.2168-9830.2009.tb01031.x","is_oa":false,"landing_page_url":"https://doi.org/10.1002/j.2168-9830.2009.tb01031.x","pdf_url":null,"source":{"id":"https://openalex.org/S73400788","display_name":"Journal of Engineering Education","issn_l":"1069-4730","issn":["1069-4730","1524-4873","2168-9830"],"is_oa":false,"is_in_doaj":false,"is_core":true,"listed_in":["cwts-core","dongbi-b","jufo-2","norway-1","poland-200","russia-white-list-1","vabb-shw"],"host_organization":"https://openalex.org/P4310320595","host_organization_name":"Wiley","host_organization_lineage":["https://openalex.org/P4310320595"],"host_organization_lineage_names":["Wiley"],"type":"journal"},"license":null,"license_id":null,"version":"publishedVersion","is_accepted":true,"is_published":true,"raw_source_name":"Journal of Engineering Education","raw_type":"journal-article"},"volume":null,"type":"article","indexed_in":["crossref"],"open_access":{"is_oa":false,"oa_status":"closed","oa_url":null,"any_repository_has_fulltext":false},"authorships":[{"author_position":"first","author":{"id":"https://openalex.org/A5012376884","display_name":"David S. Cordray","orcid":null,"observed_orcids":[]},"institutions":[{"id":"https://openalex.org/I200719446","display_name":"Vanderbilt University","ror":"https://ror.org/02vm5rt34","country_code":"US","type":"education","lineage":["https://openalex.org/I200719446"]}],"countries":["US"],"is_corresponding":true,"raw_author_name":"David S. Cordray","raw_affiliation_strings":["David S. Cordray is professor of Psychology and professor of Public Policy within the Department of Psychology and Human Development at Vanderbilt University. Between 2001 and 2007, he served as the Leader of the Assessment and Evaluation Thrust within the VaNTH/ERC. Professor Cordray's areas of specialization include design and analysis of randomized controlled trials (RCTs), multiple-site experimental evaluations, meta-analysis, and assessment and analysis of intervention implementation fidelity. He currently directs several training grants and two research grants from the Department of Education. In a multiple site field experiment, he is examining the effects of formative feedback and differentiated instructional strategies on reading performance of 4th and 5th grade students. In the other grant he is developing models and methods of analysis for assessing the fidelity with which interventions are implemented in field settings","Vanderbilt University"],"raw_orcid":null,"affiliations":[{"raw_affiliation_string":"David S. Cordray is professor of Psychology and professor of Public Policy within the Department of Psychology and Human Development at Vanderbilt University. Between 2001 and 2007, he served as the Leader of the Assessment and Evaluation Thrust within the VaNTH/ERC. Professor Cordray's areas of specialization include design and analysis of randomized controlled trials (RCTs), multiple-site experimental evaluations, meta-analysis, and assessment and analysis of intervention implementation fidelity. He currently directs several training grants and two research grants from the Department of Education. In a multiple site field experiment, he is examining the effects of formative feedback and differentiated instructional strategies on reading performance of 4th and 5th grade students. In the other grant he is developing models and methods of analysis for assessing the fidelity with which interventions are implemented in field settings","institution_ids":["https://openalex.org/I200719446"]},{"raw_affiliation_string":"Vanderbilt University","institution_ids":["https://openalex.org/I200719446"]}]},{"author_position":"middle","author":{"id":"https://openalex.org/A5110063581","display_name":"Thomas R. Harris","orcid":"https://orcid.org/0000-0002-0771-5397","observed_orcids":["https://orcid.org/0000-0002-0771-5397"]},"institutions":[{"id":"https://openalex.org/I200719446","display_name":"Vanderbilt University","ror":"https://ror.org/02vm5rt34","country_code":"US","type":"education","lineage":["https://openalex.org/I200719446"]}],"countries":["US"],"is_corresponding":true,"raw_author_name":"Thomas R. Harris","raw_affiliation_strings":["Thomas R. Harris is the Orrin Henry Ingram Distinguished Professor of Engineering, Emeritus, Professor of Biomedical Engineering, Chemical Engineering and Medicine, Emeritus, and Research Professor of Biomedical Engineering at Vanderbilt University. His current interests focus on the development of learning science and learning technology for bioengineering. He directed the National Science Foundation Engineering Research Center in Bioengineering Educational Technologies (Vanderbilt-Northwestern-Texas-Harvard/MIT ERC). Honors include selection as the Theo C. Pilkington Outstanding Educator Award of the American Society for Engineering Education in 2003. He is a past president of the Biomedical Engineering Society and of the American Institute for Medical and Biological Engineering. He has led in the organization of both the undergraduate and graduate degree programs in biomedical engineering at Vanderbilt","Vanderbilt University"],"raw_orcid":null,"affiliations":[{"raw_affiliation_string":"Thomas R. Harris is the Orrin Henry Ingram Distinguished Professor of Engineering, Emeritus, Professor of Biomedical Engineering, Chemical Engineering and Medicine, Emeritus, and Research Professor of Biomedical Engineering at Vanderbilt University. His current interests focus on the development of learning science and learning technology for bioengineering. He directed the National Science Foundation Engineering Research Center in Bioengineering Educational Technologies (Vanderbilt-Northwestern-Texas-Harvard/MIT ERC). Honors include selection as the Theo C. Pilkington Outstanding Educator Award of the American Society for Engineering Education in 2003. He is a past president of the Biomedical Engineering Society and of the American Institute for Medical and Biological Engineering. He has led in the organization of both the undergraduate and graduate degree programs in biomedical engineering at Vanderbilt","institution_ids":["https://openalex.org/I200719446"]},{"raw_affiliation_string":"Vanderbilt University","institution_ids":["https://openalex.org/I200719446"]}]},{"author_position":"last","author":{"id":null,"display_name":"Stacy Klein","orcid":null,"observed_orcids":[]},"institutions":[{"id":"https://openalex.org/I200719446","display_name":"Vanderbilt University","ror":"https://ror.org/02vm5rt34","country_code":"US","type":"education","lineage":["https://openalex.org/I200719446"]}],"countries":["US"],"is_corresponding":true,"raw_author_name":"Stacy Klein","raw_affiliation_strings":["Stacy S. Klein, Ph.D. is the associate dean for Outreach at the Vanderbilt University School of Engineering. She also holds appointments as an associate professor of the Practice of Biomedical Engineering, associate professor of Radiology and Radiological Sciences, and research assistant professor of Teaching and Learning. The Vanderbilt RET program, directed by Dr. Klein, is in its sixth year of operation. Dr. Klein has also taught high school full or part time for ten years. Through her work that began with the VaNTH ERC, she is the author of the Vanderbilt Instruction in Biomedical Engineering for Secondary Science (VIBES) program and runs related professional development workshops each year","Vanderbilt University"],"raw_orcid":null,"affiliations":[{"raw_affiliation_string":"Stacy S. Klein, Ph.D. is the associate dean for Outreach at the Vanderbilt University School of Engineering. She also holds appointments as an associate professor of the Practice of Biomedical Engineering, associate professor of Radiology and Radiological Sciences, and research assistant professor of Teaching and Learning. The Vanderbilt RET program, directed by Dr. Klein, is in its sixth year of operation. Dr. Klein has also taught high school full or part time for ten years. Through her work that began with the VaNTH ERC, she is the author of the Vanderbilt Instruction in Biomedical Engineering for Secondary Science (VIBES) program and runs related professional development workshops each year","institution_ids":["https://openalex.org/I200719446"]},{"raw_affiliation_string":"Vanderbilt University","institution_ids":["https://openalex.org/I200719446"]}]}],"institutions":[],"countries_distinct_count":1,"institutions_distinct_count":1,"corresponding_author_ids":["https://openalex.org/A5012376884","https://openalex.org/A5110063581"],"corresponding_institution_ids":["https://openalex.org/I200719446"],"apc_list":{"value":3710,"currency":"USD","value_usd":3710},"apc_paid":null,"fwci":1.941,"has_fulltext":false,"cited_by_count":88,"citation_normalized_percentile":{"value":0.84342417,"is_in_top_1_percent":false,"is_in_top_10_percent":false},"cited_by_percentile_year":{"min":88,"max":100},"biblio":{"volume":"98","issue":"4","first_page":"335","last_page":"348"},"is_retracted":false,"is_paratext":false,"is_xpac":false,"primary_topic":{"id":"https://openalex.org/T13280","display_name":"Biomedical and Engineering Education","score":0.5073000192642212,"subfield":{"id":"https://openalex.org/subfields/2204","display_name":"Biomedical Engineering"},"field":{"id":"https://openalex.org/fields/22","display_name":"Engineering"},"domain":{"id":"https://openalex.org/domains/3","display_name":"Physical Sciences"}},"topics":[{"id":"https://openalex.org/T13280","display_name":"Biomedical and Engineering Education","score":0.5073000192642212,"subfield":{"id":"https://openalex.org/subfields/2204","display_name":"Biomedical Engineering"},"field":{"id":"https://openalex.org/fields/22","display_name":"Engineering"},"domain":{"id":"https://openalex.org/domains/3","display_name":"Physical Sciences"}},{"id":"https://openalex.org/T11299","display_name":"Problem and Project Based Learning","score":0.30790001153945923,"subfield":{"id":"https://openalex.org/subfields/3304","display_name":"Education"},"field":{"id":"https://openalex.org/fields/33","display_name":"Social Sciences"},"domain":{"id":"https://openalex.org/domains/2","display_name":"Social Sciences"}},{"id":"https://openalex.org/T13682","display_name":"Engineering Education and Pedagogy","score":0.16189999878406525,"subfield":{"id":"https://openalex.org/subfields/2216","display_name":"Architecture"},"field":{"id":"https://openalex.org/fields/22","display_name":"Engineering"},"domain":{"id":"https://openalex.org/domains/3","display_name":"Physical Sciences"}}],"keywords":[{"id":"https://openalex.org/keywords/how-people-learn","display_name":"How People Learn","score":0.7860000133514404},{"id":"https://openalex.org/keywords/bioengineering-education","display_name":"bioengineering education","score":0.8209999799728394},{"id":"https://openalex.org/keywords/teaching-modules","display_name":"teaching modules","score":0.6389999985694885},{"id":"https://openalex.org/keywords/engineering-education-reform","display_name":"engineering education reform","score":0.42899999022483826},{"id":"https://openalex.org/keywords/transfer-of-learning","display_name":"transfer of learning","score":0.6510000228881836},{"id":"https://openalex.org/keywords/adaptive-expertise","display_name":"adaptive expertise","score":0.9940000176429749},{"id":"https://openalex.org/keywords/replicability","display_name":"replicability","score":0.5199999809265137},{"id":"https://openalex.org/keywords/effect-size","display_name":"effect size","score":0.6620000004768372},{"id":"https://openalex.org/keywords/student-performance","display_name":"student performance","score":0.515999972820282}],"concepts":[{"id":"https://openalex.org/C2780767217","wikidata":"https://www.wikidata.org/wiki/Q5532421","display_name":"Generality","level":2,"score":0.842826247215271},{"id":"https://openalex.org/C136197465","wikidata":"https://www.wikidata.org/wiki/Q1729295","display_name":"Variety (cybernetics)","level":2,"score":0.7296467423439026},{"id":"https://openalex.org/C177264268","wikidata":"https://www.wikidata.org/wiki/Q1514741","display_name":"Set (abstract data type)","level":2,"score":0.6439177393913269},{"id":"https://openalex.org/C145420912","wikidata":"https://www.wikidata.org/wiki/Q853077","display_name":"Mathematics education","level":1,"score":0.5415748357772827},{"id":"https://openalex.org/C15744967","wikidata":"https://www.wikidata.org/wiki/Q9418","display_name":"Psychology","level":0,"score":0.429656982421875},{"id":"https://openalex.org/C41008148","wikidata":"https://www.wikidata.org/wiki/Q21198","display_name":"Computer science","level":0,"score":0.4227994978427887},{"id":"https://openalex.org/C2777382242","wikidata":"https://www.wikidata.org/wiki/Q6017816","display_name":"Index (typography)","level":2,"score":0.41100746393203735},{"id":"https://openalex.org/C154945302","wikidata":"https://www.wikidata.org/wiki/Q11660","display_name":"Artificial intelligence","level":1,"score":0.15036439895629883},{"id":"https://openalex.org/C136764020","wikidata":"https://www.wikidata.org/wiki/Q466","display_name":"World Wide Web","level":1,"score":0.09844866394996643},{"id":"https://openalex.org/C199360897","wikidata":"https://www.wikidata.org/wiki/Q9143","display_name":"Programming language","level":1,"score":0.09361502528190613},{"id":"https://openalex.org/C542102704","wikidata":"https://www.wikidata.org/wiki/Q183257","display_name":"Psychotherapist","level":1,"score":0.0}],"mesh":[],"locations_count":1,"locations":[{"id":"doi:10.1002/j.2168-9830.2009.tb01031.x","doi":"https://doi.org/10.1002/j.2168-9830.2009.tb01031.x","is_oa":false,"landing_page_url":"https://doi.org/10.1002/j.2168-9830.2009.tb01031.x","pdf_url":null,"source":{"id":"https://openalex.org/S73400788","display_name":"Journal of Engineering Education","issn_l":"1069-4730","issn":["1069-4730","1524-4873","2168-9830"],"is_oa":false,"is_in_doaj":false,"is_core":true,"listed_in":["cwts-core","dongbi-b","jufo-2","norway-1","poland-200","russia-white-list-1","vabb-shw"],"host_organization":"https://openalex.org/P4310320595","host_organization_name":"Wiley","host_organization_lineage":["https://openalex.org/P4310320595"],"host_organization_lineage_names":["Wiley"],"type":"journal"},"license":null,"license_id":null,"version":"publishedVersion","is_accepted":true,"is_published":true,"raw_source_name":"Journal of Engineering Education","raw_type":"journal-article"}],"best_oa_location":null,"sustainable_development_goals":[{"score":0.9901999831199646,"display_name":"Quality education","id":"https://metadata.un.org/sdg/4"}],"sustainable_development_goals_aurora":[],"study_designs":[{"display_name":"Systematic Review","id":"https://openalex.org/study-designs/systematic-review"},{"display_name":"Meta-Analysis","id":"https://openalex.org/study-designs/meta-analysis"}],"awards":[],"funders":[],"has_content":{"grobid_xml":false,"pdf":false},"content_urls":null,"referenced_works_count":41,"referenced_works":["https://openalex.org/W37794030","https://openalex.org/W626113951","https://openalex.org/W1528251861","https://openalex.org/W1539537369","https://openalex.org/W1542045949","https://openalex.org/W1730782591","https://openalex.org/W1761828760","https://openalex.org/W1974948085","https://openalex.org/W2004245571","https://openalex.org/W2004295805","https://openalex.org/W2018981774","https://openalex.org/W2023794892","https://openalex.org/W2026136532","https://openalex.org/W2028532322","https://openalex.org/W2032094149","https://openalex.org/W2059783995","https://openalex.org/W2090427002","https://openalex.org/W2094419105","https://openalex.org/W2096981425","https://openalex.org/W2101802222","https://openalex.org/W2103520324","https://openalex.org/W2115669451","https://openalex.org/W2122534729","https://openalex.org/W2127127199","https://openalex.org/W2132168383","https://openalex.org/W2133907116","https://openalex.org/W2139470851","https://openalex.org/W2139530381","https://openalex.org/W2150086834","https://openalex.org/W2167023776","https://openalex.org/W2167574980","https://openalex.org/W2172253928","https://openalex.org/W2186991013","https://openalex.org/W2347998626","https://openalex.org/W2404310843","https://openalex.org/W2419354859","https://openalex.org/W2597286731","https://openalex.org/W2603217761","https://openalex.org/W2625869589","https://openalex.org/W4252560992","https://openalex.org/W4300870773"],"related_works":["https://openalex.org/W2045049461","https://openalex.org/W4381094582","https://openalex.org/W1978893398","https://openalex.org/W1977906818","https://openalex.org/W2201908702","https://openalex.org/W2369625323","https://openalex.org/W2364579609","https://openalex.org/W1522139108","https://openalex.org/W2353528968","https://openalex.org/W2032776242"],"abstract_inverted_index":{"Background":[0],"Between":[1],"2000":[2],"and":[3,9,17,35,60,63,85,103,106,148,168,174,207,210,219,244],"2006":[4],"the":[5,27,31,41,42,54,116,119,145,187,196,199,216],"Vanderbilt,":[6],"Northwestern,":[7],"Texas":[8],"Harvard/MIT":[10],"Engineering":[11],"Research":[12],"Center":[13],"(VaNTH/ERC)":[14],"developed,":[15],"tested,":[16],"implemented":[18,233],"a":[19,78,98,153,202,239],"set":[20,79],"of":[21,56,80,100,118,123,157,172,198,204,241],"educational":[22,101,208,242],"innovations":[23,221],"based":[24],"largely":[25],"on":[26,226],"ideas":[28],"presented":[29],"in":[30,68,97,129,132,201,238],"bookHow":[32],"People":[33],"Learn(HPL)":[34],"an":[36],"instructional":[37],"design":[38],"known":[39],"as":[40],"STAR":[43],"Legacy":[44],"Cycle.":[45],"The":[46,72],"motivation":[47],"for":[48],"this":[49,57,69],"study":[50],"was":[51,135],"to":[52,177],"synthesize":[53],"results":[55,188],"work.":[58],"Published":[59],"unpublished":[61],"experimental":[62,146,150],"quasi\u2010experimental":[64],"assessments":[65],"were":[66,76],"included":[67],"synthesis.":[70],"Purpose(Hypothesis)":[71],"fundamental":[73],"hypotheses":[74],"tested":[75],"whether":[77,107],"modules":[81,128,218],"involving":[82,90],"challenge\u2010based":[83,217],"instruction":[84],"other":[86,114,194,212,220,236],"course":[87],"innovations,":[88],"often":[89],"advanced":[91],"computer\u2010based":[92],"technologies,":[93],"improved":[94,227],"student":[95,104,205,228,245],"performance":[96],"variety":[99,203,240],"settings":[102,243],"populations,":[105],"improvements":[108],"could":[109],"be":[110,190,232],"achieved":[111],"by":[112,192,235],"instructors":[113,193,237],"than":[115,195],"developers":[117,197],"innovations.":[120],"Design/Method":[121],"Meta\u2010analysis":[122],"effects":[124,225],"from":[125,144],"thirty\u2010three":[126],"separate":[127],"five":[130],"courses":[131],"bioengineering":[133],"domains":[134],"undertaken,":[136],"along":[137],"with":[138],"three":[139],"case":[140],"studies.":[141],"Results":[142,143],"(randomized)":[147],"stronger\u2010quasi":[149],"studies":[151,169],"revealed":[152,185],"weighted":[154],"effect":[155],"size":[156],"0.655":[158],"(p<":[159],"0.001).":[160],"Studies":[161],"using":[162,170],"randomized":[163],"designs":[164],"produced":[165,180],"smaller":[166],"effects,":[167],"measures":[171],"transfer":[173],"adaptive":[175],"expertise":[176],"index":[178],"outcomes":[179],"larger":[181],"effects.":[182],"Analyses":[183],"also":[184],"that":[186],"can":[189,231],"replicated":[191],"modules,":[200],"populations":[206],"settings,":[209],"at":[211],"institutions.":[213],"Conclusions":[214],"Overall,":[215],"have":[222],"moderate":[223],"overall":[224],"performance.":[229],"They":[230],"successively":[234],"populations.":[246]},"counts_by_year":[{"year":2025,"cited_by_count":2},{"year":2024,"cited_by_count":8},{"year":2023,"cited_by_count":5},{"year":2022,"cited_by_count":6},{"year":2021,"cited_by_count":1},{"year":2020,"cited_by_count":17},{"year":2019,"cited_by_count":6},{"year":2018,"cited_by_count":5},{"year":2017,"cited_by_count":2},{"year":2016,"cited_by_count":4},{"year":2015,"cited_by_count":7},{"year":2014,"cited_by_count":9},{"year":2013,"cited_by_count":6},{"year":2012,"cited_by_count":4}],"updated_date":"2026-10-12T09:40:04.860316","created_date":"2025-10-10T00:00:00"}