Comparing the force and motion conceptual evaluation and the force concept inventory
Phys. Rev. ST Phys. Educ. Res. 5, 010105 (2009)
DOI: 10.1103/PhysRevSTPER.5.010105
Ronald K Thornton, Dennis Kuhl, Karen Cummings, and Jeffrey Marx
In this paper we compare and contrast student’s pretest/post-test performance on the Halloun-Hestenes force concept inventory (FCI) to the Thornton-Sokoloff force and motion conceptual evaluation (FMCE). Both tests are multiple-choice assessment instruments whose results are used to characterize how well a first term, introductory physics course promotes conceptual understanding. However, the two exams have slightly different content domains, as well as different representational formats; hence, one exam or the other might better fit the interests of a given instructor or researcher. To begin the comparison, we outline how to determine a single-number score for the FMCE and present ranges of normalized gains on this exam. We then compare scores on the FCI and the FMCE for approximately 2000 students enrolled in the Studio Physics course at Rensselaer Polytechnic Institute over a period of eight years (1998–2006) that encompassed significant evolution of the course and many different instructors. We found that the mean score on the FCI is significantly higher than the mean score on the FMCE, however there is a very strong relationship between scores on the two exams. The slope of a best fit line drawn through FCI versus FMCE data is approximately 0.54, and the correlation coefficient is approximately r=0.78 , for preinstructional and postinstructional testings combined. In spite of this strong relationship, the assessments measure different normalized gains under identical circumstances. Additionally, students who scored well on one exam did not necessarily score well on the other. We use this discrepancy to uncover some subtle, but important, differences between the exams. We also present ranges of normalized gains for the FMCE in a variety of instructional settings.
Showing posts with label FMCE. Show all posts
Showing posts with label FMCE. Show all posts
2009-03-21
2008-09-10
Smith Wittmann - PRST-PER 2008
Applying a resources framework to analysis of the Force and Motion Conceptual Evaluation
Phys. Rev. ST Phys. Educ. Res. 4, 020101 (2008) [12 pages]
Trevor I. Smith and Michael C. Wittmann
We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation. Our goal is to propose a methodology that moves beyond an analysis of student learning defined by correct responses, either on the overall test or on clusters of questions defined solely by content. We use the resources framework theory of learning to define clusters within this experimental test that was designed without the resources framework in mind. We take special note of the contextual and representational dependence of questions with seemingly similar physics content. We analyze clusters in ways that allow the most common incorrect answers to give as much, or more, information as the correctness of responses in that cluster. We show that false positives can be found, especially on questions dealing with Newton’s third law. We apply our clustering to a small set of data to illustrate the value of comparing students’ incorrect responses which are otherwise identical on a correct or incorrect analysis. Our work provides a connection between theory and experiment in the area of survey design and the resources framework.
Phys. Rev. ST Phys. Educ. Res. 4, 020101 (2008) [12 pages]
Trevor I. Smith and Michael C. Wittmann
We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation. Our goal is to propose a methodology that moves beyond an analysis of student learning defined by correct responses, either on the overall test or on clusters of questions defined solely by content. We use the resources framework theory of learning to define clusters within this experimental test that was designed without the resources framework in mind. We take special note of the contextual and representational dependence of questions with seemingly similar physics content. We analyze clusters in ways that allow the most common incorrect answers to give as much, or more, information as the correctness of responses in that cluster. We show that false positives can be found, especially on questions dealing with Newton’s third law. We apply our clustering to a small set of data to illustrate the value of comparing students’ incorrect responses which are otherwise identical on a correct or incorrect analysis. Our work provides a connection between theory and experiment in the area of survey design and the resources framework.
2007-11-13
Smith Wittmann - arxiv.org 2007
Toward a more effective use of the Force and Motion Conceptual Evaluation
Trevor I. Smith, Michael C. Wittmann
contact: Trevor.I.Smith@umit.maine.edu and wittmann@umit.maine.edu
(Submitted on 12 Nov 2007)
We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation (FMCE). Our goal is to move beyond the expert/novice analysis of student learning based on pre-/post-testing and the correctness of responses (either on the overall test or on clusters of questions defined solely by content). We base our work in resource theory, taking special note of the context dependence of questions with seemingly similar physics content. We analyze clusters in ways that allow the most common incorrect answers to give as much, or more, information as the correctness of responses in that cluster. Using this dichotomy of correct and most common incorrect models (in clusters defined by common models) we can apply Model Analysis to help better map a class's thinking about the physics on the FMCE. We give one example of such an analysis as a proof-of-concept of our approach.
Comments: 13 pages, 7 figures, submitted to Phys. Rev. ST Phys. Educ. Res
Subjects: Physics Education (physics.ed-ph)
Cite as: arXiv:0711.1838v1 [physics.ed-ph]
Submission history
[v1] Mon, 12 Nov 2007 18:11:32 GMT (250kb,D)
Trevor I. Smith, Michael C. Wittmann
contact: Trevor.I.Smith@umit.maine.edu and wittmann@umit.maine.edu
(Submitted on 12 Nov 2007)
We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation (FMCE). Our goal is to move beyond the expert/novice analysis of student learning based on pre-/post-testing and the correctness of responses (either on the overall test or on clusters of questions defined solely by content). We base our work in resource theory, taking special note of the context dependence of questions with seemingly similar physics content. We analyze clusters in ways that allow the most common incorrect answers to give as much, or more, information as the correctness of responses in that cluster. Using this dichotomy of correct and most common incorrect models (in clusters defined by common models) we can apply Model Analysis to help better map a class's thinking about the physics on the FMCE. We give one example of such an analysis as a proof-of-concept of our approach.
Comments: 13 pages, 7 figures, submitted to Phys. Rev. ST Phys. Educ. Res
Subjects: Physics Education (physics.ed-ph)
Cite as: arXiv:0711.1838v1 [physics.ed-ph]
Submission history
[v1] Mon, 12 Nov 2007 18:11:32 GMT (250kb,D)
2007-10-30
Smith and Wittmann - Phys Rev 2007
From the Physical Review - Special Topics Physics Education Research:
Comparing three methods for teaching Newton’s third law
Phys. Rev. ST Phys. Educ. Res. 3, 020105 (2007)
Trevor I. Smith and Michael C. Wittmann
Department of Physics and Astronomy, College of Education and Human Development, Center for Science and Mathematics Education Research, University of Maine, Orono, Maine 04469, USA
Received 20 April 2006; revised 11 December 2006; published 18 October 2007
Although guided-inquiry methods for teaching introductory physics have been individually shown to be more effective at improving conceptual understanding than traditional lecture-style instruction, researchers in physics education have not studied differences among reform-based curricula in much detail. Several researchers have developed University of Washington–style tutorial materials, but the different curricula have not been compared against each other. Our study examines three tutorials designed to improve student understanding of Newton’s third law: the University of Washington’s Tutorials in Introductory Physics (TIP), the University of Maryland’s Activity-Based Tutorials (ABT), and the Open Source Tutorials (OST) also developed at the University of Maryland. Each tutorial was designed with different goals and agendas, and each employs different methods to help students understand the physics. We analyzed pretest and post-test data, including course examinations and data from the Force and Motion Conceptual Evaluation (FMCE). Using both FMCE and course data, we find that students using the OST version of the tutorial perform better than students using either of the other two.
©2007 The American Physical Society
URL: http://link.aps.org/abstract/PRSTPER/v3/e020105
DOI: 10.1103/PhysRevSTPER.3.020105
PACS: 01.40.Fk, 01.40.G−, 01.40.gb
Comparing three methods for teaching Newton’s third law
Phys. Rev. ST Phys. Educ. Res. 3, 020105 (2007)
Trevor I. Smith and Michael C. Wittmann
Department of Physics and Astronomy, College of Education and Human Development, Center for Science and Mathematics Education Research, University of Maine, Orono, Maine 04469, USA
Received 20 April 2006; revised 11 December 2006; published 18 October 2007
Although guided-inquiry methods for teaching introductory physics have been individually shown to be more effective at improving conceptual understanding than traditional lecture-style instruction, researchers in physics education have not studied differences among reform-based curricula in much detail. Several researchers have developed University of Washington–style tutorial materials, but the different curricula have not been compared against each other. Our study examines three tutorials designed to improve student understanding of Newton’s third law: the University of Washington’s Tutorials in Introductory Physics (TIP), the University of Maryland’s Activity-Based Tutorials (ABT), and the Open Source Tutorials (OST) also developed at the University of Maryland. Each tutorial was designed with different goals and agendas, and each employs different methods to help students understand the physics. We analyzed pretest and post-test data, including course examinations and data from the Force and Motion Conceptual Evaluation (FMCE). Using both FMCE and course data, we find that students using the OST version of the tutorial perform better than students using either of the other two.
©2007 The American Physical Society
URL: http://link.aps.org/abstract/PRSTPER/v3/e020105
DOI: 10.1103/PhysRevSTPER.3.020105
PACS: 01.40.Fk, 01.40.G−, 01.40.gb
Subscribe to:
Posts (Atom)