Etkina Karelina Murthy Ruibal-Villasenor - PRST-PER 2009

Using action research to improve learning and formative assessment to conduct research
Phys. Rev. ST Phys. Educ. Res. 5, 010109 (2009)

Eugenia Etkina, Anna Karelina, Sahana Murthy, and Maria Ruibal-Villasenor

The paper reports on how educational research informed and supported both the process of refinement of introductory physics laboratory instruction and student development of scientific abilities. In particular we focus on how the action research approach paradigm combined with instructional approaches such as scaffolding and formative assessment can be used to design the learning environment, investigate student learning, revise curriculum materials, and conduct subsequent assessment. As the result of the above efforts we found improvement in students’ scientific abilities over the course of three years. We suggest that the process used to improve the curriculum under study can be extended to many instructional innovations.

Rosengrant Heuvelen Etkina - PRST-PER 2009

Do students use and understand free-body diagrams?
Phys. Rev. ST Phys. Educ. Res. 5, 010108 (2009)

David Rosengrant, Alan Van Heuvelen, and Eugenia Etkina

Physics education literature recommends using multiple representations to help students understand concepts and solve problems. However, there is little research concerning why students use the representations and whether those who use them are more successful. This study addresses these questions using free-body diagrams (diagrammatic representations used in problems involving forces) as a type of representation. We conducted a two-year quantitative and qualitative study of students’ use of free-body diagrams while solving physics problems. We found that when students are in a course that consistently emphasizes the use of free-body diagrams, the majority of them do use diagrams on their own to help solve exam problems even when they receive no credit for drawing the diagrams. We also found that students who draw diagrams correctly are significantly more successful in obtaining the right answer for the problem. Lastly, we interviewed students to uncover their reasons for using free-body diagrams. We found that high achieving students used the diagrams to help solve the problems and as a tool to evaluate their work while low achieving students only used representations as aids in the problem-solving process.

Kortemeyer - PRST-PER 2009

Gender differences in the use of an online homework system in an introductory physics course
Phys. Rev. ST Phys. Educ. Res. 5, 010107 (2009)

Gerd Kortemeyer

The two genders make different use of being allowed multiple tries to solve online homework problems: male students frequently attempt to immediately solve the problem, while female students are more likely to first interact with peers and teaching assistants before entering answers. More male than female students state that they use the multiple allowed attempts to enter “random stuff,” while more female than male students state that the multiple attempts allow them to explore their own problem solving approaches without worrying or being stressed out by grades.

Bailey Finkelstein - PRST-PER 2009

Development of quantum perspectives in modern physics

Phys. Rev. ST Phys. Educ. Res. 5, 010106 (2009)
DOI: 10.1103/PhysRevSTPER.5.010106

Charles Baily and Noah D. Finkelstein

Introductory undergraduate courses in classical physics stress a perspective that can be characterized as realist; from this perspective, all physical properties of a classical system can be simultaneously specified and thus determined at all future times. Such a perspective can be problematic for introductory quantum physics students, who must develop new perspectives in order to properly interpret what it means to have knowledge of quantum systems. We document this evolution in student thinking in part through pre- and post-instruction evaluations using the Colorado Learning Attitudes about Science Survey. We further characterize variations in student epistemic and ontological commitments by examining responses to two essay questions, coupled with responses to supplemental quantum attitude statements. We find that, after instruction in modern physics, many students are still exhibiting a realist perspective in contexts where a quantum-mechanical perspective is needed. We further find that this effect can be significantly influenced by instruction, where we observe variations for courses with differing learning goals. We also note that students generally do not employ either a realist or a quantum perspective in a consistent manner.

Thornton Kuhl Cummings Marx - PRST-PER 2009

Comparing the force and motion conceptual evaluation and the force concept inventory
Phys. Rev. ST Phys. Educ. Res. 5, 010105 (2009)
DOI: 10.1103/PhysRevSTPER.5.010105

Ronald K Thornton, Dennis Kuhl, Karen Cummings, and Jeffrey Marx

In this paper we compare and contrast student’s pretest/post-test performance on the Halloun-Hestenes force concept inventory (FCI) to the Thornton-Sokoloff force and motion conceptual evaluation (FMCE). Both tests are multiple-choice assessment instruments whose results are used to characterize how well a first term, introductory physics course promotes conceptual understanding. However, the two exams have slightly different content domains, as well as different representational formats; hence, one exam or the other might better fit the interests of a given instructor or researcher. To begin the comparison, we outline how to determine a single-number score for the FMCE and present ranges of normalized gains on this exam. We then compare scores on the FCI and the FMCE for approximately 2000 students enrolled in the Studio Physics course at Rensselaer Polytechnic Institute over a period of eight years (1998–2006) that encompassed significant evolution of the course and many different instructors. We found that the mean score on the FCI is significantly higher than the mean score on the FMCE, however there is a very strong relationship between scores on the two exams. The slope of a best fit line drawn through FCI versus FMCE data is approximately 0.54, and the correlation coefficient is approximately r=0.78 , for preinstructional and postinstructional testings combined. In spite of this strong relationship, the assessments measure different normalized gains under identical circumstances. Additionally, students who scored well on one exam did not necessarily score well on the other. We use this discrepancy to uncover some subtle, but important, differences between the exams. We also present ranges of normalized gains for the FMCE in a variety of instructional settings.

Lindstrøm Sharma - PRST-PER 2009

Link maps and map meetings: Scaffolding student learning
Phys. Rev. ST Phys. Educ. Res. 5, 010102 (2009) [11 pages]
DOI: http://dx.doi.org/10.1103/PhysRevSTPER.5.010102

Christine Lindstrøm and Manjula D. Sharma

With student numbers decreasing and traditional teaching methods having been found inefficient, it is widely accepted that alternative teaching methods need to be explored in tertiary physics education. In 2006 a different teaching environment was offered to 244 first year students with little or no prior formal instruction in physics. Students were invited to attend additional enrichment classes 1 h a week called map meetings. The focus of these classes was a different type of visual presentation of physics material called link maps. Link maps explicitly show the key concepts covered in lectures and how these interrelate to help novices establish their physics schemata. In each map meeting the link map for the different topic was interactively discussed by the researcher before the students worked on problems in groups using the link map. The class ended with the researcher going through one problem, talking aloud about how to logically attack it. The results were promising. Each week about 20% of the class voluntarily attended map meetings whereas 22% reported that they did not attend due to timetable clashes. Two questionnaires revealed that students thought the classes were helpful for gaining an overview of physics and for developing their problem solving abilities. In the final examination the 32 students who had attended at least eight out of ten map meetings achieved, on average, 9 points out of 90 better in the examination (p=0.004) than a comparison group (N=40) with similar academic background which had not attended map meetings. The results of this study suggest that map meetings are a valuable learning environment for physics novices. Further investigations are currently being undertaken.

Sayre Heckler - PRST-PER 2009

Peaks and decays of student knowledge in an introductory E&M course
Phys. Rev. ST Phys. Educ. Res. 5, 013101 (2009)
DOI: http://dx.doi.org/10.1103/PhysRevSTPER.5.013101

Eleanor C. Sayre and Andrew F. Heckler

A common format for assessment of learning is pretesting and post-testing. In this study, we collect student test data several times per week throughout a course, allowing for the measurement of the changes in student knowledge with a time resolution on the order of a few days. To avoid the possibility of test-retest effects, separate and quasirandom subpopulations of students are tested on a variety of tasks. We report on data taken in a calculus-based introductory E&M class populated primarily by engineering majors. Unsurprisingly for a traditional introductory course, there is little change in many conceptual questions. However, the data suggest that some student performance peaks and decays rapidly during a quarter, a pattern consistent with memory research yet unmeasurable by pretesting and post-testing. In addition, it appears that some course topics can interfere with prior knowledge, decreasing performance on questions related to earlier topics in the course.

Gire Jones Price - PRST-PER 2009

Characterizing the epistemological development of physics majors
Phys. Rev. ST Phys. Educ. Res. 5, 010103 (2009)
DOI: http://dx.doi.org/10.1103/PhysRevSTPER.5.010103

Elizabeth Gire, Barbara Jones, Ed Price

Students in introductory physics courses are likely to have views about physics that differ from those of experts. However, students who continue to study physics eventually become experts themselves. Presumably these students either possess or develop more expertlike views. To investigate this process, the views of introductory physics students majoring in physics are compared with the views of introductory physics students majoring in engineering. In addition, the views of physics majors are assessed at various stages of degree progress. The Colorado learning attitudes about science survey is used to evaluate students’ views about physics, and students’ overall survey scores and responses to individual survey items are analyzed. Beginning physics majors are significantly more expertlike than nonmajors in introductory physics courses, and this high level of sophistication is consistent for most of undergraduate study.

Kost Pollock Finkelstein - PRST-PER 2009

Characterizing the gender gap in introductory physics

Phys. Rev. ST Phys. Educ. Res. 5, 010101 (2009) [14 pages]

Lauren E. Kost, Steven J. Pollock, and Noah D. Finkelstein

Previous research [S. J. Pollock et al., Phys. Rev. ST Phys. Educ. Res. 3, 1 (2007)] showed that despite the use of interactive engagement techniques, the gap in performance between males and females on a conceptual learning survey persisted from pretest to post-test at the University of Colorado at Boulder. Such findings were counter to previously published work [M. Lorenzo et al., Am. J. Phys. 74, 118 (2006)]. This study begins by identifying a variety of other gender differences. There is a small but significant difference in the course grades of males and females. Males and females have significantly different prior understandings of physics and mathematics. Females are less likely to take high school physics than males, although they are equally likely to take high school calculus. Males and females also differ in their incoming attitudes and beliefs about physics. This collection of background factors is analyzed to determine the extent to which each factor correlates with performance on a conceptual post-test and with gender. Binned by quintiles, we observe that males and females with similar pretest scores do not have significantly different post-test scores (p>0.2) . The post-test data are then modeled using two regression models (multiple regression and logistic regression) to estimate the gender gap in post-test scores after controlling for these important prior factors. These prior factors account for about 70% of the observed gender gap. The results indicate that the gender gap exists in interactive physics classes at our institution but is largely associated with differences in previous physics and math knowledge and incoming attitudes and beliefs.

Etkina Karelina Ruibal-Villasenor - PRST-PER 2008

How long does it take? A study of student acquisition of scientific abilities
Phys. Rev. ST Phys. Educ. Res. 4, 020108 (2008)

Eugenia Etkina, Anna Karelina, and Maria Ruibal-Villasenor

Most of the time, instructors of introductory physics limit their goals to students’ acquisition of basic concepts and end-of-the-chapter problem solving efficiency. They overlook the development of students’ science process abilities required for constructing scientific knowledge and approaching complex problems as scientists do. This goal is attainable and very valuable at the same time. This paper describes how learners improved their scientific abilities during the course of one semester and reports on the activities and facilitations that helped students in the process. We investigated how long it takes for novices to develop complex scientific abilities and whether the content and the context of the tasks affect the abilities that students demonstrate. We found that students need to conduct several cycles of scaffolded investigations to gain competence in the application of scientific abilities. Depending on the particular ability, a period of five to eight weeks of work is necessary to achieve it.

Malone - PRST-PER 2008

Correlations among knowledge structures, force concept inventory, and problem-solving behaviors
Phys. Rev. ST Phys. Educ. Res. 4, 020107 (2008)

Kathy L. Malone

The modeling instruction pedagogy for the teaching of physics has been proven to be quite effective at increasing the conceptual understanding and problem-solving abilities of students to a much greater extent than that of nonmodeling students. Little research has been conducted concerning the cognitive and metacognitive skills that modeling students develop that allow for these increases. Two studies were designed to answer the following question: In what ways do the knowledge structures, metacognitive skills, and problem-solving abilities differ between modeling and nonmodeling students? In study 1, the knowledge structures developed by two groups of high school physics students taught using differing pedagogies (modeling instruction in physics and traditional methods) were determined using a card-sort task. The student’s knowledge structures were then correlated with the scores they obtained on two measures: the force concept inventory (FCI) and a problem-solving task (PS task) developed for this study. The modeling students had a more expertlike knowledge structure, while the nonmodeling students produced structures that were novicelike. In addition, the expert score correlated highly with performance on both the FCI and PS task scores demonstrating that a higher expert score predicted a higher value on each of these measures while a higher surface feature score predicted a lower score on both of these measures. In study 2, a verbal protocol design allowed for a detailed study of the problem-solving and metacognitive skills utilized by the two groups. It was determined that the skills utilized by the modeling instruction students were more expertlike. In addition, the modeling students produced significantly fewer physics errors while catching and repairing a greater percentage of their errors.

Sayre Wittmann - PRST-PER 2008

Plasticity of intermediate mechanics students’ coordinate system choice
Phys. Rev. ST Phys. Educ. Res. 4, 020105 (2008)

Eleanor C. Sayre, Michael C. Wittmann

We investigate the interplay between mathematics and physics resources in intermediate mechanics students. In the mechanics course, the selection and application of coordinate systems is a consistent thread. At the University of Maine, students often start the course with a strong preference to use Cartesian coordinates, in accordance with their prior physics and mathematics classes. In small-group interviews and in homework help sessions, we ask students to define a coordinate system and set up the equations of motion for a simple pendulum for which polar coordinates are more appropriate. We analyze video data from several encounters using a combination of Process/Object theory and Resource Theory. We find that students sometimes persist in using an inappropriate Cartesian system. Furthermore, students often derive (rather than recall) the details of the polar coordinate system, indicating that their knowledge is far from solid. To describe our work more precisely, we define a scale of plasticity and several heuristics for defining resources and their plasticity.

Otero Gray - Phys Rev 2008

Attitudinal gains across multiple universities using the Physics and Everyday Thinking curriculum
Phys. Rev. ST Phys. Educ. Res. 4, 020104 (2008) [7 pages]

Valerie K. Otero and Kara E. Gray

Instructional techniques based on research in cognitive science and physics education have been used in physics courses to enhance student learning. While dramatic increases in conceptual understanding have been observed, students enrolled in these courses tend to move away from scientistlike views of the discipline and toward novicelike views, as measured by various assessment instruments. It has been proposed that course materials and instruction that explicitly address epistemology, the nature of science, and the nature of learning science will help students develop views more closely aligned with the views of scientists. The Physics and Everyday Thinking (PET) curriculum has specific goals for helping nonscience majors explicitly reflect on the nature of science and the nature of learning science. We show that in PET courses with small and large enrollments, shifts toward expert responses ranged from +4% to +16.5% on the Colorado Learning Attitudes about Science Survey. These results are compared to results from other studies using a variety of similar assessment instruments.

McKagan Perkins Wieman - Phys Rev 2008

Deeper look at student learning of quantum mechanics: The case of tunneling
Phys. Rev. ST Phys. Educ. Res. 4, 020103 (2008)

S. B. McKagan, K. K. Perkins, and C. E. Wieman

We report on a large-scale study of student learning of quantum tunneling in four traditional and four transformed modern physics courses. In the transformed courses, which were designed to address student difficulties found in previous research, students still struggle with many of the same issues found in other courses. However, the reasons for these difficulties are more subtle, and many new issues are brought to the surface. By explicitly addressing how to build models of wave functions and energy and how to relate these models to real physical systems, we have opened up a floodgate of deep and difficult questions as students struggle to make sense of these models. We conclude that the difficulties found in previous research are the tip of the iceberg, and the real issue at the heart of student difficulties in learning quantum tunneling is the struggle to build the complex models that are implicit in experts’ understanding but often not explicitly addressed in instruction.

(Note that a pre-print of this paper was already listed on this blog. See here.)

Smith Wittmann - PRST-PER 2008

Applying a resources framework to analysis of the Force and Motion Conceptual Evaluation
Phys. Rev. ST Phys. Educ. Res. 4, 020101 (2008) [12 pages]

Trevor I. Smith and Michael C. Wittmann

We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation. Our goal is to propose a methodology that moves beyond an analysis of student learning defined by correct responses, either on the overall test or on clusters of questions defined solely by content. We use the resources framework theory of learning to define clusters within this experimental test that was designed without the resources framework in mind. We take special note of the contextual and representational dependence of questions with seemingly similar physics content. We analyze clusters in ways that allow the most common incorrect answers to give as much, or more, information as the correctness of responses in that cluster. We show that false positives can be found, especially on questions dealing with Newton’s third law. We apply our clustering to a small set of data to illustrate the value of comparing students’ incorrect responses which are otherwise identical on a correct or incorrect analysis. Our work provides a connection between theory and experiment in the area of survey design and the resources framework.

Kohl Finkelstein - PRST-PER 2008

Patterns of multiple representation use by experts and novices during physics problem solving
Phys. Rev. ST Phys. Educ. Res. 4, 010111 (2008)


Patrick B. Kohl and Noah D. Finkelstein

It is generally believed that students should use multiple representations in solving certain physics problems, and earlier work in PER has begun to outline how experts and novices differ in their use of multiple representations. In this study, we build on this foundation by interviewing expert and novice physicists as they solve two types of multiple representation problems: those in which multiple representations are provided for them and those in which the students must construct their own representations. We analyze in detail the types of representations subjects use and the order and manner in which they are used. Expert and novice representation use is surprisingly similar in some ways, especially in that both experts and novices make significant use of multiple representations. Some significant differences also emerge. Experts are more flexible in terms of starting point and move between the available representations more quickly, and novices tend to move between more representations in total. In addition, we find that an examination of how often and when multiple representations are used is inadequate to fully characterize a problem-solving episode; one must also consider the purpose behind the use of the available representations. This analysis of how experts and novices use representations sharpens the differences between the two groups, demonstrates analysis techniques that may be useful in future work, and suggests possible paths for instruction.

DOI: 10.1103/PhysRevSTPER.4.010111

Ding Reach Lee Bao - PRST-PER 2008

Effects of testing conditions on conceptual survey results
Phys. Rev. ST Phys. Educ. Res. 4, 010112 (2008)

Lin Ding, Neville W. Reay, Albert Lee, and Lei Bao

Pre-testing and post-testing is a commonly used method in Physics Education Research to assess student learning gains. It is well recognized in the community that timings and incentives in delivering conceptual tests can impact test results. However, it is difficult to control these variables across different studies. As a common practice, a pre-test is often administered either at or near the beginning of a course, while a post-test can be given either at or near the end of a course. Also, in conducting such tests there often is no norm as to whether incentives should be offered to students. Because these variations can significantly affect test results, it is important to study and document their impact. We analyzed five years of data that were collected at The Ohio State University from over 2100 students, who took both the pre-test and post-test of the Conceptual Survey of Electricity and Magnetism under various timings and incentives. We observed that the actual time frame for giving a test has a marked effect on the test results and that incentive granting also has a significant influence on test outcomes. These results suggest that one should carefully monitor and document the conditions under which tests are administered.

DOI: 10.1103/PhysRevSTPER.4.010112

Pritchard Lee Bao - Phys Rev 2008

Mathematical learning models that depend on prior knowledge and instructional strategies
Phys. Rev. ST Phys. Educ. Res. 4, 010109 (2008)

David E. Pritchard, Young-Jin Lee, Lei Bao

We present mathematical learning models—predictions of student’s knowledge vs amount of instruction—that are based on assumptions motivated by various theories of learning: tabula rasa, constructivist, and tutoring. These models predict the improvement (on the post-test) as a function of the pretest score due to intervening instruction and also depend on the type of instruction. We introduce a connectedness model whose connectedness parameter measures the degree to which the rate of learning is proportional to prior knowledge. Over a wide range of pretest scores on standard tests of introductory physics concepts, it fits high-quality data nearly within error. We suggest that data from MIT have low connectedness (indicating memory-based learning) because the test used the same context and representation as the instruction and that more connected data from the University of Minnesota resulted from instruction in a different representation from the test.

Bonham - PRST-PER 2008

Reliability, compliance, and security in web-based course assessments
Phys. Rev. ST Physics Ed. Research 4, 010106

Scott Bonham

Pre- and postcourse assessment has become a very important tool for education research in physics and other areas. The web offers an attractive alternative to in-class paper administration, but concerns about web-based administration include reliability due to changes in medium, student compliance rates, and test security, both question leakage and utilization of web resources. An investigation was carried out in introductory astronomy courses comparing pre- and postcourse administration of assessments using the web and on paper. Overall no difference was seen in performance due to the medium. Compliance rates fluctuated greatly, and factors that seemed to produce higher rates are identified. Notably, email reminders increased compliance by 20%. Most of the 559 students complied with requests to not copy, print, or save questions nor use web resources; about 1% did copy some question text and around 2% frequently used other windows or applications while completing the assessment.

Singh - PRST-PER 2008

Assessing student expertise in introductory physics with isomorphic problems. I. Performance on nonintuitive problem pair from introductory physics
Phys. Rev. ST Phys. Educ. Res. 4, 010104 (2008)

Chandralekha Singh

Investigations related to expertise in problem solving and ability to transfer learning from one context to another are important for developing strategies to help students perform more expertlike tasks. Here we analyze written responses to a pair of nonintuitive isomorphic problems given to introductory physics students and discussions with a subset of students about them. Students were asked to explain their reasoning for their written responses. We call the paired problems isomorphic because they require the same physics principle to solve them. However, the initial conditions are different, and the frictional force is responsible for increasing the linear speed of an object in one of the problems while it is responsible for decreasing the linear speed in the other problem. We categorize student responses and evaluate student performance within the context of their evolving expertise. We compare and contrast the patterns of student categorization for the two isomorphic problems. We discuss why certain incorrect responses were better than others and shed light on the evolution of students’ expertise. We compare the performance of students who worked on both isomorphic problems with those who worked only on one of the problems to understand whether students recognized their underlying similarity and whether isomorphic pairs gave students additional insight into solving each problem.

©2008 The American Physical Society
DOI: 10.1103/PhysRevSTPER.4.010104
PACS: 01.40.Fk, 01.40.Ha, 01.50.Kw