Ma Ma - Studies in Ed Evaluation

The challenge of separating effects of simultaneous education projects on student achievement
Studies In Educational Evaluation 35:1 p. 45-52

Xin Ma and Lingling Ma

When multiple education projects operate in an overlapping or rear-ended manner, it is always a challenge to separate unique project effects on schooling outcomes. Our analysis represents a first attempt to address this challenge. A three-level hierarchical linear model (HLM) was presented as a general analytical framework to separate program effects while taking into account the hierarchy in educational data. The HLM model was then applied to data from the Commonwealth Accountability Testing System that the State of Kentucky has implemented for years, in an attempt to separate the effects of two education projects aimed at improving mathematics and science education in the Appalachian region: the Appalachian Rural Systemic Initiative (ARSI) closely followed by the Appalachian Mathematics and Science Partnership (AMSP). Even though the HLM model successfully separated ARSI and AMSP effects, relevant statistical issues were discussed to improve future efforts in separating effects of simultaneous education projects on schooling outcomes.

Studies in Educational Evaluation special issue

This special issue looks really interesting for those who are focusing on methodology, credibility of measurements, and so on. The applications to PER should be relatively obvious, but they are part of our unquestioned assumptions about the data that we take. Read up for more...

The Process of Evaluation: Focus on Stakeholders
Edited by Tanner LeBaron Wallace and Marvin C. Alkin

Studies in Educational Evaluation
Volume 34, Issue 4, Pages 191-230 (December 2008)


1. Editorial Board
Page CO2

2. Editor's Note
Page 191

3. Process of evaluation: Focus on stakeholders
Pages 192-193
Tanner LeBaron Wallace, Marvin C. Alkin

4. What we learned from three evaluations that involved stakeholders
Pages 194-200
Jean A. King, John C. Ehlert

5. Integrating participatory elements into an effectiveness evaluation
Pages 201-207
Tanner LeBaron Wallace

6. When stakeholders rebel: Lessons from a safe schools program
Pages 208-211
Billie Gastic, Decoteau J. Irby, Maureen Zdanis

7. Engaging stakeholders in the planning of a collaborative multi-agency evaluation: The HousingPlus Collaborative Communities Project
Pages 212-217
John Sylvestre, J. Bradley Cousins, Purnima Sundar, Tim Aubry, Val Hinsperger

8. Encouraging stakeholder engagement: A case study of evaluator behavior
Pages 218-223
Cheryl-Anne Poth, Lyn Shulha

9. What have we learned about stakeholder involvement in program evaluation?
Pages 224-230
Sandy Taut