Preface |
|
xi | |
CHAPTER 1 Introduction |
|
1 | (32) |
|
The Importance of Program Evaluation |
|
|
1 | (4) |
|
|
5 | (1) |
|
Characteristics of "Good" Programs |
|
|
5 | (6) |
|
Program Evaluation Defined |
|
|
11 | (1) |
|
Reasons Why Programs Are Evaluated |
|
|
12 | (1) |
|
Motivations for Program Evaluation |
|
|
13 | (4) |
|
Overcoming the Subjective Perspective |
|
|
17 | (4) |
|
Philosophical Assumptions of Program Evaluation |
|
|
21 | (5) |
|
|
26 | (2) |
|
|
28 | (5) |
CHAPTER 2 Ethical Issues in Program Evaluation |
|
33 | (20) |
|
Historical Background: Why IRBs Are Necessary |
|
|
33 | (1) |
|
|
34 | (6) |
|
How Ethical Guidelines Get Operationalized |
|
|
40 | (3) |
|
Research with Special Populations |
|
|
43 | (1) |
|
Potential Problems in Conducting Ethical Research |
|
|
44 | (3) |
|
The Practitioner's Ethical Responsibilities |
|
|
47 | (3) |
|
|
50 | (3) |
CHAPTER 3 Needs Assessment |
|
53 | (34) |
|
What Is Needs Assessment? |
|
|
53 | (1) |
|
The Need for Needs Assessment |
|
|
54 | (1) |
|
|
55 | (2) |
|
Planning a Needs Assessment |
|
|
57 | (5) |
|
Selecting a Needs Assessment Approach |
|
|
62 | (10) |
|
Convergent Analysis and Multimethod Approaches |
|
|
72 | (3) |
|
Thinking Creatively about Needs Assessment |
|
|
75 | (5) |
|
|
80 | (7) |
CHAPTER 4 Qualitative Methods in Evaluation |
|
87 | (29) |
|
|
87 | (1) |
|
What Is "Qualitative Evaluation"? |
|
|
88 | (1) |
|
When Is Qualitative Evaluation Useful? |
|
|
89 | (2) |
|
Qualitative Methods and Single System Evaluation |
|
|
91 | (1) |
|
Variants in Qualitative Evaluation |
|
|
91 | (3) |
|
Methods of Qualitative Evaluation |
|
|
94 | (8) |
|
Managing and Organizing Qualitative Data |
|
|
102 | (1) |
|
|
102 | (3) |
|
|
105 | (1) |
|
|
106 | (2) |
|
An Important Final Step: Dissemination and Advocacy |
|
|
108 | (1) |
|
Examples of Qualitative Evaluations |
|
|
108 | (8) |
CHAPTER 5 Formative and Process Evaluation |
|
116 | (45) |
|
|
116 | (2) |
|
Conducting a Formative Evaluation |
|
|
118 | (4) |
|
Other Uses of Formative Evaluation |
|
|
122 | (2) |
|
|
124 | (1) |
|
|
125 | (5) |
|
|
130 | (1) |
|
Becoming a Program Monitor |
|
|
131 | (2) |
|
Mission Statements, Goals, and Objectives |
|
|
133 | (5) |
|
Writing Program Objectives |
|
|
138 | (2) |
|
Hierarchy of Goals, Objectives, and Activities |
|
|
140 | (1) |
|
What Should Be Monitored? |
|
|
141 | (6) |
|
|
147 | (3) |
|
|
150 | (3) |
|
|
153 | (8) |
CHAPTER 6 Single System Research Designs |
|
161 | (33) |
|
What Are Single System Research Designs? |
|
|
161 | (2) |
|
Selecting Outcome Measures |
|
|
163 | (2) |
|
Assessing Measures over Time |
|
|
165 | (1) |
|
|
166 | (1) |
|
Notation and General Principles |
|
|
167 | (2) |
|
|
169 | (4) |
|
Quality Assurance Studies |
|
|
173 | (2) |
|
Summative Evaluation Designs |
|
|
175 | (2) |
|
|
177 | (7) |
|
|
184 | (1) |
|
|
185 | (2) |
|
|
187 | (1) |
|
Ethics of Single System Research Designs |
|
|
188 | (2) |
|
|
190 | (4) |
CHAPTER 7 Goal Attainment Scaling |
|
194 | (13) |
|
|
194 | (1) |
|
What Is Goal Attainment Scaling? |
|
|
195 | (3) |
|
Illustration of Goal Attainment Scaling |
|
|
198 | (1) |
|
Goal Attainment Scaling and Program Evaluation |
|
|
199 | (2) |
|
Variations of Goal Attainment Scaling |
|
|
201 | (1) |
|
Problems with Goal Attainment Scaling |
|
|
202 | (5) |
CHAPTER 8 Client Satisfaction |
|
207 | (24) |
|
The Importance of Monitoring Consumer Satisfaction |
|
|
207 | (2) |
|
The Problem with Client Satisfaction Studies |
|
|
209 | (3) |
|
A Sampling of Recent Client Satisfaction Studies |
|
|
212 | (1) |
|
Annotations about Client Satisfaction |
|
|
212 | (3) |
|
Explanations for High Ratings |
|
|
215 | (1) |
|
Recommendations for Client Satisfaction Studies |
|
|
216 | (6) |
|
|
222 | (9) |
CHAPTER 9 Group Research Designs |
|
231 | (43) |
|
What Are Group Research Designs? |
|
|
231 | (1) |
|
Starting an Outcome Evaluation |
|
|
232 | (2) |
|
Outcome Evaluation Designs |
|
|
234 | (2) |
|
General Principles of Group Research Designs |
|
|
236 | (1) |
|
Pre-Experimental Research Designs |
|
|
237 | (11) |
|
Quasi-Experimental Research Designs |
|
|
248 | (6) |
|
Threats to the Internal Validity |
|
|
254 | (3) |
|
Protection against Alternative Explanations |
|
|
257 | (1) |
|
|
258 | (7) |
|
Efficacy and Effectiveness Studies |
|
|
265 | (1) |
|
A Note on the Term Experiment |
|
|
266 | (1) |
|
|
267 | (7) |
CHAPTER 10 Cost-Effectiveness and Cost Analysis Designs |
|
274 | (16) |
|
Cost as an Evaluative Criterion |
|
|
274 | (2) |
|
Example of a Cost-Effectiveness Evaluation |
|
|
276 | (1) |
|
How to Do a Cost-Effectiveness Study |
|
|
277 | (2) |
|
|
279 | (2) |
|
|
281 | (4) |
|
|
285 | (5) |
CHAPTER 11 Measurement Tools and Strategies |
|
290 | (33) |
|
Importance of Measurement |
|
|
290 | (2) |
|
|
292 | (3) |
|
|
295 | (7) |
|
|
302 | (4) |
|
Locating Appropriate Instruments |
|
|
306 | (2) |
|
Constructing "Good" Evaluation Instruments |
|
|
308 | (8) |
|
|
316 | (7) |
CHAPTER 12 Illustrations of Instruments |
|
323 | (16) |
|
Child Abuse Potential Inventory |
|
|
324 | (3) |
|
|
327 | (2) |
|
|
329 | (2) |
|
|
331 | (2) |
|
Rosenberg Self-Esteem Scale |
|
|
333 | (2) |
|
Adult-Adolescent Parenting Inventory |
|
|
335 | (4) |
CHAPTER 13 Data Analysis |
|
339 | (32) |
|
What Does It Mean to Analyze Data? |
|
|
339 | (1) |
|
Data Analysis and the Computer |
|
|
340 | (1) |
|
|
341 | (7) |
|
|
348 | (10) |
|
|
358 | (1) |
|
Myths about Statistical Significance |
|
|
359 | (2) |
|
|
361 | (3) |
|
Using Statistics in Reports |
|
|
364 | (1) |
|
Type I and Type II Errors |
|
|
365 | (6) |
CHAPTER 14 Pragmatic Issues |
|
371 | (23) |
|
|
371 | (2) |
|
|
373 | (4) |
|
Program Drift and the Transfer of Programs |
|
|
377 | (1) |
|
Political Nature of Evaluation |
|
|
378 | (3) |
|
|
381 | (2) |
|
Guidelines for Evaluation in Politically Charged Arenas |
|
|
383 | (3) |
|
Culturally Sensitive Evaluation Practice |
|
|
386 | (8) |
CHAPTER 15 Writing Evaluation Proposals, Reports, and Journal Articles |
|
394 | (23) |
|
Components of the Evaluation Proposal and Report |
|
|
395 | (9) |
|
Mistakes to Avoid in Planning and Writing Evaluation Reports |
|
|
404 | (5) |
|
Checklist for Writing and Assessing Evaluation Reports |
|
|
409 | (1) |
|
The Utilization of Evaluation Reports |
|
|
410 | (2) |
|
Writing for Professional Publication |
|
|
412 | (5) |
Index |
|
417 | |