Evaluator Competencies: Standards for the Practice of Evaluation in Organizations Book

Tables, Exhibit, and Figures     ix
Foreword     xiii
Preface     xvii
Acknowledgments     xxi
The Authors     xxiii
Introduction     xxvii
The Ibstpi Evaluator Competencies: Development, Interpretation, and Application
The Practice of Evaluation in Organizations     3
Practice-Oriented Atheoretical Approaches     5
Process-Driven Operational Approaches     7
Research-Oriented, Practice-Based Comprehensive Approaches     10
Conclusions     12
Questions for Consideration     12
In Search of Evaluator Competencies     13
Need to Determine Evaluator Competencies     14
Research Questions for the Examination of the Literature     16
Approach to the Literature Study     16
Results of the Literature Study     18
Conclusions     37
Questions for Consideration     37
Ibstpi Evaluator Competencies and Their Development     39
A Brief History of Competency Modeling     40
The ibstpi Competency Development Model     40
Assumptions Underlying the ibstpi Evaluator Competencies     45
Conclusions     47
Questions for Consideration     48
Discussion and Analysis of the Evaluator Domains and Competencies     53
Professional Foundations     54
Planning and Designing the Evaluation     66
Implementing the Evaluation Plan     83
Managing the Evaluation     92
Conclusions     95
Questions for Consideration     95
Use of the Evaluator Competencies     97
Competency Use by Those New to Evaluation     99
Competency Use by Experienced Evaluators     100
Competency Use by Managers     101
Competency Use in Academic Settings     103
Use by Consultants Providing Evaluation Seminars     106
Competency Use by Associations     108
Conclusions     110
Questions for Consideration     110
The Ibstpi Evaluator Competencies: Validation
Some Foundational Research     113
The Foundational Research     113
The Program Evaluation Standards     114
Guiding Principles by the American Evaluation Association     119
Guidelines for Ethical Conduct by the Canadian Evaluation Society     120
Standards fur Evaluation of the Deutsche Gesellschaft fur Evaluation     124
Guidelines for Ethical Conduct of Evaluations and Code of Ethics of the Australasian Evaluation Society     125
Standards on Ethics and Integrity by the Academy of Human Resource Development     127
The King, Stevahn, Ghere, and Minnema Work on Essential Evaluator Competencies     129
The Engle, Altschuld, and Kim Survey of University-Based Evaluation Programs     131
Conclusions     133
Questions for Consideration     133
The Validation Research     135
Purpose and Scope of the Study     135
Procedures     136
Ratings of Criticality     144
Competency Ranking     146
Factors Contributing to Significant Differences     149
Implications for the Final Evaluator Competencies     151
Conclusions     153
Questions for Consideration     153
Future Directions     155
Focus of Evaluations     156
Outsourcing Evaluation     157
Professionalism and Accountability     158
Global Competence     160
Conclusions     161
Questions for Consideration     161
Appendixes
ibstpi and Its History     163
Glossary     167
Evaluation Tools and Approaches     173
Annotated Bibliography      177
Professional Associations for Evaluators     189
References     191
Index     199