Framework for Evaluating Impacts of Informal Science … - importance of informal education

---

• (1) disadvantages of informal education
• (2) why informal education is important
• (3) advantages of formal learning
• (4) characteristics of informal education

Framework for
Evaluating Impacts of
Informal Science
Education Projects
Report from a National Science Foundation
Workshop
The National Science Foundation
The Directorate for Education and Human Resources
The Division of Research on Learning in Formal and Informal Settings (DRL)
Framework for Evaluating Impacts of
Informal Science Education Projects
Report from a National Science Foundation Workshop
Editor:
Alan J. Friedman
Authors:
Sue Allen
Patricia B. Campbell
Lynn D. Dierking
Barbara N. Flagg
Alan J. Friedman
Cecilia Garibay
Randi Korn
Gary Silverstein
David A. Ucko
Any opinions, findings, conclusions or recommendations expressed in this report are those of the participants and do
not necessarily represent the official views, opinions, or policy of the National Science Foundation.
To cite: Friedman, A. (Ed.). (March 12, 2008). Framework for Evaluating Impacts of Informal Science Education
Projects [On-line]. (Available at: http://insci.org/resources/Eval_Framework.pdf)
Prepared under Contract Number GS-10F-0482P, NSF Order Number DACS06D1421, Evaluation Activities
Related to the Academic Competitiveness Council's Examination of STEM Education Programs.
12 March 2008
The National Science Foundation
The Directorate for Education and Human Resources
The Division of Research on Learning in Formal and Informal Settings (DRL)
2
TABLE OF CONTENTS
Table of Contents ..........................................................................................................................................................................3
Table of Tables ....................................................................................................................................................................................6
Table of Figures ..................................................................................................................................................................................6
Acknowledgments .............................................................................................................................................................................7
Part I General Information............................................................................................................................................................8
Chapter 1 Introduction to Evaluating Impacts of NSF Informal Science Education Projects ....................9
References .....................................................................................................................................................................................13
Chapter 2 User's Guide to this Book......................................................................................................................................14
The Focus of this Book ............................................................................................................................................................14
Appropriate Evaluation Plans .............................................................................................................................................15
How to read this book .............................................................................................................................................................16
What this book is not...............................................................................................................................................................17
Who wrote this book? .............................................................................................................................................................17
Chapter 3 Evidence and Categories of ISE Impacts ....................................................................................................19
What impacts do your project team want to facilitate?.........................................................................................20
What approach/type of project will best enable your team to accomplish these goals and why do
you feel that this is the best approach to take?..........................................................................................................25
How will you know whether the activities of the project accomplished their intended goals and
objectives, and with what evidence will you support the assertion that they did? ................................27
How will you and your team ensure that unanticipated outcomes are also documented?................29
References .....................................................................................................................................................................................30
Chapter 4 Tools, Tips, and Common Issues in Evaluation Experimental Design Choices ........................31
Experimental Design Choices..............................................................................................................................................31
An array of evaluation design choices ............................................................................................................................33
Using Logic Models to Identify Desired Impacts and Audience Objectives.................................................35
Specific issues in evaluation.................................................................................................................................................41
Part II Impact Evaluation for Various Program Areas of Informal Science Education.............................44
3


What are the aims of informal education? What are the strengths of informal education? It’s a form of training. Given access to the right resources, an informal learner can often be left to figure some things out on their own. It’s cheap. It’s empowering. It’s practical. It’s immediate. It satisfies (and rewards) curiosity. It offers a more productive break. It encourages lateral thinking.

• Framework for Evaluating Impacts of Informal Science …
• Informal learning spaces and their impact on learning in …
• PRACTICE ARTICLE Informal learning in the workplace - ed
• 7-Non-Formal and Informal Education Where does it …
• Informal learning: a discussion around defining and …