Architecture of Environmental Evaluation

The Architecture of Environmental Evaluation: a Literature Review and Network Analysis

Through a literature review and citation network analysis of the body of peer reviewed environmental evaluation literature published between 2000 and 2010 searchable in the Web of Science, this project begins mapping the intellectual architecture of the field of environmental evaluation.

As an emerging theory and practice, environmental evaluation seeks to increase the efficiency and effectiveness of environmental programs and policies through objective measurement and systematic thinking.

Together, the literature review and citation network analysis answer the questions, “Within this body of literature, what are the key concepts and recommendations related to evaluating programs, policies and other approaches to achieving environmental goals?” and, “What are the citation relationships between these environmental evaluation journal articles?”

This project creates an adaptive framework for mapping the ideas, projects, individuals and relationships of the environmental evaluation community. This phase of the project will examine only peer reviewed environmental evaluation journal articles published between 2000 and 2010 and searchable in the Web of Science; however, the adaptive framework of the project allows for further peer reviewed as well as white and grey literature to be added. Each phase of this project aims to create a useful and easily understandable tool for academics and practioners. The end product is envisioned as a complete network of the environmental evaluation field.

Deliverables for this project include:

Searchable database of citation information

Binary, directed sociogram and Google Earth Map of citation information

Literature review, methodology and citation analysis manuscript to be submitted for publication with evaluation journal

Series of video files summarizing project purpose and key findings

[/list]

The audiences for this project include environmental evaluation scholars and practitioners as well as commissioners and users of evaluation products and services. All deliverables will be open access through the Environmental Evaluators Network (EEN) website and shared with the EEN’s 1000+ participants at EEN events and through EEN listserves and social media. Preliminary findings were publicized at the November 2010 American Evaluation Association Conference in San Antonio, Texas. The completed project will be presented at the EEN Forum in Washington, DC June 23-24, 2011.

In response to existing gaps in the current environmental evaluation framework, including the absence of a comprehensive body of environmental evaluation literature, project outputs and outcomes include:

Searchable Database of Citation Information;

Binary, Directed Sociogram with Attributes;

Google Earth Citations and Corresponding Locations Map;

Analysis of Citation Data and Sociogram/Google Earth Map;

Organizational and analytical framework for more systematic evolution of the field;

Identified gaps and overlaps in evaluation research and practice;

Evidence of opportunities for collaboration around issue, geography, knowledge and other attributes;

Evidence-based prioritization of measurement and evaluation improves efficiency and effectiveness of resource allocation;

Measurement and evaluation are more efficiently linked with demands for evidence of effectiveness;

Evaluation knowledge and experience is more efficiently matched to evaluation practice and policy

[/list]

To date no project of this nature or scope has been completed.

Client Contact Information

Contact Name: Matt Keene
Contact Title: Social Scientist, Evaluation Support Division, USEPA
Contact Email: Keene.Matt@epa.gov
Contact Phone: 202-566-2240

Contact Name: Kim Damm
Contact Title: MA Candidate 2011, Brown University Center for Environmental Studies
Contact Email: Kimberly.Damm@gmail.com
Contact Phone: 202-566-2240