Measurement and data Collection

Data collection requires evaluators to consider a wide and diverse variety of data sources. These include both primary and secondary data sources. Data collection can significantly impact your evaluation project. Evaluators sometimes overlook problems where secondary data is involved and overlook the fact that data for comparison purposes can affect validity. The types of data in the Learning Resources are not meant to be exhaustive but are the most common types in program evaluation.

To prepare for this Discussion, choose one of the cases provided, review the specified Learning Resources, and complete the corresponding prompts.

Case 1

Steven Levitt, the author of Freakonomics, is exemplary in his ability to make data tell "stories." Students of public administration and organizational behavior are familiar with the famous Hawthorne effect. Levitt and List's (2009) reanalysis of the original Hawthorne study (which uses incomplete, archived, and secondary data) shows how management programs that were developed to increase worker productivity can be evaluated or reevaluated, even though the experiments were conducted almost a century ago.

Post a description of at least two data collection problems that the reanalysis of Levitt and List might bring to the Hawthorne effect.

Case 2

Barbara Geddes (1990) points out the pitfalls of selecting cases, units, or observations purely on the basis of the dependent variable.

Post a brief explanation of the relevance of Barbara Geddes' argument for program evaluation. Then, explain when a scenario of choosing cases solely on the dependent variable might be permissible. Provide a rationale for your explanations.