EVALUATION OF BROAD-AIM PROGRAMS - EXPERIMENTAL DESIGN, ITS DIFFICULTIES, AND AN ALTERNATIVE

• NCJ Number: 16678
• Journal: ADMINISTRATIVE SCIENCE QUARTERLY Volume: 15 Dated: (MARCH 1970) Pages: 97-109
• Author(s): R S WEISS; M REIN
• Date Published: 1970
• Length: 13 pages
• Corporate Author: Cornell University
• Publication Format: Article
• Language: English
• Country: United States of America
• Note: PAPER GIVEN AT THE AMERICAN ACADEMY OF ARTS & SCIENCES CONF ON EVAL OF SOCIAL ACTION PROGRAMS, MAY 2-3, 1969.

Annotation

OFFERS THE EXPERIMENTAL DESIGN AS AN APPROACH TO SOCIAL ACTION PROGRAM EVALUATION AND COMPARES BROAD-AIM PROGRAMS TO NARROW-AIM PROGRAMS AND PROBLEMS IN EVALUATING THE FORMER.

Abstract

A PREFERRED RESEARCH DESIGN IS AN EXPERIEMNTAL ONE IN WHICH ASPECTS OF THE SITUATION TO BE CHANGED ARE MEASURED BEFORE AND AFTER IMPLEMENTATION OF THE ACTION PROGRAM. TO SUPPORT THE ARGUMENT THAT THE PROGRAM IS RESPONSIBLE FOR THE OBSERVED CHANGES, THE ANTICIPATED EFFECTS MAY BE MEASURED SIMULTANEOUSLY IN A CONTROL SITUATION WHICH DOES NOT RECEIVE THE PROGRAM. THIS RESEARCH DESIGN DOES NOT WORK FOR BROAD-AIM PROGRAMS WHICH HOPE TO ACHIEVE NONSPECIFIC FORMS OF CHANGE-FOR-THE-BETTER, AND WHICH INVOLVE UNSTANDARDIZED, LARGE-SCALE INTERVENTIONS. AN EXAMPLE IS PRESENTED OF SUCH A PROGRAM, THE PROBLEMS ENCOUNTERED BY THE RESEARCH GROUP EVALUATING THE PROJECT, AND THE RESULTING DISSATISFACTION AMONG PROGRAM ADMINISTRATORS. COMMENTS ARE THEN MADE ON SOME OF THE DIFFICULTIES WITH THE USE OF EXPERIMENTAL DESIGNS IN BROAD-AIM PROGRAMS, SUCH AS LIMITATIONS OF THE EXPERIMENTAL DESIGN IN THE INFORMATION IT CAN PRODUCE. IT IS NOTED THAT THERE IS A ROLE FOR EXPERIMENTAL DESIGN IN BROAD-AIM PROGRAMS IN WHICH A SINGLE OBJECTIVE IS IMPORTANT ENOUGH TO JUSTIFY COLLECTING DATA WHICH WILL LEAD TO A RELATIVELY UNQUESTIONABLE CONCLUSION. ATTENTION IS THEN GIVEN TO RESEARCH DESIGNS THAT MIGHT BE CHARACTERIZED AS PROCESS-ORIENTED QUALITATIVE RESEARCH, HISTORICAL RESEARCH, OR CASE STUDY OR COMPARATIVE RESEARCH.