INTERPRETING NULL FINDINGS OF EVALUATIVE STUDIES

• NCJ Number: 58507
• Journal: Journal of Social Service Research Volume: 1 Issue: 1 Dated: (FALL 1977) Pages: 93-104
• Author(s): A ROSENBLATT
• Date Published: 1977
• Length: 12 pages
• Corporate Author: Haworth Press, Inc
• Publication Format: Article
• Language: English
• Country: United States of America

Annotation

PRESSURES UPON EVALUATORS TO DISCOUNT NEGATIVE EVALUATION FINDINGS ARE IDENTIFIED; SOME INADEQUATE RESPONSES BY EVALUATORS ARE DISCUSSED, FOLLOWED BY SOME SUGGESTIONS FOR ASSURING OBJECTIVE, UNCOMPROMISING EVALUATIONS.

Abstract

THE EVALUATOR OF A SERVICE PROGRAM IS OFTEN SUBJECT TO SERIOUS ECONOMIC, POLITICAL, OR SOCIAL PRESSURES. THIS IS ESPECIALLY SO WHEN THE RESULTS OF A STUDY HAVE IMPORTANT, IMMEDIATE CONSEQUENCES FOR BOARD MEMBERS, ADMINISTRATORS, STAFF MEMBERS, OR RECIPIENTS OF SERVICE. UNLESS THE RESEARCHER IS PROTECTED FROM THE INFLUENCE OF THESE AUDIENCES, HIS JUDGMENT MAY BE SWAYED BY OTHER THAN SCIENTIFIC CONSIDERATIONS. UNDER THESE PRESSURES, THE EVALUATIVE RESEARCHER MAY BE MORE MERCIFUL RATHER THAN LOGICAL. SOMETIMES AN EVALUATOR CHOOSES TO ESCAPE OR DILUTE THE ANGER OF A DISSATISFIED DIRECTOR OR CLINICAL STAFF BY WATERING DOWN THE IMPLICATIONS OF THE STUDY. HE THEN BECOMES A CRITIC OF HIS OWN WORK, WHICH RENDERS HIS EVALUATION MEANINGLESS. SOME PROBLEMS IN INTERPRETING NULL FINDINGS ARE ILLUSTRATED IN A CASE EXAMPLE OF AN EVALUATION OF ACCELERATED PROGRAMS OF SOCIAL WORK EDUCATION. THREE SUGGESTIONS ARE OFFERED FOR ADMINISTRATORS AND FUNDERS IF THEY WISH A FAIR EVALUATION: (1) TRY TO BE OPENMINDED ABOUT THE POSSIBILITY OF OBTAINING NULL FINDINGS; (2) USE AN OUTSIDE EVALUATOR, PREFERABLY ONE WHO IS A PERMANENT MEMBER OF ANOTHER ORGANIZATION; (3) A PROGRAM ADMINISTRATOR SHOULD NOT TRY TO EVALUATE HIS OWN PROGRAM. A FOURTH SUGGESTION IS FOR RESEARCH FACULTY; INSTILL IN STUDENTS NOT ONLY TECHNICAL PROFICIENCY, BUT A DESIRE TO ADHERE TO MORAL NORMS IN DESIGNING AND REPORTING THE INTEGRITY OF WORK DONE. THERE ARE TWO RECOMMENDATIONS FOR RESEARCHERS: (1) LIMIT FRIENDSHIPS WITH MEMBERS OF THE SERVICE ORGANIZATION BEING EVALUATED; AND (2) HAVE THE MORAL COURAGE TO STAND BY RESULTS SHOWN IN A CAREFULLY DESIGNED, SCIENTIFIC STUDY. REFERENCES ARE PROVIDED. (RCB)