Search
MyUMUC
WebTycho
EDMS 647: Introduction to Program Evaluation
Credit: Three (3) hours
Term: IV: 25 March – 17 May 2002
Instructor: Dr. Ken J. Kovach
PSC 37, Box 3414
APO AE 09459
Ph/fax: +44 1353 860 671
Prerequisite: EDMS 645
Meetings: Saturdays and Sundays (0900-1600 hours)
Mildenhall class: 23/24 March & 11/12 May RAF Mildenhall, UK
Germany class: 6/7 April & 18/19 May Wiesbaden, Germany
Room: TBA (Contact your UMUC representative)
Required Text: Royse, A.T., Thyler, B.A., Padgett, D.K, & Logan, T.K. (2001). Program evaluation: An introduction. Belmont, CA: Wadsworth/Thomson Learning.
Course Description: Overview of the program evaluation process; problems encountered in the practice of program evaluation.
Purpose: The purpose of this course is to familiarize students with terminology, approaches, procedures, and issues associated with program evaluation. Emphasis is on current evaluation theory and methodology, with application to counseling programs. Specifically, major areas of study include needs assessment, formative and summative evaluations, analyses, and reporting.
Objectives: Upon completion of this course, a student will be able to:
1. discuss current evaluation program practices,
2. describe needs assessment procedures,
3. understand formative and summative evaluations,
4. demonstrate evaluation instrument development,
5. summarize practical techniques of evaluation, and
6. design effective evaluation programs.
Grading:
Written exercises/assignments-------------------------- 80 points
Participation------------------------------------------- 20 points
Total----------------------------------------------------100 points
Written exercises/assignments: These will be discussed during the first class session and will require students to accomplish minor research into current data. Topics may include program evaluation theories/practices and others. Each assignment will be short, but to the point. Due dates will be discussed in class. Since some of the course work will be web enhanced, specific assignments will be posted by the students for peer evaluations. Students will be assigned to teams for this activity. Specific details:
- How are programs evaluated? 1-2 pages (5 points)
- What is meant by bias in a needs assessment? 1-2 pages (5 points)
- Focus group exercise (15 points)
- Program evaluation phases 1-3 pages (10 points)
- Select and critique an article relating to an aspect of program evaluation. 2-3 pages (10 points)
- Select or develop a data collection instrument for use in a research effort and discuss its validity and reliability aspects (10 points).
- Research designs: qualitative versus quantitative (15 points)
- Sampling (5 points)
- Ethics ( 5 points)
Participation: Class work requires timely and attentive participation, to include web enhanced participation. Expected academic integrity and a positive approach to learning is required. 20 points
Class Policies and Procedures: This class is meant to be a fun and enjoyable time in learning about program evaluation. Student participation will be most important, and depending on student enrollment and interest, adjustments to the syllabus may be made with prior notice by the instructor. Importantly, student participation requires that any missed class session be made up by extra course work. This may include an extra report analysis, student presentation, or other effort relating to the course material. Academic integrity will be met by all, and the instructor reserves the right to make course adjustments when necessary and appropriate, giving prior notice to for any course work. Communication will be the key to success! Please notify the instructor before, if possible, any missed sessions or course work requirements.
Web Enhanced learning: Instead of four weekend sessions, only two sessions will be f2f; ergo, the need for more individual work. To satisfy this requirement, students will present some of their brief written exercises on an UMUC established Webboard for EDMS 647. Student teams will be responsible to review and evaluate each other’s work via the webboard. Further discussion will be conducted in the f2f sessions.
CLASS SCHEDULE:
Date Topics
Mildenhall 23/24 March Orientation/Introduction
Wiesbaden 6/7 April History of evaluation
Key definitions
Evaluation studies
Evaluation vs research
Ethics
APA Standards
General issues
Assignments: Review the course text. Read chapters 1, 2, and 15. Obtain and review the APA. Accomplish a search through an internet service provider using the descriptor program evaluation, then use other descriptors as desired. Be prepared to discuss this activity.
Web Enhanced Learning Needs assessment
Qualitative versus quantitative methods
Formative versus summative evaluations
Research designs
Sampling
Assignments: Read chapters 3 - 12 of the text and review other materials helpful in learning. Review material relating to questionnaire development or other data collection methods. Complete a sample data collection instrument and explain each item of the form relating to its purpose, use, and analysis.
Mildenhall: 11/12 May Reporting and Analysis
Wiesbaden: 18/19 May Data collection methods
Measurement tools
Practicalities
Open
Student presentations
Assignments: Read chapters 13 and 14 of the text. Review material helpful in learning to report data collected. Discuss formative and summative evaluations. Be prepared to discuss various aspects/topics covered in the course and the various assignments completed during the term.