MAC Program Evaluation

PROGRAM EVALUATION SUMMARY REPORT


The Master of Arts in Counseling (MAC) program in the Department of Behavioral Sciences obtains feedback from a variety of sources for program evaluation purposes. Some feedback is provided from the University through course evaluations and instructor evaluations, which are used in institutional evaluation and accreditation. The MAC program is regionally accredited by the Higher Learning Commission and is pre-approved as a qualifying degree for licensure as a professional counselor by the State of Ohio Counselor, Social Worker, and Marriage & Family Therapist Board (Ohio CSWMFT Board). Further, the MAC program is currently seeking accreditation in Clinical Mental Health Counseling from the Council for Accreditation of Counseling & Related Educational Programs (CACREP). Multiple program evaluations were collected by the MAC program:

  • Program Assessment (by current students)
  • Alumni Survey
  • Site Supervisor & Employer Survey

The MAC program has developed a Comprehensive Assessment Plan (CAP) to evaluate student progress throughout the program. The CAP is made available to current students on Moodle, CCU’s online learning management system; the CAP is also available for students within the MAC Program Handbook. The CAP addresses student evaluation from a variety of perspectives:

  • Student Self-Assessments
  • Transcript Reviews
  • Student Progress Assessments (by faculty)
  • Clinical Evaluations (formative & summative)
  • MAC Comprehensive Examination

The MAC program evaluation summary is provided below. The MAC program encourages students to seek continued personal and professional development, as well as to indicate how the MAC program faculty and staff can assist them in this process.


Master of Arts in Counseling
Program Evaluation Summary
2012 – 2013

Program Assessment & Alumni Survey
Current students and alumni provided an anonymous evaluation of the MAC program on a 29-item survey. The rating scale ranged from 1 (very minimal skills or knowledge) to 7 (entry-level competence or knowledge).

  • Current students reported an average of 6.44 for all survey items
  • Current students reported an overall satisfaction of 6.44 with the MAC program; overall satisfaction with the MAC program consisted of numerous strengths and areas for continued growth.
  • Areas of strength:
    • Self-awareness, self-reflection, and self-evaluation (item 2; mean = 6.78)
    • Being collaborative and contributing to a mutually respectful student-faculty atmosphere (item 5; mean = 6.78)
    • Knowledge of ethical, legal, and professional standards (item 19; mean = 6.78)
  • Areas for improvement:
    • Models of wellness and prevention of emotional and mental disorders (item 24; mean = 5.94)
    • Resolution of issues or problems that interfere with professional development or functioning in a satisfactory manner (e.g., seeking personal therapy when appropriate (item 3; mean = 6.00)
    • Career assessment and career counseling intervention strategies (item 17; mean = 6.00)

  • Alumni reported an average of 6.19 for all survey items
  • Alumni reported an overall satisfaction of 6.33 with the MAC program; overall satisfaction with the MAC program consisted of numerous strengths and areas for continued growth.
  • Areas of strength:
    • Ethical behavior applied across all professional settings (item 21; mean = 6.64)
    • Knowledge of ethical, legal, and professional standards (item 19; mean = 6.60)
    • Identify and think critically of about ethical and professional dilemmas (item 20; mean = 6.60)
  • Areas for improvement:
    • Research design and statistics (item 18; mean = 5.43)
    • Career assessment and career counseling intervention strategies (item 17; mean = 5.71)
    • Models of wellness and prevention of emotional and mental disorders (item 24; mean = 5.71)
    • The majority of alumni respondents graduated between 2010-2012; alumni participant graduation dates ranged from 1994-2012.

Site Supervisor & Employer Survey
Site supervisors and employers provided an anonymous evaluation of the MAC program on a 29-item survey. The rating scale ranged from 1 (very minimal instruction or training) to 7 (entry-level instruction or training).

  • Site supervisors and employers reported an average of 6.09
  • Site supervisors and employers reported an overall satisfaction of 5.86 with the MAC program; overall satisfaction with the MAC program consisted of numerous strengths and areas for continued growth
  • Areas of strength:
    • Psychopharmacology, including etiology of empirically supported treatments for emotional and mental disorders (item 21; mean = 6.71)
    • Foundational knowledge of counseling theories and counseling practice (item 6; mean = 6.56)
    • Openness in learning and supervision (item 3; mean = 6.50)
  • Areas for improvement:
    • Evaluate counseling theory and practice from a multicultural perspective (item 13; mean = 5.38)
    • General and specific skills to that facilitate cross-cultural relations in both counseling and professional settings (item 14; mean = 5.50)
    • Knowledge of group dynamics and skills for facilitating group counseling (item 15; mean = 5.50)

Student Self-Assessment
Current students complete the Student Self-Assessment during the fall and spring semesters; the assessment is a 29-item survey. The rating scale ranged from 1 (very minimal skills or knowledge) to 7 (entry-level competence or knowledge).

  • Students reported an average of 5.45 for all survey items
  • Students reported an overall satisfaction of 6.35 with the MAC program
  • The average GPA for the Fall 2012 semester: 3.86/4.00
  • The average GPA for the Spring 2013 semester was unavailable for reporting at the time this report was published.

Student Progress Assessment
Current students receive a progress assessment from their faculty advisor in both the fall and spring semesters. This assessment is based upon the MAC Program Objectives and consists of 14 items that are scored on a 3-point scale (1 = unsatisfactory; 2 = developing; 3 = target)

  • Students received an average overall rating of 2.87 for all items

Clinical Evaluations (Practicum)
Supervisors evaluate students’ clinical progress in multiple domains, including counseling skills, conceptualization and planning skills, supervision and consultation skills, evaluation skills, diagnostic and treatment skills, and professional behaviors.

  • Overall scores averaged 2.90 (with 3 being ‘on target’)

Clinical Evaluations (Internship)
Supervisors evaluate students’ clinical progress in multiple domains, including counseling skills, conceptualization and planning skills, supervision and consultation skills, evaluation skills, diagnostic and treatment skills, and professional behaviors.

  • Overall scores averaged 2.87 (with 3 being ‘on target’)

MAC Comprehensive Exam
Students complete the MAC Comprehensive Examination in the last semester of study; all sections of this examination must be successfully completed before a student may graduate. In the data below, mean scores are provided when the score distribution was symmetrical; whereas a median score is used when the score distribution was skewed.

Comprehensive Exam Section

N
(1st time)

N
(all)

Mean
Score

Median
Score

Assessment

123

161

- – -

80%

Career Development

123

162

- – -

80%

Group Work

123

166

- – -

81%

Helping Relationships

122

168

77%

- – -

Human Growth & Development

122

156

86%

- – -

Professional Orientation & Ethical Practice

123

156

- – -

86%

Psychopathology

121

151

85%

- – -

Research & Program Evaluation

123

152

83%

- – -

Social & Cultural Diversity

122

155

85%

- – -

Averages:

122

159

82%

84%

Students must complete each section with a minimum score of 70%. As noted in the data provided above, scores are exceeding the minimum requirements. Analysis also reveals that students are scoring lower in the ‘Helping Relationships’ section than other sections; additional attention will be placed in this area to improve student scores.