Gathering assessment data, interpreting the results, and disseminating the outcomes continues to be an area of growth and development for the program. Assessment data for the academic years 2009 – 2012 were collected using the Foliotek ePortfolio system. The system holds a variety of student and program data with which to inform strategic planning. The types of data collected included demographic, academic, admission to candidacy, and program completion.
The program is currently transitioning from the Foliotek system to the Desire to Learn (D2L) ePortfolio system. The current D2L system hosts an ePortfolio platform and will allow faculty to run statistics for each course, including the competencies addressed in each course. However, the current system will not aggregate data or create cumulative data reports. Therefore, the program will rely on Excel spreadsheets to aggregate, disaggregate, analyze, and chart student and program data.
The following data tables represent accessible Foliotek data from the 2009-2012 academic years and provide examples of how the faculty is using data to inform teaching and learning. Some tables were created manually with the Excel data downloaded from the Foliotek program site. Other tables were copy and pasted into the report directly from the Foliotek program site. Data reflects averages for all students across emphases. Implementing qualitative assessment methods and disaggregating data could provide additional data from which to analyze the particular data points presented.
ACADEMIC ASSESSMENT DATA
- 731 Group Counseling Conceptualizations. This assignment addresses CACREP standards IIG. 6. a. and c., and Professional Disposition 4 - Commitment to Learning. Data is from Spring 2012 731 Group Counseling Process (N=24 – 2011 Cohort). The first chart represents Conceptualization 1. The second charter represents Conceptualization 2. The charts suggest that students increased learning in these specific areas and learner outcomes. What would be interesting to determine is what provoked the learning and change from Conceptualization 1 to Conceptualization 2.
- 731Group Counseling Skill Demonstration. This assignment addresses CACREP standards IIG. 6. a. and b. Data is from Spring 2012 731 Group Counseling Process (N=16 – 2011 Cohort). The assignment is a culminating experience that evaluates students’ group counseling skills. The chart suggests that students met the specific competencies and learner outcomes based on the CACREP standards. Learning the differences between students that scored “Developing” and “Met” could inform teaching, learning, and practice. Likewise, giving close attention to students that scored “Beginning” would be important to retention, development, and success in the program.
- 794 Counseling Practicum Performance Evaluation. This assessment evaluates students’ skill development at the completing of 794 Counseling Practicum. The assessment is comprised of three areas of development: Primary Counseling Skills, Professional Dispositions, and Professional Behaviors. Data represents practicum sections from Fall 2010, Spring 2011, and Spring 2012 (N=56). The charts indicate that students met the expected skills, dispositions, and behaviors. Disaggregating the data further might uncover specific information across the three levels of expectation scores that could inform teaching, learning, and skill attainment. In addition, disaggregating the data relevant to emphasis, cohort, and addition demographics might be informative.
- Data (N=60) suggests that overall, practicum students meet expectations in this areas of development. However, targeting primary counseling skills and professional behaviors is of interest.
- Data (N=60) suggests that practicum students are most adept at providing encourages, empathy and immediacy, and respect and unconditional positive regard. Whereas practicum students appear to be meeting expectations for primary counseling skills, goal setting could be a skill to give additional attention to in training and practice.
- Data (N=60) reports that, overall, students are meeting expectations regarding demonstration of professional dispositions. Whereas specific areas could use additional attention, multiculturalism is of particular interest.
- Data (N=60) notes that students appear to be developing well in the area of professional behaviors. Not surprising, applying theory, case conceptualization, treatment planning, and appraisal continue to be areas of interest.
- Data (N=30) suggests some similarities and differences between faculty and supervisor perceptions of practicum student development. Specifically, differences are noted between faculty and site supervisors’ perceptions of professional counseling behaviors. Whereas the program continues to increase its connection and relationship with sites, this could be an area to add to the agenda of the upcoming site supervisor training and meeting.
- Data (N=30) suggests that faulty and site supervisors are relatively consistent regarding perceptions of practicum students’ development of primary counseling skills. Likewise, it appears that students are meeting expectations in these areas of development. The area of goal setting might need additional consideration in training and practice.
- Data (N=30) reports that faculty and site supervisors’ perceptions of practicum students’ development of professional dispositions is consistent. Multicultural dispositions appear to need additional attention.
- Data (N=30) reveals some similarities and differences in faculty and site supervisor perception of practicum students’ development of professional behaviors. Differences are noted in the areas of theory to practice, treatment planning, appraisal, and use of professional literature.
- Data (N=30) suggests that from mid-term to the end of the semester, practicum students developed well in these areas, particularly in the areas of primary counseling skill development and professional behaviors. What might be interesting to uncover is “what” specifically inspired the growth and development in these areas. Data indicates differences in faculty and site supervisors’ perceptions of skills, dispositions, and behaviors.
- Data (N=30) suggests that from mid-term to the end of the semester, practicum students developed well in these areas, particularly in the areas of empathy, immediacy, and respect. Data indicates differences in faculty and site supervisors’ perceptions of skills.
- Data (N=30) suggests that from mid-term to the end of the semester, practicum students developed well in these areas fairly consistently. Multicultural dispositions could use additional investigation. Data indicates slight differences in faculty and site supervisors’ perceptions of dispositions.
- Data (N=30) suggests that from mid-term to the end of the semester, practicum students developed well in these areas, particularly in the areas of attendance, university policy, record keeping, and seeking supervision. Using the professional literature, applying theory to practice, treatment planning, and appraisal are professional behaviors with this to give additional consideration. Data indicates differences in faculty and site supervisors’ perceptions of skills dispositions, and behaviors.
Use of Assessment Data for Program Improvement
|Goal||Target Date||Progress Toward Goal|
|Revise, update and disseminate current program handbook Fall 2013||Summer 2013||Faculty met to review and finalize the handbook in September 2013|
|Develop Assessment Report Timeline to ensure that a program assessment is complied, interpreted and disseminated every August||Summer 2013||The Assessment Report will be submitted to CACREP in September 2013. Dissemination of the report will take place in the Fall 2013 semester.|
|Implement a cut-off score for the CPCE Summer 2014 and develop a protocol of alternatives for students that score below the cut off.||Summer 2014||Faculty voted and approved implementation. Proposal for program change will be submitted to the College's Curriculum Committee in the Fall 2013 for implementation Summer 2014.|
|Develop a survey to gather Employer data and implement 2013-2014 academic year.||Summer 2014|
|Develop a survey to gather Alumni Outcome Data (e.g., 2 year, 5 year) and implement 2013-2014 academic year.||Summer 2014|
|Develop Site Supervisor Survey that reports their perceptions of students' level of preparation for the practicum and internship.||Summer 2014|
|Implement Clinical Experiences for CMH and SACC Programs by Fall 2014||Spring 2015|
|Develop a Program Advisory Council (PAC) by Fall 2015||Summer 2015|
|Develop a faculty self-assessment instrument and implement by Fall 2015||Summer 2015|