Program Assessment in Workforce Education

Core Competencies, Flexible Implementation

Florida Community College at Jacksonville

FCCJ Workforce Education

• Over 80 workforce education programs – Automotive – Aviation – Business and Finance – Information Technology – Construction Trades – Public Service – Culinary and Hospitality – Engineering and Industrial Technology – Allied Health – Legal and Office Systems • Workforce program features: – AS/AAS degrees, college credit certificates, vocational certificates, and continuing ed – College preparatory and vocational preparatory instruction (remediation) – Dual enrollment for traditional and adult high school students – Articulation between all educational levels and credit for prior learning

Workforce Program Assessment Model

Faculty and staff collaborate to interpret assessment data and develop strategies to improve student learning outcomes Faculty achieve consensus on learning outcomes to be assessed, and map outcomes to curriculum

Program improvement Student learning outcomes

Continuous improvement cycle Faculty and staff work together to gather formative and summative assessment data and compile for review

Data collection Timeline/ schedule

Faculty develop timeline for gathering assessment data, both formative and summative

Assessment methods

Faculty choose assessment methods appropriate to the outcomes, purpose of assessment, and student population

Assessment Program Components

• Identify Core Competencies: – Literacy (verbal, written, quantitative) – Problem-solving – Discipline-specific knowledge and skills

Mirrors University outcome categories

• Map competencies to curriculum and modify where necessary • Identify/develop assessment strategies • Orient/train adjuncts • Gather, compile, and interpret data • Share with program advisory committee and other stakeholders

Available Tools and Resources

• Professional development opportunities faculty and staff for • Research analyst - assistance with data collection and analysis • Faculty Fellows – support for planning and implementation • Program Assessment Rubric evaluation of progress – self-

Core Competencies:

Literacy (verbal, written, quantitative)

• Culinary arts: – Develop and execute, in both written and oral formats, such foodservice management documents as a:

menu plan, restaurant concept overview, purchasing specification, food production schedule, and catering contract proposal

• Practical Nursing: – Demonstrate grammatical and format proficiency in written documentation of patient care.

• All: – Demonstrate the ability to conduct research via Internet and other resources and put information together in a logical and concise written report.

Core Competencies:

Problem-Solving

• Cisco CCNP: – When presented with problem or design scenarios, students will demonstrate problem-solving abilities and critical thinking skills by performing appropriate configuration, design, assessment, and/or solution(s) • Paramedic: – When presented with simulated patient scenarios students will demonstrate problem-solving abilities and critical thinking skills by selecting appropriate assessment and treatment modalities • All: – Demonstrate proficiency in working with customers (internal and external) and colleagues who come from diverse backgrounds, age groups, socioeconomic groups

Core Competencies:

Discipline-specific knowledge/skills

includes teamwork and productivity

• Aviation Maintenance: – Evaluate the requirements of a maintenance task and complete it in a timely manner meeting industry standards • Office Administration: – Demonstrate the ability to prioritize projects and assignments, use effective time management techniques, and employ effective records management techniques • Cosmetology: – Demonstrate leadership and exemplary interpersonal skills while performing in groups simulating salon settings

Network Engineering Technology E-Portfolio Requirements

CET2629 Internetwork Troubleshooting (CCNP4) -

Case Study

CET2628 Building Remote Access Networks (CCNP2) -

Case Study

CET2623 Quality of Service -

NBar Case Study

CET2627 Building Multilayer Switched Networks (CCNP3) -

HSRP Case Study

EEV0585 or CET1175 Technical Support -

Resume and Presentation

EEV0531 or CET2186 - Computer Peripherals -

Certificate of Disassembly

EEV0543 or CET1512 - Operating Systems -

DOS Certificate

CET2677 Voice Over IP -

Case Study

EEV0544 or CET1742 Intro to Networking -

Putting it all together lab

EEV0570 or CET2600 Cisco I -

Report/Lab

EEV0571 or CET2610 Cisco 2 -

Case Study

CET2626 Building Scalable Networks -

Case Study 1

Network Engineering Technology

Sample E-Portfolio Assignment, Cisco 7 For each case study, submit one Word document that contains the following: The graphic for the case study provided or created yourself from the PowerPoint All the configurations of each device (make sure each device is properly labeled with a hostname so it is easily identified) Captured pertinent show commands that prove the requirements of the case study Screen captures of the host IP address and default gateway Screen captures of successful pings to the other hosts

Legal Studies – Targeted Outcomes

 Effective legal writing  Teamwork  Ethics and professionalism

Legal Studies – Assessment Methods

 Curriculum-embedded assessments covering the targeted skills    Teaches the skills Provides feedback Administered in the courses each student must take to complete the program  Transformation of Internship into a Capstone Course     Internship work experience Group presentation of solution to ethical dilemma present in a real life factual scenario Portfolio – to be compiled from specified embedded assessments throughout the required Legal Assisting courses Group presentation and portfolio to be assessed by a panel that includes employers and practicing paralegals

Aviation Maintenance

Goals:    All graduates complete written exams within 60 days of graduation At least 90% will pass the exam on first attempt Increase the number of certified technicians

Learning/Assessment Methods:

 Entry and exit surveys  Examiner administered practice oral exams • Provide students and instructors with feedback on students’ skills • Encourage students to take the official exam

Aviation Maintenance Spring 2006 Outcomes

   73% of graduates have completed the licensure exam – up from 14% two years ago 91% of graduates have a job in the aviation industry The practice exams show that there is room for improvement and continuing evaluation

Culinary Arts Classroom vs. Program Assessment

Classroom Assessment Example: Chef-Instructor evaluates student mystery basket assignment and provides feedback to student via written and class critique (feedback for instructor…) Program Assessment Example: Faculty members develop rubric for evaluating the mystery basket assignment, formally collect, aggregate and evaluate this data, and suggest and ultimately make meaningful curricular changes based on data (feedback for program…)

Culinary Arts Practical Assessment Rubric

Standard Levels of Quality

Professionalism

Industry/course terms and nomenclature Professional dress and conduct Teamwork and collaborative skills Interaction with site proctor or professor

Highly Competent (3) Excellent knowledge of terms and technical nomenclature.

Excellent professional dress and demeanor observed.

Worked very well in team environment and showed initiative and outstanding group skills. Potential leadership attributes emerged.

Interacted with site proctor in a professional manner, reflecting outstanding industry expectations.

Competent (2) Needs Improvement (1) Overall good knowledge of terms with some improvement needed.

Overall good dress and professional demeanor observed with some habits needing improvement.

Worked fairly well in a team environment with some group skills needing improvement.

Proctor interaction was adequate with improvement needed in the area of interpersonal communication.

Overall knowledge of terms not adequate to perform successfully. Significant lapses in dress and professional demeanor were observed. Difficulty performing in team setting. Significant improvements needed in order to function well with others, and to successfully collaborate with working members of a group. Some conflict emerged while interacting with site proctor. Significant improvements needed in the area of respect and overall professionalism.

Office Administration

    Identified core competencies Mapped core competencies to curriculum – spreadsheet that hyperlinks to actual assessment tools Updated official course outlines with core competencies and assessment methods Developing tracking and data management strategies

Office Administration Curriculum Map

Problem Solving

Demonstrate problem solving abilities by being able to troubleshoot minor computer operational problems.

When presented with typical business scenarios for which there are no obvious solutions, students will demonstrate problem solving abilities by selecting correct resources and actions to deal effectively with the scenarios.

OST 1100 Link to assignment rubric OST 1581 Link to case studies OST 1384 Demonstrate proficiency in working with customers from diverse backgrounds and with a variety of issues, utilizing analytical and problem-solving tools.

Link to assignment rubric Link to project rubric OST 2771 Link to assignment rubric OST2501 Link to exam and scoring guide