Transcript Assessments, Whose Needs?

Developing Assessment Plans that Work
Workshops to help your faculty use assessment
to improve teaching and learning
Computer Engineering and MIS Programs
Preparation for The Accreditation Process
Dr. Taj Mohieldin
Visiting Professor of Thermal Sciences
College of Engineering
University of Bahrain
Fulbright Scholar
Old Dominion University
Norfolk, VA, USA
ABET: Quality Assessment Program
•
•
•
What are we trying to do?
o Review/Develop
o Assess/Evaluate
o Document/use results
o Improve
o Satisfy customers
o Satisfy ABET
o Continue/Stop
How well can we do it?
o Good Assessment Plan
o Faculty ownership and
responsibility
o institution-wide support
How can we improve what
we are doing?
o Believe in it
o Do yours
o Cooperate
o Help other










Successful assessment
Flows from the institution's
mission and educational
purposes.
Emerges from a conceptual
framework.
Is marked by faculty ownership
and responsibility.
Has institution-wide support.
Relies on multiple measures.
Provides feedback to students
and the institution.
Is cost-effective.
Does not restrict or inhibit
goals of access, equity, and
diversity established by the
institution.
Leads to improvement.
Includes a process for
evaluating the assessment
program.
1
UOB Mission & Goals
Electronic Assessment
Database
Concept
College of Engineering
Mission & Goals
2
Program’s
Mission
Assessment Plan
3
Curricular Issues
PEO’s & PO’s
Database
Implementation
Constituency
Feedback
Constituency
Feedback
4
Interpretation of Effectiveness &
Improvements
Program Assessment and Evaluation Matrix
Goals:
Evaluation Methods:
•
•
•
What are the overall goals of the
program?
How do they complement institutional and
accreditation expectations?
•
What assessment methods will you
use to collect data?
How will you interpret and evaluate
the data?
Program Objectives:
Logistics:
•
•
•
•
What are the program objectives?
What should your students know and be
able to do?
Performance Criteria:
•
•
How will you know the objectives have
been met?
What level of performance meets each
objective?
Implementation Strategy:
•
•
How will the objectives be met?
What program activities (curricular and
co-curricular) help you meet each
objective?
When will you measure?
How often? Who will collect and
interpret the data and report the
results?
Feedback:
•
•
•
Who needs to know the results?
How can you convince them the
objectives were met?
How can you improve your program
and your assessment process?
What We Have To Do First?
•
•
•
•
•
•
•
•
•
•
•
•
Departmental Accreditation Committee (DAC)
Program’s Mission
Program Constituencies
Program Educational Objectives (PEO’s)
Program Outcomes (PO’s)
Program Industrial Advisory Committee (PIAC).
Program ABET Web Page.
Electronic Assessment Database.
Plan of Improvement & Assessment (PIA)
Develop performance criteria for each
objective/outcome.
Conduct Assessments and Write Up Results
Document Use of Results for Program Improvement
Program’s Mission
Example Mission
Mechanical Engineering
The mission of the Department of Mechanical Engineering is to:
Provide high quality education in mechanical engineering
for undergraduate students
Provide support for faculty to conduct high quality research
and ensure high quality education
Increase the program’s national and international
reputation
Enhance the community through civic responsibility and the
promotion of economic development
Provide technical expertise and training to industry on
advanced technologies
Program Constituencies
Constituencies
Current Students
Faculty
Potential employers of
program graduates
Former graduates and Alumni
Industrial advisory committee
Student Advisory committee
Means of
Interaction and Feedback
 Course outcome surveys
 Student satisfaction survey
 Senior students exit survey




Feedback on course outcomes surveys
Department Accreditation committee
Department meetings
Employers survey
 Alumni survey
 Committee meetings
 Committee meetings
Program Educational Objectives (PEO’s)
•
•
•
•
PEO’s are consistent with the mission
Involve constituencies
Ensure that PEO’s are well-stated and
measurable.
PEO’s can be linked with the curriculum for
the Program
Program Educational Objectives (PEO’s)
Example PEO’s






Create well-rounded engineers who possess theoretical and
practical skills, and understand the significance of humanities
and social sciences.
Produce graduates who have the necessary teamwork and
leadership skills to excel in multidisciplinary team
environments.
Develop innovative and creative thinking with an understanding
of entrepreneurship.
Develop science, mathematics, analytical, computational, and
experimental, skills, and apply them to formulate and solve
engineering problems.
Instill in students an appreciation of the impact of engineering
solutions in a global and societal context, including the broad
implications of professional ethics.
Instill in students the flexibility to adapt to changing technology
and an understanding of the need for continuous improvement
and lifelong learning.
Program Educational Objectives
Example mission
Mechanical Engineering
The undergraduate program in Mechanical Engineering has
the following educational objectives:
To graduate students who
Can effectively use science, mathematics, and engineering
concepts necessary for successful mechanical engineering
careers.
Can communicate effectively, work in teams, and provide
leadership.
Can adapt to and influence the future technological environment in
response to industrial and global changes.
Are aware of the ethical, social, and environmental impact of their
professional actions.
Can succeed in advanced study including graduate school, selfstudy, and industrial short courses.
Program Outcomes (PO’s)
•
•
•
•
•
•
PO’s satisfy the 11 ABET criteria
PO’s must be measurable and specify an appropriate
method for measurements
Outcomes must specify a criterion for judging findings.
satisfies professional component
For academic programs, include both of the following:
a. Curricular outcomes
b. Learning outcomes at the course level
Direct as well as indirect methods of measurement are to
be used.
Map PO’s into PEO’s
Map PO’s into ABET “a – k” criteria
Curriculum achieves PO’s
Curriculum satisfies professional component
•
Curriculum meets program specific criteria
•
•
•
•
Program Outcomes (PO’s)
Computer Engineering
1. Graduates will have an ability to apply knowledge of mathematics.
Specifics:
a.
Algebra, Plane Geometry and Trigonometry
b.
Differential and Integral Calculus
c.
Differential Equations
d.
Probability and Statistics
e.
Discrete Mathematics
2. Graduates will have an ability to apply knowledge of basic sciences.
Specifics:
a.
Mechanics
b.
Electricity and Magnetism
3. Graduates will have an ability to apply knowledge of core computer engineering specialties
to solve engineering problems.
Specifics:
a. Circuit Theory
b. Digital Logic and Computer Design
c. Digital Electronics
h. Computer Software
i. Computer Systems Architecture
j. Operating Systems
4. Graduates will have the ability to create computer programs to solve engineering problems.
Specifics:
a.
Requirement Analysis
b.
Design (Flowcharts and/or Pseudocode)
c.
Coding
d.
Testing Strategies
e.
Documentation
5. Graduates will have an ability to develop models and apply them to
engineering problems.
Specifics:
a.
Analytic and Empirical Models
b.
Computer Models
c.
Limitations of Models
d.
Design Evaluation using Models
6. Graduates will have effective laboratory skills.
Specifics:
a.
Design of Experiments
b.
Construction, Debugging and Execution of Experiments
c.
Collection, Analysis and Interpretation of Data
d.
Documentation of Experimental Process and Results
7. Graduates will have an ability to identify, formulate and solve engineering
problems.
8. Graduates will be able to design a system, component, process or computer
Program to meet design needs using design principles, techniques and
engineering tools.
Specifics:
a.
Design Issues such as reliability, practicality, cost and meeting specifications
b.
Process Methods such as planning, progress reviews, reporting, scheduling
9. Graduates will have an ability to work as a contributing member of a
multidisciplinary team.
10. Graduates will be able to communicate and express ideas coherently,
professionally and effectively.
Specifics:
a.
Orally
b.
Written
11. Graduates will have an understanding of professional and ethical responsibility.
Computer Science Program PEO’s & PO’s
Objective 1: students will be competent in theoretical & mathematical foundations of computer
science.
o
o
o
Students should be able to apply fundamental concepts of discrete mathematics such as logic & proofs,
set theory, relations & functions, and combinatory to model computational problems.
Students should be able to demonstrate the application of abstract structures such as graphs, finite state
machines, and recurrence relations to the solution of computer science problems.
Students should be able to analyze and evaluate comparative performance of algorithms and data
structures appropriate to solving computer science problems.
Objective 2: Students will be able to construct algorithms and data structures applicable to problems
solved by computer science.
o
o
Students should be able to apply concepts related to data structures such as lists, stacks, queues,
arrays, graphs, trees, heaps, and hashing to design & create algorithms.
Should be able to recognize design patterns & user these to guide solutions to computer science
problems.
Objective 3: Upon graduation, CSC students will be proficient in one programming language and have
a basic knowledge of several others.
o
o
o
Students should be able to write efficient solutions to specific problems using an object-oriented
programming language.
Students should be able to write programs in assembly language.
Students should be able to write programs in the C language.
Objective 4: CSC students will understand the hardware and software architecture of computer
systems.
o
o
o
o
Students should be able to define & explain instruction sets.
Students should be able to explain the function & interaction of computer processing units, memories, &
input/output devices.
Students should be able to define & explain elements of operating systems such as memory
management, process scheduling, synchronization & interaction, and input/output devices.
Students should be able to distinguish computer network elements and understand issues related to
computer security.
Computer Science Program PEO’s & PO’s
Objective 5: CSC students will demonstrate the ability to participate in professional
practices related to software engineering.
o
Students should be able to negotiate, clarify, & document customer requirements.
o
Students should be able to apply knowledge of fundamental algorithms,
programming language concepts, & design patterns to determine an overall design
for a software system.
o
Students should be able to implement a fully specified system.
o
Students should be able to test a fully specified system.
o
Students should be able to plan & monitor the progress of software projects to
ensure on-time delivery of a high quality system.
Objective 6: CSC students will be able to communicate effectively about computer
science- related topics.
o
Students should be able to deliver an audience-sensitive oral technical
presentation.
o
Students should be able to write an audience-sensitive technical document.
o
Students should be able to contribute effectively on software-based development
teams.
Objective 7: CSC students will demonstrate the ability to be responsible practitioners
of computer science & understand the social & ethical implications of
computing.
o
Students should be able to demonstrate ways in which computers pose new ethical
questions or pose new versions of standards, moral problems, and dilemmas.
o
Students should be able to recognize and, when appropriate, to resolve ethical
problems or dilemmas related to the computing profession.
Relationship of PEO’s to EC2000 Criteria
How these PEO’s Relate to Other EC 2000 Criteria
Relationship of Objectives to EC2000 Criteria
EC 2000 Criterion
2 CE
PEO
1
2
3
4
5
6
7
8
3
a
b
c
d
e
f
g
h
i
j
k
4
5
6
7
8
PO’s
PEO ’s
a. Ability to apply knowledge of mathematics, science, and engineering


b. Ability to design and conduct experiments as well as analyze and
interpret data


c. Ability to design a system to meet desired needs



d. Ability to function on multidisciplinary teams
e. Ability to identify, formulate, and solve engineering problems





f. Understanding of professional and ethical responsibility

g. Ability to communicate effectively




h. Broad education necessary to understand impact of engineering
solutions in a global/societal context

i. Recognition of the need for and ability to engage in lifelong learning

j. Knowledge of contemporary issues




k. Ability to use the techniques, skills, and modern engineering tools
necessary for engineering practice

Table 3. Example of Mapping Program Outcomes to ABET Outcomes
PO’s
1.
2.
3.
4.
5.
6.
7.
a




b



ABET
c






a-k
d e



 
 

 
f




g



h





i




j




K







What is Urgent Now?
(DAC) Submit






Program’s Mission
Program’s Constituencies
Program’s Educational Objectives (PEO’s)
Program’s Outcomes (PO’s)
Tabulated Current Curriculum
Program Industrial Advisory Committee (PIAC).
Faculty Submit:





ABET Course Syllabus
ABET Resume
Passport Photo (for Web Page)
Collect sample of students work this semester
Record of tests students grades this semester
Test # 1 Grade Distribution
student
Question 1
Question 2
Question 3
Question 4
Question 5
1
18
10
20
15
10
2
18
15
00
18
20
3
16
12
12
10
05
4
15
20
20
15
14
5
14
05
14
17
11
6
14
12
14
20
19
7
14
17
20
04
14
8
12
03
12
15
20
9
12
00
15
06
14
10
11
20
08
11
05
11
10
15
18
09
07
12
10
14
10
07
13
13
05
17
13
20
02