Transcript ACL (often/very often)

Looking Inside
The “Oakland Experience”
Another way to look at NSSE Data
April 20, 2009
NSSE Indicators of
Effective Educational Practice
• Level of Academic Challenge
• Student-Faculty Interaction
• Active and Collaborative Learning
• Enriching Educational Experiences
• Supportive Campus Environment
Level of Academic Challenge
70
59
60
50
55
48
51
50
52
54
55
55
56
Oakland
Selected Peers
40
Carnegie
30
NSSE
Top 50%
20
10
0
FY
SR
Student-Faculty Interaction
50
47
45
40
40
37
35
30
32
33
40
41
36
33
Oakland
28
Selected Peers
25
Carnegie
20
NSSE
Top 50%
15
10
5
0
FR
SR
Active & Collabortive Learning
60
54
48
50
50
45
41
40
50
51
41
41
Oakland
37
Selected Peers
30
Carnegie
NSSE
20
Top 50%
10
0
FR
SR
Enriching Educational Experiences
50
46
45
40
36
37
38
35
30
25
Oakland
30
26
25
26
40
27
Selected Peers
Carnegie
NSSE
20
Top 50%
15
10
5
0
FR
SR
Supportive Campus Environment
70
60
65
56
59
58
63
60
56
55
57
52
50
Oakland
Selected Peers
40
Carnegie
30
NSSE
Top 50%
20
10
0
FR
SR
Engaging the Institution
Students aren’t the only ones who benefit
from engagement. If NSSE is to be a
vehicle for improvement…faculty (and
staff) need to be engaged…
…an engaged campus (or department or
program) would be one in which everyone
embraces the challenge of continually
doing better for students.
Institutional Quality: A Nuanced View
• There is value in comparing data about
institutional performance between institutions,
BUT
• We all know that the institutional averages do
not represent the experience of all students in
that institution.
Institutional Quality: A Nuanced View
• For all NSSE benchmarks of effective
educational practices, less than 10% of the total
variation is attributable to institutions.
• The lion’s share of the variation is among
students, within institutions.
Looking within
Examining variation in the student experience
within an institution.
• How do experiences differ by major or by groups
of related majors.
• Demographic or other subgroups?
• Who are the least engaged students?
• Even high-performing institutions have work to
do to improve the experience of all students.
Variation of NSSE Benchmarks
Within-Institution Variation
Between Institution Variation
6%
5%
7%
7%
5%
8%
5%
94%
95%
93%
93%
95%
92%
95%
FY
SR
FY
SR
FY
SR
FY
Level
Academic
Challenge
Active &
Collaborative
Learning
StudentFaculty
Interaction
Enriching
Educational
Experiences
14%
86%
SR
4%
5%
96%
95%
FY
SR
OU data by Program Group
Looking Inside
• Same data – different perspective
• How do we identify specific areas where we can
improve the engagement, education and
experience of OU students
Data by School/College & Peer
• Most OU units lower than peer for both FY & SR
students on application of theories or concepts
% of course work that quite a bit/very much emphasizes
applying theories or concepts
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
FR
SR
CAS
SBA
SEHS
SECS
SHS
SON
UP*
Peers
Level of Academic Challenge
(students that replied quite a bit/very much)
Arts & Humanities
FR
SR
Social
Sciences
Sciences
FR
SR
FR
PreProfs
Comm/
Journalism
SR
FR
FR
SR
Worked harder than you thought you could to meet an
instructor's standards or expectations
3%
3%
-1%
-14%
4%
-5%
-2%
-9%
5%
ANALYZING basic elements of an
idea/experience/theory; examining a particular
case/situation in depth & considering its components
0%
-1%
-1%
-4%
2%
2%
6%
8%
7%
SYNTHESIZING and organizing
ideas/information/experiences into new, more complex
interpretations & relationships
6%
5%
-10%
-2%
2%
4%
5%
14%
-1%
MAKING JUDGMENTS about the value of information,
arguments, or methods, such as examining how
others gathered and interpreted data and assessing
the soundness of their conclusions
0%
4%
-6%
-11%
16%
-3%
3%
0%
8%
APPLYING theories or concepts to practical
problems or in new situations
0%
-6%
6%
-13%
7%
6%
4%
-4%
-2%
-10%
-9%
4%
10%
-4%
2%
2%
4%
3%
1%
-3%
-11%
4%
-4%
1%
6%
4%
-8%
MEMORIZING facts/ideas/methods from courses &
readings to repeat them in much the same form
Spending significant amounts of time studying and on
academic work
Level of Academic Challenge
(students that replied quite a bit/very much)
SBA
FR
Worked harder than you thought you could
to meet an instructor's standards or
expectations
SEHS
SR
SHS
FR
SR
FR
Nursing
SR
FR
SR
Engineering
FR
Comp Sci
SR
FR
SR
-5%
-7%
-4%
8%
6%
0%
10%
3%
1%
-4%
4%
-10%
ANALYZING basic elements of an
idea/experience/theory; examining a
particular case/situation in depth &
considering its components
2%
2%
0%
-1%
1%
0%
-2%
4%
-10%
2%
3%
-6%
SYNTHESIZING and organizing
ideas/information/experiences into new,
more complex interpretations &
relationships
1%
-6%
1%
6%
3%
-13%
-1%
11
%
-6%
-3%
9%
-20%
MAKING JUDGMENTS about the value of
information, arguments, or methods, such
as examining how others gathered and
interpreted data and assessing the
soundness of their conclusions
0%
2%
1%
5%
5%
-19%
-4%
13
%
3%
-11%
2%
-24%
APPLYING theories or concepts to
practical problems or in new situations
1%
4%
-8%
6%
4%
-9%
7%
5%
-1%
2%
6%
-12%
MEMORIZING facts/ideas/methods from
courses & readings to repeat them in much
the same form
-3%
6%
-3%
-9%
0%
17%
15%
13
%
-14%
-2%
7%
-13%
Spending significant amounts of time
studying and on academic work
4%
-1%
0%
1%
3%
1%
2%
3%
-6%
4%
4%
-3%
Spending significant amounts of time
studying and on academic work
4%
-1%
0%
1%
3%
1%
2%
3%
-6%
4%
4%
-3%
Level of Academic Challenge
Arts &
Humanities
Number of assigned textbooks, books, or booklength packs of course readings
Number of written papers or reports of 20
PAGES OR MORE
Number of written papers or reports
BETWEEN 5 AND 19 PAGES
Sciences
FR
SR
FR
5+
6%
14%
2%
11+
12%
22%
5+
-1%
11+
SR
Social
Sciences
FR
SR
0%
12%
11%
3%
0%
8%
-3%
3%
-4%
0%
-1%
0%
5+
-8%
5%
11+
-1%
5+
11+
PreProfs
FR
Comm/
Journalism
FR
SR
3%
5%
-4%
10%
-7%
13%
-6%
1%
0%
4%
2%
-3%
-1%
2%
0%
1%
1%
-2%
6%
-16%
5%
14%
1%
-4%
7%
2%
4%
-9%
6%
5%
3%
1%
-3%
-3%
-5%
-4%
-11%
4%
-3%
5%
15%
25
%
0%
-2%
-4%
-11%
12%
-3%
-6%
-5%
25
%
-4%
10%
7%
6%
-1%
-7%
-3%
13%
18
%
Number of written papers or reports of
FEWER THAN 5 PAGES
Hours per 7-day week spent preparing for class
(studying, reading, writing, doing homework or
lab work, analyzing data, rehearsing, and other
academic activities)
16+
hours
Level of Academic Challenge
SBA
Number of assigned textbooks, books, or
book-length packs of course readings
Number of written papers or reports of
20 PAGES OR MORE
Number of written papers or reports
BETWEEN 5 AND 19 PAGES
Number of written papers or reports of
FEWER THAN 5 PAGES
Hours per 7-day week spent preparing for
class (studying, reading, writing, doing
homework or lab work, analyzing data,
rehearsing, and other academic activities)
SEHS
SHS
FR
SR
FR
SR
5+
-5%
-9%
-1%
0%
11+
-3%
-11%
-2%
5+
1%
-4%
11+
3%
5+
FR
Nursing
SR
FR
1%
-8%
-2%
-4%
-1%
-14%
-3%
2%
-3%
-1%
-2%
1%
1%
-4%
6%
11+
0%
-6%
5+
5%
11+
16+
hrs
Engineering
SR
Computer
Science
FR
SR
FR
SR
9%
-14%
-13%
-7%
-22%
-3%
13%
-17%
-16%
-7%
-19%
-7%
0%
2%
0%
8%
0%
0%
-1%
-2%
-1%
2%
2%
-2%
-2%
1%
3%
7%
-20%
-2%
-1%
-5%
5%
-17%
-12%
-2%
1%
-2%
-6%
0%
-1%
-1%
12%
-1%
1%
0%
2%
10%
-9%
-16%
-10%
0%
-2%
-1%
15%
-14%
4%
-2%
10%
10%
-3%
-10%
-4%
-5%
-6%
-7%
3%
-5%
-6%
-9%
-2%
2%
10%
0%
14%
6%
4%
5%
-6%
-8%
Looking Inside
• Can faculty use this to help identify areas of
concern for your program?
• Which Items are important to you?
• What are you surprised to see?
Data by School/College & Peer
% of students who often/very often worked with faculty
on activities other than coursework
25%
20%
15%
FR
SR
10%
5%
0%
CAS
SBA
SEHS
SECS
SHS
SON
UP*
Peers
Student-Faculty Interaction
(students that replied often/very often)
Arts &
Humanities
FR
Social
Sciences
Sciences
SR
FR
SR
FR
PreProfs
SR
FR
Comm./
Journalism
FR
SR
Discussed grades or assignments with an instructor
-2%
5%
-6%
-10%
9%
4%
11%
-1%
8%
Talked about career plans with a faculty member or advisor
-2%
8%
-6%
5%
-3%
14%
-6%
0%
-1%
Discussed ideas from your readings or classes with faculty
members outside of class
2%
7%
3%
4%
3%
10%
1%
-2%
4%
Received prompt written or oral feedback from faculty on your
academic performance
6%
8%
-5%
2%
-11%
2%
1%
19%
-11%
Worked with faculty members on activities other than
coursework (committees, orientation, student life
activities, etc.)
0%
4%
4%
2%
5%
4%
1%
0%
2%
-1%
0%
1%
28%
1%
5%
3%
-4%
8%
Work on a research project with a faculty member outside of
course or program requirements (done)
Student-Faculty Interaction
(students that replied often/very often)
SBA
FR
SEHS
SR
FR
SHS
SR
FR
Nursing
SR
FR
SR
Engineering
Computer
Science
FR
FR
SR
SR
Discussed grades or assignments with an instructor
8%
0%
-1%
3%
-2%
-7%
0%
3%
-5%
-14%
0%
-17%
Talked about career plans with a faculty member or
advisor
-5%
-8%
5%
1%
1%
6%
0%
-8%
-1%
-13%
2%
-4%
Discussed ideas from your readings or classes with
faculty members outside of class
2%
-4%
-3%
-2%
-4%
-1%
1%
-4%
-3%
-14%
-1%
-7%
Received prompt written or oral feedback from
faculty on your academic performance
3%
-1%
1%
9%
-9%
-6%
-6%
1%
-3%
-17%
-2%
-10%
Worked with faculty members on activities other
than coursework (committees, orientation,
student life activities, etc.)
2%
-1%
-1%
-3%
-1%
2%
-1%
4%
0%
-4%
-1%
-6%
-1%
-6%
-3%
-8%
-3%
-1%
3%
2%
1%
4%
0%
1%
Work on a research project with a faculty member
outside of course or program requirements
Data by School/College & Peer
• Most OU schools are below peers in making class
presentations for both FY & senior students
% of students who often/very often made a class
presentation
100%
80%
60%
FR
SR
40%
20%
0%
CAS
SBA
SEHS
SECS
SHS
SON
UP*
Peers
Active & Collaborative Learning
(students that replied often/very often)
Differences from average
Arts & Humanities
FR
Asked questions in class or contributed to
class discussions
SR
Sciences
FR
Social Sciences
SR
FR
SR
PreProfs
FR
Comm/Journalism
SR
SR
15%
12%
4%
-15%
9%
-3%
3%
8%
5%
6%
-15%
-1%
-29%
-2%
-22%
-5%
-34%
9%
Worked with other students on projects
DURING CLASS
-2%
-4%
-13%
-21%
6%
-17%
-3%
-50%
5%
Worked with classmates OUTSIDE OF
CLASS to prepare class assignments
-9%
-34%
5%
-18%
0%
-22%
2%
-32%
-18%
1%
2%
0%
14%
-2%
-1%
-3%
-18%
3%
-2%
-7%
4%
-5%
0%
-8%
-2%
-14%
15%
2%
7%
3%
4%
3%
10%
1%
3%
4%
Made a class presentation
Tutored or taught other students (paid or
voluntary)
Participated in a community-based project
(e.g., service learning) as part of a regular
course
Discussed ideas from your readings or
classes with faculty members outside of
class
Active & Collaborative Learning
(students that replied often/very often)
Differences from average
Asked questions in class or
contributed to class discussions
Made a class presentation
Worked with other students on
projects DURING CLASS
Worked with classmates OUTSIDE
OF CLASS to prepare class
assignments
Tutored or taught other students
(paid or voluntary)
Participated in a community-based
project (e.g., service learning) as part
of a regular course
Discussed ideas from your readings
or classes with faculty members
outside of class
Business
Administrtn
Education &
Human Serv
Health
Sciences
FR
SR
FR
SR
FR
SR
FR
SR
5%
-3%
-9%
13%
-8%
-12%
-6%
14%
13%
-2%
32%
-5%
-32%
7%
5%
4%
27%
0%
11%
19%
0%
18%
1%
-4%
-2%
-1%
-7%
2%
-4%
Nursing
Engineering
Computer
Science
FR
SR
FR
SR
-16%
4%
-1%
-5%
-28%
-8%
-3%
-6%
-20%
-12%
-5%
-13%
-1%
-13%
-8%
-15%
2%
-1%
2%
-21%
0%
9%
4%
27%
3%
6%
1%
-1%
-1%
2%
-3%
8%
2%
11%
-3%
4%
11%
-1%
0%
3%
14%
-3%
-10%
-5%
-12%
-3%
-2%
-4%
-1%
1%
-4%
-3%
-14%
-1%
-7%
Data by School/College & Peer
• Prospective teachers and nurses are most likely to have
had practical experience
% of students who have done practicum, internship, field
experience, co-op experience, or clinical assignment
80%
70%
60%
50%
40%
SR
30%
20%
10%
0%
CAS
SBA
SEHS
SECS
SHS
SON
UP*
Peers
Enriching Education Experiences
A&H
Sciences
FR
SR
FR
SR
Social
Sciences
FR
PreProf
Comm/
Journalism
SR
FR
FR
SR
Used an electronic medium to discuss or complete
an assignment
Often/
V Often
2%
-8%
-8%
-7%
3%
-11%
-7%
23%
6%
Had serious conversations with students of a
different race or ethnicity than your own
Often/
V Often
2%
4%
-4%
3%
6%
7%
16%
3%
3%
Had serious conversations with students who are
very different from you in terms of their religious
beliefs, political opinions, or personal values
Often/
V Often
4%
10%
-10%
3%
11%
9%
15%
9%
3%
Practicum, internship, field experience, co-op
experience, or clinical assignment
Done
2%
-7%
4%
-1%
-3%
-12%
3%
-5%
6%
Community service or volunteer work
Done
-1%
-7%
-4%
0%
11%
-1%
-7%
0%
13%
Participate in a learning comm. or other formal
program where groups of students take two or more
classes together
Done
-4%
-3%
1%
-10%
-6%
-1%
-5%
3%
-4%
Foreign (additional) language coursework
Done
9%
4%
11%
9%
5%
1%
8%
4%
17%
Study abroad
Done
0%
5%
-3%
1%
1%
-2%
5%
0%
0%
Independent study or self-designed major
Done
0%
3%
-2%
9%
-2%
0%
-2%
1%
0%
Culminating senior experience (capstone course,
senior project or thesis, comprehensive exam, etc.)
Done
0%
15%
-1%
13%
3%
-3%
-1%
-1%
15%
Encouraging contact among students from different
economic, social, and racial or ethnic backgrounds
Quite a
bit/very
Much
-1%
5%
-1%
-4%
0%
2%
-7%
18%
-9%
Enriching Educational Experiences
SBA
FR
SEHS
SR
FR
SEHS
SR
FR
Nursing
Engineer
Comp Sci
SR
FR
SR
FR
SR
FR
SR
Used an electronic medium to discuss or
complete an assignment
Often/
V Often
-2%
4%
4%
6%
-1%
-23%
-4%
26%
4%
-2%
0%
-7%
Had serious conversations with students of
a different race or ethnicity than your own
Often/
V Often
0%
1%
-5%
-2%
4%
-13%
-4%
-5%
18%
3%
-6%
-18%
Had serious conversations with students
very different from you in terms of
beliefs/opinions
Often/
V Often
-5%
-2%
-6%
0%
3%
-14%
0%
-6%
7%
-4%
0%
-13%
Practicum, internship, field experience,
co-op experience, or clinical
assignment
Done
-1%
-13%
-2%
20%
-1%
-12%
6%
25%
0%
-2%
-1%
-6%
Community service or volunteer work
Done
-2%
-7%
4%
10%
2%
13%
3%
4%
-9%
-12%
-7%
-21%
Partic in a learning comm/other formal
program where groups take 2 or more
classes together
Done
2%
-5%
11%
11%
4%
-3%
7%
17%
-4%
-5%
-5%
-14%
Foreign (additional) language coursework
Done
-3%
-3%
-12%
-17%
3%
13%
-18%
11%
3%
6%
0%
4%
Study abroad
Done
-2%
-2%
-2%
-3%
2%
4%
0%
0%
-3%
11%
5%
-2%
Independent study or self-designed major
Done
-2%
-6%
-1%
-8%
3%
-3%
1%
1%
0%
1%
-2%
3%
Culminating senior experience (capstone
course, senior project/ thesis, comp. exam,
etc.)
Done
-1%
-6%
-1%
-12%
-1%
-2%
2%
0%
-1%
15%
3%
8%
Encouraging contact among students from
different economic, social, and racial or
ethnic backgrounds
Quite a
bit/very
Much
-8%
2%
7%
4%
-1%
-4%
0%
0%
-8%
-9%
-5%
-6%
Student Satisfaction
Arts &
Humanities
FR
SR
Social Sciences
Sciences
FR
SR
FR
SR
Communicatn/J
Pre- ournalism
Profs
FR
FR
SR
Overall, how would you evaluate the quality of
academic advising you have received at your
institution?
Good/
Excellent
-2%
0%
-22%
3%
10%
6%
1%
-18%
-4%
How would you evaluate your entire educational
experience at this institution?
Good
/Excellent
8%
-2%
-10%
-8%
8%
3%
1%
6%
0%
0%
-2%
-5%
-9%
-5%
-5%
-3%
-7%
-10%
If you could start over again, would you go to the SAME Probably/
INSTITUTION you are now attending?
Definitely yes
Student Satisfaction
SBA
FR
Overall, how would you evaluate the quality of
academic advising you have received at your
institution?
SEHS
SR
FR
SHS
SR
FR
Nursing
SR
FR
SR
Engineering
FR
SR
Computer
Science
FR
SR
Good/
Excellent
-2%
-2%
3%
-4%
3%
7%
0%
12%
-7%
3%
-11%
-15%
How would you evaluate your entire educational Good/
experience at this institution?
Excellent
3%
4%
1%
9%
-6%
0%
-1%
-3%
-16%
-8%
-11%
-23%
-2%
4%
8%
12%
-1%
2%
2%
-3%
-9%
-7%
0%
-17%
If you could start over again, would you go to the Probably/
SAME INSTITUTION you are now attending?
Definitely yes
Looking Inside
• What’s next?
• Questions?
• Thank you!