Transcript Test Test Test Test - Indiana University

Christopher
Cyphers2006
NSSE and Accreditation Self-Study
Christopher Cyphers, Ph.D.
Provost
School of Visual Arts
New York, New York
Christopher
Cyphers2006
SVA at a glance
Location: Manhattan
Carnegie: Specialized
Degrees: BFA, MFA, MTA, MPS
Physical plant: 675,000 ft2
Beds: 1,100
First-time, full-time freshmen: 661
% female: 56.6
% full-time: 100
% in-state: 34.8
% on campus: 65.4
% international: 10.6
States represented: 36
Countries represented: 14
UG enrollment: 3,100
GR enrollment: 407
% female: 52.6
% full-time: 93.4
% on campus: 32.8
% international: 13.4
States represented: 45
Countries represented: 47
First-time persistence rate
(2005 cohort): 86.4%
First-time graduation rate
(2000 cohort): 65%
Christopher
Cyphers2006
Demand for greater accountability
Christopher
Cyphers2006
. . . but not just from official bodies
Christopher
Cyphers2006
Greater emphasis on assessment
Learning in the major
Co- and extracurricular learning
Written, oral, critical thinking,
analytical skills
Foundation for lifelong learning
Academic advisement
Student support services
Christopher
Cyphers2006
The assessment universe
Christopher
Cyphers2006
Let’s do it
You commit to administering NSSE
You achieve a healthy response rate
You receive your results in a smart and tidy package
You proudly take your results binder to your president, and he says:
Christopher
Cyphers2006
Christopher
Cyphers2006
Okay. . . . Now what?
“This is great. . . what do we do with it”?
Christopher
Cyphers2006
Why NSSE?
Focused on students’ academic and student life experience,
better than comparable instruments.
NSSE embraced by Middle States Commission on Higher
education.
Numerous opportunities to benchmark institution’s data against
peer groups.
NSSE generated benchmark scores, “standardized” so as to
Comparisons over time.
Christopher
Cyphers2006
Comparative value of NSSE data
Institutional Scores Across Time
First-Year versus Seniors
Institutional Scores Against Peer Groups
Christopher
Cyphers2006
How does SVA compare to. . .
SVA
Independent Art Schools
(AICAD)
NSSE-Selected
Carnegie Peers
All NSSE Respondents
Christopher
Cyphers2006
Linking NSSE data to other data
sources
Institutional Date
NSSE Data
Other Assessment
Data
Multidimensional
Dataset
Christopher
Cyphers2006
Use of NSSE for Middle States
accreditation
Standard 7: Institutional
Assessment
Standard 9: Student Support
Services
Standard 10: Faculty
Standard 11: Educational
Offerings
Standard 12: General
Education
Standard 14: Learning
Outcomes Assessment
Christopher
Cyphers2006
Institutional assessment
Using mean scores to make
comparisons across peer groups
Christopher
Cyphers2006
What to consider
Effect size
Statistical
significance
Class year
Christopher
Cyphers2006
Student support services
NSSE Items: Students’ perception of institutional
emphasis (1=very little, 2=some, 3=quite a bit, 4=very
much)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Providing support to help you succeed academically.
FY
SR
2.82
2.75
3.01*
2.81
3.02**
2.99***
2.99*
2.87
Encouraging contact among students from different
backgrounds.
FY
SR
2.55
2.48
2.62
2.31
2.52
2.44
2.57
2.40
Helping cope with non-academic responsibilities.
FY
SR
1.94
1.77
2.02
1.80
2.15**
2.03**
2.13*
1.91
Providing support needed to thrive socially.
FY
SR
2.12
1.96
2.26
1.93
2.34**
2.21**
2.37**
2.14**
Attending campus events and activities.
FY
SR
2.63
2.47
2.90**
2.81***
2.75
2.59
2.75
2.57
Using computers in academic work.
FY
SR
3.16
3.41
3.20
3.38
3.26
3.44
3.32*
3.47
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
Student life
NSSE Items: Frequency with which student did the
following (1=never, 2=sometimes, 3=often, 4=very
often)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Attended an art exhibit, gallery, play, dance, or other
theatre performance.
FY
SR
3.21
3.12
3.06
3.16
2.03***
1.95***
2.10***
2.00***
Exercised or participated in physical fitness activities.
FY
SR
2.04
2.22
2.33**
2.42*
2.69***
2.60***
2.77***
2.70***
Participated in activities to enhance your spirituality
(worship, meditation, prayer).
FY
SR
1.69
1.77
1.80
1.86
2.17***
2.32***
2.09***
2.18***
Examined the strengths and weaknesses of your own
views on a topic or issue.
FY
SR
2.77
2.91
2.88
3.09*
2.53**
2.66***
2.57*
2.69**
Tried to better understand someone else’s views by
imagining how an issue looks from his or her
perspective.
FY
SR
2.89
2.98
3.06
3.14*
2.70*
2.78**
2.74
2.83*
Learned something that changed the way you
understand an issue or concept.
FY
SR
3.02
3.10
3.14
3.11
2.76***
2.82***
2.80**
2.87***
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
Personal development
NSSE Items: Experience at institution contributed to
the following areas (1=very little, 2=some, 3=quite a
bit, 4=very much)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Acquiring a broad general education.
FY
SR
2.69
2.74
2.77
2.68
3.05***
3.26***
3.12***
3.24***
Learning effectively on your own.
FY
SR
2.87
3.25
3.01
3.15
2.83
3.01**
2.85
3.00***
Understanding yourself.
FY
SR
2.87
3.12
3.03
3.09
2.68*
2.80***
2.71
2.78***
Contributing to the welfare of your community.
FY
SR
1.89
1.87
2.18**
2.02
2.33***
2.45***
2.34***
2.42***
Developing a deepened sense of spirituality.
FY
SR
1.86
1.92
1.84
1.68
2.13**
2.07
2.05
1.92
Voting in local, state, or national elections.
FY
SR
1.41
2.18
1.47
1.85***
1.85***
2.06
1.92***
2.10
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
Faculty
NSSE Items: Frequency with which students did the
following (1=never, 2=sometimes, 3=often, 4=very
often)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Discussed grades or assignments with an instructor.
FY
SR
2.50
2.67
2.73**
2.89**
2.64
2.87**
2.56
2.79
Talked about career plans with a faculty member or
Advisor.
FY
SR
1.97
2.71
2.11
2.63
2.18*
2.55
2.11
2.40***
Discussed ideas from readings or classes with faculty
member outside of class.
FY
SR
1.95
2.34
2.04
2.29
1.87
2.16*
1.81
2.08**
Received prompt feedback on academic performance
(written or oral).
FY
SR
2.69
2.91
2.83
2.79
2.61
2.85
2.58
2.76*
Worked harder than you thought to meet an
instructor’s standards or expectations.
FY
SR
2.74
2.99
3.04**
3.04
2.62
2.76**
2.58*
2.69**
(Positive) relationship with faculty members.
FY
SR
5.40
5.44
5.51
5.46
5.36
5.70*
5.19
5.42
Worked with faculty members on activities other than
coursework.
FY
SR
1.38
1.81
1.55*
1.79
1.66**
1.91
1.56*
1.81
Christopher
Cyphers2006
General Education
NSSE Items: Degree to which institution has
contributed to the following (1=very little, 2=some,
3=quite a bit, 4=very much)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Writing clearly and effectively.
FY
SR
2.43
2.47
2.54
2.40
2.99***
3.14***
2.95***
3.07***
Speaking clearly and effectively.
FY
SR
2.40
2.54
2.50
2.71
2.84***
3.07***
2.75***
2.96***
Thinking critically and analytically.
FY
SR
3.04
3.30
3.34***
3.37
3.14
3.34
3.16
3.33
Analyzing quantitative problems.
FY
SR
2.35
2.57
2.55
2.45
2.84***
3.05***
2.86***
3.02***
Using computing and information technology.
FY
SR
3.07
3.15
2.92
3.12
2.95
3.19***
2.92
3.14***
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
General education, II
NSSE Items: Time during the school year spent
reading and writing (1=none, 2=1-4, 3=5-10, 4=11-20,
5=20+)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Number of assigned textbooks, books, or book-length
packs of course readings.
FY
SR
3.11
2.82
3.00
2.73
3.14
3.13***
3.26*
3.18***
Number of books read on your own (not assigned) for
personal enjoyment or academic enrichment.
FY
SR
2.34
2.73
2.31
2.59
2.09**
2.21***
2.06**
2.21***
Number of written papers or reports 20 or more
pages.
FY
SR
1.23
1.38
1.22
1.32
1.28
1.67***
1.25
1.64***
Number of written papers or reports between 5 and
20 pages.
FY
SR
2.03
2.08
2.16
2.09
2.21*
2.57***
2.29***
2.59***
Number of written papers or reports fewer than 5
pages.
FY
SR
3.02
2.34
2.96
2.65***
3.03
2.90***
3.05
2.98***
To what extent have your examinations during the
current school year challenged you to do your best
work?
*p < .05, **p < .01, ***p < .001
FY
SR
4.96
5.22
5.51***
5.32
5.41***
5.51**
5.42***
5.41
Christopher
Cyphers2006
Assessment in the major or general
education
NSSE Items: Degree to which coursework has
emphasized the following ((1=very little, 2=some,
3=quite a bit, 4=very much)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Memorizing facts, ideas, or methods for courses and
readings so you can repeat them in pretty much the
same form.
FY
SR
2.38
2.16
2.33
2.08
2.87***
2.78***
2.87***
2.74***
Analyzing the basic elements of an idea, experience,
or theory, such as examining a particular case or
situation in depth and considering its components.
FY
SR
3.03
3.19
3.31***
3.27
2.99
3.19
3.06
3.22
Synthesizing and organizing ideas, information, or
experiences into new, more complex interpretations
and relationships.
FY
SR
2.88
3.18
3.17***
3.29
2.76
3.00**
2.83
3.01*
Making judgments about the value of information,
arguments, or methods, such as examining how
others gathered and interpreted data and assessing
the soundness of their conclusions.
FY
SR
2.90
3.14
3.06
3.08
2.78
2.95**
2.82
2.94**
Applying theories or concepts to practical problems
or in new situations.
FY
SR
3.03
3.39
3.27**
3.29
2.94
3.19**
2.98
3.17**
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
Overall satisfaction/quality of
relationships
NSSE Items: (1=poor, 2=fair, 3=good, 4=excellent)
Class
Year
SVA
AICAD
Carnegi
e
Peers
All
NSSE
Overall, how would you evaluate the quality of
academic advising you received at your institution?
FY
SR
2.86
2.91
2.93
2.76
3.01
2.99
2.94
2.82
How would you evaluate your entire educational
experience at this institution?
FY
SR
3.22
3.25
3.39*
3.23
3.10
3.19
3.16
3.19
If you could start over again, would you go to the
same institution you are now attending (1=definitely
no, 2=probably no, 3=probably yes, 4=definitely yes)?
FY
SR
3.37
3.32
3.39
3.21
3.10**
3.13*
3.20*
3.17*
Relationships with other students (1=unfriendly,
7=friendly, supportive, sense of belonging).
FY
SR
5.13
5.39
5.39
5.21
5.51*
5.78**
5.48
5.60
Relationships with faculty members (1=unfriendly,
7=friendly, supportive, sense of belonging).
FY
SR
5.40
5.44
5.51
5.46
5.36
5.70*
5.19
5.42
Relationships with administrative personnel and
offices (1=unfriendly, 7=friendly, supportive, sense of
belonging).
*p < .05, **p < .01, ***p < .001
FY
SR
4.46
4.41
4.66
4.32
4.79*
4.79*
4.60
4.50
Christopher
Cyphers2006
NSSE benchmark scores
Concise summaries of data along five
measurement scales
Christopher
Cyphers2006
Level of Academic Challenge
58
57.6
56
57.2
55.7 55.8
54
54.6
52
50
51.8
50.7
50.8
48
46
First-Year
SVA
AICAD
Seniors
Carnegie Peers
NSSE 2006
Christopher
Cyphers2006
Active & Collaborative Learning
60
50
40
49.2
43.3
42.7 41.3
46.1
51.4 52 50.4
30
20
10
0
First-Year
SVA
AICAD
Seniors
Carnegie Peers
NSSE 2006
Christopher
Cyphers2006
Student-Faculty Interaction
45
40
35
30
25
20
15
10
5
0
44.1 44.3 43.7
41.3
31.2
35.8 34.3
32.1
First-Year
SVA
AICAD
Seniors
Carnegie Peers
NSSE 2006
Christopher
Cyphers2006
Enriching Educational Experience
45
40
35
30
25
20
15
10
5
0
39
41 39.3 39.9
27.1 26.6 25.1 26.7
First-Year
SVA
AICAD
Seniors
Carnegie Peers
NSSE 2006
Christopher
Cyphers2006
Supportive Campus Environment
62
60
60.3
58
58.8
60.4
59.1
56
54
56.6
54.8
53.4
52
53
50
48
First-Year
SVA
AICAD
Seniors
Carnegie Peers
NSSE 2006
Christopher
Cyphers2006
Benchmark scores over time
Benchmark
Class
2003
2004
2005
2006
Level of
Academic
Challenge
FY
52.0
59.8
54.5
50.7
SR
49.9
54.5
53.6
54.6
Active &
Collaborative
Learning
FY
41.4
40.7
44.6
43.4
SR
41.0
42.0
42.3
46.1
StudentFaculty
Interaction
FY
35.0
35.7
39.2
36.7
SR
47.0
44.3
48.2
49.3
Supportive
Campus
Environment
FY
54.3
56.4
54.7
54.8
SR
51.5
54.6
57.2
53.4
Christopher
Cyphers2006
Dissecting benchmark scales
Level of Academic Challenge
(SVA)
Item 1
Item 2
Item 3
Item 4
Item 1
Major Field
Gender
Residence
GPA
First-Year Prgm
Item 5
Item 6
Christopher
Cyphers2006
Differences based on major
NSSE Benchmark
Clas
s
Advert
Anim
Computer
Art
Film/Vide
o
Cartoon
Fine Arts
Graphic
Design
Illustratio
n
Photo
Academic
Challenge*
FY
SR
53.9
9
62.1
3
53.2
9
54.4
7
52.43
49.98
51.48
50.50
48.43
42.43
43.39
60.60
52.46
58.91
46.50
55.06
46.39
52.29
Active and
Collaborate
Learning***
FY
SR
44.4
4
51.5
8
45.2
3
49.2
0
42.85
40.47
51.83
53.12
39.91
34.88
30.78
45.73
38.26
50.76
38.09
38.30
39.82
42.64
Student-Faculty
Interaction*
FY
SR
32.2
2
50.9
2
39.3
5
43.4
3
27.77
41.91
39.70
48.41
26.66
40.22
27.27
43.79
30.00
48.91
25.69
36.71
28.53
42.30
Enriching
FY
27.7
Educational
5
SR
Experience*
*p < .05, **p < .01, ***p < .001 36.5
7
29.0
3
44.4
8
25.77
35.10
33.89
42.17
25.58
29.36
24.42
38.97
28.13
40.76
20.98
33.98
24.27
42.85
Supportive Campus
Environment*
49.5
3
52.2
7
58.33
57.07
56.33
48.67
52.94
45.83
49.49
58.15
55.18
58.01
46.52
46.25
51.98
50.96
FY
SR
60.7
4
62.5
0
Christopher
Cyphers2006
Differences based on first-year
program
NSSE Benchmark
Clas
s
Common
Foundation
Departmental
Foundation
Academic Challenge
FY
SR
47.99
56.36
51.71
53.01
Active and Collaborate
Learning**
FY
SR
37.28
44.58
45.93
47.63
Student-Faculty Interaction
FY
SR
27.35
43.75
33.07
44.51
Enriching Educational
Experience
FY
SR
24.76
37.31
28.22
41.08
Supportive Campus
Environment
FY
SR
51.12
53.37
56.10
53.56
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
Differences based on Gender
NSSE Benchmark
Class
Female
Male
Academic Challenge
FY
SR
48.48
56.97
52.83
51.94
Active and Collaborate
Learning*
FY
SR
39.36
45.81
47.18
46.34
Persistence rates are generally
higher for men than women.
Student-Faculty Interaction
FY
SR
29.61
44.00
32.70
44.24
However, women enjoy a higher
6-year graduation rate.
Enriching Educational
Experience
FY
SR
26.12
40.57
28.02
37.24
Supportive Campus
Environment
FY
SR
51.48
55.18
57.99
51.36
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
Differences based on local residency
NSSE Benchmark
Class
Resident
Commuter
Academic Challenge
FY
50.37
50.18
Active and Collaborate Learning*
FY
42.14
43.48
Student-Faculty Interaction***
FY
30.94
30.87
Enriching Educational Experience**
FY
28.42
24.56
Supportive Campus Environment
FY
52.57
56.80
*p < .05, **p < .01, ***p < .001
Christopher
Cyphers2006
Christopher Cyphers
School of Visual Arts
209 East 23 Street
New York, NY 10010
[email protected]
212-592-2550