Transcript Student Experiences with Information Technology and their

Basic Reports and Data
Dissemination Strategies
Regional Users’ Workshop
October 6-7, 2005
Overview
 The NSSE Reports
 Means and Frequencies
 Benchmarks
 A deeper understanding
 Ways to break down the data
 How NSSE can help
 Special Analysis
 Peer Groups
 Data Dissemination – What and when to disclose to whom
NSSE Reports
 Institutional Report (Aug)
 Respondent
Characteristics
 Means
 Frequencies
 Annual Report (Oct)
 Benchmarks
 Benchmark
Recalculations
NSSE Reports: RCT
 A quick snapshot of
your institution
 Confirming if
sample is
representative
 Response Rate and
Sample Error
NSSE Reports: Means
NSSE Reports: Freqs
Benchmarks
 Benchmarks of Effective Educational Practice
 Level of Academic Challenge
 Active and Collaborative Learning
 Student Faculty Interaction
 Enriching Educational Experiences
 Supportive Campus Environment
 Compares to other institutions
Benchmark Recalculations
 Changes made to the
2004 Benchmarks
 Allows for comparisons
across time
 Some caveats
 SFI
 EEE
Reading you Data
 First steps -- Before the
survey
 Trial run; Have admin
take the survey as if they
were students
 Involves other people
and gets buy-in
 Think about what you do
well and what you need
to work on
 What questions do you
want answered and can
NSSE answer them?
Reading your Data
 Ask general questions first
 What confirms what you
suspected?
 What surprises you?
 How accurate was you sample
NSSE?
 Go back to you mock trials
 How accurate were folks?
 Where were they wrong?
 Look at trends as well as individual
items
 Group similar items
 Look at significance and effect
size
 Think about who your comparison
groups are
 Special Analysis?
 Go back to data set – there is more
variance within institutions than
between
 Highly engaged vs low
engaged
 Do different types of students
answer in different ways?
 Class
 Gender
 Race
A Deeper Look
 Accreditation Toolkits
 Tracking NSSE
Items to
Standards
 Can do the same
thing for mission
statements
A Deeper Look
 Use the mission
statement to create
your own
benchmarks
 Helps with buy-in as
well: can’t say its not
important if it’s in
the mission
A Deeper Look
 Comparisons by Demographics
 Comparisons over time
 Minority Students
 Program implementation
 Adult/Transfer Students
 First year students  Seniors
 Athletes
 Create your own benchmark scales
 Greek Students
 Technology
 By College or Department
 Spirituality/Ethics
 Comparisons by Behaviors
 Community Service
 Study Abroad
 High Faculty Interaction
 Oversampling?
 Satisfaction
 Diversity
 Other Surveys
 FSSE: Faculty/Student Comps
 BCSSE: Incoming Traits
 Outside Surveys: YFYC, HERI
 Internal Data: Retention, GPA
A Deeper Look
 Inter-institution Comps
 Selected Peers vs.
Consortium vs. Special
Analysis
 Selecting a peer group
 By mission
 By size
 By department
 By Race
 By Locale
 Current or Aspirant
Peers
 Selected Peers
 Before Administration
 No Additional Questions
 Institutional Level
 Consortium
 Before Administration
 Additional Questions
 Institutional Level
 Special Analysis
 Post-hoc
 No Additional Questions
 Institutional or Sub-group(s)
Level
Sample Reports
Student Time Usage - Hours Per Academic Year
600
500
400
Hours
Do c-Ext Universities
300
Do c-Int Universities
200
M aster’ s Co lleges and
Universities
Liberal A rts Co lleges
Urban Universities
100
0
In class
P reparing fo r
class
Wo rking o n
o r o ff
campus
P articipating
in co curricular
activities
Relaxing o r
so cializing
P ro viding
care fo r
dependents
Co mmuting
to class
Sample Reports
Student Faculty Interaction by Major and Dept.
60
Biochemistry
Lowest Major
Chemistry
Average
55
Theater or
Drama
Highest Major
Political
Science
Elem./Middle
Education
50
Pre-Med
Kinesiology
Chemical
Engineering
45
Environmental
Science
International
Business
Math
Speech
40
Physical
Education
Mechanical
Engineering
35
Pharmacy
Criminal
Justice
Management
Business
30
Sociology
Engineering
Other
Education
Professional
Arts &
Humanities
Social
Sciences
Biological
Sciences
Math &
Physical
Sciences
Sample Reports
Academic Challenge (Seniors)
100
90
80
Student Scores
70
60
66
70
68
65
50
40
30
20
10
0
Public Institution 1 Public Institution 2 Private Institution Private Institution
1
2
Sample Reports
100%
90%
80%
77%
70%
60%
55%
Highly Engaging
43%
50%
40%
29%
Average
32%
30%
16%
20%
10%
0%
Prompt Faculty
Feedback
Talk to Faculty
Discuss Ideas
About Career Plans Outside of Class
with Faculty
Supportive Campus Environment (First-Year Students)
% Responding Institution Emphasizes Very Much or
Quite A Bit
% Responding Very Often or Often
Student-Faculty Interaction (First-Year Students)
100%
89%
90%
80%
76%
70%
59%
Highly Engaging
60%
47%
50%
40%
41% Average
30%
30%
20%
10%
0%
Academic
Non-academic
Social
Sample Reports
Second Semester GPA by Engagement
3.3
3.3
3.2
3.2
3.2
3.2
3.2 3.2
3.2
3.1
3.1
3.1
3.1
3.1
3.1
3.1
3.1 3.1
3.1
3.1
3.1
3.2
3.1
3.0
3.0
3.0
3.0
2.9
2.9
2.9
2.8
2.7
2.6
Level of Academic
Challenge
Academic and
Collaborative
Learning
Student Interaction
w ith Faculty
Very Low
2.9
2.9
3.1
3.1
3.0
Low
3.1
3.1
3.1
3.1
3.0
Average
3.1
3.2
3.1
3.0
3.1
High
3.2
3.2
3.2
3.2
3.2
Very High
3.2
3.3
3.1
3.1
3.1
Enriching Educational Supportive Campus
Experiences
Environment
Sample Reports
Engagement by Cumulative GPA, Seniors
6.0
4.9
4.0
3.4
3.3
2.6
3.1
3.4
2.3
2.0
2.0
1.2
0.9
0.3 0.6
1.2
0.6
0.5
0.2
0.1
0.0
-2.0
-0.6
-1.1
-0.3
-0.6
-0.8
-2.0
-0.1-0.3
-2.1-2.0
-4.0
-3.5
-3.9
-6.0
-6.1
-8.0
Level of Academic
Challenge
Academic and
Collaborative Learning
Student Interaction with
Faculty
Enriching Educational
Experiences
Supportive Campus
Environment
up to 2.5
0.3
2.0
-2.0
-6.1
-3.9
2.51-3.0
0.6
3.3
1.2
-3.5
-0.6
3.01-3.25
-0.6
2.6
-0.8
-2.1
-0.3
3.26-3.5
-1.1
3.4
0.6
-2.0
0.5
3.51-3.75
0.1
3.1
2.3
0.2
-0.1
3.76-4.0
0.9
3.4
4.9
1.2
-0.3
Data Dissemination
 Provide Teasers
 Faculty
 Come to class unprepared
 Two or more drafts
 Received prompt
feedback
 Hours preparing for class
 Student Affairs/Student
Government
 Hours in co-curricular
 Providing support socially
 Had serious conversations
with those different from
you
 Study Abroad Office
 FY: Plan to study abroad
 SN: Did Study Abroad
 First Year Exp.
 Satisfaction of
participants vs. not
 Residence Life
 Engagement on-campus
vs. off-campus
 Teaching and Learning
 Memorizing vs. Applying
 Class Presentations
 Contributed to Learning
on your own
Some Decisions
 How publicly to share
 On Campus
 Off Campus
 Website
 US News
Some Decisions
 What are you going to do about
it?
 What’s you Mission?
 Involving students
 Accreditation
 College or Department level
vs. Institutional Level
 Annual Planning or Goal
Setting
 Timeline-When to do NSSE
again?
Thank you
 What experiences have you had on your
campuses?
 Questions?
 Share your stories with NSSE!