Student Experiences with Information Technology and their
Download
Report
Transcript Student Experiences with Information Technology and their
Basic Reports and Data
Dissemination Strategies
Regional Users’ Workshop
October 6-7, 2005
Overview
The NSSE Reports
Means and Frequencies
Benchmarks
A deeper understanding
Ways to break down the data
How NSSE can help
Special Analysis
Peer Groups
Data Dissemination – What and when to disclose to whom
NSSE Reports
Institutional Report (Aug)
Respondent
Characteristics
Means
Frequencies
Annual Report (Oct)
Benchmarks
Benchmark
Recalculations
NSSE Reports: RCT
A quick snapshot of
your institution
Confirming if
sample is
representative
Response Rate and
Sample Error
NSSE Reports: Means
NSSE Reports: Freqs
Benchmarks
Benchmarks of Effective Educational Practice
Level of Academic Challenge
Active and Collaborative Learning
Student Faculty Interaction
Enriching Educational Experiences
Supportive Campus Environment
Compares to other institutions
Benchmark Recalculations
Changes made to the
2004 Benchmarks
Allows for comparisons
across time
Some caveats
SFI
EEE
Reading you Data
First steps -- Before the
survey
Trial run; Have admin
take the survey as if they
were students
Involves other people
and gets buy-in
Think about what you do
well and what you need
to work on
What questions do you
want answered and can
NSSE answer them?
Reading your Data
Ask general questions first
What confirms what you
suspected?
What surprises you?
How accurate was you sample
NSSE?
Go back to you mock trials
How accurate were folks?
Where were they wrong?
Look at trends as well as individual
items
Group similar items
Look at significance and effect
size
Think about who your comparison
groups are
Special Analysis?
Go back to data set – there is more
variance within institutions than
between
Highly engaged vs low
engaged
Do different types of students
answer in different ways?
Class
Gender
Race
A Deeper Look
Accreditation Toolkits
Tracking NSSE
Items to
Standards
Can do the same
thing for mission
statements
A Deeper Look
Use the mission
statement to create
your own
benchmarks
Helps with buy-in as
well: can’t say its not
important if it’s in
the mission
A Deeper Look
Comparisons by Demographics
Comparisons over time
Minority Students
Program implementation
Adult/Transfer Students
First year students Seniors
Athletes
Create your own benchmark scales
Greek Students
Technology
By College or Department
Spirituality/Ethics
Comparisons by Behaviors
Community Service
Study Abroad
High Faculty Interaction
Oversampling?
Satisfaction
Diversity
Other Surveys
FSSE: Faculty/Student Comps
BCSSE: Incoming Traits
Outside Surveys: YFYC, HERI
Internal Data: Retention, GPA
A Deeper Look
Inter-institution Comps
Selected Peers vs.
Consortium vs. Special
Analysis
Selecting a peer group
By mission
By size
By department
By Race
By Locale
Current or Aspirant
Peers
Selected Peers
Before Administration
No Additional Questions
Institutional Level
Consortium
Before Administration
Additional Questions
Institutional Level
Special Analysis
Post-hoc
No Additional Questions
Institutional or Sub-group(s)
Level
Sample Reports
Student Time Usage - Hours Per Academic Year
600
500
400
Hours
Do c-Ext Universities
300
Do c-Int Universities
200
M aster’ s Co lleges and
Universities
Liberal A rts Co lleges
Urban Universities
100
0
In class
P reparing fo r
class
Wo rking o n
o r o ff
campus
P articipating
in co curricular
activities
Relaxing o r
so cializing
P ro viding
care fo r
dependents
Co mmuting
to class
Sample Reports
Student Faculty Interaction by Major and Dept.
60
Biochemistry
Lowest Major
Chemistry
Average
55
Theater or
Drama
Highest Major
Political
Science
Elem./Middle
Education
50
Pre-Med
Kinesiology
Chemical
Engineering
45
Environmental
Science
International
Business
Math
Speech
40
Physical
Education
Mechanical
Engineering
35
Pharmacy
Criminal
Justice
Management
Business
30
Sociology
Engineering
Other
Education
Professional
Arts &
Humanities
Social
Sciences
Biological
Sciences
Math &
Physical
Sciences
Sample Reports
Academic Challenge (Seniors)
100
90
80
Student Scores
70
60
66
70
68
65
50
40
30
20
10
0
Public Institution 1 Public Institution 2 Private Institution Private Institution
1
2
Sample Reports
100%
90%
80%
77%
70%
60%
55%
Highly Engaging
43%
50%
40%
29%
Average
32%
30%
16%
20%
10%
0%
Prompt Faculty
Feedback
Talk to Faculty
Discuss Ideas
About Career Plans Outside of Class
with Faculty
Supportive Campus Environment (First-Year Students)
% Responding Institution Emphasizes Very Much or
Quite A Bit
% Responding Very Often or Often
Student-Faculty Interaction (First-Year Students)
100%
89%
90%
80%
76%
70%
59%
Highly Engaging
60%
47%
50%
40%
41% Average
30%
30%
20%
10%
0%
Academic
Non-academic
Social
Sample Reports
Second Semester GPA by Engagement
3.3
3.3
3.2
3.2
3.2
3.2
3.2 3.2
3.2
3.1
3.1
3.1
3.1
3.1
3.1
3.1
3.1 3.1
3.1
3.1
3.1
3.2
3.1
3.0
3.0
3.0
3.0
2.9
2.9
2.9
2.8
2.7
2.6
Level of Academic
Challenge
Academic and
Collaborative
Learning
Student Interaction
w ith Faculty
Very Low
2.9
2.9
3.1
3.1
3.0
Low
3.1
3.1
3.1
3.1
3.0
Average
3.1
3.2
3.1
3.0
3.1
High
3.2
3.2
3.2
3.2
3.2
Very High
3.2
3.3
3.1
3.1
3.1
Enriching Educational Supportive Campus
Experiences
Environment
Sample Reports
Engagement by Cumulative GPA, Seniors
6.0
4.9
4.0
3.4
3.3
2.6
3.1
3.4
2.3
2.0
2.0
1.2
0.9
0.3 0.6
1.2
0.6
0.5
0.2
0.1
0.0
-2.0
-0.6
-1.1
-0.3
-0.6
-0.8
-2.0
-0.1-0.3
-2.1-2.0
-4.0
-3.5
-3.9
-6.0
-6.1
-8.0
Level of Academic
Challenge
Academic and
Collaborative Learning
Student Interaction with
Faculty
Enriching Educational
Experiences
Supportive Campus
Environment
up to 2.5
0.3
2.0
-2.0
-6.1
-3.9
2.51-3.0
0.6
3.3
1.2
-3.5
-0.6
3.01-3.25
-0.6
2.6
-0.8
-2.1
-0.3
3.26-3.5
-1.1
3.4
0.6
-2.0
0.5
3.51-3.75
0.1
3.1
2.3
0.2
-0.1
3.76-4.0
0.9
3.4
4.9
1.2
-0.3
Data Dissemination
Provide Teasers
Faculty
Come to class unprepared
Two or more drafts
Received prompt
feedback
Hours preparing for class
Student Affairs/Student
Government
Hours in co-curricular
Providing support socially
Had serious conversations
with those different from
you
Study Abroad Office
FY: Plan to study abroad
SN: Did Study Abroad
First Year Exp.
Satisfaction of
participants vs. not
Residence Life
Engagement on-campus
vs. off-campus
Teaching and Learning
Memorizing vs. Applying
Class Presentations
Contributed to Learning
on your own
Some Decisions
How publicly to share
On Campus
Off Campus
Website
US News
Some Decisions
What are you going to do about
it?
What’s you Mission?
Involving students
Accreditation
College or Department level
vs. Institutional Level
Annual Planning or Goal
Setting
Timeline-When to do NSSE
again?
Thank you
What experiences have you had on your
campuses?
Questions?
Share your stories with NSSE!