Transcript National Survey of Student Engagement, 2008

New to UBC (NUBC)
Student Survey, 2009
Results for UBC-Okanagan
NUBC Overview






UBC participates in several surveys: NSSE, CUSC, Health,
Graduate Outcomes, etc.
The NUBC survey is our first attempt to measure the impact of the
first year experience for both direct entrants and transfer students
The survey asks students about their past experiences and
expectations for their first year at UBC
In February, we’ll survey the students again to measure the impact
of their first year experience – is it what they expected? Better than
what they expected? Worse than what they expected?
Survey items also help measure indicators related to students in
UBC’s strategic plan (e.g., high impact activities, global citizenship,
student awareness of diversity, etc.)
and, we also have some questions relating to process (admissions,
etc)
Survey Development
Survey questions include:



Specific questions developed for UBC’s learning environment and
strategic plan – contributions to survey from both Vancouver and
Okanagan
Most questions are of common interest to both campuses.
Questions from other survey instruments to help provide some
benchmarks (UCUES – University of California Undergraduate
Experience Survey which has been administered since 2003; CIRP
Freshman Surveys administered by the Higher Education Research
Institute at UCLA to freshman students across the U.S. since 1965
and CARES Survey administered at Florida Atlantic University
Survey Development
The survey was also developed to provide students
with a mechanism to seek additional information or
advice by way of pop-up questions

For example, students were asked if they planned to
work for pay during the upcoming year. If they said
‘no’, they moved on to the next question. If they said
‘yes’, another question was displayed asking if they
would like to be contacted with information about
on-campus work opportunities.

Follow up emails and/or contact was then initiated
with students where appropriate
Response Rates

Survey administered in August 2009 and closed September 15, 2009
(two reminders plus the original invite)

Administered to both UBC Vancouver and Okanagan Campuses, New
Students only, Direct entrants and Transfer students to Undergraduate
Degree Programs
Direct Entrants
Invited
Responded
Response Rate
UBCV
5435
3493
64.3%
UBCO
1352
861
63.7%
Total
6787
4354
64.2%
Invited
Responded
Response Rate
UBCV
2190
1357
62.0%
UBCO
518
322
62.2%
Total
2708
1679
62.0%
Transfer
How do response rates compare?
How does a response rate of 64% compare to other response rates?

In 2006, UBCO achieved a 47% response rate on the BSSE survey

However, once students start their studies, they are overwhelmed with
email communications and requests for survey participation leading to
survey fatigue

In 2008, the first year response rate for UBCO NSSE was 31%
We need to do a better job of coordinating survey requests and managing
email communications with students
Interpreting the Data

Responses are reported in the form of means and frequencies.

Important differences are identified by:
a) statistical significance (is the change unlikely to be simple chance
variation?) and
b) effect sizes

Effect size indicates the “practical significance” of the mean difference. In
practice, an effect size of .2 is often considered small, .5 moderate, and .8
large.
Summary of Findings:
UBCO Direct Entrants

Summary of Findings

Connections to the strategic plan

UBC compared to U.S. Peers

UBCO compared to UBCV

Student Priorities on improving the experience for incoming students

Next Steps
UBCO Direct Entrants:
Distribution by faculty
Direct Entrants Distribution of respondents by faculty:
Faculty
Frequency
Percent
% of cohort
APSO
85
9.9%
8.3%
ARSC
578
67.1%
67.9%
FCCS
24
2.8%
2.5%
HSD
53
6.2%
7.3%
MGMT
71
8.2%
8.8%
NRSG
50
5.8%
4.8%
861
100.0%
Total
Distribution of respondents by faculty is similar to distribution
of registrants by faculty
UBCO Direct Entrants:
Demographics
GENDER
Domestic
Women
486
36
522
60.6%
Men
295
44
339
39.4%
Total
781
80
861
100.0%
%
International
90.7%
9.3%
Total
%
100.0%
Ethnoracial groups (students could select more than one category)
N
%
Aboriginal
22
2.6%
White
647
76.4%
Chinese
75
8.9%
South Asian (e.g., East Indian, Pakistani, Sri Lankan, etc.)
42
5.0%
Black
15
1.8%
Filipino
17
2.0%
Latin American
12
1.4%
Southeast Asian (e.g., Vietnamese, Cambodian, Malaysian, Laotian, etc.)
5
0.6%
Arab
8
0.9%
West Asian (e.g., Iranian, Afghan, etc.)
5
0.6%
Korean
16
1.9%
Japanese
12
1.4%
Other
43
5.1%
Compare
with 4.3% for
the region
(Stats Can)
UBCO Direct Entrants: more demographics

80.2% learned English as their first language
(compare with 83% for the region).
 50.5% can speak two or more languages well
enough to conduct a conversation
 21.6% have lived in another country besides
Canada for at least one year
 50.2% have fathers who have completed a postsecondary degree and 48.3% have mothers who
have completed a post-secondary degree
(compare with 13% of the 35-64 years olds in
the region).
UBCO Direct Entrants: living and commuting


63.1% of the respondents planned to live on campus and of those
living off-campus, only 33% plan to use public transport
Of those who said they would be living on campus, 96% actually are
in student residences.
How do you plan to commute to UBC? (Select the mode of transport you will use
most often)
Vehicle (alone)
118
37.5%
77
24.4%
Walk
7
2.2%
Bicycle
7
2.2%
104
33.0%
2
0.6%
Vehicle (with others/carpool)
Public transport
Other
UBCO Direct Entrants: finances and work
Do you need a loan to finance your first year at
UBC?
100%
80%
60%
No
Yes
40%
20%
0%
Domestic
Intl
Of those who need a loan, 66% will rely on government student loans
UBCO Direct Entrants: finances and work
Do you have any concern about your ability to finance your
entire university education?
100%
Major (not sure I will have enough
funds to complete university)
80%
Some (but I probably will have enough
funds)
None (I am confident that I will have
sufficient funds)
60%
40%
20%
0%
Domestic
Intl
UBCO Direct Entrants: finances and work
During this coming year, do you plan to work (for pay)?
Count
%
No, I don't plan to have a job
325
37.8%
I plan to work less than 10 hours per week
247
28.7%
I plan to work between 11 and 20 hours per week
254
29.5%
I plan to work more than 20 hours per week
34
4.0%
Expectations about learning
On a scale of 1 to 5, where 5 is ‘strongly agree’, respondents seem to be very
positive about the learning environment
GENDER
F
My courses will be interesting
I see the value in each of the courses I will be taking this semester
I am confident that I have the ability to succeed in all of my courses
Note: results between male/female are not statistically significant
M
Valid N
518
333
Mean
4.29
4.29
Standard Deviation
0.9
0.84
Valid N
518
335
Mean
4.26
4.19
Standard Deviation
0.95
0.94
Valid N
521
336
Mean
4.26
4.35
Standard Deviation
0.89
0.85
Expectations about learning
….and respondents are also confident of their ability to achieve good grades.
Grade expectation for first year direct entrants
60.0%
50.0%
40.0%
30.0%
ubco
20.0%
10.0%
0.0%
80-100 (A-,
A, A+)
68-79 (B-,
B, B+)
55-67 (C-,
C, C+)
50-54 (D)
0-49 (F)
Expectations about learning
We know however that students are going to be very disappointed with their
actual performance
Grade expectation and actuals for first year direct entrants -UBCO
60.0%
50.0%
40.0%
expected in 2009
30.0%
actual in 2008
20.0%
10.0%
0.0%
80-100 (A-, 68-79 (B-,
A, A+)
B, B+)
55-67 (C-,
C, C+)
50-54 (D)
0-49 (F)
Actual grades in 2008 for first year only, registered in a minimum of 24 credits, undergraduate degree programs
Tutoring received and will need
Tutoring
Have had:
Will need:
English
75
8.7%
119
13.8%
Reading
43
5.0%
47
5.5%
212
24.6%
225
26.1%
Science
72
8.4%
130
15.1%
Second/Additional Language
52
6.0%
87
10.1%
Writing
58
6.7%
171
19.9%
7
0.8%
21
2.4%
Mathematics
Other
Areas of concern
Very concerned
Somewhat
concerned
Not concerned
Count
Row N
%
Count
Row N
%
Count
Row N
%
166
19.3%
414
48.2%
279
32.5%
78
9.1%
247
28.8%
533
62.1%
Getting into my first choice of major
128
14.9%
350
40.8%
380
44.3%
My ability to do the coursework
169
19.7%
488
56.7%
203
23.6%
Getting the academic advising I need
122
14.2%
444
51.7%
293
34.1%
Getting the career and professional advising I need
150
17.5%
435
50.6%
274
31.9%
Getting the personal counseling I might need
43
5.0%
238
27.7%
579
67.3%
Getting along with my roommate (s), housemate (s), or family
members
85
9.9%
314
36.5%
461
53.6%
Being able to make the kind of friends I want
142
16.5%
376
43.7%
343
39.8%
Being away from family and friends; being 'homesick'
114
13.3%
282
32.9%
462
53.8%
Being able to maintain good health
117
13.6%
334
38.8%
410
47.6%
Being able to cope with expectations of parents and family
141
16.4%
323
37.5%
397
46.1%
My personal safety in and around campus
48
5.6%
155
18.0%
657
76.4%
If UBCO is the right choice for me
79
9.2%
258
30.0%
523
60.8%
Financing my education at UBCO
Being accepted for who I am
Ability to balance academic and non academic time
How confident are you in your ability to balance your academic time (in class, study
time, etc.) and non-academic time (work, exercise, socializing, care for dependents,
etc.)
Frequency
Valid
Missing
Total
Not confident
Percent
21
2.4
Somewhat confident
534
62.0
Very confident
305
35.4
Total
860
99.9
System
1
861
Of those who responded ‘not confident’, 17 or 81% asked for additional
information to be sent to them to help them achieve balance
Proficiencies as they relate to the strategic plan
If students rate their proficiencies in the following areas as very good to
excellent, how would UBC enhance / utilize these skills?
On a scale of 1 to 6 where 6=excellent
N
Mean
Std.
Deviation
Ability to appreciate, tolerate and understand racial and
ethnic diversity
856
5.38
.808
Ability to appreciate the fine arts (e.g., painting, music,
drama, dance)
853
4.90
1.183
Ability to appreciate cultural and global diversity
859
5.29
.837
Ability to take personal social responsibility
856
5.13
.813
High Impact Activities
Participate in:
Did
do
Intend to
do
student leadership activities
449
52.1%
336
39.0%
research activities
354
41.1%
357
41.5%
co-op education
103
12.0%
370
43.0%
59
6.9%
400
46.5%
volunteer work
656
76.2%
452
52.5%
community service as part of a class
432
50.2%
287
33.3%
political activities
109
12.7%
200
23.2%
tutoring or teaching other students (paid or voluntary)
351
40.8%
251
29.2%
internship or practicum
High Impact Activities
Travel to an international location:
Intend
to do
Did do
as part of school organized sport
218
25.3%
218
25.3%
for leisure
550
63.9%
512
59.5%
to participate in community/voluntary service
161
18.7%
370
43.0%
55
6.4%
350
40.7%
237
27.5%
460
53.4%
for work
for education
Mental Health
Indicate if you have felt any of the following this past year:
N
%
Overwhelmed by all I had to do
574
66.7%
Depressed
169
19.6%
Very lonely
124
14.4%
Extremely anxious
260
30.2%
Very angry
71
8.2%
40% of respondents selected extremely anxious and/or depressed
How concerned are you that these feelings will
persist during your first year at UBC?
N
%
Very concerned
65
9.3%
Somewhat concerned
407
58.3%
Not very concerned
226
32.4%
Would you like to receive an e-mail about the
services on campus that could help you?
N
%
Yes
237
51.0%
No
228
49.0%
1 in 4 students actually asked for help
Comparisons between UBCV and UBCO
Financing first year and concerns about ability to finance entire education similar
80% of UBCO respondents learned English as their first language compared to 46.2
at UBCV
76.4% self-identified as ‘white’ ( 37.8% at UBCV)
50% have fathers who have completed a post-sec degree (66.2% at UBCV)
21.6% have lived in another country for at least one year (48.4% at UBCV)
63% plan to live on campus (50% at UBCV)
Of those not living on campus, only 33% plan to use public transport (84% at UBCV)
Similar on expectations for courses and self assessment with respect to diversity and
social responsibility
Comparisons between UBCV and UBCO
Grade expectation for first year direct entrants
70.0%
60.0%
50.0%
40.0%
ubco
ubcv
30.0%
20.0%
10.0%
0.0%
80-100 (A-,
A, A+)
68-79 (B-,
B, B+)
55-67 (C-,
C, C+)
50-54 (D)
0-49 (F)
Comparisons between UBCV and UBCO
Top three areas where UBCO students are ‘very concerned’:
My ability to do the coursework
169
19.7%
Financing my education at UBCO
166
19.3%
Getting the career and professional
advising I need
150
17.5%
UBCV student concerns are similar although getting into first choice major
rates higher than financing education and more students at UBCV tend to be
‘very concerned’
Recruitment and Admissions – choice of university
How many post-secondary institutions did you apply to for Fall 2009?
N
%
only 1
283
33.1
2
213
24.9
3
181
21.1
4 or more
179
20.9
Total
856
100.0
Which best describes your situation when you applied for admission to UBCO?
N
%
UBCO was my first choice.
350
41.1
UBCO was my first choice, but I applied to other institutions to see what they would offer.
175
20.5
I did not have a first choice; I decided to wait until I heard back from all institutions before
making a decision.
179
21.0
38
4.5
I did not apply to UBCO. I was not admitted to my preferred program at UBCV and
accepted an alternate offer of...
110
12.9
Total
852
100.0
UBCO was a back-up option, since I preferred to attend another institution.
61.6% had UBCO as their first choice
Recruitment and Admissions -- Communication
I was pleased with the frequency with which UBCO communicated with
me.
N
%
Strongly disagree
17
2.0
Disagree
61
7.1
Agree
445
51.8
Strongly Agree
303
35.3
33
3.8
859
100.0
Didn't do it / Not Applicable
Total
I was able to have questions answered quickly and thoroughly.
N
%
Strongly disagree
21
2.5
Disagree
70
8.2
Agree
410
47.8
Strongly Agree
269
31.4
87
10.2
857
100.0
Didn't do it / Not Applicable
Total
Recruitment and Admissions -- Communication
Which best describes your situation when you received your offer from UBCO?
N
%
I received UBCO's offer later than most of my other decisions, and
did not have enough time to consider it seriously.
30
5.3
I received UBCO's offer later than most of my other decisions, but
nonetheless I did have enough time to give it...
176
30.9
I received UBCO's offer at about the same time as most of my
other decisions.
236
41.5
I received UBCO's offer first.
127
22.3
Total
569
100.0
Recruitment and Admissions – Decision to Apply
Decision to Apply
To no extent
To some
extent
To a large
extent
Living in Kelowna
28%
29%
43%
Distance of UBCO from home
31%
28%
40%
Ability to transfer to the UBC Vancouver campus
34%
30%
36%
UBCO's overall reputation
16%
50%
35%
Good preparation for jobs and careers
21%
48%
32%
Positive word of mouth from friends, family and counsellors
20%
52%
29%
Quality of academic experience
21%
51%
28%
Good preparation for graduate and professional schools
27%
45%
28%
Size of the campus
31%
43%
26%
Quality of overall experience
24%
52%
25%
Offer of scholarship / financial assistance
43%
37%
19%
The cost of attending UBCO compared to other choices
46%
34%
19%
Study Abroad/Exchange programs
52%
30%
18%
Friendliness of campus community
34%
48%
18%
My UBCO program's reputation
37%
45%
18%
Commute time
51%
33%
17%
My parents wanted me to come here
53%
32%
15%
On-campus housing assignment
55%
32%
13%
Rankings in national magazines
57%
31%
12%
A visit to the campus
62%
27%
11%
Co-op programs
58%
32%
11%
Information from recruiters
54%
37%
9%
UBCO is the only university that has the specific program that I am interested in
68%
23%
9%
Research opportunties
57%
35%
8%
UBCO's website
50%
42%
8%
UBCO's focus on global citizenship
60%
32%
8%
Internship and practicum programs
58%
34%
8%
UBCO's publications
66%
31%
3%
The athletic dept recruited me
92%
6%
2%
Decision to apply and decision to attend
Respondents top five reasons for attending UBCO were the same as
the top five reasons for applying to UBC





Living in Kelowna
Distance of UBCO from home
Ability to transfer to the UBC Vancouver Campus
UBCO’s overall reputation
Good preparation for jobs and careers
Of those who said ‘living in Kelowna’, 43% are from the Okanagan school
district and 28% are from outside BC (mostly Alberta and Ontario)
Re ‘ability to transfer to UBC Vancouver’ is one of the top five reasons provided
by non-Lower Mainland students
What are respondents looking forward to the most?
Students were asked to identify two areas that excited them the most
about the upcoming year





Meeting new people
New environment
Interesting classes
Living alone; change of environment
Clubs and new experiences
What are respondents concerned about the most?
Students were asked to identify two areas that worried them the most about
the upcoming year



Doing well; maintaining good grades
Social environment; making friends
Being homesick
 Finances
 Course load; being able to maintain a balance between academic and non
academic
 Overall ability to succeed
What can UBC do to improve the first year experience?






Better web site (s); information is difficult to find
Help with course selection/registration
“More user friendly ssc”
Better communication; more informative emails
Quicker response to emails/questions
Provide check lists of what’s required
What can UBC do
to improve
the first year experience?
Student
comments
I had a hard time figuring out which classes I was expected to take
during my first year, and ended up just getting advice from a second
year student at UBCO who I'm friends with. If there's any way to
make that clearer for new students? That's the only thing I'd
suggest.
Student Service Centre needs to be more knowlegable, bring
more languaus to UBCO (greek, latin)
Registering for courses is like playing tetris with your timetable. It's
really hard to do for someone who hasn't been showed anything.
Makes it really hard to be satisfied with how you think your school
year is going to go.
More media to give prospective students a clearer view of the
beautiful campus and the campus life they'll experience, because it
was a major selling point for me.
I participated in a Campus tour on a Saturday, and most of the
buildings were locked up
What can UBC do to improve the first year experience?
More student comments






Student advisors should contact the students more frequently during the admission
process as well as before and during registration. The actual admission of students
should also happen sooner (February or March as opposed to May. OttawaU accepted
students in December.) so as to make it easier for students to make a well thought out
decision when choosing between universities.
I think that first year students should get more help wits time to schedule for classes. It
took me a long time to schedule classes and I had alot of confusion with not knowing
what classes were the right choice for me.
More explanation of how system works,how to select classes, what to do to get set up
properly, etc.
Have more information on the size of the dorm rooms and what csn fit in them for new
students on your website
Get your website to a usable level, and train your service people so they can
ACCURATELY answer questions. I had to struggle on many occasions with different
service people who had no clue what they were doing. Honestly, the experience of
getting into UBCO was extremely unpleasant. UVIC students have had no problems
with registration or anything, and their website is better than UBCO's.
I received more email messages from other schools that I had applied to about the
application process and about upcoming deadlines. I would have liked to have received
more emails regarding application process and status from UBCO.
Next Steps

Analyze student comments

Analyze data for transfer students

Provide NUBC data to deans at faculty level

Drill down on some questions by gender, international

Use NUBC as the stimulus for improving processes

Focus NUBC discussion to align with institutional strategic goals (Trek
2010)

Design survey instrument for February follow up

Next year?