Transcript Survey Manager Information Forum

Dr Noel Edge
Executive Director
Survey Managers’ Information
Forum (SMIF) 2012
Noel Edge
Executive Director
Julie-Ann
Pegden
(Curtin)
Joanne Tyler
(Monash)
Phil Aungles
(DIISRTE)
Marian Thakur
(TEQSA)
Release of DIISRTE’s AQHE Report/AGS Review:
• Pivotal development for GCA (much more tomorrow!)
• Key provisions:
• New instruments as from 2014 (AGS13 as per normal):
• Centralised administration of three instruments:
• UES (revised = current UES + some CEQ?)
• GOS (based on current GDS)
• Employer Survey (based on GCA’s current GOS?)
• Stratified sample based instruments (but possibly hybrid…)
• Online and phone instruments
• Wide sector consultation
• Earlier delivery of data
• Possible longitudinal survey (= BGS ?)
• Possible separate international onshore/offshore graduates
instrument
• Tender for central administration body – end of 2012
Jul-Dec 2012
Jan-Jun 2013
Jul-Dec 2013
Jan-Jun 2014
Jul-Dec 2014
Jan-Jun 2015
Instruments
UES
Full scale trial deployment
GOS
Development
Development
AGS
October round
April round
New central body
Establishment
Establishment
GCA
AGS
AGS
Full survey
Full survey
Full survey
Full survey
Full survey
Full survey
UES/GOS
UES/GOS
UES/GOS
UES/GOS
Administrators
ACER
UES
AGS12
AGS13
? AGS14 (not proposed at this time, but …)
Technology:
• New internal servers for increased reliability and data storage
capacity/security
• New GCA website (including an integrated START site) –
increased emphasis on GCA’s web presence with innovations
in social media and web site traffic innovations
• CEQuery software – addressing technical limitations of
CEQuery and planning improved functionality and data
dictionary extensions
BGS – Beyond Graduation Survey
• Follow-up to the AGS conducted three years and five years after
course completion
• 34 institutions participated in 2011
• Just completed the first 5 years out pilot survey
• Increased interest in the BGS:
• DIISR
(ie before DIISRTE) –
7 and 9 year follow up of PhD graduates
• DFaHCSIA (Office of Women) – gender wage gap research
GOS – Graduate Outlook Survey
• Survey of graduate employers
• Addresses recruitment practices, intake numbers, perceptions of
candidate quality, etc.
• More than 500 employers responded in 2011
• DIISRTE stole our GOS acronym and name! (see AQHE Report)
Austrade talks …
• Shanghai – career fairs:
• 15 Australian universities
• 45 graduate employers
• GCA introduced to chamber of commerce and alumni groups
• Possible site content sharing between Austrade and GCA
• Useful link for international graduate survey
Changing Focus, Priorities and Organisational Structure :
• Increase our engagement level with institutions (institution
research, careers services, students, researchers, …)
• Increase our strategic initiatives an emphasis on strategy, policy
and consultation
• Work closely with Higher Education decision makers in government
(DIISRTE, TEQSA, …), Universities Australia and other university
bodies, NAGCAS and employers to explore strategic directions in
both GCA’s Research and Graduate Opportunities (GO) operations
• So some changes to our internal organisation structure …
Graduate Careers Australia Ltd
Co. Secretary
Graeme B
GCA
Board
Policy, Strategy and Stakeholder
Relations Advisor
Bruce G
Exec.Director
Noel E
General Manager
Graeme B
Survey Reference
Group
Line Management
Advisory Role
Corporate
Services
GO
Operations
GCA
Communications
Research
Operations
Graeme B (General Mgr)
Chris M (Sales/Mkt Mgr)
Tina H (Comms/Pub’n Mgr)
Darren M (Team Leader)
•Info. Tech.
•Acct’g/Legals
•Web Strategies
•Hum. Resources
•Asset Mgt
•Office Admin.
•GO Sales
•UGO Sales
•Elec. Sales
•Career Fairs
•Sales Reporting
•Communications
•Publications
•Graphic Design
•AGS
•CEQuery
•BGS
•GOS
•Custom Jobs
•Research Dev’t.
•Jo O
•Isobel H
•Leena A
•Lisa G
•Jo K
•Hina K
•Graeme B
•David C
•Jessica A
•Nadine H
Research Team
Graeme
David
Bruce
Nadine
Darren
Jessica












Prof Joan Cooper – Convenor(University of New South Wales) *
Tim Sealey (Universities Australia)
Phil Aungles, Sam Pietsch, Chris Sainsbury (DEEWR/DIISRTE)
Leone Nurbasari (Australian National University)
Helen Jacob (Deakin University)
David De Bellis (Flinders University)
Prof Phillipa Pattison (University of Melbourne) *
Prof Carole Kayrooz (University of Canberra) *
Justine Fritsch (University of Southern Queensland)
Tanya Tietze (University of the Sunshine Coast)
Robert McCormack (University of Western Australia)
Dr Noel Edge, Bruce Guthrie (GCA)
* UA nominee
More than 400 presentations over three days
Dashboards
• IE reporting tool
• Best practice
Response rates
• Declining response rates to student surveys
• All respondents to receive incentive
• Personalise as much as possible

Carroll, D. 2011. An analysis of mode effects in the 2010 Course Experience
Questionnaire. Journal of Institutional Research, 16 (2), 1–12.



Abstract
Historically, responses to the Course Experience Questionnaire (CEQ) were required to be
collected by self-administered paper or online questionnaire to be eligible for official analysis.
CEQ responses collected by telephone were excluded from the final analysis file to minimise
the potential for bias due to mode effects: systematic variation in responses obtained using
different data collection methods. For the 2010 CEQ, however, telephone data collection was
permitted to maximise response rates, with responses collected in this manner included in the
final analysis file for the first time. In all, nearly ten per cent of all valid responses to the 2010
CEQ were collected by telephone, with institutional use of telephone data collection ranging
from 18 to 56 per cent of all responses received for that institution. Using regression and
matching methods, this paper seeks to identify mode effects in the 2010 CEQ data that cannot
be attributed to compositional differences between the telephone and self-administered
respondent samples. Implications for survey practice are also discussed.
Best Paper AAIR Conference 2011

Core 2011 AGS reports released
◦
◦
◦
◦
◦
◦
◦
Graduate Destinations
Graduate Salaries
Graduate Course Experience
Postgraduate Destinations
Postgraduate Research Experience
AGS Report
GradStats and GradFiles
(or soon to be):

2011 SMIF – Melb

GCA’s centralised data collection service for private
providers – 4 institutions

GCA’s telephone data collection service for
universities – 4 institutions

Activities of bachelor degree graduates (n=68,205), males
(n=26,112) and females (n=42,027), 2011 (%)
25

Graduates available for full-time employment (n=44,176), males
(n=17,671) and females (n=26,459) bachelor graduates, 2011 (%)
26

2011 Graduate Starting Salaries (GSS)
◦ All: $50,000 pa
◦ Males: $52,000 pa
◦ Females: $50,000 pa
27
CEQ mean percentage agreement by sex, 2011
28
2008
2011
63.5
Self-management
93.7
72.0
Problem solving
93.5
74.1
Teamwork
93.4
70.0
Communication
93.1
64.8
Planning and organising
92.2
81.8
Learning
57.7
Initiative and enterprise
86.3
58.9
Technology
0
20
40
60
92.2
83.2
80
100
%
Self-rated employability skills, high/very high, bachelor degree graduates in
full-time employment, by broad field of education, 2008 and 2011 (%)
29
1-500 employees
More than 500 employees
73.6%
Your organisation's website
93.9%
59.5%
University careers services
74.3%
57.1%
Employment websites (e.g. SEEK, CareerOne)
71.0%
37.4%
University careers fairs
75.2%
Graduate recruitment handbooks
20.2%
Other websites (e.g. Facebook, Linkedin)
19.6%
58.9%
37.4%
14.7%
Newspaper advertising
26.2%
12.9%
16.4%
Other
0%
20%
40%
60%
80%
100%
Methods used to promote graduate program, by organisation size, 2011 (%)
30
Graduate Opportunity (GO)
Directories
31


So … welcome All
Informal climate and an opportunity to meet
other survey managers and GCA staff - swap
tips, information, war stories, make
suggestions, … and enjoy
questions?
answers
suggestions…
comments!
Cue Cards
… coding
tips, …