Innovations In Online Proctoring

Presented By: Rick Beaudry, CEO

, B Virtual Inc

D

ENIS

G

RAVELLE

Director, Continuing Education and Workforce Development, School of Applied Technology 416-675-6622 ext. 4447 [email protected]

W

HAT

Y

OU

’

LL

L

EARN

1. Factors & Trends 2. Emerging Best Practices in Live Online Proctoring Today 3. Q&A

S

TAY FLEXIBLE

& C

URRENT

A

CKNOWLEDGE THE NEED

B

ECOME A VOICE ON CAMPUS

TRUE OR FALSE:

The largest growth in education globally will be online

61% of students have taken at least one course online

•

“…. the number of students who take classes exclusively on physical campuses will plummet, from , according to a new forecast released by market research firm Ambient Insight.”

Lou Woodruff, Caveon

•

1,000,000 students using laptops for testing in 2011

•

2,000,000 by end of 2012

TRUE OR FALSE:

Universities & Colleges are now competing without borders

Online Journal of Distance Learning Administration, Volume VI, NumberIII, Fall2003 State University of West Georgia, Distance Education Center

•

Students are shopping for courses that meet their schedules and circumstances.

• Students’ demand is being supported and answered. In 1998, 83% of governors identified “allowing students to obtain education anytime and anyplace via technology” as a critical characteristic of universities in the twenty-first century.

TRUE OR FALSE:

How Students choose to “Learn” and to access learning is rapidly changing

T

HE

G

EN

Y F

ACTOR

All about me…me me me!!!

What

Clayton M. Christensen

Says

• Self Study online is

increasing

• Customized Learner Choices

on the rise

• Online learning will account for

50%

the “seat miles” by 2018 of ~ Clayton M. Christensen

S TUDENTS ARE LOOKING FOR A CHOICE

REGULATORY ENVIRONMENT

Quote from Higher Ed Opportunity Act of 2008

: Institutions that offer distance education must "have processes through which the institution establishes that the student who registers in a distance education or correspondence education course or program is the same student who participates in and completes the program and receives academic credit."

P OLICY S TATEMENT FROM SACSCOC

(Southern regional accrediting association - one of the regional accrediting bodies) 1. At the time of review by the Commission, the institution must demonstrate that the student who registers in a distance or correspondence education course or program is the same student who participates in and completes the course or program and receives the credit by verifying the identity of a student who participates in class or coursework by using, at the option of the institution, methods such as: (1) a secure login and pass code, (2) proctored examinations, and (3) new or other technologies and practices that are effective in verifying student identification.

http://www.sacscoc.org/pdf/Distance%20and%20correspondence%20policy%20final.pdf

• of any projected additional student charges associated with the verification of student identity at the time of registration or enrollment.

US Dept of Education

- Federal financial aid requirements, in order to quality for students to receive federal aid, the university must: • •

602.17 Application of standards in reaching an accrediting decision

.

(g) Requires institutions that offer distance education or correspondence education to have processes in place through which the institution establishes that the student who registers in a distance education or correspondence education course or program is the same student who participates in and completes the course or program and receives the academic credit. The agency meets this requirement if it- • (1) Requires institutions to verify the identity of a student who participates in class or coursework by using, at the option of the institution, methods such as- • • • • (i) A secure login and pass code; (ii) Proctored examinations; and.

(iii) New or other technologies and practices that are effective in verifying student identity; and (2) Makes clear in writing that institutions must use processes that protect student privacy and notify students

Ultimately, all institutions will interpret the HEA requirements and put processes in place to comply with them. However, there is much more to academic integrity than just meeting the current requirements of the HEA.

“The train has left the station”

Bob Hansen, CEO UPCEA

TRUE OR FALSE:

Testing delivery will continue to transform and innovate for the distance learner

T

HE

‘B

USINESS

’ • The race for more distance learners • Expanded Access • Meeting regulatory requirements • A Student-Centric Approach for all Learners • Immediate results • 24 x 7 scheduling • Anywhere Anytime • Efficiencies • Reduced Costs?

Institutions want/need to provide evidence to accreditation agencies that their online programs have integrity

Institutions want/need a manageable, integrity-based solution for proctoring online exams and/or servicing their GROWING population of distance learners

A

UTHENTICATION

& E

XAM INTEGRITY

Blackboard recently announced that a service is being made available through Acxiom that will periodically and randomly present real time challenge questions to the test-taker (i.e., in 1998 you lived at one of the following three addresses. The pitch is that along with Blackboard’s username and password, these challenge questions will ensure that the correct person is taking the test.

Right Student is in the room

Authentication without exam integrity

TRUE OR FALSE:

Processes for Proctoring Online / Remote should be different?

L IVE P ROCTORED E XAMS ...from the comfort of the student’s home.

L

IVE

O

NLINE

P

ROCTORING

D

EFINED

P

EOPLE

P

ROCESS

T

ECHNOLOGY

Basic Control procedures – Randomized tests – Only log in once, or only proctor can log in – Proctors are managed, trained, audited – Immediate feedback if questionable behaviour – Immediate help if technical challenges – Everything is recorded – video, audio, computer

M

OST

I

MPORTANT

?

• Student Experience?

• Schedule, Interaction, Ease, BRAND • Validity of Results?

• Authentication, Integrity, Content Protection • Stay Current • Technology, regulation, learner preferences

P

EOPLE

• S ELECTED , T RAINED , M ONITORED • Screened for required competencies • Trained in detecting aberrant behavior online • Technically skilled to solve problems quickly • Customer Service focused for seamless student exam experience

S

CHEDULING

& S

YSTEM TESTING

• Seamless scheduling – Web Portal • Group scheduling in time blocks • Centralized “Phone In” scheduling • Simple “test’ to eliminate technical issues

E

XAM

D

AY

• Click to Connect • Authenticate • “”X” Point Inspection” plan for guiding students through online exam process • Shift exam initiation responsibility to proctor quickly

I

NTEGRATED

O

NLINE

P

ROCESSES

• Communication channels during the exam • Consistency in auditing processes during exams • Transition of content to institution

W

HAT DOES STUDENT NEED

?

•Access to a Computer •Webcam •High Speed Internet

O

NLINE

P

ROCTORING

T

ECHNOLOGY

•Brand Promise - Perception is reality •Keeping it simple for students •Technology should increase the integrity of the online examination and proctoring solution, not become a barrier to it •Stay current

L

IVE

R

EMOTE

M

ONITORING

•Take Control Early • Computer Scanning •“Pinning” •Audio, video, live chat and phone • Controlled credentialing

A

UDIT

T

RAIL

•

Capture, log and store

•

Video, Audio, System Activity

Best Practice

Secure Technology Audit (STA) Visual Authentication (VAP) Continuous Rick Assessment (CRA) Random Environment Challenge (REC)

Best Practice Definition

Through our remote access software, we confirm application usage, monitor(s) access, and 3 rd party tools which may lead to aberrant behavior and compromise the online proctoring experience.

Requires proctors to authenticate students through photo identification and signature process Full life cycle auditing of aberrant behavior and potential for compromised proctored exams. This process includes independent audits of online policies.

In-proctoring process by which the proctor will test or challenge the environment that the student is in. This includes audio review, as well as web cam movement to insure exam integrity.

Multi Modal Authentication + Monitoring + Recording

Authentication WTH exam integrity

• Voice Recognition • Simple to deploy. • No upfront costs. Per session fee of a few dollars.

• Minimize the chance of software malfunction.

• In combination with video, ensures we know the person is the same person that will then answer the exam questions. • Voice matching, video, password and live computer and environment monitoring.

• Allow for contingency if biometrics test is a “fail”

• Review Program Design • Review Testing Design • Stakeholder Review/Changes (pre-pilot) • Student Pilot Online Proctoring • Feedback/Review/Changes • Go Live • Student/Proctor Feedback • Random Audits • Continuous Improvement (includes technology & regulations)

International Exam Strategy Loyalist Certification Services •Over 150,000 learners in 38 countries •On-demand scheduling and rescheduling •Governing body regulations •Aberrant behavior •Brand and process consistency

Y

OUR

R

OLE

?

•“Become the EXPERT on campus…..You be the one to bring the message forward” • Lou Woodruff, Caveon August 3, 2012 11:55pm •Frame the debate on campus •Partner versus Threat – An Extension of the Campus Facility?

•Don’t Pause • Audit, monitor, continuous Improvement

•

Guidelines for Good Practice in Proctoring

•

(Human Proctoring) WCET’s Academic Integrity and Student Authentication CIG

TRUE OR FALSE:

Testing will continue to transform for the distance learner

INSPIRING SUCCESS AND INNOVATION THROUGH TRUST AND PARTNERSHIPS

Established in 1999 Offices in Atlanta and Toronto Recognized as an innovation leader in every industry where we do business

S tep ONE – Visit the “Live Online Proctoring Center” (You branded Portal)

S tep TWO – Schedule Your Exam

Click on the “Schedule Your Exam” from the portal above (see Step ONE) Student lands on the Scheduling Page

S tep THREE – Confirm Technical Requirements

S tep FOUR – TEST Your System

Student chooses “Test Your System” from the portal (see portal from Step ONE )

S tep FIVE – Start Your Exam

Choose "Start Your Exam” from the portal (see portal in Step ONE)

S tep SIX – Proctor Takes Control of Your Computer Immediately

Proctor Opens Exam Room

T echnical Support at Any time – Choose “Contact Support” 24x7x365

I nstructor Adds Exam Information Online