Transcript slides
NSW Learning Analytics Working Group Meeting Plenary discussion: Academic analytics versus learning analytics – Rivals or complementary strangers Presented by Kathryn Bartimote-Aufflick Institute for Teaching and Learning, DVC(Education) Portfolio 30 June 2015 The University of Sydney Page 1 In pairs What’s your definition of… Academic analytics? Learning analytics? Business intelligence? Discuss, argue… iconarchive.com The University of Sydney Page 2 A taxonomy for analytics Learning analytics (LA) & educational data mining (EDM) Learner analytics & personalization Academic/instit Systemic utional improvement analytics Online activity events Individual students Whole Whole sector organization or a sub-unit Data Use existing data provenance e.g. LMS, MOOC Actively collect data Use existing data Actively collect data Data examples Learning (& other) styles, prior learning, socioeconomic status Student admissions, student records, finance, staff performance U.S. schools national/state longitudinal testing, teacher & student background information, teacher evaluations Page 3 Unit of analysis Access, learning materials usage, task completion, discussion/chat/wik i/blog participation, grades, interactions The University of Sydney A taxonomy for analytics (continued) Learning analytics (LA) & educational data mining (EDM) Learner analytics & personalization Academic/instit Systemic utional improvement analytics Detect patterns; analyze which patterns linked to achievement; design interventions (LA) or adapt the technology (EDM) to influence student activity and alter patterns Explore relationships between learner differences and persistence/achi evement; support or redirect students at risk Student progression to inform future admissions; productivity in central services; staff productivity; benchmarking Future ? Enhanced visual possibilities feedback for students & teachers; evidenceThe University of Sydney based actions Optimize for all students; over time; evidencebased measures Develop and share common metrics and models across institutions Type of work to date ‘Data-driven decision making’ by teachers, schools, districts; teacher valueadded models Page 4 References Chatti, M.A, Dyckhoff, A.L., Schroeder, U. & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5/6), 318-331. Piety, P.J., Hickey, D.T., & Bishop, M.J. (2014). Educational data sciences – Framing emergent practices for analytics of learning, organizations, and systems. Paper for the Learning and Knowledge Analytics (LAK) Conference 24-28 March 2014 in Indianapolis, USA. http://dx.doi.org/10.1145.2567574.2567582 Romero, C. & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics: Part C: Applications and Reviews, 40(6), 601-618. Siemens, G. (2012). Learning analytics: Envisioning a research discipline and a domain of practice. Paper for the Learning and Knowledge Analytics (LAK) Conference 29 April – 2 May 2012 in Vancouver, Canada. The University of Sydney Page 5 Group discussion Form groups Discuss the following 1. – What are some problems worth solving in this area? Select one to discuss in depth 2. 3. Learning analytics/educational data mining [back left] Learner analytics & personalization [back right] Institutional analytics [front centre] konaapplemac.com The University of Sydney – What data sources would be useful to gain insight into this problem? – What personnel skill sets would be needed to grapple with this problem? – What actions might be appropriate to address this problem? Page 6 Quick report back Key issues arising out of the discussion… Roadblocks? Promising new ideas? Points of overlap and collaboration? Thank you Simon Buckingham Shum (UTS) Panos Vlachopoulos (MQ) The University of Sydney Page 7 Next… Grant opportunities Analytics gatherings (Sydney internal) Educational Innovation Grants, close 27 Aug with earlier internal deadlines http://www.itl.usyd.edu.au/awards/educationa l_innovation_grants.htm #edtech talk Gregor Kennedy ‘Logging students: Understanding digital learning one click at a time’ Mon 27 Jul http://tiny.cc/v4dzzx (National) OLT , cross-institutional, close approx late Nov with earlier internal deadlineshttp://www.olt.gov.au/grants-andprojects/innovation-and-development Australian Learning Analytics Summer Institute (ALASI) 26-27 Nov, University of Sydney Learning Analytics & Knowledge (LAK) Conf 25-29 April 2016, University of Edinburgh, UK http://lak16.solaresearch.org/ Stay in touch – http://listserv.uts.edu.au/mailman/listinf o/nswlawg – [email protected] – @abelardopardo – @SoLAResearch The University of Sydney Page 8