Transcript Slide 1
ADAPTIVE SYSTEMS Valerie Shute, Florida State University ARI Workshop on Adaptive Training Technologies, Charleston, SC (March 3-5, 2009) Shute, V. J. & Zapata-Rivera, D. (2008). Adaptive technologies. In J. M. Spector, D. Merrill, J. van Merriënboer, & M. Driscoll (Eds.), Handbook of Research on Educational Communications and Technology (3rd Edition) (pp. 277-294). New York, NY: Lawrence Erlbaum Associates, Taylor & Francis Group. Simple Logic Adaptive Content Diagnosis Assessment Evidence Definitions (foundation) Rationale (motivation) Four-process adaptive cycle (frame) Current technologies (hard & soft) Concrete example (via my bag) Future visions (briefly) Definitions 1. Adaptivity Refers to a natural or artificial system’s ability to alter its behavior (etc.) according to the environment. Adaptive technologies (hard/soft) allow an instructional system to alter its behavior according to learner needs (etc.). Typically linked with a learner model (see next slide). 2. Learner Model Representation of a learner, maintained by an adaptive system. Models can be used to give personalized assistance to individuals based on cognitive and noncognitive aspects of their profile. Learner models have been used in many areas, especially advanced educational and training systems. 3. Hard Technologies Eye tracking device Devices used in adaptive systems to capture learner info or present content. Used to detect performance data or affective states (e.g., boredom, excitement, confusion, etc.) or present stuff in a more accessible manner. Best when coupled with soft technologies (next slide). Talking tactile tablet 4. Soft Technologies Usually algorithms, programs, or envir’s that broaden the types of interaction between learners and computer. SMART MIM v 1.3 March 24, 2005 Loop as appropriate Classroom test or instructional unit For IDMS 8/2005 Release Classroom test or instructional unit Score report Individualized instruction Not proficient in some standard Mathematics Intervention Module 3 MC items per leaf topic Engaging Instructional Unit Locator Test Leaf topics sequenced from most mastered to least mastered Set initial Student Model values and sequence leaf topics for presentation Leaf Topic (Skill)1 Brief Instructional Object (Overview of skill area) For example, an adaptive algorithm can be used in a program to: (a) select a task that provides the most info about a learner, or (b) suggest additional resources tailored to the learner’s needs. E tasks Yes Student Model updated Detailed Instructional Object E Integrated Task Set 1 - 8 tasks integratingskills to reflect the standard as a whole. [Relationship to student model TBD] Student presented Hard E task Task scored No Tries = 3? Tries = 3? Student is provided targeted, progressive feedback Is the student's response correct? Yes Student is provided targeted, progressive feedback No Yes No Task scored Is the student's response correct? No Student Model updated Student presented Easy E task Teacher is provided with summary feedback Proficient in standard? Yes No Yes G tasks N tasks T tasks Add'l Practice Multiple-choice items, feedback limited to answers/ rationales Teacherselectable options: Leaf Topic 2 Leaf Topic 3 1: All students 2: Student choice 3. Do not deliver Leaf Topic n Standardlevel Instructional Recap Task Response Types: E = Equation | G = Graphic | N = Numeric | T = Textual Order within topic (skill) specified by topic, based on educational appropriateness = Optional (Teacher-selectable?) 5. Adaptive Systems Actual room temperature Heating/ cooling Desired temperature Temperature difference Thermostat heating/AC system AC systems monitor and adjust room temperature, and cruise-control systems monitor and adjust your car speed. Similarly, adaptive educational/training systems monitor important learner characteristics and make (or suggest) appropriate adjustments to support and enhance relevant competencies. 6. Goal of Adaptive Systems … to create a sound and flexible environment that supports learning for persons with a wide range of abilities, disabilities, interests, backgrounds, traits, states, etc. The challenge rests mainly on accurately identifying and estimating these learner variables then leveraging the info to improve learning/skill. Rationale Why Adapt? People differ across countless dimensions. Different dimensions are more/less suited for different types of instruction/training. Adaptive systems can enhance learning/skill via extra practice opportunities, alternative multimedia options (especially useful to those with disabilities), tailored instruction/training, etc. Adaptive systems are helpful/relevant in the world of business and education … And they are (and will be) of growing importance in terms of supporting U.S. Army’s evolving training needs. Adaptive Cycle 4-Process Adaptive Cycle Shute & Zapata-Rivera, 2008 Adaptive technology is intended to support learning (effectiveness, efficiency, and/or engagement). This requires accurate diagnoses. Learner info used as basis for content selection. Our 4-process cycle combines & extends: (a) a simpler 2-process adaptive model (Dx/Rx), and (b) a process model to support assessment (Mislevy, Steinberg, & Almond, 2003). 4-Process Adaptive Cycle Learner Model Analyze Select Capture Present Learner Alternative Cycles Scenario Description Complete All processes are exercised and cycle cycle (1, 2, 3, will continue until goals of the 4, 5, 6) instructional/training activity have been met. Modifying Learner allowed to interact with the the model learner model. The nature of the (1, 2, 3, 4, 5, interaction and effects on the learner 6, 9) model can vary (e.g., overwriting the value of a particular variable). Monitoring Learner continuously monitored; info is path (1, 2, 3) analyzed and used to update learner profiles. This path spins off to a 3rd party (e.g., surveillance system, profiling for risk-analysis). Short (or Adaptation based on info gathered from temporary) the latest interaction(s) between learner memory and the system. No permanent LM is cycle (1, 7, 5, maintained. 6) Learner Information Diagnosis Over Time Communication: Agents/Learners Each agent maintains a personal view of the learner. LM info and content can be distributed in different places. Agents can communicate with each other directly or through an LM server to share information that can be used to help the learner achieve learning goals. Overview of Technologies Analyze Select Capture • Performance data Present Quantitative Techniques Qualitative Techniques Cognitive Variables Noncognitive Variables • Eye-gaze tracker • Speech capture • Gesture/posture • Haptic devices • .... • Personalized content • Multiple representations • Bayesian nets • Machine learning • Accommodations • Stereotypes • • Plan recognition .... • Meaning equivalencies • .... Experts’ Views What to adapt? How to adapt? Cristina Conati What variables should be taken into account when implementing an adaptive system? What are the best technologies and methods that you use or recommend? Jim Greer Tanja Mitrovic Julita Vassileva Beverly Woolf What to Adapt? Learner variables Instructional variables Cognitive abilities (e.g., math skills, Feedback type (e.g., hints, reading skills, cognitive development stage, problem solving, analogical reasoning) explanations) and timing (e.g., immediate, delayed) Metacognitive skills (e.g., self- Content sequencing (e.g., concepts explanation, self-assessment, reflection, planning) and learning objects as well as tasks, items, or problems to solve) Affective states (e.g., motivation, Scaffolding (e.g., support and fading as attention, engagement) warranted, rewards) Additional variables (e.g., View of material (e.g., overview, personality, learner styles, social skills such as collaboration, perceptual skills) preview, and review as well as visualization of goal or solution structure) How to Adapt? Approach Rationale Probability and decision theory Rule-based approaches often used in adaptive systems, but using probabilistic LMs provides formal theories of decision making for adaptation. Decision theory takes into account uncertainty in both model assessment and adaptation outcome, & combines it with formal representation of system objectives to identify best actions. Concept mapping To adapt content (e.g., sequences of concepts, learning objects, hints) to the learner, employ a concept map with prerequisite relationships, an overlay model of the students’ knowledge, and a reactive planning algorithm. Unsupervised machine learning Most existing LMs built by relying on expert knowledge (either for direct model definition or labeling data) to be used by supervised machine learning techniques. But expert knowledge can be very costly, and for some innovative applications such knowledge may be nonexistent. Alternatively – use unsupervised machine learning to build LMs from unlabeled data using clustering techniques for defining classes of user behaviors during environment interactions. Challenges The main barriers to moving ahead in the area of adaptive technologies include the following: Valid LM Increase ROI Obtaining useful and accurate learning info on which to base adaptive decisions. Maximizing benefits to learners while minimizing costs associated with adaptive technologies. Control/Privacy Addressing issues relating to learner control (of environment and LM) and privacy. Grain size Figuring out the bandwidth problem (re: scope of learner data). Example Flow & Grow Shute, V. J., Ventura, M., Bauer, M. I., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, M. J. Cody, & P. Vorderer (Eds.), The Social Science of Serious Games: Theories and Applications. Philadelphia, PA: Routledge/LEA. Games to Learning Games Flow Engagement Learning but… Games lack assessment infrastructure Assessments determine what’s been learned Typical assessments disrupt flow Thus we need stealth assessments in games Evidence-centered design can accomplish this Stealth Assessment New advances in measurement let us to administer formative assessment (FA) during learning to Extract ongoing, multifaceted info from a learner Make accurate inferences of competencies React in immediate and helpful ways. When FA is so seamlessly woven into the fabric of the learning environment that it’s invisible, this is stealth assessment. Introducing Assessment Design Competency Model What do you want to say about the person? Evidence Model What observations would provide best evidence for what you want to say? Task/Action Model Model What kinds of tasks let you make the necessary observations? Design & Diagnosis Assessment Models & Metrics Competency Evidence Stat Model Task Evidence Rules Capture Analyze Monitor & Diagnose Success Competency Model: Organization of competencies & claims to be made about students, and current mastery estimates. Evidence Model: Criteria or rubrics for evidence of claim (i.e., specific student performance data; observables). Task Model: A range of templates and parameters for task development to elicit evidence needed for the evidence model. Elder Scrolls IV Oblivion Elder Scrolls IV: Oblivion First person 3D RPG set in a medieval world Can be one of many characters (e.g., knight, mage, elf), each who has (or can obtain) various weapons, spells, and tools Primary goal—gain rank & complete quests (like America’s Army) Quests may include locating a person to obtain info, figuring out a clue for future quests, etc. Multiple mini quests along the way, and a major quest that results in winning the game (100s of hr of game play) Players have the freedom to complete quests in any order Quests: Problem Solving In Oblivion (like AA), problem solving plays a key role in quests since the player has to figure out what to do and how to do it. Problem solving often viewed as the most important cognitive activity in everyday & professional contexts, but it’s seldom explicitly assessed or rewarded in formal instructional/training settings. Assessment and support of problem solving skills are very important to improve long-term learning potential. Quests: Persistence There are many character skills to improve in Oblivion which are frequency based (i.e., number of actions relative to a skill). Learning to play the game and developing skills require many hours of game play, and many hours of game play implies persistence—in the face of success and failure. Persistence has been shown to significantly predict achievement—in academic, business, and military worlds. Quests: Attention In many games (and combat games in particular), attention plays a key role in success. In Oblivion, you need to attend to factors such as: health, fatigue, enemy maneuvering, escape plan, etc. The central role of attention in learning has been demonstrated for decades. Oblivion Competency Model Success in Oblivion Cognitive Noncognitive Creative Problem Solving Attention Domain Knowledge Problem Solving Efficiency Working Memory Reading Comp Listening Comp Speaking Skill Persistence Creativity Novelty Reflection Exploratory Behavior Example ECD Models Competency Model Creative Problem Solving Unobservables Problem Solving Creativity Efficiency Novelty Evidence Model Scene 1 Scene 2 The Glue Action Model Scene 1 Observables Action Indicators Scene 2 Action Model with Indicators Problem: Cross river filled with dangerous fish to get to the cave on the other side. Relevant* Action Novelty Efficiency Swim across the river n = 0.12 e = 0.22 Levitate over the river n = 0.33 e = 0.70 Freeze water with a spell and slide across n = 0.76 e = 0.80 Find a bridge over the river n = 0.66 e = 0.24 Dig a tunnel under the river n = 0.78 e = 0.20 * Relevant refers to any action included in a successful solution. Indicators Per Action Novelty: 1 – frequency Efficiency: Inverse fn (resources, time) Action: Find a bridge over the river Indicators: Novelty = 1 - 0.34 = 0.66 Efficiency = 1 / [(3 × 0.4) + (5 × 0.6)] = 0.24 • Resources Used = Weapon (1, fight monster with sword) + Health (1, damage from monster) + Object (1, magic potion) = 3 resources (weight = 0.4) • Time expended = 5 minutes (weight = 0.6) Bayes Model—Case 1 CreativeProblemSolving Low 0.60 High 0.40 ProblemSolving Low 0.64 High 0.36 Creativity Low 0.11 High 0.89 Efficiency Low 0.86 High 0.14 ObservedEfficiency 0 to 0.25 1 0.25 to 0.5 0 0.5 to 0.75 0 0.75 to 1 0 0.20 ± 0.07 Low High Novelty 0.02 0.98 ObservedNovelty 0 to 0.25 0 0.25 to 0.5 0 0.5 to 0.75 0 0.75 to 1 1 0.78 ± 0.07 Dig a tunnel under the river: e = 0.20; n = 0.78 Bayes Model—Case 2 CreativeProblemSolving Low 0.18 High 0.82 ProblemSolving Low 0.12 High 0.88 Creativity Low 0.03 High 0.97 Efficiency Low 0.02 High 0.98 ObservedEfficiency 0 to 0.25 0 0.25 to 0.5 0 0.5 to 0.75 0 0.75 to 1 1 0.76 ± 0.07 Low High Novelty 0.01 0.99 ObservedNovelty 0 to 0.25 0 0.25 to 0.5 0 0.5 to 0.75 0 0.75 to 1 1 0.80 ± 0.07 Freeze water and slide across: e = 0.76; n = 0.80 Supporting “Grow” Bayes nets can be used in various ways to improve learning and performance. They continuously observe & integrate evidence of performance for accurate, real-time estimates of competencies. Info on competencies may be used by (a) trainers (to adjust instruction), (b) the system (to select new gaming experiences), and/or (c) trainees (to reflect on how they’re doing). Supporting “Grow” (cont.) Re: learning, current estimates of competencies can be integrated into the game and displayed as progress indicators. This elevates valued competencies to the same level as health & weapons! Example Summary To address military training challenges and harness the potential of immersive games, I presented an ECD-inspired idea which involved the following: • Specify valuable competencies to be acquired from the game • Define evidence models that link game behaviors to competencies • Update the learner model at certain intervals Next step—adapt content in the game to fit the current needs of player/learner. Future Visions Experts’ Future Visions Broad themes included: Lifelong learner models under control of each learner and with aggregation of info possible across models. Issues: privacy and user control of personal data, its use and reuse (Kay). Ecological approach to adaptivity, where environment contains repositories of artificial agents (representing learning objects) and personal agents (representing learners). Each agent maintains a model of other agents and users to help achieve its goals. Continuously accumulating info, with natural selection re: objects (McCalla). Getting benefits to exceed costs of adaptive technologies. Adaptivity is worthwhile within a restricted range of settings, so it’s important to identify settings and conducting good adaptive experiments (Jameson). Judy Kay Gord McCalla Anthony Jameson Overall Summary Evaluation Studies Needed. To advance adaptive systems, we need controlled evaluations of technologies and systems (e.g., Shute, Hansen, & Almond—You can’t fatten a hog by weighing it, or can you?). Such studies will let us gauge the added value of expensive technologies in relation to important outcomes. What / How to Adapt? Traits targeted for adaptation should clearly improve the pedagogical effectiveness of the system. This depends on if (a) a trait is relevant to achieve system goals, (b) there’s enough variability on the trait to justify personalization, and (c) there’s sufficient knowledge on how to adapt to learner diffs on the trait. Human beings, viewed as behaving systems, are quite simple. The apparent complexity of our behavior is largely a reflection of the complexity of the environment in which we find ourselves. ~Herbert A. Simon Capture Gathering personal (cognitive and noncognitive) info about the learner as she interacts with the environment. Get Back Analyze The creation and maintenance of a learner model. Typically the info is represented in terms of inferences on current states. In the 4-process figure, it’s the smaller human icon (i.e., the LM). Get Back Select Info (i.e., content in the broadest sense) is selected according to the LM and goals of the system (e.g., next learning object, test item, type of feedback). This process is used to determine how & when to intervene. Get Back Present Special delivery! Based on results from the select process, specific content is presented to the learner. This involves using different media, devices, and technologies to efficiently and effectively convey info. Get Back