Transcript Unified Model with Neuro emphasis (SLRF 2012)

From Models to Methods:
Linking L1 and L2 Theory to
Web-Based Learning
Brian MacWhinney
Psychology, Modern Languages, and LTI
Carnegie Mellon University
http://talkbank.org/slrf.ppt
1
Outline
1. L1 & L2: Similar or Different?
2. Why is L2 attainment so variable?
• L1 learning is pretty variable too
3. The Competition Model Approach
•
•
•
risk factors, protective factors
competition, maps, connections, transfer,
participation
explicit / implicit learning interplay
4. Tests in the Field
Unified Model
2
CPH  FDH
•
The Critical Period Hypothesis (CPH)
•
•
•
•
central evidence for UG
evident to the "person in the street"
but it has many evidential problems.
The Fundamental Difference Hypothesis (FDH) is
more interesting
•
•
•
•
•
Bley-Vroman: UG is dead
Clahsen & Felser’s shallow structure hypothesis (SSH)
Kuhl’s Perceptual Magnet
Paradis/Ullman declarative/procedural
Brain changes (Neville, Friederici)
Unified Model
3
FDH  FSH
•
•
•
•
•
The Fundamental Similarity Hypothesis (FSH)
L1 and L2 use the same cognitive and social
resources and processes
The target is the same
Competition is still the fundamental organizing
principle
What differs is the constellation of the resources
Unified Model
4
Competition
•
Competition is fundamental:
•
•
•
•
•
Darwin, Edelman, Chicago Economics
Minsky, Eagleman – Society of Mind
PDP
Competition Model, Sociolinguistics
Competition
• brain areas are multifunctional
• multiple pathways lead to processing
• horse races
• indeterminacy
• variability
• indeterminacy
Unified Model
5
The Classic Model circa 1987
•
•
•
•
Form-function mapping
Competition
Cue validity, reliability from corpora
Cue strength measures in experiments
Unified Model
6
Functions compete for forms
Forms compete for functions
Unified Model
7
Thanks to ...
Patricia Brooks
Michèle Kail
Jared Leinbach
Stan Smith
Janet McDonald
Yvan Rose
Ping Li
Melita Kovacevic
Gordana Dobravac
Johannes Wagner
Julia Evans
Yoshinori Sasaki
Yanhui Zhang
Nora Presson
Angel Chan
Csaba Pléh
NIH
Elizabeth Bates
Angel Chan
Beverly Wulfeck
Christophe Parisse
Dan Slobin
Hasan Taman
Hong Li
Igor Farkas
Joseph Stemberger
Klaus Köpcke
Jeffrey Sokolov
Natasha Tokowicz
Richard Wong
Xiaowei Zhao
Yanping Dong
Yun Zhao
Zhou Jing
NSF
Unified Model
Antonella Devescovi
Vera Kempe
Colleen Davy
Roman Taraban
Elena Pizzuto
Phillip Pavlik
Arturo Hernandez
Sanako Mitsugi
Maryellen MacDonald
Kerry Kilborn
Ovid Tzeng
Reinhold Kliegl
Yuki Yoshimura
Anat Prior
Laura Morett
MacArthur Foundation
8
Findings
•78
Competition Model studies in 18 languages
(http://psyling.psy.cmu.edu/papers)
•In adults, cue strength is determined by cue
reliability
•Children begin with prototypes and availability,
but shift to reliability
•Online processing focuses on single strong cues
with later integration
•Perspective taking impacts processing (mental
models)
Unified Model
9
Extensions
•
•
•
•
•
•
•
•
1989: Added cue cost
1987-2012: Online measures
1995: Focus on dynamics of L2 learning
2000: Links to neural processing
2005: DevLex II
2007: Extensions to fluency
2010: Stress on early prototypes – Leipzig
2010: Risks-protections model
Unified Model
10
The Unified Competition Model
Risk Factors Basis
ProtectiveFactors
Basis
Entrenchment
Cortical Maps Resonance
Hippocampus
Misconnection
White Matter
Proceduralization
Thalamus, BG
Parasitism
Transfer
Internalization +
Inner Speech
Isolation
Social
Stratification
Participation
Group
Inclusion
Unified Model
11
Component Theories
Competition
interactive activation, Bayes
Maps
entrenchment, SOM
Connectivity
imaging, topological encoding
Transfer
markedness, explicit feedback
Chunking
fluency, proceduralization, IBPs
Resonance
PDP, hippocampus, scheduling
Internalization
inner speech, embodied cognition
Participation
codes, groups, stratification
12
Risks
•
•
•
First we will examine the risks that L2
learners face and their basis
Then we will examine the protective factors
and their basis
Finally, we will consider how we increase
the strength of the protective factors
Unified Model
13
Risk #1: Map Entrenchment
•
•
Maps are in areas of CORTEX
Maps self-organize (SOM)
Unified Model
14
Maps (Subsystems)
Subsystem
Area
Audition
STG, IPG
Processes
Theory
Extracting
phonemes
BA44, motor cortex Targets, timing
Statistical learning
Lexicon
STG
RH coding
Phonology to
meaning
DevLex
Syntax
BA45,47
Slots, sequences
Item-based patterns
Mental Models
BA47, DLPFC,
MTG
Deixis, Perspective Perspective, Roles
Participation
Social system
Topics, turn-taking Conversation
Analysis
Articulation
Resonance, gating
23
DevLex - Ping Li
24
Entrenchment
50, 100, 250, and 500 words
Unified Model
17
L2 part-of-speech mismatches
•
•
•
L1 Navajo will have classifiers, discontinuous
aspect-verb, impersonal verb-adjectives, nouns
decomposed into spatial relations
Navajos learning German must deal with
prepositions, phrasal verbs, gender, case, etc.
In general L1 and L2 will not be an exact
match
18
Risk #2: Misconnection
Organizing Connectivity is the
Brain's Basic Challenge
19
Detail from
•
•
•
•
DTI (Schneider, MGH)
MEG underconnectivity in autism (Just,
Ghuman)
Cortico-cortical evoked potentials (CCEP) Bookheimer, Matsumoto, others
Gamma band coherence analysis
Unified Model
20
Ten Major Fiber Pathways in the
Human Brain - Schneider
Unified Model
21
Connections are White Matter
•
Rewiring local areas is easier than rewiring
distant connections
• Work on children with focal lesions, palsy
• Connections emerge during embryogenesis
•
•
A third of the brain is connections
Interaction of hemispheres is also based on
connections across the corpus callosum
Unified Model
22
Connections between Maps
Somatotopic, tonotopic, retinotopic, locotopic
organization works to guide connections.
Receiving area must understand map of
sending area.
Some areas, like the thalamus, only need to
relate priorities between areas.
Communication also involves temporal
synchronization.
10
Wernicke-Geschwind
Connection Model
24
65
Hickok-Poeppel
Speech Processing Model
25
Competition Model
•
Production
•
•
•
•
•
DLPFC mental models activate PT constructions
PT constructions (IBPs) gate STG lexicon
Lexicon also receives input from mental models
STG lexicon gates BA44 and motor output
Comprehension
• Auditory input activates STG lexical competition
• BA45 pattern competition gated by STG input
• Mental models take input from lexicon, syntax,
and conversation model
26
Roles in Mental Models
Mental
Model Roles
action
recur
object
Item-based
patterns
want
more
X=milk
Temporal DevLex Maps
Unified Model
27
Frontal Models – Koechlin
Unified Model
28
Integrated processing
•
•
Production and comprehension use same
maps and connections, but in different
configurations (Kempen)
Emphasis on gating and connections, rather
than movement of information
29
Risks
•
•
•
•
•
#1-Entrenchment and #2-Misconnection
L1 maps "know" what to connect to.
In L2, maps will not align completely,
otherwise L2 learning would just be
vocabulary extension.
Major long-distance connections cannot
regrow.
Connections can become tangled during
embryogenesis.
30
Risk #3: Parasitism and Transfer
“turtle”
translation route
“tortuga”
direct route
Unified Model
31
Entrenchment and bilingualism
Simultaneous Bilingualism
LX
LY
balanced
Successive Bilingualism
L1
L2
dominates
Unified Model
32
The Problem
•
•
•
Again: If L1/L2 areas were isomorphic, L2
learning would be nothing but new
vocabulary learning
Also, fluency would not be impaired,
because the connections would be smooth
But languages mismatch radically, so
parasitism leads to both negative transfer
and lessened fluency
Unified Model
33
Principles of Transfer
•
Competition Model claims:
• Everything that can transfer will.
• Transfer follows markedness
• Transfer is strongest when mismatch cannot be
detected
•
Semantics and perspective transfer well (except when
there are wide cultural differences as in Pirahã, Japanese).
•
Phonology transfers, but not so cleanly and there must be
rearranging and readjustment.
•
Morphosyntax and IBP cannot easily transfer.
•
Unmarked FBP transfers: S + V
• Marked FBP goes back to IBP: Adv + V + S
Unified Model
34
L1 supports L2
Tokowicz & MacWhinney 2005
Su abuela cocina/*cocinando muy bien.
Her aunt cooks/*cooking very well.
Unified Model
35
Tolentino & Tokowicz 2011
•
•
•
•
•
Parallel structures show parallel ERPs
Different structures show different ERPs
Late AoA subjects show more attention
SSH (Clahsen) not supported, learners start
to approach native speaker ERP profiles
N400 to P600 to ELAN shifts
Unified Model
36
Interim Summary
•
•
•
Maps, Connections, and Parasitism pose
Risks to L2 learners
Without reorganization, L2 will suffer from
disfluency and negative transfer
But there are Protective Factors that can
trigger successful reorganization
• resonance (cortical reorganization)
• proceduralization (connection reorganization)
37
Protection #1: Resonance
Interactive Activation and Gangs
Units that fire together, wire together
3
38
Hippocampal Support
Wittenburg et al. 2002
39
Scheduling:
Graduated interval recall
•Pimsleur
67
Unified Model
40
Varying Consolidation
Timescales
•
•
•
•
•
Gaskell, Davis – overnight consolidation
Avi Karni has shown that decline in implicit
learning in adulthood is erased by naps
Rats show retrograde amnesia for days
HM and others showed retrograde amnesia
for weeks, even years (Squire TV study)
So, the hippocampus may be continually
involved in consolidation
Unified Model
41
Resonant Methods
• Semantic field elaboration: textbook units
• Morphological analysis, etymology
• Mnemonics, keywords
• Multiple representations: phonological and
orthographic, subtitles
• Phonological recoding (script dependent)
• Radical learning in CJK scripts
• Staying in L2 (Internalization)
42
Protection #2: Chunking
•
•
•
•
Lexical chunks short-circuit problems with
IFG – STG connectivity and mapping
Phrases: por lo mucho que _, it reminds
one of __
Idioms, frozen forms
Compounds, poems, rhymes
• Donau_dampf_schiff_fahrt_gesellschafts_haup
t_stellvertretender_kapitän
• Rockabye baby on the tree top ...
Unified Model
43
Protection #3: Proceduralization
Time
Routing
Operation
1
Routing
Operation
2
Region 1
Region 2
Region 3
A representation
The same
representation
A transformed
representation
The transformed
representation
Unified Model
44
With practice
Time
New
routing
Operation
Region 1
Region 2
Region 3
A representation
A representation that
has been processed
Unified Model
45
Proceduralization
Unified Model
46
Acquiring Fluency
•
•
Disfluency: Omissions, errors, substitutions
stuttering
Increasing fluency by
• cutting out stages
• creating a single chain
•
•
•
•
Item-based patterns (IBPs) as the backbone
Getting timing right within IBP chain
Synchronizing with other processes
General age-related declines impact
proceduralization more than resonance
Unified Model
47
Protection #4: Internalization
•
•
•
•
We build up mental models through
perspective-taking.
Comprehensible input -- L2 speaker can
construct a coherent mental model.
The Communicative Approach can promote
internalization
Internalization produces whole-brain
resonance
Unified Model
48
Risk #4: Isolation
•
•
•
•
•
•
Insufficient comprehensible input and
output
Peer-group exclusion
Immigrant group insulation
Role entrenchment
Ascendance of international English
Work commitment
Unified Model
49
Protection #5: Participation
• Identity Theory:
• identifying with the L2 culture
• identifying with particular L2 members
• Extroversion/Introversion
• Group alignment: Danish handball team,
church membership
• Immigrant sweet spot of 8-13 Cathy
Caldwell-Harris
37
Unified Model
50
Similar or Different?
•
Critical Period Hypotheses
• Procedural Deficit Hypothesis
• Shallow Structure Hypothesis
• UG is dead
•
Unified Model
• Both L1 and L2 use the same resources
• What differs is the configurations of risk factors and
protective factors
• Successful L2 learning is based on optimizing
protective factors
51
How to maximize protection
•
•
Teachers can provide motivation,
organization, and conversation
But classrooms cannot provide
•
•
•
•
•
Scheduled practice
Consistent feedback
Rich student model
Immediate link to outside world
Modern computer systems can
52
Language Partner
Unified Model
53
PSLC Basic Skills Studies
•Phil
Pavlik: Chinese vocabulary optimization
•Yuki Yoshimura: Fluency testing
•Colleen Davy: Fluency training
•Nora Presson: French gender cues
•Nora Presson: Spanish conjugation
•Yanhui Zhang: Pinyin dictation tutor
•Helen Yun Zhao: English article tutor
•Like Li: character tutor
•Dan Walter: German case/gender cues
Unified Model
54
Chinese Resonance
Unified Model
55
Yoshimura - Fluency
Error Analysis by type
complexity = complex
1
Number of errors in production
omis s ion
0.8
retrace
0.6
grammatic al
e rror
0.4
s ubs titution
0.2
addition
0
4
6
8
10
Sentence Length
56
Unified Model
57
58
Davy - Spanish Fluency
Unified Model
59
But it is best to listen first –
Potovsky (1974)
Unified Model
60
Yun Zhao - English Articles
Unified Model
61
Cue Contrast
•Alice is only interested
•cue: 0-noncountable
in 0 wealth.
•Alice
is only interested in the wealth of her
parents.
•cue: the-noncountable+PP
62
Zhao - Greatest gains for explicit
feedback
with transparent cues
63
Explicit–Implicit Contrast
•
•
•
•
Classic implicit learning literature was
about lack of awareness
L2 learners are very much aware
So, there is no really implicit learning, only
relative degrees of explicitness
This issue can be rephrased in terms of
proceduralization
64
In Progress
•
•
•
•
VILLA individual differences diagnosis
system
DOVE subtitled video system
Google Maps Tours
Working with Luis van Ahn's DuoLingo
• German, English, Spanish
• 250,000 users
• Best retention when formal rule diagnosis is
given
65
http://talkbank.org/pslc
•
•
•
•
•
•
VILLA
Pinyin Tutor
Chinese / Spanish Vocab Tutor
Chinese Character Tutor
Article Tutor
DOVE captioned video
66
From Theory To Practice
•
•
•
•
•
Tutors must integrate with classroom
practice
Instructors must find them valuable
Students must find them valuable
Data must allow us to further test the theory
Work with Pinyin Tutor, Spanish Tutor, and
DuoLingo show how we can collect huge
amounts of relevant data
67
Summary
•
•
•
Linguistic theory maps well to the brain
Competition is central
The theory must also explain
• maps, connectivity, fluency/chunking
• resonance, internalization, participation
•
The model should be able to help us
understand various forms of language
disorder, as well as barriers to second
language learning
68