Transcript Aucun titre de diapositive

Activity presentation
Communication Langagière et
Interaction Personne-Système
Fédération IMAG
BP 53 - 38041 Grenoble Cedex 9 - France
Director: Jean Caelen (DR CNRS)
Vice-Director : Catherine Berrut (Prof. UJF)
[email protected]
www-clips.imag.fr
Institutions
UMR 5524
Research Topics
Man-Machine Interaction(s)
Collaborative interactions with machines
Speech, Image, Language Processing
E-Learning
Perceptive Rooms and Augmented Reality
Multimedia Document Indexing
Man Machine Interaction Engineering
Speech Recognition and Natural Language Dialogue
Collaborative and Multimodal Interfaces
Information Retrieval
Machine Translation
Language Processing
Structure
Direction council
Direction
Research
• ARCADE
• GEOD
• GETA
• IIHM
• MRIM
Valorisation
• MultiCom
People : 72 (staff + PhD students)
UJF, CNRS, INPG, UPMF, US
Technical staff
• Maintenance
• Projects
Administration
• Secretariat
• People Management
• Financial
• Subsistance
• Communication
Research Teams
ARCADE (J.P. Peyrin, prof. UJF)
e-Learning (Ateliers de Réalisation et de Conception d’Applications Destinées à
l’Education)
GEOD (J.F. Serignat, MCF INPG)
Speech Group (Groupe d’Etude sur l’Oral et le Dialogue)
GETA (C. Boitet, prof. UJF)
Machine Translation Group (Groupe d’Etude sur la Traduction
Automatique)
IIHM (J. Coutaz, prof. UJF)
Man Machine Interaction Engineering (Ingénierie de l’Interaction
Homme-Machine)
MRIM (M.F. Bruandet, prof. UJF)
Multimedia Information Retrieval (Modélisation et Recherche
d’Informations Multimédia)
People 1/1/2002
Regular Staff
(a) Profs + Researchers
(b) Engineers + Admin.
(c) PhD + Post-docs
(d) Under contracts
(e) Masters and others
(g) Invited
Total
73
29
11
26
7
24
10
107
Technological transfert
MultiCom : Usability platform for the design and the evaluation
of interactive systems
Start-up creations
1998 : NOVADIS, ergonomics, cognitive engineering
1999 : ARLYS (MENRT, CARMI, Microsoft, Axe et Cible), elearning, education software development
2000 : DMAILER, e-mail indexing and processing
MultiCom
Technological Platform :
• To study human factors in situated tasks
• To design and evaluate innovative and interactive services (or
systems)
by,
• Real usage experimentation
• Simulation (Woz for instance)
Partnership
Linguists, Sociologists, Ergonomists
Relationship and contracts
MultiCom
• 6 industrial : (Schneider, France-Télécom, Leti-CEA, STM),
• 2 european : SIRLAN IST 5th PCRD, ADAMOS, Finlandia
• 2 regional : SHIVA RRA 99 et Thématique 2000
Research
• 6 industrial : (Thalès, France-Télécom, EDF, Alcatel) in
RNRT, RNTL, CTI CNET, DGA
• 2 international : C-STAR, UNL (17 countries)
• 5 european : NESPOLE, TACIT, TIPS, ARIADNE, GLOSS,
CAMELEON, FAME
• 3 research networks : CNRS (french networks)
• 2 regional
• 5 local (C-STAR, RICOM, RESIDE-HIS, EPIC, e-Xpérience)
Multi-team projects
C-STAR/NESPOLE! : Face to face speech translation
(GEOD, GETA)
RICOM : Multimodal interaction for Multimedia
information retrieval (GEOD, IIHM, MRIM)
Smart Rooms : disable people monitoring, home
services… (GEOD, IIHM)
FORMID : e-learning, virtual teaching (ARCADE, IIHM)
C-STAR : Consortium for Speech Translation Advanced
Research (Japan, Corea, USA, Germany, Italy, France)
NESPOLE! (IST project) : NEgotiating through SPOken
Language in E-commerce
Projet C-STAR
Speech translation
Applications to : tourism, hot
line, e-commerce
2 ways possible
speaking
Speech recognition
source
IF coding
Translation
texte IF
Generation
target
Speech synthesis
listening
Interchange Format
• Meaning representation
• Based on
– Speech acts
• What to want or to do
– Concepts
• What to say
give-information
+availability+room
– Arguments
• Discourse predicates
room-type=(single ; double)
The 22th july 1999
at Grenoble
RICOM : Information Retrieval: Interactive, Collaborative and
Multimodale
HALPIN : Man-Machine Dialogue
CoVitesse : Information Representation
HALPIN
What have you on ... e, artificial
intelligence ?
I found 1206 documents on
the topic artificial
intelligence. Do you want
refine your research ?
Man-Machine Dialogue : speech recognition + dialogue management +
information retrieval + speech synthesis
History of dialogue
Outputs
Documents
Input
Speech Buttons
Speech Recognition
Collaborative surfing
Trace of navigation
Document annotation
Collected documents
Session control
RESIDE-HIS : Smart Home for disable people
COMEDI : Informal Communication
RESIDE-HIS
Telemonitoring
Réseau Téléphonique Public
Modem
Home bus
H
Modem
Physiological and biological sensors
Microphones
Monitoring on :
Events
Alarms
Statistics
Plan HIS
CoMedi : Informal communication
Awareness, Focus
Feed-back, privacy control
Feed-back control
Acces control
Example of filters
Curtain
EigenSpace
Poster
EigenSpace filter: Main Component
Analysis
Image base
Eigen Space
Eigen vector
Image captured
Image to send
ArgMin(distance)
FORMID : FORmation Interactive à Distance
Magic Board : Collaborative Space and augmented reality
FORMID
FORMID : Toolkit for teaching by example
I learn what I do.
GeneSimu
Oasis
Magic Board
Platform for design and evaluation
of interactive systems
Lifecyle
Observations
Analyse des besoins
Evaluation
ergonomique
Tests Utilisateurs
Task analysis
Conception
Design
Tests d’intégration
Software design
Conception logicielle
Tests Unitaires
Codage
Development
Objectives
To anticipate the usage and to predict the usability
To design and to evaluate interactive systems along
the lifecycle
using
Participatory design method
And simulation techniques (as Moz)
for the experimentation and the test
A good starting point : enrich the first idea
Functions
Diagnostic
Observation
Mockup
Idea
Specifications
Validation
Evaluation
Scenario
Taking into
account all the
criteria about
(a) sociological,
(b) ergonomical,
(c) economical,
(d) technological
points of view
Sociology…
Practice analysis
Usage meaning
• By questionnaire
• By interviews
• By recording practices
Applying sociological criteria
 Recommendations for
the design
Ergonomics...
Simulation, Woz, Scenarios…
• Test human perceptive
• Test human behavior (after capture) under definite and limited
scenarios
• Task and activity analysis
 Recommendations for the design
The first cycle ends…
Functionalities definition
Design constraints
Criteria Evaluation definition
Specifications
Then development can start along a second
iterative cycle
The hardware platform
Devices for observation
User
Control video
Multimedia recording
Interactive devices
Wizard 1
Wizard 2
Conclusion… CLIPS-IMAG is…
• A research lab on interactive systems
• Open on the technological transfert
• Focused on user centered design methods
Communication Langagière et
Interaction Personne-Système
Fédération IMAG
BP 53 - 38041 Grenoble Cedex 9 - France