Transcript emotion.ppt
Emotional Speech
Julia Hirschberg
CS 6998
7/15/2016
1
Today
Defining emotional speech
Emotional categories
Eliciting judgments
Producing emotional speech
Detecting emotional speech
7/15/2016
2
Cowie ‘00
Is there a good theoretical or practical definition
of emotional speech?
“Full-blown” emotion vs. emotional state
Cause and effect descriptions
Primary and secondary (second order)
Everyday descriptions
Representations
Biological
7/15/2016
3
Dimensions in continuous space, e.g.
Valence: positive or negative
Activation level: how disposed to take action
Structural models: different ways of
appraising situation that evokes emotion
e.g. positive or negative? Does situation help
agent to achieve his/her goals?
Timing as a key variable
sadness vs. grief vs. depression vs. gloominess
7/15/2016
4
How are emotions expressed?
Display rules? In speech?
Mixing
Simulation
7/15/2016
5
Schroeder ‘01: Emotion in
Synthesis
How is a given emotion expressed in speech?
What are the properties of the emotion to be
expressed? How are they related to those of
other emotions?
What kind of synthesizer works best?
Formant
Diphone
Unit selection
7/15/2016
6
Prosody rules: what to modify?
How do we evaluate the results?
Forced choice
Free response
Recognition rate
Perceived naturalness
7/15/2016
7
Ten Bosch ‘00: Emotion
Recognition
How hard is the problem?
Is ‘standard’ ASR technology well-suited to it?
Acoustic and language models target short
local events
Feature extraction normlizes/excludes e.g.
pitch, rate, amplitude -- why?
Interaction: emotional speech and ASR
performance
Synthesis needs one good example but...
7/15/2016
8
7/15/2016
9