Transcript emotion.ppt

Emotional Speech
Julia Hirschberg
CS 6998
7/15/2016
1
Today
Defining emotional speech
Emotional categories
Eliciting judgments
Producing emotional speech
Detecting emotional speech
7/15/2016
2
Cowie ‘00
Is there a good theoretical or practical definition
of emotional speech?
“Full-blown” emotion vs. emotional state
Cause and effect descriptions
Primary and secondary (second order)
Everyday descriptions
Representations
Biological
7/15/2016
3
Dimensions in continuous space, e.g.
Valence: positive or negative
Activation level: how disposed to take action
Structural models: different ways of
appraising situation that evokes emotion
e.g. positive or negative? Does situation help
agent to achieve his/her goals?
Timing as a key variable
sadness vs. grief vs. depression vs. gloominess
7/15/2016
4
How are emotions expressed?
Display rules? In speech?
Mixing
Simulation
7/15/2016
5
Schroeder ‘01: Emotion in
Synthesis
How is a given emotion expressed in speech?
What are the properties of the emotion to be
expressed? How are they related to those of
other emotions?
What kind of synthesizer works best?
Formant
Diphone
Unit selection
7/15/2016
6
Prosody rules: what to modify?
How do we evaluate the results?
Forced choice
Free response
Recognition rate
Perceived naturalness
7/15/2016
7
Ten Bosch ‘00: Emotion
Recognition
How hard is the problem?
Is ‘standard’ ASR technology well-suited to it?
Acoustic and language models target short
local events
Feature extraction normlizes/excludes e.g.
pitch, rate, amplitude -- why?
Interaction: emotional speech and ASR
performance
Synthesis needs one good example but...
7/15/2016
8
7/15/2016
9