Transcript The Source-Filter Theory: The Sound Source SPPA 6010 Advanced Speech 1

The Source-Filter Theory:
The Sound Source
SPPA 6010 Advanced Speech
Science
1
Topic 3a:
Physical Acoustics Review
SPPA 6010 Advanced Speech
Science
2
Learning Objectives
• Outline the physical processes underlying
simple harmonic motion using the massspring model
• Describe the molecular basis of sound
wave propagation
SPPA 6010 Advanced Speech
Science
3
Spring Mass Model
• Mass (inertia)
• Elasticity
• Friction
SPPA 6010 Advanced Speech
Science
4
What is sound?
• It may be defined as the propagation of a
pressure wave in space and time.
• propagates through a medium
SPPA 6010 Advanced Speech
Science
5
Sound-conducting media
• Medium is composed of
molecules
• Molecules have “wiggle
room”
• Molecules exhibit random
motion
• Molecules can exert pressure
A
SPPA 6010 Advanced Speech
Science
B
6
Model of air molecule vibration
(Time 1)
Air molecules sitting side by side
Rest positions
SPPA 6010 Advanced Speech
Science
7
Model of air molecule vibration (Time 2)
SPPA 6010 Advanced Speech
Science
8
Model of air molecule vibration (Time 3)
SPPA 6010 Advanced Speech
Science
9
Model of air molecule vibration (Time 4)
SPPA 6010 Advanced Speech
Science
10
Model of air molecule vibration (Time 5)
SPPA 6010 Advanced Speech
Science
11
Model of air molecule vibration
a
Time
b
c
d
1
2
3
4
5
Distance
SPPA 6010 Advanced Speech
Science
12
Wave action of molecular
motion
Time
1
2
3
4
5
Distance
SPPA 6010 Advanced Speech
Science
13
Amplitude waveform
Position
Time
SPPA 6010 Advanced Speech
Science
14
Amplitude waveform
Question: How long will this last?
Amplitude
Time
SPPA 6010 Advanced Speech
Science
15
Model of air molecule vibration
Time
1
2
3
4
5
Questions:
Where is a region of compression?
Where is a region of rarefaction?
Pressure measuring device
SPPA 6010 Advanced Speech
Science
16
Pressure
For example…
Time
SPPA 6010 Advanced Speech
Science
17
Learning Objectives
• Define the key characteristics of sinusoidal
motion (amplitude, frequency/period and
phase)
• Outline the relationship between the
frequency and wavelength of a sound
wave
SPPA 6010 Advanced Speech
Science
18
Pressure vs. time (pressure waveform)
Amplitude
Phase (deg)
Phase: when a period
begins
Pressure
Period (T)
Frequency (F):
rate that waveform
repeats itself (1/T)
Time
SPPA 6010 Advanced Speech
Science
19
Phase
SPPA 6010 Advanced Speech
Science
20
Initiating a sound waves that
differ only in phase
A force is applied to molecule at frequency f and time t
same force applied at frequency f at time t+a where a < the period of vibration
SPPA 6010 Advanced Speech
Science
21
Features of a pressure
waveform
• Amplitude
–
–
–
–
Measured in pressure units
peak amplitude
peak-to-peak amplitude
Instantaneous amplitude
• Period and Frequency
– Period measured in time (basic quantity)
– Frequency is a rate measure (per unit time) expressed as Hertz
(s-1)
– May be expressed as octaves, semitones, etc
• Phase
– Measured in degrees (relative to period length)
– 0-360 degrees
SPPA 6010 Advanced Speech
Science
22
Spatial variation in pressure
wave
wavelength () is the
distance covering
adjacent high and low
pressure regions
SPPA 6010 Advanced Speech
Science
23
For example…
Pressure
Wavelength ()
Distance
SPPA 6010 Advanced Speech
Science
24
Relation between frequency and
wavelength
=c/F where
: wavelength
F: is the frequency
c: is sound speed in medium (35,000 cm/sec)
SPPA 6010 Advanced Speech
Science
25
Additional Concepts
• Propagation of waves
– Transmission
– Absorption
– Reflection
– Reverberation
SPPA 6010 Advanced Speech
Science
26
Learning Objectives
• Draw and describe time-domain and frequency-domain
representation of sound
• Distinguish between simple and complex sound sounds
with regard to physical characteristics and graphical
representations
• Distinguish between periodic and aperiodic sounds with
specific emphasis on terms such as fundamental
frequency/period, harmonics, and overtones
• Distinguish between continuous and transient sounds
• Describe how waves sum, define Fourier's theorem and
be able to describe the basics of Fourier analysis
SPPA 6010 Advanced Speech
Science
27
Graphic representation of sound
• Time domain
– Called a waveform
– Amplitude plotted as
a function of time
• Frequency domain
– Called a spectrum
– Amplitude spectrum
• amplitude vs. frequency
– Phase spectrum
• phase vs. frequency
– May be measured using a
variety of “window” sizes
SPPA 6010 Advanced Speech
Science
28
Same sound, different graphs
Time domain
Frequency domain
From Hillenbrand
SPPA 6010 Advanced Speech
Science
29
Classification of sounds
• Number of frequency components
– Simple
– Complex
• Relationship of frequency components
– Periodic
– Aperiodic
• Duration
– Continuous
– Transient
SPPA 6010 Advanced Speech
Science
30
Simple periodic sound
• Simple: one frequency component
• Periodic: repeating pattern
• Completely characterized by
– amplitude
– period (frequency)
– phase
• Other names: sinusoid, simple harmonic
motion, pure tone
SPPA 6010 Advanced Speech
Science
31
Simple periodic sound: Graphic
appearance
From Hillenbrand
SPPA 6010 Advanced Speech
Science
32
Complex periodic sounds
•
•
•
•
Complex: > one frequency component
Periodic: repeating pattern
Continuous
Frequencies components have a special relation
– Lowest frequency: fundamental frequency
• Symbol: fo
• Frequency component with longest period
– Higher frequency components: harmonics
• integer (whole number) multiples of the fo
SPPA 6010 Advanced Speech
Science
33
Complex periodic sounds: Graphic
appearance
• Time domain:
– repeating pattern of pressure change
– within the cycle, things look complex
• Frequency domain:
– spectral peaks at evenly spaced frequency
intervals
– “picket fence” appearance
• Auditory impression: sounds ‘musical’
SPPA 6010 Advanced Speech
Science
34
Complex periodic sounds: Graphic
appearance
From Hillenbrand
SPPA 6010 Advanced Speech
Science
35
SPPA 6010 Advanced Speech
Science
36
Amplitude vs. Phase Spectrum
Amplitude spectrum:
different
Phase spectrum:
same
SPPA 6010 Advanced Speech
Science
37
Amplitude vs. Phase Spectrum
Amplitude spectrum:
same
Phase spectrum:
different
SPPA 6010 Advanced Speech
Science
38
(Complex) Aperiodic sounds
• Complex: > one frequency component
• Aperiodic: Does not repeat itself
• Frequency components are not
systematically related
• May be
– Continuous
– Transient
SPPA 6010 Advanced Speech
Science
39
Aperiodic sounds: Graphic
appearance
• Time domain:
– no repeating pattern of pressure change
• Frequency domain:
– the spectrum is dense
– No “picket fence”
• Auditory impression: sounds ‘noisy’
SPPA 6010 Advanced Speech
Science
40
Aperiodic sounds: Graphic
appearance
From Hillenbrand
SPPA 6010 Advanced Speech
Science
41
Analysis of complex waves
• Waves can be summed
• Complex waves are the sum of simple waves
• Fourier: French Mathematician:
– Any complex waveform may be formed by summing sinusoids of
various frequency, amplitude and phase
• Fourier Analysis
– Provides a unique (only one) solution for a given sound signal
– Is reflected in the amplitude and phase spectrum of the signal
– Reveals the building blocks of complex waves, which are
sinusoids
SPPA 6010 Advanced Speech
Science
42
Learning Objectives
• Draw and differentiate the waveform and
the waveform envelope
• Draw and differentiate the amplitude
spectrum, the phase spectrum and the
spectrum envelope
• Differentiate between short-term and longterm average amplitude spectra
SPPA 6010 Advanced Speech
Science
43
The “envelope” of a sound wave
• Waveform envelope:
– imaginary smooth line that follows the peak of
the amplitude of a sound pressure waveform
• Spectrum envelope:
– Imaginary smooth line drawn on top of the
amplitude spectrum
SPPA 6010 Advanced Speech
Science
44
Waveform envelope
From Hillenbrand
SPPA 6010 Advanced Speech
Science
45
Waveform envelope
Time
SPPA 6010 Advanced Speech
Science
46
Spectrum envelope
From Hillenbrand
SPPA 6010 Advanced Speech
Science
47
Thought Question
Can an aperiodic and complex
periodic sound have identical
spectrum envelopes?
SPPA 6010 Advanced Speech
Science
48
Amplitude Spectrum: Window
Size
• “short-term” vs. “long-term average”
amplitude spectrum
SPPA 6010 Advanced Speech
Science
49
“Instantaneous” Amplitude
Spectra
SPPA 6010 Advanced Speech
Science
50
(Long Term) Average Amplitude Spectrum
SPPA 6010 Advanced Speech
Science
51
SPPA 6010 Advanced Speech
Science
52
The Spectrogram
SPPA 6010 Advanced Speech
Science
53
F
A
Rotate
90 degrees
F
A
SPPA 6010 Advanced Speech
Science
54
F
F
Rotate it so that
The amplitude is
Coming out of the
page
Time
A
This is really narrow
because it is a slice in time
SPPA 6010 Advanced Speech
Science
55
Frequency
Dark bands
= amplitude
Peaks
Time
SPPA 6010 Advanced Speech
Science
56
Two main types of
spectrograms
• Wide-band spectrograms
– Akin to spectrum envelopes “lined up”
– Frequency resolution not so sharp
• Narrow-band spectrograms
– Akin to amplitude spectrums “lined up”
– Frequency resolution is really sharp
SPPA 6010 Advanced Speech
Science
57
Highlights harmonic structure
Highlights spectrum envelope
SPPA 6010 Advanced Speech
Science
58
Learning Objectives
• Define an acoustic filter
• Draw and label a frequency response curve
• Draw and differentiate different types of acoustic
filters
• Define terms such as cutoff frequency, center
frequency, roll off rate, gain, and bandwidth
• Define and draw a basic filter system and relate
that to the source-filter theory of speech
production
SPPA 6010 Advanced Speech
Science
59
What is an “Acoustic” Filter
• holds back (attenuates) certain sounds and lets
other sounds through - selective.
SPPA 6010 Advanced Speech
Science
60
Why might we be interested in
filters?
• Human vocal tract acts like a frequency selective
acoustic filter
• Human auditory system behaves as a frequency
selective filter
• helps us understand how speech is produced
and perceived.
SPPA 6010 Advanced Speech
Science
61
Frequency Response Curve (FRC)
Center frequency
+
3 dB
Gain
passband
lower cutoff
frequency
upper cutoff
frequency
low
high
Frequency
SPPA 6010 Advanced Speech
Science
62
Operation of a filter on a signal
NOTE:
Amplitude spectrum describes a sound
Frequency response curve describes a filter
SPPA 6010 Advanced Speech
Science
63
Kinds of frequency selective
filters
Low-pass filters
– Lets low frequencies “pass through” and attenuates
high frequencies
High-pass filters
– Lets high frequencies “pass through” and attenuates
low frequencies
Band-pass filters
– Lets a particular frequency range “pass through” and
attenuates other frequencies
SPPA 6010 Advanced Speech
Science
64
Low Pass Filters
Gain
+
low
Frequency
SPPA 6010 Advanced Speech
Science
high
65
High Pass Filters
Gain
+
low
Frequency
SPPA 6010 Advanced Speech
Science
high
66
Band Pass Filter
Gain
+
low
Frequency
SPPA 6010 Advanced Speech
Science
high
67
Learning Objectives
• Define resonance, free and forced
vibration
• Outline how acoustic resonators behave
like acoustic filters
SPPA 6010 Advanced Speech
Science
68
Free vibration
• objects tend to vibrate at a characteristic
or resonant frequency (RF)
SPPA 6010 Advanced Speech
Science
69
Forced vibration
• A vibrating system can force a nearby
system into vibration
• The efficiency with which this is
accomplished is related to the similarity in
the resonant frequency (RF) of the two
systems
SPPA 6010 Advanced Speech
Science
70
Forced vibration
• If the RF of the two systems are the same,
the amplitude of forced vibration will be
large
• If the RF of the two systems are quite
different, the amplitude of forced vibration
will be small or nonexistent
SPPA 6010 Advanced Speech
Science
71
Resonance refers to
• Natural vibrating frequency of a system
• The ability of a vibrating system to force
another system into vibration
SPPA 6010 Advanced Speech
Science
72
Resonance
Acoustic (Cavity) Resonators
• Transmit sound frequencies with more
or less efficiency, depending upon the
physical characteristics
• Therefore, they act as filters, passing
through (and even amplifying) some
frequencies and attentuating others.
SPPA 6010 Advanced Speech
Science
73
Resonance
•
•
•
•
Acoustic (Cavity) Resonators
And since they act as filters, they have most
of the same features of a filter, even though
we might use different names.
Center frequency is often termed the
resonant frequency.
Frequency response curve often termed the
resonance curve.
Resonators may be sharply or broadly
“tuned” which refers to the roll-off frequency
SPPA 6010 Advanced Speech
Science
74
Resonator Features
Sharply tuned
Broadly tuned
SPPA 6010 Advanced Speech
Science
75
Resonator Features
Gain
Frequency
An example of the resonance characteristics
of the human vocal tract
SPPA 6010 Advanced Speech
Science
76