Transcript Usability of Dialogue Services

ITU-T Study Group 12: Structures and
Guide for University Participants
Sebastian Möller
(with the support from Jean-Yves Monfort, ITU-T SG12 Chairman)
Quality and Usability Lab, Deutsche Telekom Laboratories
TU Berlin, Germany
[email protected]
Overview


Structure of ITU-T Study Group 12
– General structure of the ITU-T
– Study Group 12
– Documents, etc.
Quality assessment and prediction for voice services
1
Structure of ITU-T Study Group 12
General structure of the ITU-T.
Plenipotentiary Conference
ITU Council
General
Secretariat




ITU-T
ITU-R
ITU-D
World Telecommunication
Standardization Assembly
World Radiocommunication
Conference
World Telecommunication
Development Conference
General Secretariat: Coordinates the Union's activities and the
overall management of the Union
ITU-T: Telecommunication standardization on a world-wide basis on
technical, operating and tariff Questions
ITU-R: Radio communications and wireless
ITU-D: Use and deployment of telecom networks and services in the
developing nations
2
Structure of ITU-T Study Group 12
Structure of ITU-T Study Groups and Working Parties.
WORLD TELECOMMUNICATION
STANDARDIZATION ASSEMBLY
(WTSA)
TELECOMMUNICATION
STANDARDIZATION
ADVISORY GROUP
(TSAG)
STUDY GROUP XX
STUDY GROUP X
WORKING
PARTY
STUDY GROUP Y
WORKING
PARTY
WORKING
PARTY
(WP)
R
R
R
R
R
RECOMMENDATION
R
R
R
EDITORS
R = RAPPORTEUR GROUP
3
Structure of ITU-T Study Group 12
Structure of ITU-T Study Groups and Working Parties.
Workshops / Seminars:

Cover the most important topics in modern telecommunication technology and
applications.

Speakers are renowned telecommunication experts.

Usually free of charge and open to public .

To come : From Speech to Audio: Bandwidth Extension, Binaural Perception,
see http://www.itu.int/ITU-T/studygroups/com12/index.asp.
Focus Groups:

Participation of non-member experts welcome.

Work on a well-defined topic and time-schedule for completion.

e.g. : IPTV Focus Group in which SG12 is involved

Under SG12 : Focus Group From/In/ToCarCommunication, see
http://www.itu.int/ITU-T/studygroups/com12/fgfit/index.html
Joint Coordination Groups:

Coordinate a broad study by more than one study group. They do not perform
technical studies nor write Recommendations.
4
Structure of ITU-T Study Group 12
Study Group 12 mandate.
Responsible for Recommendations
on the end-to-end transmission performance of terminals
and networks, in relation to the perceived quality and
acceptance by users of text, data, speech, and multi-media
applications.
Although this work includes the related transmission
implications of all networks and all telecommunication
terminals, a special focus is given to IP QoS, interoperability
and implications for NGN, and also includes work on
performance and resource management.
5
Structure of ITU-T Study Group 12
Management team and structure.
SG 12 – Performance and QoS
Chairman
Mr Jean-Yves Monfort
QoS Coordination
Mr C. Dvorak, VC
WP 1
TSB Support
Mrs J. Katona
Kiss,
Councellor
WP 2
Bridging the gap
for developping countries
Mr J.J. Massima-Landji, VC
Telephonometry, terminals and subjective
assessment
Co-Chairs : C. Quinquis, G. Lecucq
Performance, planning and tools
Mr Klemens Adler, SG 12 Vice Chair
Mrs S. Scott,
Secretary
WP 3
IP-related QoS and resource management
M. Paul Coverdale, SG 12 Vice Chair
6
Structure of ITU-T Study Group 12
SG12 structure and questions.
SG 12 – Questions 1/12 and 15/12
Q.1/12
Q.15/12
Workprogram, definitions,
handbooks, guides, tutorials,
Bridging the Standardization Gaps
Mr JY Monfort, Mr J. Pomy, Mr
J.J. Massima-Landji
QoS and performance
coordination
Mr C. Dvorak
7
Structure of ITU-T Study Group 12
SG12 structure and questions.
WP /12 – Telephonometry, terminals
and Subjective assessment
Co Acting Chairs
C. Quinquis, G. Lecucq
Q.3/12
Speech transmission characteristics of speech
terminals …
Mr Shi Denian
Q.4/12
Hands-free communications in vehicles
Mr H.W. Gierlich, Mr M. Rung
Q.5/12
Telephonometrics methodologies for handsets
and headset terminals
Mr L. Madec
Q.6/12
Analysis methods using complex measurement
signals….
Mr H.W. Gierlich
Q.7/12
Methods, tools and test plans for the subjective
assessment… Mr P. Usai and Mrs C. Quinquis
8
Structure of ITU-T Study Group 12
SG12 structure and questions.
WP 2/12 – Performance, Planning and Tools
Chairman
Mr Klemens Adler
Q.8/12
Extension of the E-model
Mrs U. Jekosch and Mr S. Möller
Q.9/12
Perceptual-based objective methods for voice,
audio and visual quality…
Mr J. Berger
Q.10/12
Transmission planning and performance
considerations…
Mr V. Sypli
Q.12/12
Performance evaluation of services based on
speech technology Mr S.Möller&MrA. Raake
Q.14/12
In-service non intrusive assessment of voice
transmission performance
Mr V. Barriac
Q.20/12
Objective assessment of conversational speech
quality in networks
Mr J. Pomy
9
Structure of ITU-T Study Group 12
SG12 structure and questions.
WP 3/12 – IP-Related QoS andRessource management
Chairman
Mr Paul Coverdale
(also involved in Questions* 13/12 and 19/12)
Q.2/12
Speech transmission charact. & meas. methods
for IP terminals and gateways
Mr U. Brunner
Q.11/12
IP based multimedia services end to end transm.
planning ….
M. J. Pomy
Q.13/12
IPTV and multimedia QoE/QoS performance
requ. and assessment methods
A. Takahashi
Q.16/12
Broadband and IP-related resource management
Mr D. Mustill
Q.17/12
Performance of IP-based networks
Mr A. Morton and Mr H. Kim
Q.19/12
Call processing performance
10
Structure of ITU-T Study Group 12
SG12 structure and questions.
SG 12 Liaison Officers
JRG MMQA
Joint Rapporteur Group "Multimedia quality
assessment"
Mr P. Juric
IEC 29
Electroacoustics
Mr L. Madec, Mr H.Gerlich
IEEE
Electroacoustics
Mr A. Woo
QSDG
QoS Development Group
TSAG
Communication Mr C. Dvorak,
EWM Mr J. Pomy, Bridging the standardization
Gaps Mr J.J. Massima-Landji
Others
Mr D. Mustill
Security, OAM, ICG-SAT Mr JY Monfort,
FGNGN Mr C.Dvorak, FGNGN Mr P. Coverdale
ITU-D Mr J.J. Massima
Flagship Group QoS
Mr D. Waturu
11
Structure of ITU-T Study Group 12
Questions, Rapporteurs and Editors.
Questions:
 Set up by the WTSA or by the Study Group.
 Define a particular subject to be studied.
Rapporteurs:
 Appointed by the SG or a WP to each Question.
 Ensure progress of the group of experts towards Recommendations.
 Lead, moderate debates (e-mails, conf. Calls, etc.)
and coordinate progress.
 Chair the meetings of the experts (Rapporteurs Group Meetings).
Editors:
 Appointed by Rapporteurs, prepare and follow-up
draft Recommendations.
12
Structure of ITU-T Study Group 12
Approval of Recommendations.
Alternative Approval Process (AAP):
 For technical Recommendations
 Once the text is considered to be mature, it is submitted for AAP at an
SG or WP meeting (Rec. A.8)
Traditional Approval Process (TAP):
 For Recommendations subject to policy or
regulatory implications
 Initiated at an SG or WP meeting and completed, for final approval, at
the subsequent SG meeting (Res. 1)
13
Structure of ITU-T Study Group 12
AAP Sequence.
Approved
LC
4 weeks
(a)
3 weeks Approved
4
SG or
WP
meeting
(1)
Edited
text
for LC
(2)
(b)
Director's
announcement (c)
(7)
and posting
for LC
Comment
resolution
(3)
LC: Last Call
AR: Additional Review
Director's
SG
announcement Meeting
and posting
(6)
AR
(5)
(a)
(b)
3 weeks
Approved
9
11
(b)
(a)
Edited Director's
Director's
notification
announcement
text
for AR and posting
and publication
for AR
(8)
(see Rec. A.11)
(10)
(12)
TG120480-00
See Figure 1 (Rec. A.8)
14
Structure of ITU-T Study Group 12
Meeting documentation.
Contributions (C):

To be submitted at least 10 calendar days before the meeting.
Reports (R):

Official records of SG or WP meetings. To be available shortly after the closure of
the meetings (Rec. A.1).
Temporary Documents (TDs):

Submitted by an ‘official’ (a member of the SG Management Team, Rapporteur,
Editor, etc.) within the meeting participants.
Working Documents (WDs):

Issued during meetings by small groups.
15
Structure of ITU-T Study Group 12
Further information.
Visit www.itu.int/ITU-T/studygroups/com12/index.asp
for more information.
Overview


Structure of ITU-T Study Group 12
Quality assessment and prediction for voice services
– Quality assessment and prediction
– Taxonomy of prediction models
– E-model for NB and WB networks
17
Quality Assessment and Prediction
Voice services.
Linguist.
Backgr.
Experience
Attitude Emotions
User Factors
Subjective
Quality
Judgment
Transmission
System
System
Parameters
Model
Our focus:
Motivation,
Goals
Estimated
Quality Index
Methods for assessing narrow-band and wideband speech,
but also video quality
18
Quality Assessment and Prediction
Quality aspects of transmitted speech.
Quality of Service
Quality:
Result of judgment of the
perceived composition of
an entity with respect
to its desired composition.
(Jekosch, 2005)

Quality of Service
(Rec. E.800)
Quality of Experience
Voice Transmission
Quality
Ease of
Communication
Service
Factors
Contextual
Factors
Conversation
Effectiveness
Communication
Efficiency
User
Factors

Speech Communication
Factors
Service
Efficiency
Economical
Benefit
Usability
User
Satisfaction
Utility
Acceptability
Quality of
Experience
(Möller, 2000)
19
Quality Assessment and Prediction
Taxonomy of prediction models.
Input information:

Signals
−
−


Output information:

Listening-only
one or two signals
acoustic or electric
Parameters
Protocol information
Measurement of input information:

Online

Offline

Estimation
−
−


integral quality
quality features
Conversational
Talking-only
Application area:

Planning

Set-up and optimization

Monitoring
Network type:

Narrow-band

Wideband
20
Quality Assessment and Prediction
Taxonomy of prediction models: Narrow-band case.
Signals
1, el.
Input Information
1, ac.
2, el.
2, ac.
Protocol
Meas.
Parameters
Estim.
Meas.
Output Information
Listening
Conversation
Overall
Quality
Overall
Quality
Quality
Feat.
Quality
Feat.
P.563 Psychoac.
CCI
Measures (P.562)
Psychoac.
Measures
P.862
[Heute05] P.CQO?
P.CQO?
P.OLQA
P.OLQA
[STI]
P.OLQA?
P.VTQ?
P.CQO?
P.CQO?
G.107
NIEM
(P.562)
21
Quality Assessment and Prediction
Taxonomy of prediction models: Wideband case.
Signals
1, el.
Input Information
1, ac.
2, el.
2, ac.
Protocol
Meas.
Parameters
Estim.
Output Information
Listening
Conversation
Overall
Quality
Overall
Quality
Quality
Feat.
Quality
Feat.
Psychoac.
Measures
Psychoac.
Measures
P.862.2 [Heute05]
P.OLQA
P.OLQA
[STI]
P.OLQA?
WB-EModel
Meas.
22
Quality Assessment and Prediction
E-model for narrow-band networks.
Linear distortion, delay
4
4
IP
WAN
Backgr.
noise,
acoustic
coupling
Codec
Jitter
buffer,
VAD
Packet
loss
Talker echo,
listener echo
Circuit
noise
Backgr.
noise,
acoustic
coupling
23
Quality Assessment and Prediction
E-model for narrow-band networks.
SLR, RLR, Ta
4
4
IP
WAN
Ps, Ds,
STMR
Ie, qdu
Impairments
Overall quality
Estimated user judgment
R=
Bpl
Ppl
SNR
simultaneous
Ro
- Is
TELR, T,
WEPL, Tr
delayed
- Id
Nc, Nfor Pr, Dr,
LSTR
nonlin./timevar.
- Ie,eff
MOS = f (R )
24
Quality Assessment and Prediction
E-model extension for wideband networks.
Ro,max = 129
140
Rmax=129
120
RNB
100
80
60
40
20
0
0
20
40
60
RNB/WB
80
100
(Raake, 2006; Appendix II, ITU-T Rec. G.107, 2006)
25
Quality Assessment and Prediction
E-model extension for wideband networks.
Ro,max = 129
AMR-WB (23.05)
Ref.
G.722
G.722.1
G.722.2
AMR-WB (6.6)
(Raake, 2006;
Möller et al., 2006)
G.711
G.728
G.729
G.729A + VAD
IS-54
GSM 06.10, FR
GSM 06.60, EFR
G.723.1
G.723.1
Operating
rate kbit/s
64
56
48
32
24
23.85
23.05
19.85
18.25
15.85
14.25
12.65
8.85
6.6
64
16
8
8
8
13
12.2
5.3
6.3
Ie,wb
value
13
20
31
13
19
8
1
3
5
7
10
13
26
41
36
43
46
47
56
56
41
55
51
26
Thanks to Jean-Yves Monfort (ITU-T SG12 Chairman) for
providing the description of Study Group 12.
Thank you for your attention.
Visit www.qu.tlabs.tu-berlin.de for more information.