Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction  Web-based video.

Download Report

Transcript Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction  Web-based video.

Slide 1

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 2

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 3

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 4

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 5

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 6

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 7

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 8

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 9

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 10

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 11

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 12

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 13

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 14

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 15

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 16

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 17

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 18

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 19

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 20

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 21

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 22

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 23

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 24

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 25

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 26

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 27

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 28

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 29

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 30

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 31

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 32

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 33

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 34

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 35

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 36

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 37

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 38

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 39

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 40

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 41

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 42

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 43

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 44

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]


Slide 45

Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities

Los Angeles, CA
March 16, 2005

Overview
Introduction
 Web-based video players
 The technology
 Creating accessible video
 Flash video
 Our Flash player
 Future of Web-based video


Introduction
Law, Health Policy & Disability Center
 Training


 Work

Incentive Grantees
 Disability Program Navigators

Standup training at conferences
 Accessible video of talking heads for
further training


Our Needs


Provide accessible Web-based training
 High

quality video with quality audio
 Closed captions
 Transcripts
 Supporting documents

Different formats (QuickTime, Windows
Media Player)
 Efficient development and deployment


Players
QuickTime
 Windows Media Player
 Real Player
 Others


 Flash
 Java

?

Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
 Free plugin/player (may autoinstall/update)
 Streaming or progressive download
 Cross platform availability (with caveats)
 Ability to “protect” content from download
 Large installed base


Players Captioning Capabilities
QuickTime, Windows Media, Real



All can handle captioning
All can use “component-based” captioning





Multiple files used
text-track captioning also available in QT

All supported by existing captioning tools

Players Comparison
QuickTime Advantages






“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software

QuickTime Disadvantages




Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)

Players Comparison
Windows Media Player Advantages





Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)

Windows Media Player Disadvantages




No ability to “scrub”
One movie at a time
Inconsistent feature implementation

Players Comparison



Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages



May be difficult to find free download







Pro version promoted heavily

Not typically pre-installed
One movie at a time
Streaming server costs

Flash Player Advantages





Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004







Incorporates QuickTime
Simulates a stream
Includes Controls component

Can build in compatibility with other players
Possible to add features

Flash Player Disadvantages
Not highly accessible, though getting
better
 Cost (Flash MX 2004)
 Initial development time
 Expertise required
 Upgrading plugin


 Manually

controls

added accessible text to video

The Technology
Clients and servers
 Plugins or whatever
 Downloading
 Embedding video in Web pages
 Captioning
 Flash


Understanding how the pieces fit together
helps for producing accessible video

Clients vs. Servers
Server

Clients

Clients

Clients vs. Servers


Server





Stores HTML, video, caption text, other files
Files can be stored on different servers

Client




Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
 Caption
 Video Player
 HTML


Client View
Browser Window

Embedded Player

Video

Captions

The Player / Plug-in



Embeds the player in the browser
ActiveX




Plug-ins







Internet Explorer
Netscape
Firefox
Opera

Need to account for both in the HTML
User must install if not available

Web-based Video Delivery
Download
 Streaming
 Progressive download


Download




Provide a link
Entire movie on client hard drive
Benefits






Minimizes low bandwidth
Multiple views from same download
Distribute to others

Disadvantages





Usability
Requires hard drive space
Captioning not always possible
Distribute to others

Streaming
Server controls content
 Active client-server connection
 Benefits


 Live

broadcasts
 Low client hard drive space usage


Disadvantages
 High

bandwidth needed
 Troubleshooting
 May require local network setup (firewalls)

Progressive Download



Play video while downloading
Benefits







Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users

Disadvantages





Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded

Accessible Video and Web Pages
See www.warp.webaim.org
 Standalone players


 Real

 Windows



Media Player

Embedded
 QuickTime

 Flash

Embedded Captioned Video
Server

Client

Video File

Combining File

Caption File

HTML File

Embedded Players


Different technologies among browsers




versus

Control user experience
 Player

size
 Automatic startup
 Surround video with supporting information

Difficult to implement when players are not
up to date
 Valid HTML?


Captioning – Technologies


XML




SMIL




Microsoft® Synchronized Accessible Media
Interchange

QuickTime caption file




Synchronized Multimedia Integration Language

SAMI




Extensible Markup Language

Apple

Flash


Macromedia

Web-based Video Formats
QuickTime (.mov)
 Windows Media Video (.wmv)
 Windows video (.avi) – as intermediary
format
 Flash video (.flv)


Caption Files
Caption text
 Time codes for synchronization with video
 Text Formatting


 Font

and font size
 Carriage returns
 Bolding, colors, etc.

Speakers
 Language support


Captioning – QuickTime


Video
 .mov



file and others

Caption file
 .txt
 QuickTime



caption file

SMIL
 .smi

or .mov
 Integrates video and caption files

Captioning – Media Player


Video
 .wmv



Caption file
 .smi



(XML / SAMI)

Integration file
 .asx

 Integrates

video and caption files

Captioning – Flash


Flash code




Video






.flv

Caption file




.fla

Whatever (.txt, .xml, .smi)

XML configuration file
Flash application (Shockwave)



.swf compiled from Flash code
Integrates video and caption files

Creating a Video
Shoot (or acquire) video/audio of highest
possible quality
 Acquire secondary audio source and/or
CART file if possible
 Capture, edit and compress video


3



output formats: .mov, .wmv, and .flv

Make audio tapes for transcription

Transcribing Audio or Video



High quality audio makes better movies and
better transcripts
Staff or student workers transcribe using inhouse guidelines




Transcript saved in 3 formats







Includes speaker identification and non-verbal
elements ([Laughter], [Applause], [Inaudible])
MSWord .doc
accessible .pdf
plain .txt for caption file

Proof and correct

Pre-Captioning Steps




Text is broken up into “caption-sized chunks”
Special characters eliminated (“smart” quotes,
em-dashes, etc.)
Caption timing software (MAGpie or HiCaption






Both let you transcribe directly or import prepared text
files
Both attach timecodes to text in realtime
Both export in plaintext, SAMI, QuickTime SMIL or
RealPlayer SMIL

Proof and Correct

Final QuickTime Assembly



The movie - moviename.mov
The caption file -moviename_captions.txt




Includes captions and timing info

The SMIL file - moviename_smil.mov




Combines movie and captions on the fly
Includes URL pointers to movie & caption files
.mov extension forces QT playback

Captions display automatically as part of SMIL
standard

Final Windows Media Player
Assembly
The movie - moviename.wmv
 The SAMI file - moviename.smi


 Includes



captions and timing info

The ASX file - moviename.asx
 Includes

URL pointers to movie & caption files

User must toggle captions in Windows
Media Player “View” menu

Final Flash Player Assembly






The Flash playback engine - moviename.swf
The movie - moviename.flv
The caption file -moviename_captions.txt


Includes captions and timing info



Same file as QT

The caption control file - captions.xml


Includes URL pointers to movie & caption files

User must toggle captions in our Flash Video
Player (CC icon, on by default)

Files on the Server
(For each movie)
1.

2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.

Transcript in Word
Transcript in Acrobat
Movie in QT
Movie in Windows Media Player
Movie in Flash
Caption file
SAMI file
SMIL file
Windows integration file
Flash integration file
Flash video player engine
Resizable Flash page

.doc
.pdf
.mov
.wmv
.flv
.txt
.smi
.smi (or .mov)
.asx
.xml
.swf
.htm

Flash Video
Becoming more accessible by version 6
 More integration with video
 Frustrated with “player wars”
 Lack of standards compliance
 Continual, relentless upgrades
 Difficulty in upgrading – pushing users
toward paid versions
 Hijacking of media types / file extensions


Flash – Compress Video
Create .flv file from movie (.mov, .avi)
 Method 1


 Import

into Flash library and compress

 Sorenson

 Export



Spark within Flash

to external file or drag to timeline

Method 2
 Or

compress using non-Flash application

 Sorenson

Squeeze

Create XML Configuration
Open configuration file (XML)
 Add settings


 Video

location
 Caption file location
 Video size and width in pixels
 Video total time in seconds

Combine Files


Upload
 Video

(.flv)
 Caption file
 Caption configuration (caption.xml)
 Flash file (.swf)


Incorporate embedding tags in HTML



Flash Security
Keep files in same folder
 Use BASE attribute










And


Test thoroughly, especially among browsers and
browser versions

Future


Our Flash video player development
 Customized

controls
 More configuration options in external XML
file
 Embedded formatting in captions


Speech recognition
 Real-time

voice recognition
 Automatic time codes (real-time)


Searchable / Linkable video

Resources


WebAIM




World Wide Web Consortium Web Video Standards




http://ncam.wgbh.org/webaccess/magpie/

Captioned Media Program




http://www.hisoftware.com/hmcc/acc4mcc.html

National Consortium on Accessible Media (MAGpie)




http://www.w3.org/AudioVideo/

Hi Software (HiCaption)




http://www.webaim.org/techniques/captions/

http://www.cfv.org

National Association of the Deaf


http://www.nad.org/

Contact


Law, Health Policy & Disability Center




This presentation




http://disability.law.uiowa.edu/
http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html

LHPDC Bulletin Board (download Flash playback engine)


http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3

David Klein
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]

K. “Fritz” Thompson
280-1 Boyd Law Bldg.
College of Law
University of Iowa
Iowa City, IA 52242
319-335-6748
[email protected]