Slide 1 Accessible Video in a Diverging
Web Environment
David Klein
K. “Fritz” Thompson
CSUN Conference:
Technology and Persons with Disabilities
Los Angeles, CA
March 16, 2005
Overview
Introduction
Web-based video players
The technology
Creating accessible video
Flash video
Our Flash player
Future of Web-based video
Introduction
Law, Health Policy & Disability Center
Training
Work
Incentive Grantees
Disability Program Navigators
Standup training at conferences
Accessible video of talking heads for
further training
Our Needs
Provide accessible Web-based training
High
quality video with quality audio
Closed captions
Transcripts
Supporting documents
Different formats (QuickTime, Windows
Media Player)
Efficient development and deployment
Players
QuickTime
Windows Media Player
Real Player
Others
Flash
Java
?
Players Shared Advantages
QuickTime, Windows Media, Real
Capable of High Quality audio/video
Free plugin/player (may autoinstall/update)
Streaming or progressive download
Cross platform availability (with caveats)
Ability to “protect” content from download
Large installed base
Players Captioning Capabilities
QuickTime, Windows Media, Real
All can handle captioning
All can use “component-based” captioning
Multiple files used
text-track captioning also available in QT
All supported by existing captioning tools
Players Comparison
QuickTime Advantages
“Pro” version available ($30)
Ability to "scrub" while viewing
Ability to FF/Rewind (with audio) while viewing
Ability to have multiple videos playing simultaneously
Free multi-platform streaming server software
QuickTime Disadvantages
Free player bugs you to upgrade to pro
Some useful features limited to pro version
iTunes may be bundled with player (Windows version)
Players Comparison
Windows Media Player Advantages
Feature rich
Pre-installed (on Windows Platform)
Easy, automatic upgrades
Free streaming server software (Windows server only)
Windows Media Player Disadvantages
No ability to “scrub”
One movie at a time
Inconsistent feature implementation
Players Comparison
Real Player Advantages
Feature rich
Large content providers vested
Real Player Disadvantages
May be difficult to find free download
Pro version promoted heavily
Not typically pre-installed
One movie at a time
Streaming server costs
Flash Player Advantages
Installed base – 98%
Arguably easier to upgrade
Loads quickly
New version – MX 2004
Incorporates QuickTime
Simulates a stream
Includes Controls component
Can build in compatibility with other players
Possible to add features
Flash Player Disadvantages
Not highly accessible, though getting
better
Cost (Flash MX 2004)
Initial development time
Expertise required
Upgrading plugin
Manually
controls
added accessible text to video
The Technology
Clients and servers
Plugins or whatever
Downloading
Embedding video in Web pages
Captioning
Flash
Understanding how the pieces fit together
helps for producing accessible video
Clients vs. Servers
Server
Clients
Clients
Clients vs. Servers
Server
Stores HTML, video, caption text, other files
Files can be stored on different servers
Client
Displays HTML in browser
Launches players
Assembles/packages the pieces
Video
Caption
Video Player
HTML
Client View
Browser Window
Embedded Player
Video
Captions
The Player / Plug-in
Embeds the player in the browser
ActiveX
Plug-ins
Internet Explorer
Netscape
Firefox
Opera
Need to account for both in the HTML
User must install if not available
Web-based Video Delivery
Download
Streaming
Progressive download
Download
Provide a link
Entire movie on client hard drive
Benefits
Minimizes low bandwidth
Multiple views from same download
Distribute to others
Disadvantages
Usability
Requires hard drive space
Captioning not always possible
Distribute to others
Streaming
Server controls content
Active client-server connection
Benefits
Live
broadcasts
Low client hard drive space usage
Disadvantages
High
bandwidth needed
Troubleshooting
May require local network setup (firewalls)
Progressive Download
Play video while downloading
Benefits
Maximizes experience – bandwidth vs. wait time
Can be saved and redistributed
Can be protected from saving by users
Easiest for users
Disadvantages
Uses hard drive space (but temporarily)
Starts and stops
Still a problem for captioning when downloaded
Accessible Video and Web Pages
See www.warp.webaim.org
Standalone players
Real
Windows
Media Player
Embedded
QuickTime
Flash
Embedded Captioned Video
Server
Client
Video File
Combining File
Caption File
HTML File
Embedded Players
Different technologies among browsers
versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 2 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 3 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 4 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 5 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 6 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 7 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 8 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 9 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 10 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 11 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 12 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 13 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 14 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 15 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 16 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 17 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 18 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 19 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 20 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 21 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 22 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 23 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 24 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 25 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 26 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 27 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 28 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 29 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 30 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 31 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 32 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 33 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 34 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 35 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 36 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 37 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 38 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 39 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 40 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 41 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 42 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 43 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 44 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] Slide 45 Accessible Video in a Diverging Web Environment David Klein K. “Fritz” Thompson CSUN Conference: Technology and Persons with Disabilities Los Angeles, CA March 16, 2005 Overview Introduction Web-based video players The technology Creating accessible video Flash video Our Flash player Future of Web-based video Introduction Law, Health Policy & Disability Center Training Work Incentive Grantees Disability Program Navigators Standup training at conferences Accessible video of talking heads for further training Our Needs Provide accessible Web-based training High quality video with quality audio Closed captions Transcripts Supporting documents Different formats (QuickTime, Windows Media Player) Efficient development and deployment Players QuickTime Windows Media Player Real Player Others Flash Java ? Players Shared Advantages QuickTime, Windows Media, Real Capable of High Quality audio/video Free plugin/player (may autoinstall/update) Streaming or progressive download Cross platform availability (with caveats) Ability to “protect” content from download Large installed base Players Captioning Capabilities QuickTime, Windows Media, Real All can handle captioning All can use “component-based” captioning Multiple files used text-track captioning also available in QT All supported by existing captioning tools Players Comparison QuickTime Advantages “Pro” version available ($30) Ability to "scrub" while viewing Ability to FF/Rewind (with audio) while viewing Ability to have multiple videos playing simultaneously Free multi-platform streaming server software QuickTime Disadvantages Free player bugs you to upgrade to pro Some useful features limited to pro version iTunes may be bundled with player (Windows version) Players Comparison Windows Media Player Advantages Feature rich Pre-installed (on Windows Platform) Easy, automatic upgrades Free streaming server software (Windows server only) Windows Media Player Disadvantages No ability to “scrub” One movie at a time Inconsistent feature implementation Players Comparison Real Player Advantages Feature rich Large content providers vested Real Player Disadvantages May be difficult to find free download Pro version promoted heavily Not typically pre-installed One movie at a time Streaming server costs Flash Player Advantages Installed base – 98% Arguably easier to upgrade Loads quickly New version – MX 2004 Incorporates QuickTime Simulates a stream Includes Controls component Can build in compatibility with other players Possible to add features Flash Player Disadvantages Not highly accessible, though getting better Cost (Flash MX 2004) Initial development time Expertise required Upgrading plugin Manually controls added accessible text to video The Technology Clients and servers Plugins or whatever Downloading Embedding video in Web pages Captioning Flash Understanding how the pieces fit together helps for producing accessible video Clients vs. Servers Server Clients Clients Clients vs. Servers Server Stores HTML, video, caption text, other files Files can be stored on different servers Client Displays HTML in browser Launches players Assembles/packages the pieces Video Caption Video Player HTML Client View Browser Window Embedded Player Video Captions The Player / Plug-in Embeds the player in the browser ActiveX Plug-ins Internet Explorer Netscape Firefox Opera Need to account for both in the HTML User must install if not available Web-based Video Delivery Download Streaming Progressive download Download Provide a link Entire movie on client hard drive Benefits Minimizes low bandwidth Multiple views from same download Distribute to others Disadvantages Usability Requires hard drive space Captioning not always possible Distribute to others Streaming Server controls content Active client-server connection Benefits Live broadcasts Low client hard drive space usage Disadvantages High bandwidth needed Troubleshooting May require local network setup (firewalls) Progressive Download Play video while downloading Benefits Maximizes experience – bandwidth vs. wait time Can be saved and redistributed Can be protected from saving by users Easiest for users Disadvantages Uses hard drive space (but temporarily) Starts and stops Still a problem for captioning when downloaded Accessible Video and Web Pages See www.warp.webaim.org Standalone players Real Windows Media Player Embedded QuickTime Flash Embedded Captioned Video Server Client Video File Combining File Caption File HTML File Embedded Players Different technologies among browsers versus Control user experience Player size Automatic startup Surround video with supporting information Difficult to implement when players are not up to date Valid HTML? Captioning – Technologies XML SMIL Microsoft® Synchronized Accessible Media Interchange QuickTime caption file Synchronized Multimedia Integration Language SAMI Extensible Markup Language Apple Flash Macromedia Web-based Video Formats QuickTime (.mov) Windows Media Video (.wmv) Windows video (.avi) – as intermediary format Flash video (.flv) Caption Files Caption text Time codes for synchronization with video Text Formatting Font and font size Carriage returns Bolding, colors, etc. Speakers Language support Captioning – QuickTime Video .mov file and others Caption file .txt QuickTime caption file SMIL .smi or .mov Integrates video and caption files Captioning – Media Player Video .wmv Caption file .smi (XML / SAMI) Integration file .asx Integrates video and caption files Captioning – Flash Flash code Video .flv Caption file .fla Whatever (.txt, .xml, .smi) XML configuration file Flash application (Shockwave) .swf compiled from Flash code Integrates video and caption files Creating a Video Shoot (or acquire) video/audio of highest possible quality Acquire secondary audio source and/or CART file if possible Capture, edit and compress video 3 output formats: .mov, .wmv, and .flv Make audio tapes for transcription Transcribing Audio or Video High quality audio makes better movies and better transcripts Staff or student workers transcribe using inhouse guidelines Transcript saved in 3 formats Includes speaker identification and non-verbal elements ([Laughter], [Applause], [Inaudible]) MSWord .doc accessible .pdf plain .txt for caption file Proof and correct Pre-Captioning Steps Text is broken up into “caption-sized chunks” Special characters eliminated (“smart” quotes, em-dashes, etc.) Caption timing software (MAGpie or HiCaption Both let you transcribe directly or import prepared text files Both attach timecodes to text in realtime Both export in plaintext, SAMI, QuickTime SMIL or RealPlayer SMIL Proof and Correct Final QuickTime Assembly The movie - moviename.mov The caption file -moviename_captions.txt Includes captions and timing info The SMIL file - moviename_smil.mov Combines movie and captions on the fly Includes URL pointers to movie & caption files .mov extension forces QT playback Captions display automatically as part of SMIL standard Final Windows Media Player Assembly The movie - moviename.wmv The SAMI file - moviename.smi Includes captions and timing info The ASX file - moviename.asx Includes URL pointers to movie & caption files User must toggle captions in Windows Media Player “View” menu Final Flash Player Assembly The Flash playback engine - moviename.swf The movie - moviename.flv The caption file -moviename_captions.txt Includes captions and timing info Same file as QT The caption control file - captions.xml Includes URL pointers to movie & caption files User must toggle captions in our Flash Video Player (CC icon, on by default) Files on the Server (For each movie) 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Transcript in Word Transcript in Acrobat Movie in QT Movie in Windows Media Player Movie in Flash Caption file SAMI file SMIL file Windows integration file Flash integration file Flash video player engine Resizable Flash page .doc .pdf .mov .wmv .flv .txt .smi .smi (or .mov) .asx .xml .swf .htm Flash Video Becoming more accessible by version 6 More integration with video Frustrated with “player wars” Lack of standards compliance Continual, relentless upgrades Difficulty in upgrading – pushing users toward paid versions Hijacking of media types / file extensions Flash – Compress Video Create .flv file from movie (.mov, .avi) Method 1 Import into Flash library and compress Sorenson Export Spark within Flash to external file or drag to timeline Method 2 Or compress using non-Flash application Sorenson Squeeze Create XML Configuration Open configuration file (XML) Add settings Video location Caption file location Video size and width in pixels Video total time in seconds Combine Files Upload Video (.flv) Caption file Caption configuration (caption.xml) Flash file (.swf) Incorporate embedding tags in HTML Flash Security Keep files in same folder Use BASE attribute And Test thoroughly, especially among browsers and browser versions Future Our Flash video player development Customized controls More configuration options in external XML file Embedded formatting in captions Speech recognition Real-time voice recognition Automatic time codes (real-time) Searchable / Linkable video Resources WebAIM World Wide Web Consortium Web Video Standards http://ncam.wgbh.org/webaccess/magpie/ Captioned Media Program http://www.hisoftware.com/hmcc/acc4mcc.html National Consortium on Accessible Media (MAGpie) http://www.w3.org/AudioVideo/ Hi Software (HiCaption) http://www.webaim.org/techniques/captions/ http://www.cfv.org National Association of the Deaf http://www.nad.org/ Contact Law, Health Policy & Disability Center This presentation http://disability.law.uiowa.edu/ http://disability.law.uiowa.edu/lhpdc/publications/kleinpubs.html LHPDC Bulletin Board (download Flash playback engine) http://disability2.law.uiowa.edu/ubbthreads/ubbthreads.php?Cat=3 David Klein 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected] K. “Fritz” Thompson 280-1 Boyd Law Bldg. College of Law University of Iowa Iowa City, IA 52242 319-335-6748[email protected]