Usages of DASH for Rich Media Services
Download as PPTX, PDF•1 like•1,067 views
The document discusses the use of DASH (Dynamic Adaptive Streaming over HTTP) for delivering rich media services, covering both theoretical frameworks and practical implementations. It details two studies: the first focuses on creating a generic API for manipulating media presentation descriptions (MPDs) while ensuring compatibility with existing languages, and the second explores synchronizing rich media streams with related audio/video. Solutions proposed include the use of fragment identifiers, external data references, and initialization segments to improve bandwidth efficiency and interactivity in media delivery.
![Study B: DescriptionGoalDeliverRich Media Streamssynchronouslywithrelated audio/video dataAutomaticrepackaging of existingbroadcast interactive services over DASHRequirementsEnable transposition of the traditional carrousel approachMinimizebandwidth, leverage HTTPPreserveinteractivityUse caseDigital Radio Service [demonstration: http://www.youtube.com/watch?v=Bmer91TZhCo]T-DMB (MPEG-2 TS + MPEG-4 A/V + MPEG-4 BIFS)page 7](https://image.slidesharecdn.com/concolato169-110223123446-phpapp01/85/Usages-of-DASH-for-Rich-Media-Services-8-320.jpg)
Usages of DASH for Rich Media Services
- 1. Usages of DASH for Rich Media ServicesCyril ConcolatoJean Le FeuvreRomainBouqueauMMSys 2011
- 2. Rich Media ServicesServices featuringMultiple media elements audio, video, text, 2D/3D graphicsDynamicity Changing text, animated graphics, …Possibly triggered on server-side (streaming)Synchronization with media elementsInteractivityExample of Rich Media TechnologiesHTML 5, MPEG-4 BIFS, Flash…page 1
- 3. ContextRapid development of HTTP Streaming technologiesMPEG, 3GPP, OIPF, W3C, …Increased usages of Rich Media Technologies Presentation glue for A/V content (HTML+video)Streamed services including live meta-data (SVG/DIMS, MPEG-4 BIFS)page 2
- 4. Research QuestionsHow can Rich Media languages use DASH-delivered audio/video content?Study AHow can Rich Media content be delivered over DASH?Study Bpage 3
- 5. Study A: DescriptionGoalProvide a generic API for MPD manipulations within a rich media documentCompatibility with existing Rich Media languagesHypothesisBandwidth related manipulations are handled at the DASH levelTrick Mode related manipulations may be handledat both DASH and browser levelsRequirements The API shall provide access to:The desired video resolution & frame rateThe desired languageThe desired qualityThe desired viewpage 4
- 6. Study A: Architecturepage 5BrowserMedia PlayerIntegratedRenderingMedia Elements (audio,video…)Media Selectionand ControlRich Media Elements (HTML, …)DASH ClientHTTP Stack
- 7. Study A: SolutionsUse of fragment identifiersUse of attributes in DASH namespaceUse of ECMAScriptpage 6<video src="dash.mpd#viewpoint=1&width=176&height=144"><video src="dash.mpd"> <track kind=subtitles src="dash.mpd"dash:qualityRanking="1" srclang="en"></video>var track = createTrackFromDASH(‘subtitles’,‘lang’,’en’);
- 8. Study B: DescriptionGoalDeliverRich Media Streamssynchronouslywithrelated audio/video dataAutomaticrepackaging of existingbroadcast interactive services over DASHRequirementsEnable transposition of the traditional carrousel approachMinimizebandwidth, leverage HTTPPreserveinteractivityUse caseDigital Radio Service [demonstration: http://www.youtube.com/watch?v=Bmer91TZhCo]T-DMB (MPEG-2 TS + MPEG-4 A/V + MPEG-4 BIFS)page 7
- 9. Study B: Architecturepage 8IntegratedRenderingBrowserMedia PlayerRich Media Elements (HTML, …)Media Elements(audio, video…)DASH ClientHTTP Stack
- 10. page 9Digital Radio Service & Broadcast environmentDigital radio streamAudioData carousel (500 ms)Data carousel (2 s)Live dataDigital radio receivers
- 11. Approach1: Basic Segmentationpage 10Digital radio stream segments…Media SegmentMedia SegmentSegment the MPEG-2 TS Possiblywith « carousel » alignmentBandwidth inefficient because of carouselNeed to extract « carousel » data out of media segmentsDigital radio stream segments…Media SegmentMedia SegmentData into IS not yetallowed by the DASH standardProblem: how to signal version numberincrementWithoutrequiring the use of new periodsInitialization SegmentApproach 2: InitializationSegmentpage 11
- 12. Approach 3: Externaldata referencespage 12Digital radio stream segments…Media SegmentMedia SegmentMedia Segment with updated data referenceswith initial datareferenceswith initial datareferences= HTTP link to= HTTP link to= HTTP link to
- 13. Approach3: Externaldata references (cont’d)External Data References and Segment formatsNot possible with MPEG-2 TS syntaxPotentially possible with FLUTE or others but highoverheadPossible withDataReferenceBox in MP4Not yetauthorized by the DASH standardAdditionalproblemAvoidcarouselrefresh for DASH clients already« tuned-in »Use of « redundant » signaling in MP4page 13
- 14. AdditionalConsideration:RedundantSignalingpage 14Media Segment #nMedia Segment #n+1No change in « carousel » dataUser interactswith Client 1 and locally changes the Rich Media StateClient 1 processes segment #n including « Carousel » dataClient 1 ignores redundant data (preserved interaction)Client 2 processes « Carousel » data Client 1 starts and requestssegment #nClient 1 requests segment #n+1Client 2 startsand requestssegment #n+1
- 15. Study B: Summary of solutions Use of data in Initialization Segment (IS)Under evaluation for DASHUse of external data references (EDR)Requires MP4Under evaluation for DASHUse of redundantsignaling (RS) in MP4 for RM dataAccepted as an MP4 amendmentPossible joint usages:IS+EDR or EDR + RS or IS+EDR+RSpage 15
- 16. ImplementationGPAC Open Source ProjetDASH PlayerSupports MPD and M3U8 playlistsMP4BoxSegmentation tool for MP4 filesMP42TSDVB & DMB MuxSegmentationpage 16