The MPEG-7 Standard - A Brief Tutorial - .


27 views
Uploaded on:
Category: Medical / Health
Description
The MPEG-7 Standard - A Brief Tutorial -. Ali Tabatabai Sony US Research Laboratories February 27, 2001. Objectives of the MPEG-7 Standard Main Elements of MPEG-7 Scope of MPEG-7 MPEG-7 Application Areas MPEG 7’s relation with other standards. Outline. Fast & Accurate Access.
Transcripts
Slide 1

The MPEG-7 Standard - A Brief Tutorial - Ali Tabatabai Sony US Research Laboratories February 27, 2001

Slide 2

Objectives of the MPEG-7 Standard Main Elements of MPEG-7 Scope of MPEG-7 MPEG-7 Application Areas MPEG 7\'s connection with different guidelines Outline

Slide 3

Fast & Accurate Access Personalized Content Production and Consumption Content Management Automation Why do we require MPEG-7 ? Bolster for Advanced Query Visual Audio Sketch + N e d

Slide 4

Established in 1988 A Working Group of ISO/IEC responsible for the Development of Standards for Coded Representation of Digital Audio and Video MPEG: A Brief History (1) MPEG: Moving Picture Experts Group ISO/IEC/JTC1/SC29/WG11

Slide 5

MPEG: A Brief History (2) MPEG-1 : Interactive CD and MP3 11/1992 MPEG-2 : DTV, STB, DVD 11/1994 MPEG-4 : Web and Mobility ver1: 09/1998 ver2: 11/1999 MPEG-7 : ??? 08/2001 MPEG-21 : Multimedia Framework 11/2001

Slide 6

IS NOT a COMPRESSION Standard like MPEG-1/2/4 or their Extension IS NOT a STANDARD for FEATURE EXTRACTION/MATCHING Content Description of Various Audio Visual Information MPEG-7: What Is It ? THE MPEG 7 STANDARD Types of Audio Visual Information Audio, Speech Moving video, still pictures, illustrations Information on how articles are joined in scenes

Slide 7

MPEG-7: Application Areas Storage and recovery of varying media databases ( picture, film, radio files ) Broadcast media determination ( radio, TV programs ) Surveillance ( movement control, surface transportation, generation chains ) E-business and Tele-shopping ( hunting down garments/designs ) Remote detecting ( cartography, biology, normal assets administration ) Entertainment ( scanning for a diversion, for a karaoke ) Cultural administrations ( historical centers, workmanship exhibitions ) Journalism ( hunting down occasions, people ) Personalized news benefit on Internet ( push media sifting ) Intelligent sight and sound presentations Educational applications Bio-restorative applications

Slide 8

MPEG-7 Description Scope for AV Content Description Granularity Low-level High-level Form Access Classification Link Context

Slide 9

MPEG-7: Main Elements Descriptors (D) linguistic structure and semantics of every element representation Description Schemes (DS) structure and semantics of the connections between parts Description Definition Language (DDL) production of new DS\'s alteration/augmentation of existing DS\'s

Slide 10

MPEG-7: Major Functionalities Systems (ISO/IEC 15938 - 1) Description Definition Language (ISO/IEC 15938 - 2) Visual (ISO/IEC 15938 - 3) Audio (ISO/IEC 15938 - 4) Multimedia Description Schemes (ISO/IEC 15938 - 5) Reference Software (ISO/IEC 15938 - 6)

Slide 11

DDL <Object> <Label/> <Definition/> . . </Object> Instantiation DS2 Systems D1 D2 D3 0001100 MPEG-7: Main Elements (2) DS1 DS3

Slide 12

MPEG-7: Systems It characterizes apparatuses to: accommodate proficient capacity and transport synchronize amongst substance and portrayal oversee and ensure licensed innovation

Slide 13

MPEG-7: DDL and its Components Description Definition Language: Creation of the Ds and DS\'s: XML Schema & MPEG-7 Extensions Instantiation of XML Schema: Data sorts Simple and Complex sorts Elements, characteristics Inheritance, Abstract sorts MPEG-7 expansions: Array and Matrix information sort

Slide 14

MPEG-7: Audio Sound Effects Music Instrument Timbre Spoken Content Melody Contour

Slide 15

MPEG-7: Visual (1) Color quantization, prevailing, versatile, shading structure, design, GoF/GoP Texture Shape area based, form based, 3D Motion camera movement, movement direction, parametric movement, movement action

Slide 16

MPEG-7: Visual (2) Localization spatio transient Others confront acknowledgment

Slide 17

MPEG-7: Basic Visual Structures Grid Layout 2D-3D Multiple View Time Series Spatial 2D Coordinates Temporal Interpolation

Slide 18

Video sections Still districts Moving areas Audio fragments Low level Audio Visual descriptors Color Shape Position Texture Color Camera movement Motion action Mosaic Color Motion direction Parametric movement Spatio-fleeting shape Spoken substance Spectral portrayal Music: timbre, song

Slide 19

Basic components Schema Datatype & Link & media Basic DSs devices structures limitation MPEG-7: MMDS Basic Elements Root, Top-level components, Packages Time, Duration, Medialocators Language Annotation,Person, Place

Slide 20

Creation & generation Media Content Usage Content administration Content depiction Structural Conceptual angles viewpoints Basic components Schema Datatype & Link & media Basic DSs devices structures restriction MPEG 7: Content Management and Description Title, Creator, Creation area & date, Purpose, Classification, Genre, Review, Parental direction, and so on. (Creator produced) Format, Coding, Instances, Identification, Transcoding Hint, and so forth. (A few occurrences) Rights holder, Access rights, Usage Record, Financial angles, and so on. (Advancement) Viewpoint of the structure: Segments Spatial/transient structure Audio, video low-level Ds Elementary semantic data. Perspective of reasonable ideas Events, objects, unique ideas, and their connection

Slide 21

SR1: · Creation, Usage meta data · Media portrayal · SR6: Textual explanation · Color Histogram Color histogram, Texture · Textual comment SR2: · Shape · Color Histogram · Textual comment SR5: · Shape · Textual comment SR3: · Shape SR4: · Color Histogram · Shape · Textual comment · Color Histogram · Textual comment Example of Segment trees Foreground Background

Slide 22

Time Semantic DS (Events) • Introduction • Summary • Program logo • Studio • Overview • News Presenter • News Items • International • Clinton Case • Pope in Cuba • National • Twins • Sports • Closing Axis Segment Tree Shot1 Shot2 Shot3 Segment 1 Sub-section 1 Sub-fragment 2 Sub-fragment 3 Sub-section 4 fragment 2 Segment 3 Segment 4 Segment 5 Segment 6 Segment 7

Slide 23

Navigation & Creation & Access generation Media Content Usage Summary Content administration Content depiction Variation Structural Conceptual viewpoints angles Basic components Schema Datatype & Link & media Basic DSs apparatuses structures limitation MPEG 7: Navigation and Access Efficient support of: disclosure, perusing, route, perception Substitution of the first substance Adaptation to terminal, system, or client inclinations

Slide 24

Hierarchical Summary HighlightLevel Highlight Segment A-V Data MPEG 7: Hierarchical synopsis

Slide 25

Frame Property Sequential Text Summary Property Sound Property A-V Data MPEG 7: Sequential outline

Slide 26

MPEG 7: Variation Universal Multimedia Access Adapt conveyance to network and terminal qualities (QoS)

Slide 27

Analytic Model Content association Navigation & Creation & Access generation Media Content Usage Summary Content administration Content portrayal Variation Structural Conceptual angles Basic components Schema Datatype & Link & media Basic DSs devices structures restriction MPEG-7: Content Organization Collection & Classification Description and association of gathering of archives

Slide 28

MPEG-7: Collection

Slide 29

Analytic Model Content association Navigation & Creation & Access generation Media Content Usage User inclinations Summary Content administration Content depiction Variation Structural Conceptual viewpoints perspectives Basic components Schema Datatype & Link & media Basic DSs devices structures confinement MPEG 7: User Interaction Collection & Classification User Interaction User distinguishing proof and inclinations: Filtering, hunt and perusing

Slide 30

MPEG-7 Its Relation with different norms AHG on "Metadata harmonization": SMPTE: Metadata word reference, KLV encoding Dublin Core Metadata Initiative European Broadcast Union AHG on TV AnyTime Application Large number of Liaisons: SMPTE Dublin Core W3C (XML Schema) and so forth

Slide 31

MPEG-7: TimeLine - The Work Plan Divergence Competition: Individual work Definition extension and r Convergence 1996 1998 1999 2000 2001 Call for proposition Working draft Committee draft International standard Final board Draft global standard

Slide 32

MPEG - 7: AV content depiction for interoperable application Description Definition Language: XML Schema (adaptability) + Binary rendition (productivity) Description Schemes: Library of depiction devices Covers an extensive variety of bland needs Conclusions on AV Content Description and MPEG-7

Recommended
View more...