MPEG-4

Audio/video and synthetic graphics/audio for mixed media

verfasst von: Peter K. Doenges, Tolga K. Capin, Fabio Lavagetto, Joern Ostermann, Igor S. Pandzic, Eric D. Petajan
Abstract: MPEG-4 addresses coding of digital hybrids of natural and synthetic, aural and visual (A/V) information. The objective of this synthetic/natural hybrid coding (SNHC) is to facilitate content-based manipulation, interoperability, and wider user access in the delivery of animated mixed media. SNHC will support non-real-time and passive media delivery, as well as more interactive, real-time applications. Integrated spatial-temporal coding is sought for audio, video, and 2D/3D computer graphics as standardized A/V objects. Targets of standardization include mesh-segmented video coding, compression of geometry, synchronization between A/V objects, multiplexing of streamed A/V objects, and spatial-temporal integration of mixed media types. Composition, interactivity, and scripting of A/V objects can thus be supported in client terminals, as well as in content production for servers, also more effectively enabling terminals as servers. Such A/V objects can exhibit high efficiency in transmission and storage, plus content-based interactivity, spatial-temporal scalability, and combinations of transient dynamic data and persistent downloaded data. This approach can lower bandwidth of mixed media, offer tradeoffs in quality versus update for specific terminals, and foster varied distribution methods for content that exploit spatial and temporal coherence over buses and networks. MPEG-4 responds to trends at home and work to move beyond the paradigm of audio/video as a passive experience to more flexible A/V objects which combine audio/video with synthetic 2D/3D graphics and audio.
Externe Organisation(en): Evans & Sutherland
Eidgenössische Technische Hochschule Lausanne (ETHL)
Università degli studi di Genova (UniGe)
Lucent
Universität Genf
Bell Laboratories
AT&T Labs
Typ: Artikel
Journal: Signal Processing: Image Communication
Band: 9
Seiten: 433-463
Anzahl der Seiten: 31
ISSN: 0923-5965
Publikationsdatum: 05.1997
Publikationsstatus: Veröffentlicht
Peer-reviewed: Ja
ASJC Scopus Sachgebiete: Software, Signalverarbeitung, Maschinelles Sehen und Mustererkennung, Elektrotechnik und Elektronik
Elektronische Version(en): https://doi.org/10.1016/S0923-5965(97)00007-6 (Zugang: Geschlossen)

BibTeX

@article{a6b5d27242af4b51ac362787b9067d08,
title = "MPEG-4: Audio/video and synthetic graphics/audio for mixed media",
abstract = "MPEG-4 addresses coding of digital hybrids of natural and synthetic, aural and visual (A/V) information. The objective of this synthetic/natural hybrid coding (SNHC) is to facilitate content-based manipulation, interoperability, and wider user access in the delivery of animated mixed media. SNHC will support non-real-time and passive media delivery, as well as more interactive, real-time applications. Integrated spatial-temporal coding is sought for audio, video, and 2D/3D computer graphics as standardized A/V objects. Targets of standardization include mesh-segmented video coding, compression of geometry, synchronization between A/V objects, multiplexing of streamed A/V objects, and spatial-temporal integration of mixed media types. Composition, interactivity, and scripting of A/V objects can thus be supported in client terminals, as well as in content production for servers, also more effectively enabling terminals as servers. Such A/V objects can exhibit high efficiency in transmission and storage, plus content-based interactivity, spatial-temporal scalability, and combinations of transient dynamic data and persistent downloaded data. This approach can lower bandwidth of mixed media, offer tradeoffs in quality versus update for specific terminals, and foster varied distribution methods for content that exploit spatial and temporal coherence over buses and networks. MPEG-4 responds to trends at home and work to move beyond the paradigm of audio/video as a passive experience to more flexible A/V objects which combine audio/video with synthetic 2D/3D graphics and audio.",
keywords = "2D/3D graphics, Facial/avatar animation, Geometry/texture compression, Natural/synthetic hybrid coding, Real-time communications, Scalable multimedia, Structured synthetic audio, Text-to-speech synthesis, Text/graphics integration, Virtual environments",
author = "Doenges, {Peter K.} and Capin, {Tolga K.} and Fabio Lavagetto and Joern Ostermann and Pandzic, {Igor S.} and Petajan, {Eric D.}",
year = "1997",
month = may,
doi = "10.1016/S0923-5965(97)00007-6",
language = "English",
volume = "9",
pages = "433--463",
journal = "Signal Processing: Image Communication",
issn = "0923-5965",
publisher = "Elsevier",
number = "4",
}