An MPEG-7 Compatible Video Retrieval System with Integrated Support for Complex Multimodal Queries

We present BilVideo-7, an MPEG-7 compatible, video indexing and retrieval system that supports complex multimodal queries in a unified framework. An MPEG-7 profile is developed to represent the videos by decomposing them into Shots, Keyframes, Still Regions and Moving Regions. The MPEG-7 compatible...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE multimedia S. 1
Hauptverfasser: Bastan, Muhammet, Cam, Hayati, Gudukbay, Ugur, Ulusoy, Ozgur
Format: Magazine Article
Sprache:Englisch
Veröffentlicht: IEEE 2019
Schlagworte:
computer vision
Feature extraction
Fuses
H.2.4.e Multimedia databases
I.4 Image Processing and Computer Vision
I.5 Pattern Recognition
image processing
Indexing
MPEG 7 Standard
mpeg-7
multimedia
Multimedia databases
pattern recognition
Query processing
Semantics
Shape
Spatial databases
video processing
video retrieval
Visual databases
XML
ISSN:1070-986X, 1941-0166
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We present BilVideo-7, an MPEG-7 compatible, video indexing and retrieval system that supports complex multimodal queries in a unified framework. An MPEG-7 profile is developed to represent the videos by decomposing them into Shots, Keyframes, Still Regions and Moving Regions. The MPEG-7 compatible XML representations of videos according to this profile are obtained by the MPEG-7 compatible video feature extraction and annotation tool of BilVideo-7, and stored in a native XML database. Users can formulate text-based semantic, color, texture, shape, location, motion and spatio-temporal queries on an intuitive, easy-to-use Visual Query Interface, whose Composite Query Interface can be used to specify very complex queries containing any type and number of video segments with their descriptors. The multi-threaded Query Processing Server parses incoming queries into subqueries and executes each subquery in a separate thread. Then, it fuses subquery results in a bottom-up manner to obtain the final query result. The whole system is unique in that it provides very powerful querying capabilities with a wide range of descriptors and multimodal query processing in an MPEG-7 compatible interoperable environment. We present sample queries to demonstrate the capabilities of the system.
ISSN:1070-986X
1941-0166
DOI:10.1109/MMUL.2009.74