Journal article
Markup SVG-An Online Content-Aware Image Abstraction and Annotation Tool
IEEE transactions on multimedia, v 13(5), pp 993-1006
01 Oct 2011
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
Suppose you want to effectively search through millions of images, train an algorithm to perform image and video object recognition, or research the complex patterns and relationships that exist in our visual world. A common and essential component for any of these tasks is a large annotated image dataset. However, obtaining labeled image data is a complex and tedious task that requires methods for annotating and structuring content. Therefore, we developed a comprehensive online tool and data structure, Markup SVG, that simplifies the collection of annotated image data by leveraging state-of-the-art image processing techniques. As the core data structure of our tool, we adopt scalable vector graphics (SVG), an extensible and versatile language built upon XML. Given the extensibility of our framework, we are able to encode low-level image features, high-level semantics, and further define interactions with the data to assist the user with image annotation. We also demonstrate the ability to merge multiple online and offline datasets into our system in an effort to standardize image collection and its data representation. Lastly, we present our modular design; each component acts as a plug-in to our system. We developed several novel components and algorithms to highlight the possibilities of semi-supervised segmentation and automatic annotation within our proposed framework. Further, our modular design provides the necessary capabilities to incorporate future image features, methods, or algorithms. Our results show that our tool is able to greatly simplify the process of obtaining large annotated image collections in an online collaborative platform.
Metrics
Details
- Title
- Markup SVG-An Online Content-Aware Image Abstraction and Annotation Tool
- Creators
- Edward Kim - Lehigh UniversityXiaolei Huang - Lehigh UniversityGang Tan - Lehigh University
- Publication Details
- IEEE transactions on multimedia, v 13(5), pp 993-1006
- Publisher
- IEEE
- Number of pages
- 14
- Grant note
- 0812120; 0854606 / Div Of Information & Intelligent Systems; Direct For Computer & Info Scie & Enginr; National Science Foundation (NSF); NSF - Directorate for Computer & Information Science & Engineering (CISE) IIS-0812120 / National Science Foundation NSF; National Science Foundation (NSF)
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- Computer Science (Computing)
- Web of Science ID
- WOS:000295007300013
- Scopus ID
- 2-s2.0-80052942174
- Other Identifier
- 991021884692304721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Web of Science research areas
- Computer Science, Information Systems
- Computer Science, Software Engineering
- Telecommunications