Home
Resource
A novel framework for understanding atypical images
PDF
PDF format is widely accepted and good for printing.
Plug-in required
PDF-1(59.41 MB)
Citation & Export
View Usage Statistics
Staff View

Citation & Export
Hide

Simple citation

Saleh, Babak. A novel framework for understanding atypical images. Retrieved from https://doi.org/doi:10.7282/T36W9DH1

Export

Click here for information about Citation Management Tools at Rutgers.

Statistics
Hide

Description

TitleA novel framework for understanding atypical images
NameSaleh, Babak (author); Elgammal, Ahmed (chair); Feldman, Jacob (internal member); Bekris, Kostas (internal member); Parikh, Devi (outside member); Rutgers University; Graduate School - New Brunswick
Date Created2017
Other Date2017-01 (degree)
SubjectComputer Science, Machine learning, Computer vision, Image processing
Extent1 online resource (xvi, 181 p. : ill.)
DescriptionIn the past few years, there has been a tremendous amount of progress in the field of computer vision. As of now, we have reliable object detectors and classifiers that can recognize thousands of object categories. However, the ultimate goal of computer vision is to build systems that can understand and reason about images, far beyond scene categorization and object detection. In this thesis, algorithms have been proposed to empower computers with the human-level ability of detecting and reasoning about images that are understudied in the mainstream computer vision community. In chapter 1, we open the conversation about abnormality detection, by discussing how hu- mans form visual concepts (e.g. an object category) and perceive meaningful deviations from these learned concepts as signals for abnormality. However, there is not a comprehensive study about what factors lead humans in this decision-making process. In chapter 2 we collect the first dataset of abnormal images from the web. Conduct several human subject experiments, and perform a thorough set of analysis to discover hidden factors in human judgment about abnormality. These analyses lead us to propose a taxonomy of comprehensive reasons of ab- normality in images. Inspired by human reasoning, we address the problem of detecting abnormal objects and reasoning about their abnormality in terms of visual attributes, such as irregular shape, texture or color (chapter 3). Although our computational models are learned without seeing any ab- normal objects at training time, but still are capable of detecting and reasoning about abnormal images at the test time. In chapter 4 we develop probabilistic frameworks to model typical images and find atypical images as a meaningful deviation from this model. In chapter 5, we use the typicality scores of images and objects to improve the generalization capacity of the state- of-the-art Convolutional Neural Networks (CNN) for the task of object classification. We train these CNN models by minimizing a weighted loss function that incorporates in the typicality scores of samples. Our experiments show that this training strategy results in more generalized classifiers, which can be applied even to the extent of abnormal images. In chapter 6 of this thesis, we study two problems that extend our framework for abnormality detection to special cases. We develop algorithms for detecting and localizing attributes in images. In addition to the application of localized attributes for the problem of abnormality detection, we show that fine-grained object categorization benefit from such rich information as well. We also propose algorithms to learn visual classifiers directly from the textual description of an object category. This zero-shot learning strategy extends the abnormality detection framework to object categories that are not present at the time of training. We close this thesis by discussing the main contributions and some future work.
NotePh.D.
NoteIncludes bibliographical references
Noteby Babak Saleh
Genretheses, ETD doctoral
Persistent URLhttps://doi.org/doi:10.7282/T36W9DH1
Languageeng
CollectionGraduate School - New Brunswick Electronic Theses and Dissertations
Organization NameRutgers, The State University of New Jersey
RightsThe author owns the copyright to this work.
Version 8.5.5
Rutgers University Libraries - Copyright ©2024