Learning Robust Support Vector Machine Classifiers With Uncertain Observations
Electronic Theses of Indian Institute of Science
View Archive InfoField | Value | |
Title |
Learning Robust Support Vector Machine Classifiers With Uncertain Observations
|
|
Creator |
Bhadra, Sahely
|
|
Subject |
Support Vector Machines
Machine Learning Robust Classifiers Robust Optimization Kernel Matrices - Uncertainty Chance Constraint Programming Interval-Valued Uncertainty Vector Machine Classifiers Kernel Matrix Robust Classification Robust Formulations Knowledge Uncertainity Mirror Descent Algorithm (MDA) Computer Science |
|
Description |
The central theme of the thesis is to study linear and non linear SVM formulations in the presence of uncertain observations. The main contribution of this thesis is to derive robust classfiers from partial knowledge of the underlying uncertainty. In the case of linear classification, a new bounding scheme based on Bernstein inequality has been proposed, which models interval-valued uncertainty in a less conservative fashion and hence is expected to generalize better than the existing methods. Next, potential of partial information such as bounds on second order moments along with support information has been explored. Bounds on second order moments make the resulting classifiers robust to moment estimation errors. Uncertainty in the dataset will lead to uncertainty in the kernel matrices. A novel distribution free large deviation inequality has been proposed which handles uncertainty in kernels through co-positive programming in a chance constraint setting. Although such formulations are NP hard, under several cases of interest the problem reduces to a convex program. However, the independence assumption mentioned above, is restrictive and may not always define a valid uncertain kernel. To alleviate this problem an affine set based alternative is proposed and using a robust optimization framework the resultant problem is posed as a minimax problem. In both the cases of Chance Constraint Program or Robust Optimization (for non-linear SVM), mirror descent algorithm (MDA) like procedures have been applied. |
|
Contributor |
Bhattacharyya, Chiranjib
|
|
Date |
2015-08-19T07:36:03Z
2015-08-19T07:36:03Z 2015-08-19 2012-03 |
|
Type |
Thesis
|
|
Identifier |
http://etd.iisc.ernet.in/handle/2005/2475
http://etd.ncsi.iisc.ernet.in/abstracts/3194/G25312-Abs.pdf |
|
Language |
en_US
|
|
Relation |
G25312
|
|