Skip to content Skip to navigation
Summary: Brief explanation of Support Vector Machines (SVM) and the related optimization problem
A Support Vector Machine (SVM) is a decision-based prediction algorithm which can classify data into several groups. It is based on the concept of decision planes where the training data is mapped to a higher dimensional space and separated by a plane defining the two or more classes of data [1].
A simple example is seen in Figure 1. Squares are data of class one while circles are data of class two. The SVM sets up the decision plane (in this case a simple line) and separates the two classes.
| 2-D Example |
|---|
 |
However, often the data is not distinguishable in two dimensions in which case it is mapped to higher dimensions and the same process is done. An example is shown in Figure 2.
| Mapping In Higher Dimensional Space |
|---|
 |
Support Vector Machine models can be classified into four major groups.
The first two are classification algorithms which minimize different error functions while the second two perform similar algorithms by regression [1].
[1] Chih-Chung Chang and Chih-Jen Lin, LIBSVM : a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
More about this module: Metadata | Downloads | Version History
This work is licensed by Siddharth Gupta, Veena Padmanabhan, Heather Johnston, and Grant Lee under a Creative Commons Attribution License (CC-BY 2.0), and is an Open Educational Resource.
Last edited by Heather Johnston on Dec 23, 2005 1:17 pm -0600.
