epsilon-SSVR: a smooth support vector machine for epsilon-insensitive regression Yuh-Jye Lee, Wen-Feng Hsieh, and Chien-Ming Huang   View Paper (PDF)   Return to May 2005, Volume 17, Issue 5 Abstract A new smoothing strategy for solving epsilon-support vector regression (epsilon-SVR), tolerating a small error in fitting a given data set linearly or nonlinearly, is proposed in this paper. Conventionally, epsilon-SVR is formulated as a constrained minimization problem, namely, a convex quadratic programming problem. We apply the smoothing techniques that have been used for solving the support vector machine for classification, to replace the epsilon-insensitive loss function by an accurate smooth approximation. This will allow us to solve epsilon-SVR as an unconstrained minimization problem directly. We term this reformulated problem as epsilon-smooth support vector regression (epsilon-SSVR). We also prescribe a Newton-Armijo algorithm that has been shown to be convergent globally and quadratically to solve our epsilon-SSVR. In order to handle the case of nonlinear regression with a massive data set, we also introduce the reduced kernel technique in this paper to avoid the computational difficulties in dealing with a huge and fully dense kernel matrix. Numerical results and comparisons are given to demonstrate the effectiveness and speed of the algorithm. ©2006 Association for Computing Machinery