{"id":798,"date":"2017-03-13T17:53:42","date_gmt":"2017-03-13T17:53:42","guid":{"rendered":"http:\/\/www.kelp-ml.org\/?page_id=798"},"modified":"2017-03-16T08:36:02","modified_gmt":"2017-03-16T08:36:02","slug":"regressionlearningalgorithm","status":"publish","type":"page","link":"http:\/\/www.kelp-ml.org\/?page_id=798","title":{"rendered":"Regression Algorithms"},"content":{"rendered":"<p>Algorithms that learn from labeled data a regression function.<\/p>\n<p>The following regression\u00a0learning algorithm are divided\u00a0into:<\/p>\n<ul>\n<li><strong>Kernel Methods<\/strong>: methods operating in the\u00a0Reproducing Kernel Hilbert Space<\/li>\n<li><strong>Linear Methods<\/strong>: methods operating in the explicit primal space<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h1 style=\"padding-left: 30px;\"><strong><span style=\"color: #800000;\">Kernel Methods<\/span><\/strong><\/h1>\n<hr \/>\n<h3>EpsilonSvmRegression<\/h3>\n<p><strong>Java class<\/strong>:\u00a0<a href=\"http:\/\/www.kelp-ml.org\/kelp-javadoc\/current-version\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/libsvm\/EpsilonSvmRegression.html\" target=\"_blank\">EpsilonSvmRegression<\/a><\/p>\n<p><strong>Source code<\/strong>:\u00a0<a href=\"https:\/\/github.com\/SAG-KeLP\/kelp-core\/blob\/master\/src\/main\/java\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/libsvm\/EpsilonSvmRegression.java\" target=\"_blank\">EpsilonSvmRegression.java<\/a><\/p>\n<p><strong>Maven Project<\/strong>: kelp-core<\/p>\n<p><strong>JSON type<\/strong>:\u00a0epsilonSvmRegression<\/p>\n<p><strong>Description<\/strong>: It implements the \u03b5-Support Vector Regression learning algorithm. It is a learning algorithm for linear regression based on Support Vector Machines [Vapnik(1998)]. It relies on kernel functions. It is a Java porting of the library LIBSVM v3.17, written in C++ [Chang and Lin(2011)].<\/p>\n<p><strong>Parameters:<\/strong><\/p>\n<ul>\n<li><em>kernel: The kernel function<\/em><\/li>\n<li><em>pReg<\/em>: The regularization parameter for positive examples<\/li>\n<li><em>c<\/em>: The regularization parameter<\/li>\n<\/ul>\n<hr \/>\n<h3>KernelizedPassiveAggressiveRegression<\/h3>\n<p><strong>Java class<\/strong>:\u00a0<a href=\"http:\/\/www.kelp-ml.org\/kelp-javadoc\/current-version\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/passiveaggressive\/KernelizedPassiveAggressiveRegression.html\" target=\"_blank\">KernelizedPassiveAggressiveRegression<\/a><\/p>\n<p><strong>Source code<\/strong>:\u00a0<a href=\"https:\/\/github.com\/SAG-KeLP\/kelp-additional-algorithms\/blob\/master\/src\/main\/java\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/passiveaggressive\/KernelizedPassiveAggressiveRegression.java\" target=\"_blank\">KernelizedPassiveAggressiveRegression.java<\/a><\/p>\n<p><strong>Maven Project<\/strong>: kelp-additional-algorithms<\/p>\n<p><strong>JSON type<\/strong>:\u00a0kernelizedPA-R<\/p>\n<p><strong>Description<\/strong>: Online Passive-Aggressive Learning Algorithm for regression tasks (kernel-based version, proposed in [Crammer et al.(2006)]).<\/p>\n<p><strong>Parameters<\/strong>:<\/p>\n<div class=\"page\" title=\"Page 48\">\n<div class=\"layoutArea\">\n<div class=\"column\">\n<ul>\n<li><em>kernel<\/em>: The kernel function<\/li>\n<li><em>policy<\/em>: The updating policy applied by the Passive Aggressive Algorithm\u00a0when a miss-prediction occurs<\/li>\n<li><em>c<\/em>: The aggressiveness parameter<\/li>\n<li><em>eps<\/em>: The accepted distance between the predicted and the real regression values<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<\/div>\n<\/div>\n<\/div>\n<h1>\u00a0<strong><span style=\"color: #800000;\">Linear\u00a0Methods<\/span><\/strong><\/h1>\n<hr \/>\n<h3>LibLinearRegression<\/h3>\n<p><strong>Java class<\/strong>: <a href=\"http:\/\/www.kelp-ml.org\/kelp-javadoc\/current-version\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/liblinear\/LibLinearRegression.html\" target=\"_blank\">LibLinearRegression<\/a><\/p>\n<p><strong>Source code<\/strong>:\u00a0<a href=\"https:\/\/github.com\/SAG-KeLP\/kelp-additional-algorithms\/blob\/ec316d2616aa9746c6c6f992654123fbcbdde05f\/src\/main\/java\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/liblinear\/LibLinearRegression.java\" target=\"_blank\">LibLinearRegression.java<\/a><\/p>\n<p><strong>Maven Project<\/strong>: kelp-additional-algorithms<\/p>\n<p><strong>JSON type<\/strong>: liblinearregression<\/p>\n<p><strong>Description<\/strong>: This class implements linear SVM regression trained using a coordinate descent algorithm [Fan et al.(2008)]. It operates in an explicit feature space (i.e., it does not rely on any kernel). This code has been adapted from the Java port of the original LIBLINEAR C++ sources.<\/p>\n<p><strong>Parameters<\/strong>:<\/p>\n<div class=\"page\" title=\"Page 45\">\n<div class=\"layoutArea\">\n<div class=\"column\">\n<ul>\n<li><em>p<\/em>: The \u03b5 in the loss function of SVR (default 0.1)<\/li>\n<li><em>c<\/em>: The regularization parameter<\/li>\n<li><em>representation<\/em>: The identifier of the representation to be considered for the training step<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<\/div>\n<hr \/>\n<h3>LinearPassiveAggressiveRegression<\/h3>\n<p><strong>Java class<\/strong>: <a href=\"http:\/\/www.kelp-ml.org\/kelp-javadoc\/current-version\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/passiveaggressive\/LinearPassiveAggressiveRegression.html\" target=\"_blank\">LinearPassiveAggressiveRegression<\/a><\/p>\n<p><strong>Source code<\/strong>:\u00a0<a href=\"https:\/\/github.com\/SAG-KeLP\/kelp-additional-algorithms\/blob\/ec316d2616aa9746c6c6f992654123fbcbdde05f\/src\/main\/java\/it\/uniroma2\/sag\/kelp\/learningalgorithm\/regression\/passiveaggressive\/LinearPassiveAggressiveRegression.java\" target=\"_blank\">LinearPassiveAggressiveRegression.java<\/a><\/p>\n<p><strong>Maven Project<\/strong>: kelp-additional-algorithms<\/p>\n<p><strong>JSON type<\/strong>:\u00a0linearPA-R<\/p>\n<p><strong>Description<\/strong>: Online Passive-Aggressive Learning Algorithm for regression tasks (linear version, proposed in [Crammer et al.(2006)]).<\/p>\n<p><strong>Parameters<\/strong>:<\/p>\n<div class=\"page\" title=\"Page 48\">\n<div class=\"layoutArea\">\n<div class=\"column\">\n<ul>\n<li><em>policy<\/em>: The updating policy applied by the Passive Aggressive Algorithm when a miss-prediction occurs<\/li>\n<li><em>c<\/em>: The aggressiveness parameter<\/li>\n<li><em>eps<\/em>: The accepted distance between the predicted and the real regression values<\/li>\n<li><em>representation<\/em>: The identifier of the representation to be considered for the training step<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<hr \/>\n<h3>References<\/h3>\n<p>Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer.\u00a0<em>On-line passive-aggressive algorithms<\/em>. Journal of Machine Learning Research, 7:551\u2013585, December 2006. ISSN 1532-4435.<\/p>\n<p><span class=\"s1\">Hsieh<\/span>, C.<span class=\"s2\">&#8211;<\/span>J., <span class=\"s1\">Chang<\/span>, K.<span class=\"s2\">&#8211;<\/span>W., <span class=\"s1\">Lin<\/span>, C.<span class=\"s2\">&#8211;<\/span>J., <span class=\"s1\">Keerthi<\/span>, S. S. and\u00a0<span class=\"s1\">Sundararajan<\/span>, S.\u00a0(2008). <em>A Dual Coordinate Descent Method for Large<span class=\"s2\">&#8211;<\/span>scale Linear SVM.<\/em>\u00a0Proceedings of the 25th international conference on Machine learning <span class=\"s2\">&#8211;<\/span> ICML\u00a0&#8217;08 (<span class=\"s1\">pp<\/span>. 408<span class=\"s2\">&#8211;<\/span>415). New York, New York, USA: ACM Press.<\/p>\n<p>R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and <b>C.-J. Lin<\/b>. <a href=\"https:\/\/www.csie.ntu.edu.tw\/~cjlin\/papers\/liblinear.pdf\">LIBLINEAR: A library for large linear classification <\/a><i><a href=\"http:\/\/www.jmlr.org\/\">Journal of Machine Learning Research<\/a><\/i> 9(2008), 1871-1874.<\/p>\n<p>&nbsp;<\/p>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Algorithms that learn from labeled data a regression function. The following regression\u00a0learning algorithm are divided\u00a0into: Kernel Methods: methods operating in the\u00a0Reproducing Kernel Hilbert Space Linear Methods: methods operating in the explicit primal space &nbsp; Kernel Methods EpsilonSvmRegression Java class:\u00a0EpsilonSvmRegression Source code:\u00a0EpsilonSvmRegression.java Maven Project: kelp-core JSON type:\u00a0epsilonSvmRegression Description: It implements the \u03b5-Support Vector Regression learning algorithm. <a href=\"http:\/\/www.kelp-ml.org\/?page_id=798\" rel=\"nofollow\"><span class=\"sr-only\">Read more about Regression Algorithms<\/span>[&hellip;]<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=\/wp\/v2\/pages\/798"}],"collection":[{"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=798"}],"version-history":[{"count":12,"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=\/wp\/v2\/pages\/798\/revisions"}],"predecessor-version":[{"id":914,"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=\/wp\/v2\/pages\/798\/revisions\/914"}],"wp:attachment":[{"href":"http:\/\/www.kelp-ml.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=798"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}