|
|
Boosted Generalized Additive Models (bgam) package 1.0 File ID: 84475 |
|---|
|
| Boosted Generalized Additive Models (bgam) package 1.0 License: Shareware File Size: 20.5 KB Downloads: 3
| Submit Rating: |
|
|
|
Boosted Generalized Additive Models (bgam) package 1.0 Description |
|---|
Description: bgam - Boosted Generalized Additive Models package
---
Implements boosting for the Generalized Additive and Linear Models (GAM and GLM).
Extensible, fully documented. Implements linear and stub learners,
least-squares/logistic/Poisson regression.
The generalized linear model (GLM) is a flexible generalization of ordinary
least squares regression. The GLM generalizes linear regression by allowing
the linear model to be related to the response variable via a link function
and by allowing the magnitude of the variance of each measurement to be a
function of its predicted value. (Wikipedia)
A common example of a GLM is binomial-logistic distribution/inverse link
GLM (aka logistic regression), where:
eta = X*w, y ~ Binomial( logistic (eta ))
This GLM allows one to tackle classification problems (where the output is 0 or 1)
in a quasi-linear way.
The generalized additive model (GAM) is a generalization of the GLM where the internal
dynamics are nonlinear, but nevertheless additive:
eta_i = f_1(X^(i,1)) + f_2(X^(i,2)) + ...
f_i are known as smoothers or (in the context of boosting) as learners. Boosting is
a method of fitting GAMs and by extension GLMs by building up a model (eta) iteratively,
by, at every iteration, adding to the model the learner most similar to the gradient
of the likelihood with respect to eta. Regularization is usually done by early-stopping
where the optimal number of iterations is determined through validation.
bgam is a well-documented package that implements boosting with GAMs.
It currently implements linear learners and stubs (depth-1 trees). Implemented distro-link
combos include Gaussian/identity, Binomial/Logistic, Poisson/exponential. The package is
object-oriented and new distro-link combos and learners can be implemented and used
with ease. The package includes facilities for cross-validation, including a parallel implementation through the parallel computing toolbox. It also allows a subset
of the data to be used at any boosting iteration (stochastic gradient boosting).
Open up TestBgam.m in the editor for several usage examples.
Contributions and requests for new features are welcome.
Author: Patrick Mineault (patrick DOT mineault AT gmail DOT com)
References:
Friedman, Hastie and Tibshirani. Additive logistic regression: a
statistical view of boosting. Ann. Statist. Volume 28, Number 2 (2000),
337-407.
BdoDshlmann and Hothorn. Boosting Algorithms: Regularization, Prediction
and Model Fitting. Statist. Sci. Volume 22, Number 4 (2007), 477-505.
Wood. Generalized Additive Models: an introduction with R. CRC Press,
2006.
Hastie, T. J. and Tibshirani, R. J. (1990). Generalized Additive
Models. Chapman & Hall/CRC. License: Shareware Related: objectoriented, implemented, includes, poissonexponential, binomiallogistic, Include, gaussianidentity, facilities, crossvalidation, Toolbox O/S:BSD, Linux, Solaris, Mac OS X File Size: 20.5 KB Downloads: 3
|
|
| More Similar Code |
|---|
This is the package for online (competitive)/batch prediction using generalized linear models under square loss. The algorithms are derived using the Aggregating Algorithm.
The algorithms have guarantees on the cumulative square loss for the worst case when applied in online fashion in comparison with the best model from the class [1].
The variable regressed should lie in [0,1], thus the program is a tool for two-class...
Optimal experimental designs for generalized linear models (GLM) depend on the unknown coefficients, and two experiments having the same model but different coefficient values will typically have different optimal designs. Therefore, unlike...
Sequential Experimental Designs for Generalized Linear Models
Experimental Design is about choosing locations in which to take measurements. For example, choosing different drug doses in which to examine the success of a treatment. A...
Generalized linear models (GLMs) are a natural extension of linear regression models in which eta = X*w is related to y by a fixed nonlinearity and a possibly non-Gaussian noise source. Standard linear regression, logistic regression and Poisson...
fastBSpline - A fast, lightweight class that implements
non-uniform B splines of any order
Matlab's spline functions are very general. This generality comes at
the price of speed. For large-scale applications, including...
Bayesian analysis is often hard to implement. While working on sequential experimental design for GLM, we suggested a simple implementation that numerically assesses the posterior in cases where the closed form of the Bayesian posterior is hard to...
the package has compared two L1 regularized image restoration models
Generates the Data Envelopment Analysis for additive, BCC and CCR models (with a choice of input or output orientation).
This submission provides functions (and examples scripts) for estimation, simulation and forecasting of a general Markov Regime Switching Regression.
Features of the package:
- Support for univariate and multivariate models.
This package includes files for modelling nonlinear dynamic systems using a recurrent generalized neural network. The learning scheme uses the complex method of nonlinear nonderivative optimization, thereby avoiding the problems of computing the... |
| User Review for Boosted Generalized Additive Models (bgam) package |
|
