## Machine Learning Notes

2013 Sang Han

A collection of notes and useful articles on numerical algorithms.

# Definitions

**Markov Chains:** A special type of *stochastic process*. The standard
definition of a stochastic process is an ordered collection of random variables:

**Self-Organized Criticality (SOC)**: “Self-Organized” means that from any initial condition, the system tends to move toward a critical state, and stay there, without external control. A system is “critical” if it is in transition between two phases.

**Kernel Density Estimation**: Because fuck histograms.

### Regression:

- Least Squares
- Ridge Regression
- Last Angle Regression
- Elastic Net
- Kernel Ridge Regression
- Support Vector Machines (SVR)
- Partial Least Squares (PLS ...