🛟 Convex Optimization

Given some $f:R^d\to R$, find:

• ${\min }_{w\in R^d}f(w)$
• $w\ast ={\text{argmin}}_{w\in R^d}f(w)$ where $f$ is continuous, differentiable, etc.

Linear Regression

☝️ Logistic Regression

Gradient Descent

Properties of Convex Functions

Backtracking Line Search

Subgradients

Stochastic Gradient Descent

Strong Convexity

Constrained Optimization

// TODO + split up into separate pages