🛟 Convex Optimiation

Given some $f:R^d\to R$, find:

• ${\min }_{w\in R^d}f(w)$
• $w\ast ={\text{argmin}}_{w\in R^d}f(w)$ where $f$ is continuous, differentiable, etc.

Linear Regression

☝️ Logistic Regression

Properties of Convex Functions

Gradient Descent

Backtracking Line Search

Subgradients

Stochastic Gradient Descent

Strong Convexity

Constrained Optimization