The Hessian matrix is denoted by H or ∇²
Image: CC BY 4.0, via Wikimedia Commons
Hessian matrix
The Hessian matrix is denoted by H or ∇²
The Hessian matrix is a fundamental concept in multivariable calculus and optimization. It is a square matrix containing second-order partial derivatives of a scalar-valued function. The Hessian matrix provides valuable information about the local curvature of the function, helping to determine whether a critical point is a local minimum, maximum, or saddle point.
The Hessian matrix was developed in the 19th century by the German mathematician Ludwig Otto Hesse. Hesse originally used the term "functional determinants" to describe this matrix. Over time, the term "Hessian" became more commonly used.
The Hessian matrix can be denoted in several ways, including H, ∇², ∇⊗∇, or D². Each notation represents the same mathematical concept, but they may be used in different contexts or by different authors.
Example
For a function f(x, y) = x² + y², the Hessian matrix is given by H = [[2, 0], [0, 2]].
Understanding the Hessian matrix is crucial for analyzing the behavior of multivariable functions and optimizing them in various applications.
Related concepts
Normalization (machine learning)
L2 normalization equation: x_i' = x_i / ||x||_2
Gradient descent
Gradient descent weight update equation: w := w - α * ∇J(w)
Lagrangian L(x,λ) = f(x) - λg(x)
L(x,λ) = f(x) - λ(g(x) - c)
Regression analysis
Linear regression equation: ŷ = β0 + β1X
Stochastic gradient descent
Policy Gradient Theorem Equation
Rotation matrix
Determinant of a 2x2 matrix: ad - bc
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews