
A fixed point is where dx/dt = 0
A fixed point is where dx/dt = 0
A fixed point in a dynamical system is a state where the rate of change is zero, meaning the system remains constant over time. This concept is fundamental in understanding the behavior of systems that evolve according to differential equations.
Example
Consider a simple pendulum. At its equilibrium position, the pendulum momentarily stops before swinging back, representing a fixed point where dx/dt = 0.
Identifying fixed points helps predict system behavior and stability, which is crucial for applications in various fields like physics and engineering.
the L1 norm is not differentiable at zero
The L1 norm is not differentiable at zero because the absolute value function has a kink at zero
Physics-informed neural networks
Neural ODEs model continuous-time dynamics with a neural network as the derivative
saddle points are more common than local minima in high dimensions
Saddle points arise due to mixed partial derivatives being zero, leading to more complex curvature in high dimensions
Lyapunov exponents measure: rate of divergence of nearby trajectories in a dynamical system
Lyapunov exponents measure the rate of divergence of nearby trajectories in a dynamical system
the condition number κ(A) measures: sensitivity of Ax=b to perturbations
The condition number κ(A) measures the sensitivity of Ax=b to perturbations
The elastic net combines L1 and L2: λ₁|w| + λ₂w² gives both sparsity and stability
Elastic net: λ₁|w| + λ₂w² enforces sparsity and stability simultaneously
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews