wavelets provide over Fourier: both time and frequency localization

Short-time Fourier transform

STFT divides a signal into shorter segments for analysis

sinusoidal position encoding works: each dimension has a different frequency

Sinusoidal position encoding assigns unique frequencies to each dimension, enabling the model to distinguish positions effectively

L1 vs L2 regularization: L1 gives sparsity (feature selection), L2 gives small weights

L1 regularization: L1 = L2 + sparsity; L2 regularization: L2 = L1 + small weights

Rate-distortion theory: minimum bits to represent data within distortion D

Rate-distortion theory: minimum bits to represent data within distortion D = R(D)

AI content watermarking

AI content watermarking embeds imperceptible signals

aliasing is: high frequencies masquerading as low frequencies due to undersampling

Aliasing occurs when high frequencies masquerade as low frequencies due to undersampling