Write the formula for KL divergence D_KL(P||Q)

Write the equation for cross-entropy loss

H(y, p) = -Σ(y_i * log(p_i)) for all i

What is the formula for calculating the mutual information between two discrete random variables X and Y?

I(X;Y) = ∑∑ P(x,y) log(P(x,y)/(P(x)P(y)))

Write the formula for Mahalanobis distance

D^2 = (x - μ)^T Σ^(-1) (x - μ)

Write the policy gradient theorem equation

E[\nabla_\theta J(\theta)] = \mathbb{E}[\nabla_\theta \log \pi_\theta(a|s)]

Mutual information I(X;Y) = H(X) - H(X|Y) = H(Y) - H(Y|X)

Mutual information measures dependence between variables X and Y

Write the formula for PageRank equation

Pr(A) = (1-d) + d * Σ(Pr(W)/L(W)) for all outbound links W leading to page A