GAT (Graph Attention Network) adds: learned attention weights between neighbors

GCN (Graph Convolutional Network) does: spectral convolution approximated by neighbor averaging

GCN approximates spectral convolution via neighbor averaging

message passing does in GNNs: each node aggregates features from its neighbors

Each node aggregates features from its neighbors using message passing

Graduate Aptitude Test in Engineering

GATE exam assesses engineering and science undergraduate subjects for postgraduate admissions in India

GraphSAGE does: samples and aggregates a fixed-size neighborhood

GraphSAGE samples and aggregates a fixed-size neighborhood

Attention (machine learning)

Flash attention speeds up processing by tiling attention across input, avoiding N×N matrix materialization

ring attention does: distributes long sequences across multiple devices

Ring attention distributes long sequences across multiple devices