What operator fusion does at the compiler level: merges adjacent ops to reduce memory traffic

What BPE tokenization does: iteratively merges the most frequent byte pairs

BPE tokenization merges the most frequent byte pairs iteratively to create subword units

How do lock-free data structures manage concurrent access to shared memory in a multithreaded environment?

Lock-free data structures use atomic operations to ensure concurrent access without traditional locking mechanisms

How tiling works in matrix multiplication — loading blocks into shared memory

Tiling in matrix multiplication optimizes cache usage by partitioning matrices into submatrices

What cooperative groups enable in CUDA: flexible thread synchronization patterns

CUDA allows cooperative groups for flexible thread synchronization patterns via atomic operations and events

What the Y combinator does: enables recursion in languages without named functions

The Y combinator enables recursive function definitions in lambda calculus and similar functional languages

What bank conflicts are in shared memory — multiple threads accessing the same bank

Shared memory conflicts arise when multiple threads concurrently access the same bank in a banking system