SQL vs NoSQL: SQL enforces schema and ACID, NoSQL offers flexibility and horizontal scaling

ACID

ACID guarantees data validity in transactions

REST vs GraphQL: REST has fixed endpoints, GraphQL lets clients request specific fields

REST uses fixed endpoints; GraphQL allows clients to request specific fields

consistent hashing does: minimizes remapping when nodes join/leave

Consistent hashing distributes data across nodes, minimizing remapping when nodes join/leave

Hash table

Hash table lookup: O(1) average time complexity

paged attention (vLLM) improves serving throughput

Paged attention (vLLM) improves serving throughput by reducing latency through non-contiguous KV-cache pages, enabling faster data retrieval

the vocabulary size matters: larger vocab = shorter sequences but more parameters

Larger vocab reduces sequence length, increasing model complexity and parameters