Amortized O(1) means expensive operations are rare enough to average out over time
Image: United States Federal Reserve Bank, Public domain, via Wikimedia Commons
Amortized O(1) means expensive operations are rare enough to average out over time
subword tokenization solves: handles rare words by breaking into known pieces
Subword tokenization solves rare word handling by breaking into known pieces
arithmetic intensity is
Arithmetic intensity = FLOPs / Bytes accessed
occupancy means in GPU programming
Occupancy = Active Warps / Max Warps
register pressure means: too many variables per thread reduces occupancy
Register pressure: Excessive variables per thread lead to reduced occupancy and potential performance bottlenecks
Effect size
Cohen's D benchmarks: 0.2 = small, 0.5 = medium, 0.8 = large effect
aliasing is: high frequencies masquerading as low frequencies due to undersampling
Aliasing occurs when high frequencies masquerade as low frequencies due to undersampling
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews