LDPC codes revolutionized coding theory with significant performance improvements
Image: Wikideas1, CC0, via Wikimedia Commons
LDPC codes revolutionized coding theory with significant performance improvements
Low-density parity-check (LDPC) codes, also known as Gallager codes, have significantly improved coding theory since their resurgence in the mid-1990s. Originally conceived by Robert G. Gallager in 1960, these codes were largely ignored due to computational expense until improved hardware made them practical. They provided a high-performance, patent-free alternative to turbo codes, sparking a revolution in coding theory.
Example
LDPC codes are now widely used in wireless communications, such as 5G and WiFi, showcasing their adaptability and high performance.
Understanding LDPC codes is crucial for advancing wireless communication technologies and improving data transmission reliability.
Error correction code
Turbo codes achieve near-Shannon-limit error correction with iterative decoding
Error detection and correction
Reed-Solomon codes correct burst errors in data transmission and storage
Huffman coding
Huffman coding is an entropy-optimal prefix code for lossless data compression
Rate-distortion theory: minimum bits to represent data within distortion D
Rate-distortion theory: minimum bits to represent data within distortion D = R(D)
Shannon's source coding theorem: you can't compress below entropy
Shannon's theorem: Data compression can't exceed entropy limit
Kolmogorov complexity
Kolmogorov complexity is uncomputable
One email a day: 5 concepts + the 5 stories that matter →
Swipe through 100 ML concepts daily
Open TickerNews