Skip to content

Sections

Maps Timeline Graph Cosmos Life Culture Innovation People Climate Trends Art

Browse Dictionary Books Food Places Asteroids Search

© 2026 Vinony · Knowledge from Wikipedia, Wikidata, and 27 public APIs.

Shannon's source coding theorem · Vinony

🌐English

English Español Français Italiano Nederlands Polski Português Русский فارسی 中文日本語

EntityQ2411312· pop 16· linked from 41 articles

Shannon's source coding theorem

Data compression theory

Available in 16 languages

Español
Français
中文
日本語
Русский
Português
Italiano
Catalan
Macedonian

Connections

information entropy

Categories

Coding theory Data compression Information theory Mathematical theorems in theoretical computer science Presentation layer protocols

Sources

wikipedia.externallinksexternallink

via Wikidata sitelinks · CC0

independent and identically distributed random variables

Entity

International Standard Book Number

Wayback Machine

information theory

data compression

random variable

Kolmogorov complexity

Kullback–Leibler divergence

channel capacity

mutual information

error correction code

Shannon–Hartley theorem

Sign in to save

What links here41 pages

information theory

information entropy

Jacob Wolfowitz

Rate–distortion theory

Shannon–Fano coding

arithmetic coding

algorithmic information theory

information content

conditional entropy

A Mathematical Theory of Communication

differential entropy

quantum information

statistical inference

mutual information

Similar entities

Discovered by embedding cosine similarity (sentence-transformers MiniLM, 384-dim).

Entitydist 0.33

Sub-band coding

Entitydist 0.45

Entitydist 0.46

Audio Lossless Coding

Entitydist 0.46

Jensen–Shannon divergence

Entitydist 0.54

Linear predictive coding

Entitydist 0.55

principle of maximum entropy

Entitydist 0.56

Radio Data System

Entitydist 0.59

Entitydist 0.61

Entitydist 0.61

Enhanced full rate

Entitydist 0.62

König's theorem

Entitydist 0.63