information theory

Also known as communication theory

mathematical theory from the field of probability theory and statistics

AI overview

Information theory is a branch of mathematics that uses probability and statistics to measure and understand how much information is contained in messages, data, or signals. It matters because it provides precise tools for figuring out how efficiently information can be communicated, stored, or processed—which is fundamental to everything from computer science to telecommunications.

AI-generated from the Wikipedia summary — may contain errors.

Research

69,529 papers

Information theory in vertebrate stress physiology.ReviewTrends in endocrinology and metabolism: TEM · 2022Zimmer C, Woods HA, Martin LBDOI: 10.1016/j.tem.2021.10.001
Information Theory: New Look at Oncogenic Signaling Pathways.ReviewTrends in cell biology · 2019Zielińska KA, Katanaev VLDOI: 10.1016/j.tcb.2019.08.005
Integrated information theory does not make plant consciousness more convincing.ReviewBiochemical and biophysical research communications · 2021Mallatt J, Taiz L, Draguhn A et al.DOI: 10.1016/j.bbrc.2021.01.022
The strength of weak integrated information theory.ReviewTrends in cognitive sciences · 2022Mediano PAM, Rosas FE, Bor D et al.DOI: 10.1016/j.tics.2022.04.008
Concepts and Applications of Information Theory to Immuno-Oncology.ReviewTrends in cancer · 2021Karolak A, Branciamore S, McCune JS et al.DOI: 10.1016/j.trecan.2020.12.013
Information theory in ecology.ReviewComputers & chemistry · 2001Ulanowicz REDOI: 10.1016/s0097-8485(01)00073-0
Information theory and neural coding.ReviewNature neuroscience · 1999Borst A, Theunissen FEDOI: 10.1038/14731
A Tutorial for Information Theory in Neuroscience.RevieweNeuro · 2018Timme NM, Lapish CDOI: 10.1523/ENEURO.0052-18.2018

via PubMed

Wikidata facts

Image: Binary erasure channel.svg

Show 4 more facts

Commons category: Information theory
ACM Classification Code (2012): 10003712
Stack Exchange tag: math.stackexchange.com/tags/information-theory
P13411: physiology

Sources (6)

via Wikidata · CC0

~40 min read

Article

Information theory is the mathematical study of the quantification, storage, and communication of a particular type of mathematically defined information. The field was established and formalized by Claude Shannon in the 1940s, though early contributions were made in the 1920s through the works of Harry Nyquist and Ralph Hartley.

Information theory was initially formed in the context of telecommunication but soon found a wide range of other applications. It is now at the intersection of mathematics, statistics and computer science, and has applications in diverse fields ranging from electrical engineering and physics to neurobiology.