This is the talk page for discussing improvements to the Information theory article. This is not a forum for general discussion of the subject of the article.
This article is within the scope of WikiProject Statistics, a collaborative effort to improve the coverage of statistics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.StatisticsWikipedia:WikiProject StatisticsTemplate:WikiProject StatisticsStatistics
This article is within the scope of WikiProject Computing, a collaborative effort to improve the coverage of computers, computing, and information technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.ComputingWikipedia:WikiProject ComputingTemplate:WikiProject ComputingComputing
This article is within the scope of WikiProject Computer science, a collaborative effort to improve the coverage of Computer science related articles on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.Computer scienceWikipedia:WikiProject Computer scienceTemplate:WikiProject Computer scienceComputer science
This article is within the scope of WikiProject Mathematics, a collaborative effort to improve the coverage of mathematics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.MathematicsWikipedia:WikiProject MathematicsTemplate:WikiProject Mathematicsmathematics
This article is within the scope of WikiProject Telecommunications, a collaborative effort to improve the coverage of Telecommunications on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.TelecommunicationsWikipedia:WikiProject TelecommunicationsTemplate:WikiProject TelecommunicationsTelecommunications
This article is within the scope of WikiProject Cryptography, a collaborative effort to improve the coverage of Cryptography on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.CryptographyWikipedia:WikiProject CryptographyTemplate:WikiProject CryptographyCryptography
This article is within the scope of WikiProjectSystems, which collaborates on articles related to systems and systems science.SystemsWikipedia:WikiProject SystemsTemplate:WikiProject SystemsSystems
This article is within the scope of WikiProject Neuroscience, a collaborative effort to improve the coverage of Neuroscience on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.NeuroscienceWikipedia:WikiProject NeuroscienceTemplate:WikiProject Neuroscienceneuroscience
That article's concluding paragraph admits that "Sadly, in modern usage, the terms bit and binary digit have become synonymous." That is simply a fact, not necessarily a mistake–bit is a term formed as a contraction of "binary digit". While some people may try to draw a distinction between what those two terms mean, most do not– even in academic literature (as I suspect you know, since it seems you wrote that). Context or additional explanation is needed (or alternative terminology, such as using the term binary symbol instead of binary digit to draw the distinction, or talking about bits of data versus bits of entropy or bits of information). Many words have multiple meanings and depend on context for their exact interpretation. — BarrelProof (talk) 02:16, 10 April 2023 (UTC)Reply
What is meant by information should be clarified here
Latest comment: 7 months ago2 comments1 person in discussion
The article's first sentence is ambiguous, if not misleading.
'Information theory is the mathematical study of the quantification, storage, and communication of information'
It then links to the Wikipedia article for information in general. This opening sentence is true only if it refers to information in the technical sense used by information theory, rather than information more generally. Overall I think the first sentence should be re-written, as it reads now it's hardly more than 'information theory is theory about information'. Ethan (talk) 23:13, 5 November 2025 (UTC)Reply
Additionally, the source this sentence is citing makes no such claim. Information theory is not defined on the page cited (page 14 of elements of information theory volume 2). This page is merely a preface to the second addition anyhow. Chapter 1 (beginning on page 21) is where Information Theory is actually described. Ethan (talk) 23:09, 6 December 2025 (UTC)Reply