Who was the founder of information theory? Founder of information theory

Shennong. His 1948 publication in the Bell Journal of Systems Technology on the Mathematical Theory of Communication marked the birth of information theory.

Claude Shannon（claudeshannon）

American mathematician and electronics engineer.

and cryptographers, known as information theory.

The founder. In 1948, Shannon published the epoch-making "Mathematical Principles of Communication", which laid the foundation of modern information theory.

Shannon came up with information entropy.

The concept laid the foundation for information theory and digital communication. The main ones are Lu Xiang's master's degree in 1938 "Symbolic Analysis of Relay and Switching Circuits" in "Mathematical Principles of Communication" and "Communication under Noise" in 1949.

In 1949, Shannon published another famous article in the magazine, "Communication Under Noise". In these two articles, Xiangpapinong clarifies the basic problems of communication, gives the model of the communication system, proposes the mathematical expression of the amount of information, and solves a series of basic technical problems such as channel capacity, source statistical characteristics, source coding, and channel coding.

The founder of information theory is Claude Shannon, and the Shannon Prize, which was established in honor of Claude Ayrwood Shannon, is the highest award in the field of communication theory, also known as the "Nobel Prize in the field of information".

Claude Ellwood Shannon (April 30, 1916 – February 24, 2001) was an American mathematician and the founder of information theory. He received his bachelor's degree from the University of Michigan in 1936. He received his M.A. and Ph.D. degrees from the Massachusetts Institute of Technology in 1940 and joined Bell Labs in 1941.

Shannon proposed the concept of information entropy, which laid the foundation for information theory and digital communication. The main ones are "Symbolic Analysis of Relays and Switching Circuits" in 1938 and "Mathematical Principles of Communication" in 1949 and "Communication under Noise" in 1949.

Biography of the character. In 1940, while at the Institute for Advanced Study in Princeton, Shannon began to ponder the problems of information theory and effective communication systems. After eight years of hard work, Shannon published the far-reaching "Mathematical Principles of Communication" in the Bell System Technology Journal, June and October 1948.

In 1949, Shannon published another famous ** in the same magazine, "Communication Under Noise". In these two articles, Shannon clarified the basic problem of communication, gave the model of the communication system, proposed the mathematical expression of the amount of information, and solved a series of basic technical problems such as channel capacity, source statistical characteristics, source coding, and channel coding. The two ** articles became the foundational works of information theory.

In 1948, the epoch-making "A Mathematical Theory of Communication" was published in the July and October issues of the Bell System Technical Journal, divided into two parts. This article systematically discusses the definition of information, how to quantify information, and how to better encode information. In these studies, probability theory is an important tool used by Shannon.

Shannon also proposed the concept of information entropy, which is used to measure the uncertainty of a message.

In 1949, Shannon published another important article, "Communication Theory of Secrecy Systems", which was based on this working practice, and its significance was to turn confidential communication from art to science.

a.Wiener. b.Shennong.

c.Dahl was defeated.

d.Berta Langfi.

Correct investigation Li Min answered the answer: b

Shannon's information theory has a clever definition of information: the amount of information is not determined by the length of the message, but by how much uncertainty is reduced.

For example, every number in 32576 is deterministic, which means that all uncertainties are eliminated and cannot be deleted; And "that big red apple must be delicious." The words "red big" and "affirmative" in this sentence are not very helpful in eliminating uncertainty and have little information, so the whole sentence can be compressed into "that apple is delicious" and will not affect the main message.

In addition, the amount of information contained in the same information is also different in the first and second passes, often the first time the amount of information is more than the second, because the information that has been obtained for the first time will no longer further eliminate uncertainty in the second time, and only those new information that has not been noticed or understood can eliminate uncertainty for the second time, which is information. The second time is faster and easier to understand than the first time, because the amount of information in the second book is less for the person who reads the book than the first time.

Some things contain a high concentration of information, and some contain low information, so which one is better? It depends on how much time and energy you are willing to put in, if you have enough time and are willing to spend energy, then the high concentration is of course more suitable, on the contrary, if you don't have enough time or don't want to spend more energy, then the lower concentration of information is better.

For example, in ancient times, it was difficult to transmit information, and everyone was accustomed to reciting words repeatedly to understand the meaning, and classical Chinese was the best choice; Modern Internet and other communication tools are highly developed, information has been flooded, time, energy and patience are lacking, the amount of information in classical Chinese is huge, and it is not easy to digest and understand the way of expression is very inappropriate, and even vernacular is not enough, many of them are transmitted in the way of voice, **combination or **.

There is a loss between the amount of information transmitted and the amount of information received, because on the one hand, the transmission speed is too fast to receive, and on the other hand, the reception of information is too difficult and too laborious. Therefore, in order to reduce information loss, we often have to receive it repeatedly and grit our teeth and insist.

Redundant information is also useful, it can rescue and restore correct information when the information is damaged, so that the information can be more resistant to attacks. For example, if a few words are sometimes cut out of a paragraph, we can still understand the main meaning smoothly through the remaining words, just like this paragraph.

1. Information theory is an applied mathematics discipline that uses probability theory and mathematical statistics to study information, information entropy, communication systems, data transmission, cryptography, data compression and other problems.

2. Information system is a communication system in a broad sense, which generally refers to a system composed of all the equipment required to transmit a certain information from one place to another. Information theory is a theory about information, which should have its own clear research object and scope of application. But since the birth of information theory, people have understood it differently.

The study of the interpretation of information theory The measurement of information and the science of sending, transmitting, transforming, storing and receiving information. See also "Bury information".

Words decompose the interpretation of the letter or the belief ì honesty, not deceive : credit. Abide by.

Token. Letters. Vow solemnly.

do not doubt, think reliable: trust. Fiduciary.

Confidence. Belief. Worship:

Faith. Believer. Message:

Information. There was no news. Correspondence:

Correspondence. Letterhead. Homing pigeon.

Petition. 。