Information theory: This is the branch of applied probability theory applicable to various communication and signal processing problems in the field of engineering and biology. Information theorists dedicate their efforts to the quantitative examination of the following three questions given below;:

* What do is information?

* What are the primary limitations on accuracy with which information can be transmitted?

* What the design methodologies and the computational algorithms yield to the practical systems for the communication and storing information which perform close to the fundamental limits mentioned previously?