Ask Computer Engineering Expert

Interval Coding

1. For the ensemble X with alphabet A = { 1, 2, 3} and probabilities p = ( 1=4, 1=3, 5=12 )

(a) Evaluate the cumulative distribution function F(a) = P(x ≤ a) for a ∈ A and give the values of F(1), F(2), and F(3)

(b) Evaluate the binary intervals for [F(0), F(1))2, [F(1), F(2))2, and [F(2), F(3))2 (where F(0) = 0). Use the repeating notation (e.g., 0:101) where necessary.

(c) Construct the Shannon-Fano-Elias code for X, code the input sequence x = 3 3 1 1 2, and decode the sequence 011001110.

(d) Evaluate the expected length L(C,X) for the code just constructed.

(e) Is the code you just constructed an optimal code in terms of expected length? Explain why or why not?

Arithmetic Coding

1. Consider the Dirichlet multinomial model with m = (3, 3, 3) for the alphabet A = {a, b, c}. Evaluate the following probabilities under this model:

(a) P(x = b)
(b) P(x = a|baa)
(c) P(x = b|ac)
(d) P(x = c|s) where s is a sequence consisting of 100 as and 200 bs and no cs.

2. Using an arithmetic coder with the above Dirichlet multinomial model:

(a) Code the sequence cba.
(b) Decode the rst three symbols of the input sequence 11111 : : : of all 1s. Be sure to show the intervals and probabilities at each step.

3. Without doing a new coding, describe how the arithmetic code for cba would be di erent from the previous one if a Dirichlet multinomial model with m = (1, 100, 1) was used. Explain what sort of input sequences would be given the longest arithmetic codes under this new model?

Lempel-Ziv Coding

1. Use the LZ78 algorithm to code the sequence aaabababaaaa. Show the steps you used to build the code.

2. What kind of sequences from the alphabet A = {a, b}:
(a) Result in the longest possible LZ77 codes, assuming a window size of W = 2?
Give an example.
(b) Result in the longest possible LZ78 codes? Give an example and show the resulting tree.

Noisy-Channel Coding

1. Consider a channel with inputs X = fa, b, cg, outputs Y = fa, cg, and transition matrix

150_Noisy-Channel Coding.png

(a) Assuming a uniform distribution over input symbols, what is the mutual information I(X, Y ) between the input and output of the channel? What is the average probability of error?

(b) Assuming a distribution p = (0:5, 0, 0:5) over input symbols, what is the mutual information and average probability of error?

(c) Using the previous answer, give a non-zero lower bound for the capacity of this channel?

(d) Design a simple code for this channel that achieves a maximal probability of error less than 0:05.

2. Let Q be a channel with four inputs and outputs, each expressed as a 2-bit symbol.

That is, X = Y = { 00, 01, 10, 11}. Each time this channel is used, exactly one of the two input bits is flipped and the other are transmitted unchanged. Both bits are equally likely to be the one that is
ipped.

(a) Write out the transition matrix for this channel

(b) Evaluate the capacity of this channel.

(c) Design a block code with zero error for this channel with the highest possible rate.

Computer Engineering, Engineering

  • Category:- Computer Engineering
  • Reference No.:- M9131960

Have any Question?


Related Questions in Computer Engineering

Does bmw have a guided missile corporate culture and

Does BMW have a guided missile corporate culture, and incubator corporate culture, a family corporate culture, or an Eiffel tower corporate culture?

Rebecca borrows 10000 at 18 compounded annually she pays

Rebecca borrows $10,000 at 18% compounded annually. She pays off the loan over a 5-year period with annual payments, starting at year 1. Each successive payment is $700 greater than the previous payment. (a) How much was ...

Jeff decides to start saving some money from this upcoming

Jeff decides to start saving some money from this upcoming month onwards. He decides to save only $500 at first, but each month he will increase the amount invested by $100. He will do it for 60 months (including the fir ...

Suppose you make 30 annual investments in a fund that pays

Suppose you make 30 annual investments in a fund that pays 6% compounded annually. If your first deposit is $7,500 and each successive deposit is 6% greater than the preceding deposit, how much will be in the fund immedi ...

Question -under what circumstances is it ethical if ever to

Question :- Under what circumstances is it ethical, if ever, to use consumer information in marketing research? Explain why you consider it ethical or unethical.

What are the differences between four types of economics

What are the differences between four types of economics evaluations and their differences with other two (budget impact analysis (BIA) and cost of illness (COI) studies)?

What type of economic system does norway have explain some

What type of economic system does Norway have? Explain some of the benefits of this system to the country and some of the drawbacks,

Among the who imf and wto which of these governmental

Among the WHO, IMF, and WTO, which of these governmental institutions do you feel has most profoundly shaped healthcare outcomes in low-income countries and why? Please support your reasons with examples and research/doc ...

A real estate developer will build two different types of

A real estate developer will build two different types of apartments in a residential area: one- bedroom apartments and two-bedroom apartments. In addition, the developer will build either a swimming pool or a tennis cou ...

Question what some of the reasons that evolutionary models

Question : What some of the reasons that evolutionary models are considered by many to be the best approach to software development. The response must be typed, single spaced, must be in times new roman font (size 12) an ...

  • 4,153,160 Questions Asked
  • 13,132 Experts
  • 2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

Why might a bank avoid the use of interest rate swaps even

Why might a bank avoid the use of interest rate swaps, even when the institution is exposed to significant interest rate

Describe the difference between zero coupon bonds and

Describe the difference between zero coupon bonds and coupon bonds. Under what conditions will a coupon bond sell at a p

Compute the present value of an annuity of 880 per year

Compute the present value of an annuity of $ 880 per year for 16 years, given a discount rate of 6 percent per annum. As

Compute the present value of an 1150 payment made in ten

Compute the present value of an $1,150 payment made in ten years when the discount rate is 12 percent. (Do not round int

Compute the present value of an annuity of 699 per year

Compute the present value of an annuity of $ 699 per year for 19 years, given a discount rate of 6 percent per annum. As