Ask Question, Ask an Expert

+1-415-315-9853

info@mywordsolution.com

Ask Statistics and Probability Expert

1) Consider a Markov chain C1,C2, . . . .

(a) Prove that the joint probability of the first n steps is

p(C1, . . . ,Cn) = p(C1)πt=2p(Ct| Ct-1).

(b) Hence prove that, for any r < s < t p(Cr, Cs,Ct) = p(Cr) p(Cs|Cr) p(Ct | Cs).

(c) Hence prove that Cr and Ct are conditionally independent given Cs.

2) For an m-state Markov chain Ct with transition matrix G,
(a) prove that the marginal state probabilities at times t and t + 1 are related through

u(t + 1) = u(t) τ,

where u(t) is row vector (p(Ct = 1), . . . , p(Ct = m)).

(b) Hence prove that u(t + k) = u(t) τk                          (*)

for any integer k>=0.

(c) Under what conditions would (*) hold for k < 0?

3) For a general discrete homogenous Markov chain with transition matrix G and a specified initial distribution u(1), prepare an R function to do the following:

(a) compute the marginal distribution u(t) from t = 1 up to a specified time t = n

(b) plot the results.

• use operator %*% for matrix multiplication

• use rbind to collect vectors into rows of a matrix U

• use matplot(c(1:n),U,type="l") to plot them in a single plot.

Your R function should contain plenty of comments documenting its inputs, outputs and internal steps.

4) A discrete homogenous Markov chain has transition matrix

1178_Transition matrix.jpg

(a) Using your R function from Exercise 4, plot the marginal distribution u(t) for t = 1, . . . , 20, assuming the chain starts in state 1.

(b) Repeat part (a), assuming the chain starts in state 4.

(c) Deduce theoretically the stationary distribution δ of this chain.

(d) Compare your results from parts (a)–(c).

5) A discrete homogenous Markov chain has transition matrix

587_Transition matrix_1.jpg

where 0 < a < 1.

(a) Show that  δ= ( 1/3 , 1/3 , 1/3) is a stationary distribution of this Markov chain.

(b) Are there other stationary distributions of this chain?

(c) Comment on your conclusion.

6)a) prepare an R function to generate a sequence of a given length from an m-state homogenous Markov chain with given transition matrix and initial state. As always, your code should contain plenty of comments. Hint: use sample(c(1:m), size=1, prob=p) to sample a single value from distribution p.

(b) Use this function to generate a sequence of length 100 from a Markov chain with initial state 1 and transition matrix

685_Transition matrix_2.jpg

(c) From the resulting sequence, estimate the transition matrix, showing all working.

(d) Compare the true and estimated transition matrices.

7) (a) prepare an R function to estimate the transition matrix of a discrete homogenous Markov chain from a given sequence of observations.

(b) Repeat Exercise E2.7b, this time generating a sequence of length 1000. For each value of k in 100, 200, . . . , 1000, estimate the transition matrix from only the first k observations, using your function from part (a).

(c) Plot these estimated transition matrices against k. Hint: use function matplot.

(d) Comment on your results.

8) N independent sequences, each of length n, are generated from a discrete homogenous Markov chain with transition matrix τ, with initial states drawn from an unknown distribution f .

(a) prepare down the likelihood for such data.

(b) Derive the MLEs of f and τ.

(c) Comment on your results.

Statistics and Probability, Statistics

  • Category:- Statistics and Probability
  • Reference No.:- M91861

Have any Question? 


Related Questions in Statistics and Probability

Statistics antpsysoc 235 - dr kaeochindaassignment 1 focus

Statistics (ANT/PSY/SOC 235) - Dr. Kaeochinda Assignment 1 (Focus: Chapter 2, Scaling and Scales of Measurements) A small portion of every assignment will be completed using SPSS (version 21) that is available in every c ...

N balls labeled 1 through are placed in box 1 while a box 2

N balls labeled 1 through are placed in Box 1 while a Box 2 is initially empty. At each time instant, one of the balls is chosen (with equally probability) and moved to the other box.    be the number of balls in Box 1 a ...

Let x be a two-element zero-mean random vector suppose we

Let X be a two-element zero-mean random vector. Suppose we construct a new random vector Y according to a linear transformation, . Find the transformation matrix,  Y=TX,  such that has a covariance matrix of T such that  ...

Two fair dice are rolled let one of the dice be red and the

Two fair dice are rolled. Let one of the dice be red and the other green so that we can tell them apart. Let be the sum of the two values shown on the dice and be the difference (red minus green) of the two values shown ...

Two players compete against each other in a game of chance

Two players compete against each other in a game of chance where Player A wins with probability 1/3 and Player B wins with probability 2/3. Every time Player A loses he must pay Player B $1, while every time Player B los ...

Letnbsp x t be a wss random process with mean and

Let  X (t) be a WSS random process with mean and autocorrelation function      . Consider forming a new process  according to (a) Find the mean function oF (b) Find the autocorrelation function of

A pcm waveform has the two states 1 and 0 suppose the

A PCM waveform has the two states +1 and 0. Suppose the transition matrix is The initial value of the waveform is determined by the flip of a coin, with the outcome of a head corresponding to +1 and a tail to 0. (a) What ...

Question 1assignment personality inherited or

QUESTION # 1 Assignment Personality: Inherited or Determined? PLEASE PROVIDE REFERENCES. Details: Psychologists have often asked themselves, which is the main factor that determines personality: is personality geneticall ...

Letnbspnbspbe a sequence of iid zero-mean gaussian random

Let   be a sequence of IID zero-mean Gaussian random variables with variance   a) Write a MATLAB program to generate the process (b) Estimate the mean function of this process by generating a large number of realizations ...

Please provide a highly cogent response to the question

Please provide a highly cogent response to the question below. Minimum is 2 paragraphs and please list all references. Does British political culture reflect Europe or is it as its people often argue unique to itself? Ex ...

  • 4,153,160 Questions Asked
  • 13,132 Experts
  • 2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

A cola-dispensing machine is set to dispense 9 ounces of

A cola-dispensing machine is set to dispense 9 ounces of cola per cup, with a standard deviation of 1.0 ounce. The manuf

What is marketingbullwhat is marketing think back to your

What is Marketing? • "What is marketing"? Think back to your impressions before you started this class versus how you

Question -your client david smith runs a small it

QUESTION - Your client, David Smith runs a small IT consulting business specialising in computer software and techno

Inspection of a random sample of 22 aircraft showed that 15

Inspection of a random sample of 22 aircraft showed that 15 needed repairs to fix a wiring problem that might compromise

Effective hrmquestionhow can an effective hrm system help

Effective HRM Question How can an effective HRM system help facilitate the achievement of an organization's strate