Ask Question, Ask an Expert

+1-415-315-9853

info@mywordsolution.com

Ask Statistics and Probability Expert

1) Consider a Markov chain C1,C2, . . . .

(a) Prove that the joint probability of the first n steps is

p(C1, . . . ,Cn) = p(C1)πt=2p(Ct| Ct-1).

(b) Hence prove that, for any r < s < t p(Cr, Cs,Ct) = p(Cr) p(Cs|Cr) p(Ct | Cs).

(c) Hence prove that Cr and Ct are conditionally independent given Cs.

2) For an m-state Markov chain Ct with transition matrix G,
(a) prove that the marginal state probabilities at times t and t + 1 are related through

u(t + 1) = u(t) τ,

where u(t) is row vector (p(Ct = 1), . . . , p(Ct = m)).

(b) Hence prove that u(t + k) = u(t) τk                          (*)

for any integer k>=0.

(c) Under what conditions would (*) hold for k < 0?

3) For a general discrete homogenous Markov chain with transition matrix G and a specified initial distribution u(1), prepare an R function to do the following:

(a) compute the marginal distribution u(t) from t = 1 up to a specified time t = n

(b) plot the results.

• use operator %*% for matrix multiplication

• use rbind to collect vectors into rows of a matrix U

• use matplot(c(1:n),U,type="l") to plot them in a single plot.

Your R function should contain plenty of comments documenting its inputs, outputs and internal steps.

4) A discrete homogenous Markov chain has transition matrix

1178_Transition matrix.jpg

(a) Using your R function from Exercise 4, plot the marginal distribution u(t) for t = 1, . . . , 20, assuming the chain starts in state 1.

(b) Repeat part (a), assuming the chain starts in state 4.

(c) Deduce theoretically the stationary distribution δ of this chain.

(d) Compare your results from parts (a)–(c).

5) A discrete homogenous Markov chain has transition matrix

587_Transition matrix_1.jpg

where 0 < a < 1.

(a) Show that  δ= ( 1/3 , 1/3 , 1/3) is a stationary distribution of this Markov chain.

(b) Are there other stationary distributions of this chain?

(c) Comment on your conclusion.

6)a) prepare an R function to generate a sequence of a given length from an m-state homogenous Markov chain with given transition matrix and initial state. As always, your code should contain plenty of comments. Hint: use sample(c(1:m), size=1, prob=p) to sample a single value from distribution p.

(b) Use this function to generate a sequence of length 100 from a Markov chain with initial state 1 and transition matrix

685_Transition matrix_2.jpg

(c) From the resulting sequence, estimate the transition matrix, showing all working.

(d) Compare the true and estimated transition matrices.

7) (a) prepare an R function to estimate the transition matrix of a discrete homogenous Markov chain from a given sequence of observations.

(b) Repeat Exercise E2.7b, this time generating a sequence of length 1000. For each value of k in 100, 200, . . . , 1000, estimate the transition matrix from only the first k observations, using your function from part (a).

(c) Plot these estimated transition matrices against k. Hint: use function matplot.

(d) Comment on your results.

8) N independent sequences, each of length n, are generated from a discrete homogenous Markov chain with transition matrix τ, with initial states drawn from an unknown distribution f .

(a) prepare down the likelihood for such data.

(b) Derive the MLEs of f and τ.

(c) Comment on your results.

Statistics and Probability, Statistics

  • Category:- Statistics and Probability
  • Reference No.:- M91861

Have any Question? 


Related Questions in Statistics and Probability

Suppose that the number of men equals the number of women

Suppose that the number of men equals the number of women, and that Vera is last on the preference list of every man. Prove that under every stable matching, Vera is matched to the same man. Who is the unlucky guy?

A scarf company built a new parking garage in a business

A Scarf Company built a new parking garage in a business district. For a random sample of 100 days, daily fees collected averaged $1,800, with a standard deviation of $500. Construct a 90% confidence interval estimate of ...

Answer questions a through e using the following

Answer questions (a) through (e) using the following information and output for multiple regression The production of car tires in any given year is related to the number of cars produced that year and in prior years. Su ...

Afire with faith 1820-18501 how did revivalism help people

Afire with Faith, 1820-1850} 1. How did revivalism help people adjust to the market? 2. Describe the range of antislavery positions, and mention at least three people who exemplified those different positions? 3. How did ...

A new process is proposed for the manufacture of steel

A new process is proposed for the manufacture of steel shafts, Data are 6.38, 6.40, 6.41, 6.38, 6.39, 6.36 and 6.37. Target is 6.40. a. What is the expected loss? b. What is the standard deviation?

A recent report suggested that older people think more

A recent report suggested that older people think more slowly than younger people because they have more information stored in their brains.  Because WeStudyEverything wasn't sure regarding the source of the study, they ...

Box a has 2 green and 5 blue marbles in it box b has 9

Box A has 2 green and 5 blue marbles in it. Box B has 9 green and 6 blue marbles in it. A marble is drawn from Box A, transferred to Box B, and then a marble is drawn from Box B. What is the probability a blue marble was ...

What were the key events that marked the move toward

What were the key events that marked the move toward American Independence?

This exercise generalizes aumanns agreement theorem to a

This exercise generalizes Aumann's Agreement Theorem to a set of players of arbitrary finite size. Given an Aumann model of incomplete information with beliefs (N, Y, (Fi) i ∈N  , s, P) with n players, suppose that for e ...

Plot four different regression graphs x v y tomatometer v

Plot four different regression graphs (X v Y): Tomatometer v Audience, Budget v Gross, Budget v Tomatometer, Audience v Gross and find the best-fit line equation and correlation coefficient (r-value) for each one. X repr ...

  • 4,153,160 Questions Asked
  • 13,132 Experts
  • 2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

Section onea in an atwood machine suppose two objects of

SECTION ONE (a) In an Atwood Machine, suppose two objects of unequal mass are hung vertically over a frictionless

Part 1you work in hr for a company that operates a factory

Part 1: You work in HR for a company that operates a factory manufacturing fiberglass. There are several hundred empl

Details on advanced accounting paperthis paper is intended

DETAILS ON ADVANCED ACCOUNTING PAPER This paper is intended for students to apply the theoretical knowledge around ac

Create a provider database and related reports and queries

Create a provider database and related reports and queries to capture contact information for potential PC component pro

Describe what you learned about the impact of economic

Describe what you learned about the impact of economic, social, and demographic trends affecting the US labor environmen