Ask Question, Ask an Expert

+1-415-315-9853

info@mywordsolution.com

Ask Statistics and Probability Expert

1) Consider a Markov chain C1,C2, . . . .

(a) Prove that the joint probability of the first n steps is

p(C1, . . . ,Cn) = p(C1)πt=2p(Ct| Ct-1).

(b) Hence prove that, for any r < s < t p(Cr, Cs,Ct) = p(Cr) p(Cs|Cr) p(Ct | Cs).

(c) Hence prove that Cr and Ct are conditionally independent given Cs.

2) For an m-state Markov chain Ct with transition matrix G,
(a) prove that the marginal state probabilities at times t and t + 1 are related through

u(t + 1) = u(t) τ,

where u(t) is row vector (p(Ct = 1), . . . , p(Ct = m)).

(b) Hence prove that u(t + k) = u(t) τk                          (*)

for any integer k>=0.

(c) Under what conditions would (*) hold for k < 0?

3) For a general discrete homogenous Markov chain with transition matrix G and a specified initial distribution u(1), prepare an R function to do the following:

(a) compute the marginal distribution u(t) from t = 1 up to a specified time t = n

(b) plot the results.

• use operator %*% for matrix multiplication

• use rbind to collect vectors into rows of a matrix U

• use matplot(c(1:n),U,type="l") to plot them in a single plot.

Your R function should contain plenty of comments documenting its inputs, outputs and internal steps.

4) A discrete homogenous Markov chain has transition matrix

1178_Transition matrix.jpg

(a) Using your R function from Exercise 4, plot the marginal distribution u(t) for t = 1, . . . , 20, assuming the chain starts in state 1.

(b) Repeat part (a), assuming the chain starts in state 4.

(c) Deduce theoretically the stationary distribution δ of this chain.

(d) Compare your results from parts (a)–(c).

5) A discrete homogenous Markov chain has transition matrix

587_Transition matrix_1.jpg

where 0 < a < 1.

(a) Show that  δ= ( 1/3 , 1/3 , 1/3) is a stationary distribution of this Markov chain.

(b) Are there other stationary distributions of this chain?

(c) Comment on your conclusion.

6)a) prepare an R function to generate a sequence of a given length from an m-state homogenous Markov chain with given transition matrix and initial state. As always, your code should contain plenty of comments. Hint: use sample(c(1:m), size=1, prob=p) to sample a single value from distribution p.

(b) Use this function to generate a sequence of length 100 from a Markov chain with initial state 1 and transition matrix

685_Transition matrix_2.jpg

(c) From the resulting sequence, estimate the transition matrix, showing all working.

(d) Compare the true and estimated transition matrices.

7) (a) prepare an R function to estimate the transition matrix of a discrete homogenous Markov chain from a given sequence of observations.

(b) Repeat Exercise E2.7b, this time generating a sequence of length 1000. For each value of k in 100, 200, . . . , 1000, estimate the transition matrix from only the first k observations, using your function from part (a).

(c) Plot these estimated transition matrices against k. Hint: use function matplot.

(d) Comment on your results.

8) N independent sequences, each of length n, are generated from a discrete homogenous Markov chain with transition matrix τ, with initial states drawn from an unknown distribution f .

(a) prepare down the likelihood for such data.

(b) Derive the MLEs of f and τ.

(c) Comment on your results.

Statistics and Probability, Statistics

  • Category:- Statistics and Probability
  • Reference No.:- M91861

Have any Question? 


Related Questions in Statistics and Probability

Choose one historical event and discuss the effect that it

Choose one historical event and discuss the effect that it has has on you. Provide a rationale for your response.

Its believed that as many as 20 of adults over 50 never

It's believed that as many as 20% of adults over 50 never graduated from high school. We wish to see if this percentage is the same among the 25 to 30 age group. a) How many of this younger age group must we survey in or ...

An accounting professor is notorious for being stingy in

An accounting professor is notorious for being stingy in giving out good letter grades. In a large section of 140 students in the fall semester, she gave out only 5% As, 23% Bs, 42% Cs, and 30% Ds and Fs. Assuming that t ...

1 why are researchers often interested in the proportion of

1. Why are researchers often interested in the proportion of total variance that is systematic variance? 2. What would the proportion of total variance that is systematic variance indicate if it were .25? .OO? .98?

You are interested in using linear regression to test

You are interested in using linear regression to test whether drinking a protein shake improves weightlifting performance. From a sample of 200 college students, you estimate a linear regression with WEIGHTLIFT as the de ...

This exercise generalizes aumanns agreement theorem to a

This exercise generalizes Aumann's Agreement Theorem to a set of players of arbitrary finite size. Given an Aumann model of incomplete information with beliefs (N, Y, (Fi) i ∈N  , s, P) with n players, suppose that for e ...

1 how can partial correlation help researchers explore

1. How can partial correlation help researchers explore possible causal relationships among correlated variables? 2. When is the Spearman rank-order correlation used? 3. What is a dichotomous variable? What correlations ...

An alternative to the experiment in q3 to investigate

An alternative to the experiment in Q.3 to investigate whether loud music tends to increase the time it takes mice to complete a maze would involve randomly assigning say, 50 mice to two groups. The 25 mice in Group A (c ...

Assignment- probability1a credit card company decides to

Assignment- Probability 1. A credit card company decides to study the frequency with which its cardholders charge for items from a certain chain of retail stores. The data values collected in the study appear to be norma ...

Use a fast food restaurant and for 5 types of food from the

Use a fast food restaurant and for 5 types of food from the restaurant, list the fat grams and its total calories. Is there a linear relationship between the two variables? The double whopper has 900 calories and 56 gram ...

  • 4,153,160 Questions Asked
  • 13,132 Experts
  • 2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

Section onea in an atwood machine suppose two objects of

SECTION ONE (a) In an Atwood Machine, suppose two objects of unequal mass are hung vertically over a frictionless

Part 1you work in hr for a company that operates a factory

Part 1: You work in HR for a company that operates a factory manufacturing fiberglass. There are several hundred empl

Details on advanced accounting paperthis paper is intended

DETAILS ON ADVANCED ACCOUNTING PAPER This paper is intended for students to apply the theoretical knowledge around ac

Create a provider database and related reports and queries

Create a provider database and related reports and queries to capture contact information for potential PC component pro

Describe what you learned about the impact of economic

Describe what you learned about the impact of economic, social, and demographic trends affecting the US labor environmen