Ask Question, Ask an Expert

+1-415-315-9853

info@mywordsolution.com

Ask Statistics and Probability Expert

1) Consider a Markov chain C1,C2, . . . .

(a) Prove that the joint probability of the first n steps is

p(C1, . . . ,Cn) = p(C1)πt=2p(Ct| Ct-1).

(b) Hence prove that, for any r < s < t p(Cr, Cs,Ct) = p(Cr) p(Cs|Cr) p(Ct | Cs).

(c) Hence prove that Cr and Ct are conditionally independent given Cs.

2) For an m-state Markov chain Ct with transition matrix G,
(a) prove that the marginal state probabilities at times t and t + 1 are related through

u(t + 1) = u(t) τ,

where u(t) is row vector (p(Ct = 1), . . . , p(Ct = m)).

(b) Hence prove that u(t + k) = u(t) τk                          (*)

for any integer k>=0.

(c) Under what conditions would (*) hold for k < 0?

3) For a general discrete homogenous Markov chain with transition matrix G and a specified initial distribution u(1), prepare an R function to do the following:

(a) compute the marginal distribution u(t) from t = 1 up to a specified time t = n

(b) plot the results.

• use operator %*% for matrix multiplication

• use rbind to collect vectors into rows of a matrix U

• use matplot(c(1:n),U,type="l") to plot them in a single plot.

Your R function should contain plenty of comments documenting its inputs, outputs and internal steps.

4) A discrete homogenous Markov chain has transition matrix

1178_Transition matrix.jpg

(a) Using your R function from Exercise 4, plot the marginal distribution u(t) for t = 1, . . . , 20, assuming the chain starts in state 1.

(b) Repeat part (a), assuming the chain starts in state 4.

(c) Deduce theoretically the stationary distribution δ of this chain.

(d) Compare your results from parts (a)–(c).

5) A discrete homogenous Markov chain has transition matrix

587_Transition matrix_1.jpg

where 0 < a < 1.

(a) Show that  δ= ( 1/3 , 1/3 , 1/3) is a stationary distribution of this Markov chain.

(b) Are there other stationary distributions of this chain?

(c) Comment on your conclusion.

6)a) prepare an R function to generate a sequence of a given length from an m-state homogenous Markov chain with given transition matrix and initial state. As always, your code should contain plenty of comments. Hint: use sample(c(1:m), size=1, prob=p) to sample a single value from distribution p.

(b) Use this function to generate a sequence of length 100 from a Markov chain with initial state 1 and transition matrix

685_Transition matrix_2.jpg

(c) From the resulting sequence, estimate the transition matrix, showing all working.

(d) Compare the true and estimated transition matrices.

7) (a) prepare an R function to estimate the transition matrix of a discrete homogenous Markov chain from a given sequence of observations.

(b) Repeat Exercise E2.7b, this time generating a sequence of length 1000. For each value of k in 100, 200, . . . , 1000, estimate the transition matrix from only the first k observations, using your function from part (a).

(c) Plot these estimated transition matrices against k. Hint: use function matplot.

(d) Comment on your results.

8) N independent sequences, each of length n, are generated from a discrete homogenous Markov chain with transition matrix τ, with initial states drawn from an unknown distribution f .

(a) prepare down the likelihood for such data.

(b) Derive the MLEs of f and τ.

(c) Comment on your results.

Statistics and Probability, Statistics

  • Category:- Statistics and Probability
  • Reference No.:- M91861

Have any Question? 


Related Questions in Statistics and Probability

1 a successive independent survey design and a longitudinal

1. A successive independent survey design and a longitudinal survey design both examine changes in responses over time. How do they differ in their approach? 2. Distinguish between demographic and epidemiological researc ...

1 what is the difference between a stratum and a cluster2

1. What is the difference between a stratum and a cluster? 2. What is the drawback of obtaining random samples by telephone? 3. In what way would the use of sampling improve the accuracy of the United States census?

A social psychologist is interested in whether the type of

A social psychologist is interested in whether the type of music a college student is listening to will have any effect on the number of beers the student drinks. Fifteen college students were randomly assigned to one of ...

Please explain every step to make the sum understandableit

Please explain every step to make the sum understandable. It has been hypothesized that the distribution of seasonal colds in Canada is as follows: Season          Percentage Fall                    35% Winter            ...

The following tables depict the preferences of three

The following tables depict the preferences of three universities regarding a set of applicants, and the preferences of the applicants regarding the universities. Every university also has a specified quota for the numbe ...

When how and why was israel created discuss the six day

When, how, and why was Israel created? Discuss the Six Day War and the Yom Kipper War from both the Israeli and Arab points of view. Who are the most important leaders and personalities in the Middle East today?How might ...

A citys mean minimum daily temperature in february is 27

A city's mean minimum daily temperature in February is 27 degrees F. Suppose the standard deviation of the minimum temperature in February is 4 degrees F and that the distribution of minimum temperatures in February is a ...

This course is designed to provide you with the knowledge

This course is designed to provide you with the knowledge and skills in application, evaluation, analysis, and interpretation of biostatistical data used to inform public health programs, policy, and practice. View the o ...

Christine has always been weak in mathematics based on her

Christine has always been weak in mathematics. Based on her performance prior to the final exam in Calculus, there is a 45% chance that she will fail the course if she does not have a tutor. With a tutor, her probability ...

Let x have a poisson distribution with parameter lambda

Let X have a Poisson distribution with parameter lambda. Show that E(X)= lambda directly from the definition of expected value. [Hint: The first term in the sum equals 0, and then x can be canceled. Now factor out lambda ...

  • 4,153,160 Questions Asked
  • 13,132 Experts
  • 2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

Section onea in an atwood machine suppose two objects of

SECTION ONE (a) In an Atwood Machine, suppose two objects of unequal mass are hung vertically over a frictionless

Part 1you work in hr for a company that operates a factory

Part 1: You work in HR for a company that operates a factory manufacturing fiberglass. There are several hundred empl

Details on advanced accounting paperthis paper is intended

DETAILS ON ADVANCED ACCOUNTING PAPER This paper is intended for students to apply the theoretical knowledge around ac

Create a provider database and related reports and queries

Create a provider database and related reports and queries to capture contact information for potential PC component pro

Describe what you learned about the impact of economic

Describe what you learned about the impact of economic, social, and demographic trends affecting the US labor environmen