Ask Question, Ask an Expert

+1-415-315-9853

info@mywordsolution.com

Ask Statistics and Probability Expert

1) Consider a Markov chain C1,C2, . . . .

(a) Prove that the joint probability of the first n steps is

p(C1, . . . ,Cn) = p(C1)πt=2p(Ct| Ct-1).

(b) Hence prove that, for any r < s < t p(Cr, Cs,Ct) = p(Cr) p(Cs|Cr) p(Ct | Cs).

(c) Hence prove that Cr and Ct are conditionally independent given Cs.

2) For an m-state Markov chain Ct with transition matrix G,
(a) prove that the marginal state probabilities at times t and t + 1 are related through

u(t + 1) = u(t) τ,

where u(t) is row vector (p(Ct = 1), . . . , p(Ct = m)).

(b) Hence prove that u(t + k) = u(t) τk                          (*)

for any integer k>=0.

(c) Under what conditions would (*) hold for k < 0?

3) For a general discrete homogenous Markov chain with transition matrix G and a specified initial distribution u(1), prepare an R function to do the following:

(a) compute the marginal distribution u(t) from t = 1 up to a specified time t = n

(b) plot the results.

• use operator %*% for matrix multiplication

• use rbind to collect vectors into rows of a matrix U

• use matplot(c(1:n),U,type="l") to plot them in a single plot.

Your R function should contain plenty of comments documenting its inputs, outputs and internal steps.

4) A discrete homogenous Markov chain has transition matrix

1178_Transition matrix.jpg

(a) Using your R function from Exercise 4, plot the marginal distribution u(t) for t = 1, . . . , 20, assuming the chain starts in state 1.

(b) Repeat part (a), assuming the chain starts in state 4.

(c) Deduce theoretically the stationary distribution δ of this chain.

(d) Compare your results from parts (a)–(c).

5) A discrete homogenous Markov chain has transition matrix

587_Transition matrix_1.jpg

where 0 < a < 1.

(a) Show that  δ= ( 1/3 , 1/3 , 1/3) is a stationary distribution of this Markov chain.

(b) Are there other stationary distributions of this chain?

(c) Comment on your conclusion.

6)a) prepare an R function to generate a sequence of a given length from an m-state homogenous Markov chain with given transition matrix and initial state. As always, your code should contain plenty of comments. Hint: use sample(c(1:m), size=1, prob=p) to sample a single value from distribution p.

(b) Use this function to generate a sequence of length 100 from a Markov chain with initial state 1 and transition matrix

685_Transition matrix_2.jpg

(c) From the resulting sequence, estimate the transition matrix, showing all working.

(d) Compare the true and estimated transition matrices.

7) (a) prepare an R function to estimate the transition matrix of a discrete homogenous Markov chain from a given sequence of observations.

(b) Repeat Exercise E2.7b, this time generating a sequence of length 1000. For each value of k in 100, 200, . . . , 1000, estimate the transition matrix from only the first k observations, using your function from part (a).

(c) Plot these estimated transition matrices against k. Hint: use function matplot.

(d) Comment on your results.

8) N independent sequences, each of length n, are generated from a discrete homogenous Markov chain with transition matrix τ, with initial states drawn from an unknown distribution f .

(a) prepare down the likelihood for such data.

(b) Derive the MLEs of f and τ.

(c) Comment on your results.

Statistics and Probability, Statistics

  • Category:- Statistics and Probability
  • Reference No.:- M91861

Have any Question? 


Related Questions in Statistics and Probability

A sample of 19 school children was randomly selected and

A sample of 19 school children was randomly selected and their age, height and weight was recorded for each child. The results are given below. The goal is to predict the weight of the child by using the height and age. ...

1e model for a simple linear regression

1. Recall the model for a simple linear regression:  where  is Normally distributed with mean 0 and variance , where Cov( ) = 0 for all i, j and Cov(  = 0 for all i,j.A day trader wishes to develop a prediction model for ...

The mean monthly car payment for 123 residents of the local

The mean monthly car payment for 123 residents of the local apartment complex is $624. What is the best point estimate for the mean monthly car payment for all residents of the local apartment complex?

Suppose a researcher believes that college faculty vote at

Suppose a researcher believes that college faculty vote at a lower rate than college students. She collects data from 200 college faculty and 200 college students using simple random sampling. If 120 of the faculty and 1 ...

1 why do researchers want the error variance in their data

1. Why do researchers want the error variance in their data to be small? 2. Why do researchers use meta-analysis?

A psychologist measures units of change for a memory test

A psychologist measures units of change for a memory test after students are given an opportunity to sleep only four hours. The following change units were obtained: 7, -12, 4, -7, 3, -10. Find the a) mean, b) median, c) ...

Random and independent samples of 80 recent prime time

Random and independent samples of 80 recent prime time airings from each of two major networks have been considered. The first network aired a mean of 110.7  commercials during prime time, with a standard deviation of 4. ...

Problem 1 three times each day a quality engineer samples a

Problem 1: Three times each day, a quality engineer samples a component from a recently manufactured batch and tests it. Each part is classified as conforming (suitable for its intended use), downgraded (unsuitable for t ...

Using size as the independent variable and cost as the

Using "size" as the independent variable and "cost" as the dependent variable, draw a scatter plot. b. Does it appear from inspection that there is a relationship between the variables? Why or why not? c. Calculate the l ...

An iq test is designed so that the mean is 100 and the

An IQ test is designed so that the mean is 100 and the standard deviation is 16 for the population of normal adults. Find the sample size necessary to estimate the mean IQ score of statistics students such that it can be ...

  • 4,153,160 Questions Asked
  • 13,132 Experts
  • 2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

Section onea in an atwood machine suppose two objects of

SECTION ONE (a) In an Atwood Machine, suppose two objects of unequal mass are hung vertically over a frictionless

Part 1you work in hr for a company that operates a factory

Part 1: You work in HR for a company that operates a factory manufacturing fiberglass. There are several hundred empl

Details on advanced accounting paperthis paper is intended

DETAILS ON ADVANCED ACCOUNTING PAPER This paper is intended for students to apply the theoretical knowledge around ac

Create a provider database and related reports and queries

Create a provider database and related reports and queries to capture contact information for potential PC component pro

Describe what you learned about the impact of economic

Describe what you learned about the impact of economic, social, and demographic trends affecting the US labor environmen