Ask Question, Ask an Expert

+1-415-315-9853

info@mywordsolution.com

Ask Statistics and Probability Expert

1) Consider a Markov chain C1,C2, . . . .

(a) Prove that the joint probability of the first n steps is

p(C1, . . . ,Cn) = p(C1)πt=2p(Ct| Ct-1).

(b) Hence prove that, for any r < s < t p(Cr, Cs,Ct) = p(Cr) p(Cs|Cr) p(Ct | Cs).

(c) Hence prove that Cr and Ct are conditionally independent given Cs.

2) For an m-state Markov chain Ct with transition matrix G,
(a) prove that the marginal state probabilities at times t and t + 1 are related through

u(t + 1) = u(t) τ,

where u(t) is row vector (p(Ct = 1), . . . , p(Ct = m)).

(b) Hence prove that u(t + k) = u(t) τk                          (*)

for any integer k>=0.

(c) Under what conditions would (*) hold for k < 0?

3) For a general discrete homogenous Markov chain with transition matrix G and a specified initial distribution u(1), prepare an R function to do the following:

(a) compute the marginal distribution u(t) from t = 1 up to a specified time t = n

(b) plot the results.

• use operator %*% for matrix multiplication

• use rbind to collect vectors into rows of a matrix U

• use matplot(c(1:n),U,type="l") to plot them in a single plot.

Your R function should contain plenty of comments documenting its inputs, outputs and internal steps.

4) A discrete homogenous Markov chain has transition matrix

1178_Transition matrix.jpg

(a) Using your R function from Exercise 4, plot the marginal distribution u(t) for t = 1, . . . , 20, assuming the chain starts in state 1.

(b) Repeat part (a), assuming the chain starts in state 4.

(c) Deduce theoretically the stationary distribution δ of this chain.

(d) Compare your results from parts (a)–(c).

5) A discrete homogenous Markov chain has transition matrix

587_Transition matrix_1.jpg

where 0 < a < 1.

(a) Show that  δ= ( 1/3 , 1/3 , 1/3) is a stationary distribution of this Markov chain.

(b) Are there other stationary distributions of this chain?

(c) Comment on your conclusion.

6)a) prepare an R function to generate a sequence of a given length from an m-state homogenous Markov chain with given transition matrix and initial state. As always, your code should contain plenty of comments. Hint: use sample(c(1:m), size=1, prob=p) to sample a single value from distribution p.

(b) Use this function to generate a sequence of length 100 from a Markov chain with initial state 1 and transition matrix

685_Transition matrix_2.jpg

(c) From the resulting sequence, estimate the transition matrix, showing all working.

(d) Compare the true and estimated transition matrices.

7) (a) prepare an R function to estimate the transition matrix of a discrete homogenous Markov chain from a given sequence of observations.

(b) Repeat Exercise E2.7b, this time generating a sequence of length 1000. For each value of k in 100, 200, . . . , 1000, estimate the transition matrix from only the first k observations, using your function from part (a).

(c) Plot these estimated transition matrices against k. Hint: use function matplot.

(d) Comment on your results.

8) N independent sequences, each of length n, are generated from a discrete homogenous Markov chain with transition matrix τ, with initial states drawn from an unknown distribution f .

(a) prepare down the likelihood for such data.

(b) Derive the MLEs of f and τ.

(c) Comment on your results.

Statistics and Probability, Statistics

  • Category:- Statistics and Probability
  • Reference No.:- M91861

Have any Question? 


Related Questions in Statistics and Probability

Exam - probability and stochastic modelspart a -q1 twelve

Exam - Probability and Stochastic models Part A - Q1. Twelve recruits were subjected to a selection test to ascertain their suitability for a certain course of training. At the end of training there were given a proficie ...

Following the rash of school shootings that occurred in the

Following the rash of school shootings that occurred in the late 1990s, some individuals suggested that violent video games were making children and adolescents more aggressive. Imagine that you obtained a sample of 150 ...

Jenks co partially refunded 180000 of its outstanding 10

Jenks Co. partially refunded $180,000 of its outstanding 10% note payable, made 1 year ago to Arma State Bank by paying $180,000 plus $18,000 interest (having obtained the $198,000 by using $52,400 cash and signing a new ...

Three individuals are seated in a room each one of them is

Three individuals are seated in a room. Each one of them is wearing a hat, which may be either red or white. Each of them sees the hats worn by the others, but cannot see his own hat (and in particular does not know its ...

Roger reports i ascribe probability 03 to the philadelphia

Roger reports: I ascribe probability 0.3 to "the Philadelphia Phillies will win the World Series next year, Chris ascribes probability 0.4 to their winning the World Series and to me ascribing probability 0.4 that they w ...

The percentage of people with advanced degrees is 165 on

The percentage of people with advanced degrees is 16.5% on average if 1000 people are randomly selected what is the probability that the percentage of these poeple with advanced degrees is between 17% and 18.5%?

Consider the following two dynamic regression modelsmodel 1

Consider the following two dynamic regression models: Model 1 yt = αyt-1 + βxt + t Model 2 yt =γxt1-φL +t1-θL where L is the lag operator and α, β, γ, φ, and θ are parameters. Assume that t ∼ N(0, σ2) (not necessarily th ...

Of the people who fished at clearwater park today 63 had a

Of the people who fished at Clearwater Park today, 63 had a fishing license, and 27 did not. Of the people who fished at Mountain View Park today, 60 had a license, and 40 did not. (No one fished at both parks.) Suppose ...

You are purchasing a home for 220000 the down payment is 30

You are purchasing a home for $220,000. The down payment is 30% and the balance will be financed with a 20- year mortgage at 9% and 2 discount points. You put down a deposit of $5,000 (applied to the down payment) when t ...

The mean sat score in mathematics is 515 the founders of a

The mean SAT score in mathematics is 515 . The founders of a nationwide SAT preparation course claim that graduates of the course score higher, on average, than the national mean. Suppose that the founders of the course ...

  • 4,153,160 Questions Asked
  • 13,132 Experts
  • 2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

WalMart Identification of theory and critical discussion

Drawing on the prescribed text and/or relevant academic literature, produce a paper which discusses the nature of group

Section onea in an atwood machine suppose two objects of

SECTION ONE (a) In an Atwood Machine, suppose two objects of unequal mass are hung vertically over a frictionless

Part 1you work in hr for a company that operates a factory

Part 1: You work in HR for a company that operates a factory manufacturing fiberglass. There are several hundred empl

Details on advanced accounting paperthis paper is intended

DETAILS ON ADVANCED ACCOUNTING PAPER This paper is intended for students to apply the theoretical knowledge around ac

Create a provider database and related reports and queries

Create a provider database and related reports and queries to capture contact information for potential PC component pro