Geometric convergence via coupling

Orthogonality and probability: mixing times 61 where A = 1+q−pq+r−q 1+q−p1−2p and B = p q+r 1+ 1 p pq −p 1 − Æ p q r+1+q −p 2q+r 1+ Æ p q r −1+q−p 2q+r . Therefore, taking ǫ ↓ 0, the mixing time t mi x ǫ = O log ǫ log mp, q , where mp, q = max h r + 2ppq, q q+r i . Observe that in the above complex integral all three finite poles are located inside the unit circle. Thus we only need to consider a pole at infinity. The proof of Theorem 1 is provided in section 3. The result in Theorem 1 is the first instance the Karlin-McGregor orthogonal polynomials approach is used to estimate mixing rates. As it was suggested in [3] we would like the approach to work for a larger class of reversible Markov chains over an infinite state space with a unique stationary distribution. There is an immediate corollary see section 3: Corollary. If q q+r r + 2ppq, ν − µ t T V ≥ A q q + r t − Br + 2 p pq t for t large enough, i.e. we have a lower bound of matching order. Observe that one can easily adjust these results for any origination site X = i. In the next section we will compare the above Karlin-McGregor approach to some of the classical techniques for estimating the “distance to stationarity ν − µ t T V . 2 Comparison to the other techniques For the case of geometrically ergodic Markov chains, there are several techniques that produce an upper bound on the distance to stationarity that were developed specifically for the cases when the sample space is large, but finite. These methods are not directly applicable to chains on general state spaces. The coupling method stands out as the most universal. Here we compare the geometric rate in Theorem 1 to the one obtained via a classical coupling argument. Then we explain why other geometric ergodicity methods based on renewal theory will not do better than coupling. See [6] and [4] for detailed overview of geometric convergence and coupling.

2.1 Geometric convergence via coupling

Consider a coupling process X t , Y t , where X = 0 as in Theorem 1, while Y is distributed ac- cording to the stationary distribution ν = 1 ρ π. A classical Markovian coupling construction allows X t and Y t evolve independently until the coupling time τ coupl ing = min{t : X t = Y t }. It is natural to compare P τ coupl ing t to Pτ t, where τ = min{t : Y t = 0} is a hitting time, as the chain is positive recurrent. Now, simple combinatorics implies, for k ≥ n, P τ = k | Y = n = X i, j: 2i+ j=k −n k ii + n j p i q i+n r j 62 Electronic Communications in Probability Therefore P τ t ≤ 1 p ρ X k: k t   X i, j,n: 2i+ j=k −n k ii + n j p i+n q i r j   , where ‘ ≤’ appears because π = 1 1 p , but it does not change the asymptotic rate of convergence, i.e. we could write ‘ ≈’ instead of ‘≤’. The right hand side can be rewritten as 1 p ρ X k: k t k X j=0 k j r j p + q k − j ℓk − j for ℓm = PY ≥ m2, where Y is a binomial random variable with parameters m, ep = p p+q . Now, by Cramér’s theorem, ℓm ∼ e [log 2+ 1 2 log ep+ 1 2 log1 −ep]m , and therefore P τ t ∼ 1 p ρ X k: k t r + 2ppq k = r + 2ppq p ρpq − p p 2 r + 2ppq t 1 Recall that in the Corollary, if q is sufficiently larger than r and p, then q q+r t dominates r + 2ppq t , and the total variation distance ν − µ t T V = A q q + r t ± Br + 2 p pq t , where A and B are given in Theorem 1 of this paper. Thus we need to explain why, when q is sufficiently large, in the equation 1, we fail to notice the dominating term of q q+r t . In order to understand why, observe that the second largest eigenvalue − q q+r originates from the difference between τ coupl ing and τ. In fact, Y t can reach state zero without ever sharing a site with X t they will cross each other, of course. Consider the case when p is either zero, or close to zero. There, the problem reduces to essentially coupling a two state Markov chain with transition probabilities p0, 1 = 1 and p1, 0 = q q+r . Thus the coupling time will be expressed via a geometric random variable with the failure probability of q q+r . Of course, one could make the Markov chain P “lazier by increasing r at the expense of p and q, while keeping proportion q p fixed, i.e. we can consider P ǫ = 1 1+ ǫ P + ǫI. This will minimize the chance of X t and Y t missing each other, but this also means increasing r + 2ppq, and slowing down the rate of convergence in 1. In order to obtain the correct exponents of convergence, we need to redo the coupling rules as follows. We now let the movements of X t and Y t be synchronized whenever both are not at zero i.e. {X t , Y t } ∩ {0} = ;, while letting X t and Y t move independently when one of them is at zero, and the other is not. Then at the hitting time τ, either X t = Y t = 0 and the processes are successfully coupled, or X t = 1 and Y t = 0. In the latter case we are back to the geometric variable with the failure probability of q q+r . That is, the only way for X t and Y t to couple would be if one of the two is at state 0 and the other is at state 1. Using the set theory notations, if {X t , Y t } = {0, 1}, conditioning on {X t+1 , Y t+1 } 6= {1, 2} would give us {X t+1 , Y t+1 } = {1} with probability r q+r , {0, 1} with probability q q+r , Orthogonality and probability: mixing times 63 When q q+r r + 2ppq, the above modified coupling captures the order q q+r t . The coefficient A however is much harder to estimate using the coupling approach, while it is immediately provided in Theorem 1 and its corollary. Take for example p = 1 11 , r = 1 11 and q = 9 11 . There q q+r r +2ppq, and according to the Corollary, the lower bound of A q q+r t − Br + 2 p pq t and the upper bound of A q q+r t + Br + 2ppq t are of the matching order, and the oreder of convergence is tight ν − µ t T V = 91 171 9 10 t ± 39 28 7 11 t

2.2 Drift, minorization and geometric ergodicity

Dokumen yang terkait

AN ALIS IS YU RID IS PUT USAN BE B AS DAL AM P E RKAR A TIND AK P IDA NA P E NY E RTA AN M E L AK U K A N P R AK T IK K E DO K T E RA N YA NG M E N G A K IB ATK AN M ATINYA P AS IE N ( PUT USA N N O MOR: 9 0/PID.B /2011/ PN.MD O)

0 82 16

ANALISIS FAKTOR YANGMEMPENGARUHI FERTILITAS PASANGAN USIA SUBUR DI DESA SEMBORO KECAMATAN SEMBORO KABUPATEN JEMBER TAHUN 2011

2 53 20

EFEKTIVITAS PENDIDIKAN KESEHATAN TENTANG PERTOLONGAN PERTAMA PADA KECELAKAAN (P3K) TERHADAP SIKAP MASYARAKAT DALAM PENANGANAN KORBAN KECELAKAAN LALU LINTAS (Studi Di Wilayah RT 05 RW 04 Kelurahan Sukun Kota Malang)

45 393 31

FAKTOR – FAKTOR YANG MEMPENGARUHI PENYERAPAN TENAGA KERJA INDUSTRI PENGOLAHAN BESAR DAN MENENGAH PADA TINGKAT KABUPATEN / KOTA DI JAWA TIMUR TAHUN 2006 - 2011

1 35 26

A DISCOURSE ANALYSIS ON “SPA: REGAIN BALANCE OF YOUR INNER AND OUTER BEAUTY” IN THE JAKARTA POST ON 4 MARCH 2011

9 161 13

Pengaruh kualitas aktiva produktif dan non performing financing terhadap return on asset perbankan syariah (Studi Pada 3 Bank Umum Syariah Tahun 2011 – 2014)

6 101 0

Pengaruh pemahaman fiqh muamalat mahasiswa terhadap keputusan membeli produk fashion palsu (study pada mahasiswa angkatan 2011 & 2012 prodi muamalat fakultas syariah dan hukum UIN Syarif Hidayatullah Jakarta)

0 22 0

Pendidikan Agama Islam Untuk Kelas 3 SD Kelas 3 Suyanto Suyoto 2011

4 108 178

ANALISIS NOTA KESEPAHAMAN ANTARA BANK INDONESIA, POLRI, DAN KEJAKSAAN REPUBLIK INDONESIA TAHUN 2011 SEBAGAI MEKANISME PERCEPATAN PENANGANAN TINDAK PIDANA PERBANKAN KHUSUSNYA BANK INDONESIA SEBAGAI PIHAK PELAPOR

1 17 40

KOORDINASI OTORITAS JASA KEUANGAN (OJK) DENGAN LEMBAGA PENJAMIN SIMPANAN (LPS) DAN BANK INDONESIA (BI) DALAM UPAYA PENANGANAN BANK BERMASALAH BERDASARKAN UNDANG-UNDANG RI NOMOR 21 TAHUN 2011 TENTANG OTORITAS JASA KEUANGAN

3 32 52