Example 1: Local level model – state filtering

Comparison of four particle filters for the local level model. For \(t = 1,\ldots,n\), the local level model can be written as \[\begin{eqnarray*} y_t &\sim& N(x_t,\sigma^2)\\ x_t &\sim& N(\alpha x_{t-1},\tau^2), \end{eqnarray*}\] with initial value \(x_0 \sim N(m_0,C_0)\)and known quantities \((\alpha,\sigma^2,\tau^2,m_0,C_0)\). The four particle filters are

  1. bootstrap filter (Gordon et al, 1993),

  2. auxiliary particle filter (Pitt and Shephard, 1999),

  3. optimal bootstrap filter, and

  4. optimal auxiliary particle filter.

R code: https://hedibert.org/wp-content/uploads/2014/06/Example1-locallevelmodel-R.txt

Example 4: Local level model – state filtering & parameter learning

Comparison of three particle filters for the local level model when parameter learning is also taken into account. For t=1,,n, the model can be written as \[\begin{eqnarray*} y_t|x_t &\sim& N(x_t,\sigma^2)\\ x_t|x_{t-1} &\sim& N(\alpha+\beta x_{t-1},\tau^2) \end{eqnarray*}\] with additional priors \[\begin{eqnarray*} x_0 &\sim& N(m_0,C_0)\\ \sigma^2 &\sim& IG(a_0,A_0)\\ \alpha|\tau^2 &\sim& N(b_{01},\tau^2B_{01})\\ \beta|\tau^2 &\sim& N(b_{02},\tau^2B_{02})\\ \tau^2 &\sim& IG(\nu_0/2,\nu_0\tau^2_0/2), \end{eqnarray*}\] and known hyperparameters \((m_0,C_0)\), \((a_0,A_0)\), \((b_0,B_0)\) and \((\nu_0,\tau^2_0)\). The three filters are

  1. Liu and West filter (Liu and West, 2001),

  2. Storvik filter (Storvik, 2002), and

  3. Particle learning (Carvalho et al., 2010)

R code: http://hedibert.org/wp-content/uploads/2014/06/Example4-comparison-lw-sf-pl-R.txt

Example 4: Local level model – PL versus MCMC

Same context as the above example:

  1. Comparison of MCMC and optimal auxiliary particle filter,

  2. Comparison of MCMC and particle learning.

R code: http://hedibert.org/wp-content/uploads/2014/06/Example4-comparison-pl-mcmc-R.txt

Application 1: Dynamic Beta regression

Brazilian monthly unemployment rate from March 2002 to December 2009 (IBGE).

R code: http://hedibert.org/wp-content/uploads/2014/06/Application1-dynamicbetaregression-R.txt

Application 2: Stochastic volatility model

For \(t=1,\cdots,n\), the basic normal stochastic volatility model can be written as \[\begin{eqnarray*} y_t | x_t &\sim& N(0, \exp\{x_t/2\})\\ x_t | x_{t-1} &\sim& N(\alpha + \beta x_{t-1}, \tau^2) \end{eqnarray*}\] with \(x_0 \sim N(m_0,C_0)\), \(\alpha|\tau^2 \sim N(b_{01},\tau^2 B_{01})\), \(\beta|\tau^2 \sim N(b_{02},\tau^2 B_{02})\), where \(\tau^2 \sim IG(\nu_0/2,\nu_0\tau^2_0/2)\) and known hyper-parameters \(m_0\), \(C_0\), \(B_0\), \(\nu_0\) and \(\tau_0^2\).

Data: Monthly log returns of GE stock.

Period: January 1926 to December 1999 (888 observations).

Source: Tsay (2005), Chapter 12, Example 12.6, page 591.

Dataset: https://www.chicagobooth.edu/-/media/faculty/ruey-s-tsay/teaching/fts2/m-geln.txt

R code: http://hedibert.org/wp-content/uploads/2014/06/Application2-stochasticvolatility-R.txt

Application 3: Realized volatility

We entertain two realized volatility models:

  1. Three RV time series are modeled by independent univariate local level models

  2. Trivariate vector of RV time series is modeled by a multivariate local level.

Data: Intradaily realized volatility of Alcoa stock (5m, 10m, 20m) from 2 January 2003 to 7 May 2004 for 340 observations. The daily realized volatilities used are the the sums of squares of intraday 5 min, 10 min and 20 min log returns measured in percentages. Tsay (2005), Chapter 11: State-Space Models and Kalman Filter.

Dataset: https://www.chicagobooth.edu/-/media/faculty/ruey-s-tsay/teaching/fts2/aa-3rv.txt

R code: http://hedibert.org/wp-content/uploads/2014/06/Application3-realizedvolatility-R.txt

LS0tCnRpdGxlOiAiRXhhbXBsZXMgZnJvbSBMb3BlcyBhbmQgVHNheSAoMjAxMSkiCmF1dGhvcjogIkhlZGliZXJ0IEZyZWl0YXMgTG9wZXMiCmRhdGU6ICJgciBTeXMuRGF0ZSgpYCIKb3V0cHV0OgogIGh0bWxfZG9jdW1lbnQ6CiAgICB0aGVtZTogcGFwZXIKICAgIGhpZ2hsaWdodDogcHlnbWVudHMKICAgIHRvYzogdHJ1ZQogICAgdG9jX2RlcHRoOiAzCiAgICB0b2NfY29sbGFwc2VkOiB0cnVlCiMgICB0b2NfZmxvYXQ6IHRydWUKICAgIGNvZGVfZG93bmxvYWQ6IHRydWUKIyAgIG51bWJlcl9zZWN0aW9uczogdHJ1ZQotLS0KICAKCgojIEV4YW1wbGUgMTogTG9jYWwgbGV2ZWwgbW9kZWwg4oCTIHN0YXRlIGZpbHRlcmluZwpDb21wYXJpc29uIG9mIGZvdXIgcGFydGljbGUgZmlsdGVycyBmb3IgdGhlIGxvY2FsIGxldmVsIG1vZGVsLiBGb3IgJHQgPSAxLFxsZG90cyxuJCwgdGhlIGxvY2FsIGxldmVsIG1vZGVsIGNhbiBiZSB3cml0dGVuIGFzIApcYmVnaW57ZXFuYXJyYXkqfQp5X3QgJlxzaW0mICBOKHhfdCxcc2lnbWFeMilcXAp4X3QgJlxzaW0mIE4oXGFscGhhIHhfe3QtMX0sXHRhdV4yKSwgClxlbmR7ZXFuYXJyYXkqfQp3aXRoIGluaXRpYWwgdmFsdWUgICR4XzAgXHNpbSBOKG1fMCxDXzApJGFuZCBrbm93biBxdWFudGl0aWVzICQoXGFscGhhLFxzaWdtYV4yLFx0YXVeMixtXzAsQ18wKSQuIFRoZSBmb3VyIHBhcnRpY2xlIGZpbHRlcnMgYXJlIAoKaSkgYm9vdHN0cmFwIGZpbHRlciAoR29yZG9uIGV0IGFsLCAxOTkzKSwgCgppaSkgYXV4aWxpYXJ5IHBhcnRpY2xlIGZpbHRlciAoUGl0dCBhbmQgU2hlcGhhcmQsIDE5OTkpLCAKCmlpaSkgb3B0aW1hbCBib290c3RyYXAgZmlsdGVyLCBhbmQgCgppdikgb3B0aW1hbCBhdXhpbGlhcnkgcGFydGljbGUgZmlsdGVyLgoKUiBjb2RlOiBodHRwczovL2hlZGliZXJ0Lm9yZy93cC1jb250ZW50L3VwbG9hZHMvMjAxNC8wNi9FeGFtcGxlMS1sb2NhbGxldmVsbW9kZWwtUi50eHQKCgojIEV4YW1wbGUgNDogTG9jYWwgbGV2ZWwgbW9kZWwg4oCTIHN0YXRlIGZpbHRlcmluZyAmIHBhcmFtZXRlciBsZWFybmluZwoKQ29tcGFyaXNvbiBvZiB0aHJlZSBwYXJ0aWNsZSBmaWx0ZXJzIGZvciB0aGUgbG9jYWwgbGV2ZWwgbW9kZWwgd2hlbiBwYXJhbWV0ZXIgbGVhcm5pbmcgaXMgYWxzbyB0YWtlbiBpbnRvIGFjY291bnQuICBGb3IgdD0xLFxsZG90cyxuLCB0aGUgbW9kZWwgY2FuIGJlIHdyaXR0ZW4gYXMgClxiZWdpbntlcW5hcnJheSp9CnlfdHx4X3QgJlxzaW0mIE4oeF90LFxzaWdtYV4yKVxcCnhfdHx4X3t0LTF9ICZcc2ltJiBOKFxhbHBoYStcYmV0YSB4X3t0LTF9LFx0YXVeMikKXGVuZHtlcW5hcnJheSp9CndpdGggYWRkaXRpb25hbCBwcmlvcnMKXGJlZ2lue2VxbmFycmF5Kn0KeF8wICZcc2ltJiBOKG1fMCxDXzApXFwKXHNpZ21hXjIgJlxzaW0mIElHKGFfMCxBXzApXFwKXGFscGhhfFx0YXVeMiAmXHNpbSYgTihiX3swMX0sXHRhdV4yQl97MDF9KVxcClxiZXRhfFx0YXVeMiAmXHNpbSYgTihiX3swMn0sXHRhdV4yQl97MDJ9KVxcClx0YXVeMiAmXHNpbSYgSUcoXG51XzAvMixcbnVfMFx0YXVeMl8wLzIpLApcZW5ke2VxbmFycmF5Kn0KYW5kIGtub3duIGh5cGVycGFyYW1ldGVycyAkKG1fMCxDXzApJCwgJChhXzAsQV8wKSQsICQoYl8wLEJfMCkkIGFuZCAkKFxudV8wLFx0YXVeMl8wKSQuICBUaGUgdGhyZWUgZmlsdGVycyBhcmUgCgppKSBMaXUgYW5kIFdlc3QgZmlsdGVyIChMaXUgYW5kIFdlc3QsIDIwMDEpLCAKCmlpKSBTdG9ydmlrIGZpbHRlciAoU3RvcnZpaywgMjAwMiksIGFuZCAKCmlpaSkgUGFydGljbGUgbGVhcm5pbmcgKENhcnZhbGhvIGV0IGFsLiwgMjAxMCkKClIgY29kZTogaHR0cDovL2hlZGliZXJ0Lm9yZy93cC1jb250ZW50L3VwbG9hZHMvMjAxNC8wNi9FeGFtcGxlNC1jb21wYXJpc29uLWx3LXNmLXBsLVIudHh0CgoKCiMgRXhhbXBsZSA0OiBMb2NhbCBsZXZlbCBtb2RlbCDigJMgUEwgdmVyc3VzIE1DTUMKClNhbWUgY29udGV4dCBhcyB0aGUgYWJvdmUgZXhhbXBsZTogIAoKaSkgQ29tcGFyaXNvbiBvZiBNQ01DIGFuZCBvcHRpbWFsIGF1eGlsaWFyeSBwYXJ0aWNsZSBmaWx0ZXIsIAoKaWkpIENvbXBhcmlzb24gb2YgTUNNQyBhbmQgcGFydGljbGUgbGVhcm5pbmcuCgpSIGNvZGU6IGh0dHA6Ly9oZWRpYmVydC5vcmcvd3AtY29udGVudC91cGxvYWRzLzIwMTQvMDYvRXhhbXBsZTQtY29tcGFyaXNvbi1wbC1tY21jLVIudHh0CgojIEFwcGxpY2F0aW9uIDE6IER5bmFtaWMgQmV0YSByZWdyZXNzaW9uCgpCcmF6aWxpYW4gbW9udGhseSB1bmVtcGxveW1lbnQgcmF0ZSBmcm9tIE1hcmNoIDIwMDIgdG8gRGVjZW1iZXIgMjAwOSAoSUJHRSkuCgpSIGNvZGU6IGh0dHA6Ly9oZWRpYmVydC5vcmcvd3AtY29udGVudC91cGxvYWRzLzIwMTQvMDYvQXBwbGljYXRpb24xLWR5bmFtaWNiZXRhcmVncmVzc2lvbi1SLnR4dAoKCiMgQXBwbGljYXRpb24gMjogU3RvY2hhc3RpYyB2b2xhdGlsaXR5IG1vZGVsCgpGb3IgJHQ9MSxcY2RvdHMsbiQsIHRoZSBiYXNpYyBub3JtYWwgc3RvY2hhc3RpYyB2b2xhdGlsaXR5IG1vZGVsIGNhbiBiZSB3cml0dGVuIGFzIApcYmVnaW57ZXFuYXJyYXkqfQp5X3QgfCB4X3QgJlxzaW0mIE4oMCwgXGV4cFx7eF90LzJcfSlcXAp4X3QgfCB4X3t0LTF9ICZcc2ltJiBOKFxhbHBoYSArIFxiZXRhIHhfe3QtMX0sIFx0YXVeMikKXGVuZHtlcW5hcnJheSp9CndpdGggJHhfMCBcc2ltIE4obV8wLENfMCkkLCAkXGFscGhhfFx0YXVeMiBcc2ltIE4oYl97MDF9LFx0YXVeMiBCX3swMX0pJCwgCiRcYmV0YXxcdGF1XjIgXHNpbSBOKGJfezAyfSxcdGF1XjIgQl97MDJ9KSQsIHdoZXJlICRcdGF1XjIgXHNpbSBJRyhcbnVfMC8yLFxudV8wXHRhdV4yXzAvMikkIAphbmQga25vd24gaHlwZXItcGFyYW1ldGVycyAkbV8wJCwgJENfMCQsICRCXzAkLCAkXG51XzAkIGFuZCAkXHRhdV8wXjIkLiAgCgpEYXRhOiBNb250aGx5IGxvZyByZXR1cm5zIG9mIEdFIHN0b2NrLiAgCgpQZXJpb2Q6IEphbnVhcnkgMTkyNiB0byBEZWNlbWJlciAxOTk5ICg4ODggb2JzZXJ2YXRpb25zKS4gIAoKU291cmNlOiBUc2F5ICgyMDA1KSwgQ2hhcHRlciAxMiwgRXhhbXBsZSAxMi42LCBwYWdlIDU5MS4KCkRhdGFzZXQ6IGh0dHBzOi8vd3d3LmNoaWNhZ29ib290aC5lZHUvLS9tZWRpYS9mYWN1bHR5L3J1ZXktcy10c2F5L3RlYWNoaW5nL2Z0czIvbS1nZWxuLnR4dAoKUiBjb2RlOiBodHRwOi8vaGVkaWJlcnQub3JnL3dwLWNvbnRlbnQvdXBsb2Fkcy8yMDE0LzA2L0FwcGxpY2F0aW9uMi1zdG9jaGFzdGljdm9sYXRpbGl0eS1SLnR4dAoKCiMgQXBwbGljYXRpb24gMzogUmVhbGl6ZWQgdm9sYXRpbGl0eQoKV2UgZW50ZXJ0YWluIHR3byByZWFsaXplZCB2b2xhdGlsaXR5IG1vZGVsczogIAoKKGkpIFRocmVlIFJWIHRpbWUgc2VyaWVzIGFyZSBtb2RlbGVkIGJ5IGluZGVwZW5kZW50IHVuaXZhcmlhdGUgbG9jYWwgbGV2ZWwgbW9kZWxzIAoKKGlpKSBUcml2YXJpYXRlIHZlY3RvciBvZiBSViB0aW1lIHNlcmllcyBpcyBtb2RlbGVkIGJ5IGEgbXVsdGl2YXJpYXRlIGxvY2FsIGxldmVsLiAgCgpEYXRhOiBJbnRyYWRhaWx5IHJlYWxpemVkIHZvbGF0aWxpdHkgb2YgQWxjb2Egc3RvY2sgKDVtLCAxMG0sIDIwbSkgZnJvbSAyIEphbnVhcnkgMjAwMyB0byA3IE1heSAyMDA0IGZvciAzNDAgb2JzZXJ2YXRpb25zLiAgVGhlIGRhaWx5IHJlYWxpemVkIHZvbGF0aWxpdGllcyB1c2VkIGFyZSB0aGUgdGhlIHN1bXMgb2Ygc3F1YXJlcyBvZiBpbnRyYWRheSA1IG1pbiwgMTAgbWluIGFuZCAyMCBtaW4gbG9nIHJldHVybnMgbWVhc3VyZWQgaW4gcGVyY2VudGFnZXMuICBUc2F5ICgyMDA1KSwgQ2hhcHRlciAxMTogU3RhdGUtU3BhY2UgTW9kZWxzIGFuZCBLYWxtYW4gRmlsdGVyLiAgCgpEYXRhc2V0OiBodHRwczovL3d3dy5jaGljYWdvYm9vdGguZWR1Ly0vbWVkaWEvZmFjdWx0eS9ydWV5LXMtdHNheS90ZWFjaGluZy9mdHMyL2FhLTNydi50eHQKClIgY29kZTogaHR0cDovL2hlZGliZXJ0Lm9yZy93cC1jb250ZW50L3VwbG9hZHMvMjAxNC8wNi9BcHBsaWNhdGlvbjMtcmVhbGl6ZWR2b2xhdGlsaXR5LVIudHh0CgoK