This paper presents a new approach to inverting (fitting) models of coupled dynamical systems based on state-of-the-art (cubature) Kalman filtering. Crucially, this inversion furnishes posterior estimates of both the hidden states and parameters of a system, including any unknown exogenous input. Because the underlying generative model is formulated in continuous time (with a discrete observation process) it can be applied to a wide variety of models specified with either ordinary or stochastic differential equations. These are an important class of models that are particularly appropriate for biological time-series, where the underlying system is specified in terms of kinetics or dynamics (i.e., dynamic causal models). We provide comparative evaluations with generalized Bayesian filtering (dynamic expectation maximization) and demonstrate marked improvements in accuracy and computational efficiency. We compare the schemes using a series of difficult (nonlinear) toy examples and conclude with a special focus on hemodynamic models of evoked brain responses in fMRI. Our scheme promises to provide a significant advance in characterizing the functional architectures of distributed neuronal systems, even in the absence of known exogenous (experimental) input; e.g., resting state fMRI studies and spontaneous fluctuations in electrophysiological studies. Importantly, unlike current Bayesian filters (e.g. DEM), our scheme provides estimates of time-varying parameters, which we will exploit in future work on the adaptation and enabling of connections in the brain.

Department of Biomedical Engineering Brno University of Technology Brno Czech Republic

See more in PubMed

Aguirre GK, Zarahn E, D’esposito M. The variability of human, BOLD hemodynamic responses. Neuroimage. 1998;8:360–369. PubMed

Arasaratnam I, Haykin S. MICAI 2008: Advances in Artificial Intelligence. 2008. Nonlinear Bayesian Filters for Training Recurrent Neural Networks; pp. 12–33.

Arasaratnam I, Haykin S. Cubature Kalman Filters. IEEE Transactions on Automatic Control. 2009;54:1254–1269.

Attwell D, Buchan AM, Charpak S, Lauritzen M, MacVicar BA, Newman EA. Glial and neuronal control of brain blood flow. Nature. 2010;468:232–243. PubMed PMC

Berns GS, Song AW, Mao H. Continuous functional magnetic resonance imaging reveals dynamic nonlinearities of “dose-response” curves for finger opposition. Journal of Neuroscience. 1999;19:1–6. PubMed PMC

Birn RM, Saad ZS, Bandettini PA. Spatial heterogeneity of the nonlinear dynamics in the FMRI BOLD response. Neuroimage. 2001;14:817–826. PubMed

Biscay R, Jimenez JC, Riera JJ, Valdes PA. Local linearization method for the numerical solution of stochastic differential equations. Annals of the Institute of Statistical Mathematics. 1996;48:631–644.

Biswal B, Yetkin FZ, Haughton VM, Hyde JS. Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magnetic Resonance in Medicine. 1995;34:537–541. PubMed

Bucy RS, Senne KD. Digital synthesis of non-linear filters. Automatica. 1971;7:287–298.

Buxton RB, Uludag K, Dubowitz DJ, Liu TT. Modeling the hemodynamic response to brain activation. Neuroimage. 2004;23:S220–S233. PubMed

Buxton RB, Wong EC, Frank LR. Dynamics of blood flow and oxygenation changes during brain activation: the balloon model. Magnetic Resonance in Medicine. 1998;39:855–864. PubMed

David O. fMRI connectivity, meaning and empiricism Comments on: Roebroeck et al. The identification of interacting networks in the brain using fMRI: Model selection, causality and deconvolution. NeuroImage. 2009 In Press. PubMed

David O, Guillemain I, Saillet S, Reyt S, Deransart C, Segebarth C, Depaulis A. Identifying neural drivers with functional MRI: an electrophysiological validation. PLoS Biology. 2008;6:2683–2697. PubMed PMC

Deneux T, Faugeras O. Using nonlinear models in fMRI data analysis: model selection and activation detection. NeuroImage. 2006;32:1669–1689. PubMed

Doucet A, De Freitas N, Gordon N. Sequential Monte Carlo methods in practice. Springer Verlag; 2001.

Fernandez-Prades C, Vila-Valls J. Bayesian Nonlinear Filtering Using Quadrature and Cubature Rules Applied to Sensor Data Fusion for Positioning. In proceeding of IEEE International Conference on Communications; IEEE; 2010. pp. 1–5.

Friston K. Variational filtering. Neuroimage. 2008a;41:747–766. PubMed

Friston K. Dynamic casual modeling and Granger causality Comments on: The identification of interacting networks in the brain using fMRI: Model selection, causality and deconvolution. Neuroimage. 2009 In Press. PubMed PMC

Friston KJ. Bayesian estimation of dynamical systems: an application to fMRI. NeuroImage. 2002;16:513–530. PubMed

Friston KJ. Hierarchical models in the brain. PLoS Computional Biology. 2008b;4:e1000211. PubMed PMC

Friston KJ, Harrison L, Penny W. Dynamic causal modelling. Neuroimage. 2003;19:1273–1302. PubMed

Friston KJ, Mechelli A, Turner R, Price CJ. Nonlinear responses in fMRI: the Balloon model, Volterra kernels, and other hemodynamics. NeuroImage. 2000;12:466–477. PubMed

Friston KJ, Stephan KE, Daunizeau J. Mathematical Problems in Engineering. 2010. Generalised Filtering; p. 2010.

Friston KJ, Trujillo-Barreto N, Daunizeau J. DEM: a variational treatment of dynamic systems. Neuroimage. 2008;41:849–885. PubMed

Gitelman DR, Penny WD, Ashburner J, Friston KJ. Modeling regional and psychophysiologic interactions in fMRI: the importance of hemodynamic deconvolution. Neuroimage. 2003;19:200–207. PubMed

Handwerker D, Ollinger J, D’Esposito M. Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses. Neuroimage. 2004;21:1639–1651. PubMed

Haykin SS. Kalman filtering and neural networks. Wiley Online Library; 2001.

Hinton GE, van Camp D. Keeping the neural networks simple by minimizing the description length of the weights; In proceedings of COLT-93; ACM; 1993. pp. 5–13.

Hu Z, Zhao X, Liu H, Shi P. Nonlinear analysis of the BOLD signal. EURASIP Journal on Advances in Signal Processing. 2009;2009:1–13.

Iadecola C. CC commentary: intrinsic signals and functional brain mapping: caution, blood vessels at work. Cerebral Cortex. 2002;12:223–224. PubMed

Ito K, Xiong K. Gaussian filters for nonlinear filtering problems. Automatic Control, IEEE Transactions. 2002;45:910–927.

Jaakkola TS. Tutorial on variational approximation methods. Advanced mean field methods: theory and practice. 2000:129–159.

Jacobsen D, Hansen L, Madsen K. Bayesian model comparison in nonlinear BOLD fMRI hemodynamics. Neural computation. 2008;20:738–755. PubMed

Ji Z, Brown M. Joint State and Parameter Estimation For Biochemical Dynamic Pathways With Iterative Extended Kalman Filter: Comparison With Dual State and Parameter Estimation. Open Automation and Control Systems Journal. 2009;2:69–77.

Jimenez JC. A simple algebraic expression to evaluate the local linearization schemes for stochastic differential equations* 1. Applied Mathematics Letters. 2002;15:775–780.

Jimenez JC, Ozaki T. Local linearization filters for non-linear continuous-discrete state space models with multiplicative noise. International Journal of Control. 2003;76:1159–1170.

Jimenez JC, Shoji I, Ozaki T. Simulation of stochastic differential equations through the local linearization method. A comparative study. Journal of Statistical Physics. 1999;94:587–602.

Johnston LA, Duff E, Mareels I, Egan GF. Nonlinear estimation of the BOLD signal. NeuroImage. 2008;40:504–514. PubMed

Julier S, Uhlmann J, Durrant-Whyte HF. A new method for the nonlinear transformation of means and covariances in filters and estimators. Automatic Control, IEEE Transactions. 2002;45:477–482.

Kalman RE. A new approach to linear filtering and prediction problems. Journal of basic Engineering. 1960;82:35–45.

Kaminski P, Bryson A, Jr, Schmidt S. Discrete square root filtering: A survey of current techniques. Automatic Control, IEEE Transactions. 1971;16:727–736.

Kloeden PE, Platen E. Numerical Solution of Stochastic Differential Equations, Stochastic Modeling and Applied Probability. 3. Springer; 1999.

Krüger G, Glover GH. Physiological noise in oxygenation sensitive magnetic resonance imaging. Magnetic Resonance in Medicine. 2001;46:631–637. PubMed

Lauritzen M. Relationship of spikes, synaptic activity, and local changes of cerebral blood flow. Journal of Cerebral Blood Flow & Metabolism. 2001;21:1367–1383. PubMed

Li P, Yu J, Wan M, Huang J. The augmented form of cubature Kalman filter and quadrature Kalman filter for additive noise. IEEE Youth Conference on Information, Computing and Telecommunication, YC-ICT ‘09; IEEE; 2009. pp. 295–298.

Ljung L, Söderström T. Theory and practice of recursive identification. MIT Press; Cambridge, MA: 1983.

Logothetis NK. The neural basis of the blood–oxygen–level–dependent functional magnetic resonance imaging signal. Philosophical Transactions of the Royal Society of London Series B: Biological Sciences. 2002;357:1003. PubMed PMC

MacKay DJC. Developments in probabilistic modelling with neural networks-ensemble learning. In proceedings of 3rd Annual Symposium on Neural Networks; Nijmegen, Netherlands. 1995. pp. 191–198.

Magistretti P, Pellerin L. Cellular Mechanisms of Brain Energy Metabolism and their Relevance to Functional Brain Imaging. Philos Trans R Soc Lond B Biol Sci. 1999;354:1155–1163. PubMed PMC

Mandeville J, Marota J, Ayata C, Zaharchuk G, Moskowitz M, Rosen B, Weisskoff R. Evidence of a cerebrovascular postarteriole windkessel with delayed compliance. Journal of Cerebral Blood Flow & Metabolism. 1999a;19:679–689. PubMed

Mandeville JB, Marota JJA, Ayata C, Zaharchuk G, Moskowitz MA, Rosen BR, Weisskoff RM. Evidence of a cerebrovascular postarteriole windkessel with delayed compliance. Journal of Cerebral Blood Flow & Metabolism. 1999b;19:679–689. PubMed

Mechelli A, Price C, Friston K. Nonlinear coupling between evoked rCBF and BOLD signals: a simulation study of hemodynamic responses. NeuroImage. 2001;14:862–872. PubMed

Miller KL, Luh WM, Liu TT, Martinez A, Obata T, Wong EC, Frank LR, Buxton RB. Nonlinear temporal dynamics of the cerebral blood flow response. Human Brain Mapping. 2001;13:1–12. PubMed PMC

Murray L, Storkey A. Continuous time particle filtering for fMRI. Advances in Neural Information Processing Systems. 2008:20.

Nelson AT. PhD thesis. Oregon Graduate Institute of Science and Technology; 2000. Nonlinear estimation and modeling of noisy time-series by dual Kalman filtering methods.

Norgaard M, Poulsen NK, Ravn O. New developments in state estimation for nonlinear systems. Automatica. 2000;36:1627–1638.

Ozaki T. A bridge between nonlinear time series models and nonlinear stochastic dynamical systems: a local linearization approach. Statistica Sinica. 1992;2:113–135.

Riera J, Watanabe J, Kazuki I, Naoki M, Aubert E, Ozaki T, Kawashima R. A state-space model of the hemodynamic approach: nonlinear filtering of BOLD signals. NeuroImage. 2004;21:547–567. PubMed

Robbins H, Monro S. A stochastic approximation method. The Annals of Mathematical Statistics. 1951;22:400–407.

Roebroeck A, Formisano E, Goebel R. Reply to Friston and David:: After comments on: The identification of interacting networks in the brain using fMRI: Model selection, causality and deconvolution. NeuroImage. 2009a In Press. PubMed

Roebroeck A, Formisano E, Goebel R. The identification of interacting networks in the brain using fMRI: Model selection, causality and deconvolution. Neuroimage. 2009b In Press. PubMed

Simandl M, Dunik J. Design of derivative-free smoothers and predictors. In proceeding of the 14th IFAC Symposium on System Identification, SYSID06; 2006. pp. 1240–1245.

Sitz A, Schwarz U, Kurths J, Voss HU. Estimation of parameters and unobserved components for nonlinear systems from noisy time series. Physical Review E. 2002;66:1–9. PubMed

Sotero RC, Trujillo-Barreto NJ, Jiménez JC, Carbonell F, Rodríguez-Rojas R. Identification and comparison of stochastic metabolic/hemodynamic models (sMHM) for the generation of the BOLD signal. Journal of computational neuroscience. 2009;26:251–269. PubMed

Stephan KE, Kasper L, Harrison LM, Daunizeau J, den Ouden HEM, Breakspear M, Friston KJ. Nonlinear dynamic causal models for fMRI. NeuroImage. 2008;42:649–662. PubMed PMC

Särkkä S, Hartikainen J. Extension of VB-AKF to Estimation of Full Covariance and Non-Linear Systems. IEEE Transactions on Automatic Control Under revision.

Särkkä S, Nummenmaa A. Recursive noise adaptive Kalman filtering by variational Bayesian approximations. Automatic Control, IEEE Transactions. 2009;54:596–600.

Valdes Sosa PA, Sanchez Bornot JM, Sotero RC, Iturria Medina Y, Aleman Gomez Y, Bosch Bayard J, Carbonell F, Ozaki T. Model driven EEG/fMRI fusion of brain oscillations. Human brain mapping. 2009;30:2701–2721. PubMed PMC

Van der Merwe R. PhD thesis. Oregon Graduate Institute of Science and Technology; 2004. Sigma-point Kalman filters for probabilistic inference in dynamic state-space models.

Wu Y, Hu D, Wu M, Hu X. Unscented Kalman filtering for additive noise case: augmented vs. non-augmented. IEEE Signal Processing Letters. 2005;12:357–359.