Optimal Nonlinear Prediction of Random Fields on Networks

Cosma Rohilla Shalizi

doi:10.46298/dmtcs.2310

Cosma Rohilla Shalizi - Optimal Nonlinear Prediction of Random Fields on Networks

dmtcs:2310 - Discrete Mathematics & Theoretical Computer Science, January 1, 2003, DMTCS Proceedings vol. AB, Discrete Models for Complex Systems (DMCS'03) - https://doi.org/10.46298/dmtcs.2310

Optimal Nonlinear Prediction of Random Fields on NetworksArticle

Authors: Cosma Rohilla Shalizi ¹

1 Center for the study of complex systems

It is increasingly common to encounter time-varying random fields on networks (metabolic networks, sensor arrays, distributed computing, etc.).This paper considers the problem of optimal, nonlinear prediction of these fields, showing from an information-theoretic perspective that it is formally identical to the problem of finding minimal local sufficient statistics.I derive general properties of these statistics, show that they can be composed into global predictors, and explore their recursive estimation properties.For the special case of discrete-valued fields, I describe a convergent algorithm to identify the local predictors from empirical data, with minimal prior information about the field, and no distributional assumptions.

https://doi.org/10.46298/dmtcs.2310

Source: HAL:hal-01183318v1

Volume: DMTCS Proceedings vol. AB, Discrete Models for Complex Systems (DMCS'03)

Section: Proceedings

Published on: January 1, 2003

Imported on: November 21, 2016

Keywords: recursive estimation,Networks,random fields,sufficient statistics,nonlinear prediction,information theory,[INFO.INFO-DM] Computer Science [cs]/Discrete Mathematics [cs.DM],[MATH.MATH-CO] Mathematics [math]/Combinatorics [math.CO],[NLIN.NLIN-CG] Nonlinear Sciences [physics]/Cellular Automata and Lattice Gases [nlin.CG],[INFO.INFO-HC] Computer Science [cs]/Human-Computer Interaction [cs.HC]

Classifications

Mathematics Subject Classification 2020¹

Sources:

[1] zbMATH Open.

Bibliographic References

10 Documents citing this article

Rupe, Adam Thomas;Crutchfield, James P., 2022, Algebraic Theory of Patterns as Generalized Symmetries, eScholarship (California Digital Library), 10.3390/sym14081636, https://escholarship.org/uc/item/72w0n7hn.

Adam Rupe;Mr Prabhat;James P. Crutchfield;Nalini Kumar;Vladislav Epifanov;et al., arXiv (Cornell University), DisCo: Physics-Based Unsupervised Discovery of Coherent Structures in Spatiotemporal Systems, 96, pp. 75-87, 2019, Denver, CO, USA, 10.1109/mlhpc49564.2019.00013, https://arxiv.org/abs/1909.11822.

Jimpei Harada;David Darmon;Michelle Girvan;William Rand, Lecture notes in social networks, Prediction of Elevated Activity in Online Social Media Using Aggregated and Individualized Models, pp. 169-187, 2017, 10.1007/978-3-319-53420-6_7.

Christopher Schlick;Bruno Demissie, Understanding complex systems, Evaluation of Complexity in Product Development, pp. 159-214, 2015, 10.1007/978-3-319-21717-8_3.

Daniel Cervone;Natesh S. Pillai;Debdeep Pati;Ross Berbeco;John Henry Lewis, 2014, A location-mixture autoregressive model for online forecasting of lung tumor motion, The Annals of Applied Statistics, 8, 3, 10.1214/14-aoas744, https://doi.org/10.1214/14-aoas744.

Tuomo Mäki-Marttunen;Juha Kesseli;Matti Nykter, 2013, Balance between Noise and Information Flow Maximizes Set Complexity of Network Dynamics, PLoS ONE, 8, 3, pp. e56523, 10.1371/journal.pone.0056523, https://doi.org/10.1371/journal.pone.0056523.

Xinwei Gong;Joshua E. S. Socolar, 2012, Quantifying the complexity of random Boolean networks, arXiv (Cornell University), 85, 6, 10.1103/physreve.85.066107, https://arxiv.org/abs/1202.1540.

Chih-Chun Chen;Sylvia B. Nagl;Christopher D. Clack, Studies in computational intelligence, Complexity and Emergence in Engineering Systems, pp. 99-128, 2008, 10.1007/978-3-540-88075-2_5.

Guillaume Bertello;Pierre-Jean Arduin;Fabio Boschetti;Dion Weatherley, 2008, Application of Computational Mechanics to the Analysis of Seismic Time-series via Numerical Optimisation, New Generation Computing, 27, 1, pp. 1-23, 10.1007/s00354-008-0052-x.

Cosma Rohilla Shalizi, Springer eBooks, Methods and Techniques of Complex Systems Science: An Overview, pp. 33-114, 2007, 10.1007/978-0-387-33532-2_2.

Sources : OpenCitations, OpenAlex & Crossref

Share and export

Consultation statistics

This page has been seen 417 times.

This article's PDF has been downloaded 351 times.