Alexander Hvatov
ABSTRACT
The modern machine learning methods allow one to obtain the data-driven models in various ways. However, the more complex the model is, the harder it is to interpret. In the paper, we describe the algorithm for the mathematical equations discovery from the given observations data. The algorithm combines genetic programming with the sparse regression.
This algorithm allows obtaining different forms of the resulting models. As an example, it could be used for governing analytical equation discovery as well as for partial differential equations (PDE) discovery.
The main idea is to collect a bag of the building blocks (it may be simple functions or their derivatives of arbitrary order) and consequently take them from the bag to create combinations, which will represent terms of the final equation. The selected terms pass to the evolutionary algorithm, which is used to evolve the selection. The evolutionary steps are combined with the sparse regression to pick only the significant terms. As a result, we obtain a short and interpretable expression that describes the physical process that lies beyond the data.
In the paper, two examples of the algorithm application are described: the PDE discovery for the metocean processes and the function discovery for the acoustics.
- Jens Berg and Kaj Nyström. 2019. Data-driven discovery of PDEs in complex datasets. J. Comput. Phys. 384 (2019), 239--252.Google Scholar
Digital Library
- Sergey V Kovalchuk, Oleg G Metsker, Anastasia A Funkner, Ilia O Kisliakovskii, Nikolay O Nikitin, Anna V Kalyuzhnaya, Danila A Vaganov, and Klavdiya O Bochenina. 2018. A Conceptual Approach to Complex Model Management with Generalized Modelling Patterns and Evolutionary Identification. Complexity 2018 (2018).Google Scholar
- Zachary C Lipton. 2016. The mythos of model interpretability. arXiv preprint arXiv:1606.03490 (2016).Google Scholar
- Mikhail Maslyaev, Alexander Hvatov, and Anna Kalyuzhnaya. 2019. Data-Driven Partial Derivative Equations Discovery with Evolutionary Approach. In Computational Science --- ICCS 2019. Springer International Publishing, 635--641.Google ScholarCross Ref
- Christoph Molnar. 2019. Interpretable machine learning. Lulu. com.Google Scholar
- Nikolay O Nikitin et. al. 2019. Deadline-driven approach for multi-fidelity surrogate-assisted environmental model calibration: SWAN wind wave model case study. In Proceedings of the Genetic and Evolutionary Computation Conference Companion. 1583--1591.Google Scholar
- NSS Team. 2020. Fedot E* algotirhms. https://github.com/ITMO-NSS-team/FEDOT.Algs.Google Scholar
- M. Raissim. 2018. Deep hidden physics models: Deep learning of nonlinear partial differential equations. (2018). https://arxiv.org/abs/1801.06637Google Scholar
- Samuel H Rudy, Steven L Brunton, Joshua L Proctor, and J Nathan Kutz. 2017. Data-driven discovery of partial differential equations. Science Advances 3, 4 (2017), e1602614.Google ScholarCross Ref
- H. Schaeffer, R. Caflisch, C. D. Hauck, and S. Osher. 2017. Learning partial differential equations via data discovery and sparse optimization. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Science 473, 2197 (2017), 20160446. https://doi.org/473(2197):20160446Google Scholar
- Michael Schmidt and Hod Lipson. 2009. Distilling free-form natural laws from experimental data. science 324, 5923 (2009), 81--85.Google Scholar
Index Terms
- The data-driven physical-based equations discovery using evolutionary approach
Recommendations
Comparison of Single- and Multi- Objective Optimization Quality for Evolutionary Equation Discovery
GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary ComputationEvolutionary differential equation discovery proved to be a tool to obtain equations with less a priori assumptions than conventional approaches, such as sparse symbolic regression over the complete possible terms library. The equation discovery field ...
Data-Driven Partial Derivative Equations Discovery with Evolutionary Approach
Computational Science – ICCS 2019AbstractThe data-driven models are able to study the model structure in cases when a priori information is not sufficient to build other types of models. The possible way to obtain physical interpretation is the data-driven differential equation discovery ...
Discovery of Differential Equations Using Probabilistic Grammars
Discovery ScienceAbstractOrdinary differential equations (ODEs) are a widely used formalism for mathematical modeling of dynamical systems, a task omnipresent in many scientific domains. The paper introduces a novel method for inferring ODEs from data. It extends ProGED, ...
Comments