Empirical Emulators for First Principle Models

Created by W.Langdon from gp-bibliography.bib Revision:1.8051

@InProceedings{mercure:2001:AIChE,

• author = "Peter Kip Mercure and Guido F. Smits and Arthur Kordon",
• title = "Empirical Emulators for First Principle Models",
• booktitle = "AIChE Fall Annual Meeting",
• year = "2001",
• address = "Reno Hilton",
• month = "6 " # nov,
• organisation = "AIChe",
• keywords = "genetic algorithms, genetic programming",
• broken = "http://www.aiche.org/conferences/techprogram/paperdetail.asp?PaperID=2373&DSN=annual01",
• abstract = "Empirical emulators mimic the performance of first principle models by using various data-driven modeling techniques. The driving force for developing empirical emulators is the push for reducing the time and cost for new product development. Empirical emulators are especially effective when hard real-time optimization of a variety of complex fundamental models is needed. The increased robustness of the modern data-driven techniques (analytic neural networks, support vector machines, genetic programming, etc.) is a reliable basis for accurate representation of fundamental models and gives many opportunities for effective synergy between these two key modeling approaches.

  The main schemes for building empirical emulators are discussed in the paper. Several contemporary techniques for robust empirical emulator design are explored including analytic neural networks, recurrent neural networks and Genetic Programming (GP), and the capabilities of the proposed approach are illustrated with a case study for a simple first principle model.

  A key feature of empirical emulators is that the training data for empirical model building is generated by design of experiments from first principle models called simulators. This allows a high degree of freedom for development of reliable data-driven models. The most obvious scheme for implementation of empirical emulators is as accelerator of computational time for fundamental models (the gain is 10³ to 10⁵ times faster). Another possible scheme is to use the empirical emulator as an estimator of fundamental model performance. Of special importance to on-line optimization is a scheme using the empirical emulator to integrate different types of fundamental models (steady-state, dynamic, fluid, kinetic, thermal, etc). Most of the known empirical emulators are implemented as {"}classical{"} neural networks based on back-propagation learning algorithm. Their property of being universal approximators is a key theoretical result for successful emulation. At the same time {"}classical{"} neural networks suffer from a number of problems like: long computational time for training, convergence to local minima, sensitivity to weight generalization, too many tunable parameters, etc. These problems put serious limitations on the quality of the developed empirical model, increase development time, and require experienced model developers. An alternative empirical emulator based on analytic neural networks is described in the paper. A key advantage of analytic neural networks is that the function to be optimized is a quadratic function of the weights of the hidden-to-output layer error and has one global optimum. It is no longer possible to get stuck in local minima and the learning algorithm is not iterative. As a result, the data-driven modeling process is significantly reduced and the developed empirical models are parsimonious. Of special importance to empirical emulator's performance is the ability of analytic neural networks to deliver multiple-model solution with confidence limits. Empirical emulators with confidence limits are aware of their own performance which is essential for any data-driven model application, especially in real-time. In the case of emulating process dynamics a different type of recurrent neural networks are needed. Recurrent networks are neural networks with one or more local or global feedback loops. The application of feedback enables neural networks to acquire state representations, making them suitable for emulation of dynamic fundamental models. A proper structure of an empirical emulator to mimic dynamic behavior is based on a recurrent version of the analytic neural networks.",

• abstract = "Another approach to build a successful empirical emulator is genetic programming. By simulation of natural evolution and using genetic operators like crossover and mutation, genetic programming delivers empirical models in a form of explicit analytic functions between process inputs and outputs. The non-black-box form is a significant advantage of this type of empirical emulator. In principle, a functional relationship has better generalization capability and is a more reliable indicator of model performance outside the training range. This unique capability makes empirical emulators designed by genetic programming a promising modeling solution for process scale-up. The performance of empirical emulators based on analytic neural networks, analytic recurrent neural networks, and genetic programming is illustrated in a case study of emulating a phase change propagation in a solid.",
• notes = "American Institute of Chemical Engineers, 3 Park Ave, New York, N.Y., 10016-5991, U.S.A.",

}

Genetic Programming entries for Peter Kip Mercure Guido F Smits Arthur K Kordon

Citations