Fuzzy Aggregated Topology Evolution for Cognitive Multi-tasks

Created by W.Langdon from gp-bibliography.bib Revision:1.8081

@Article{Chaturvedi:2021:CognComput,

• author = "Iti Chaturvedi and Chit L Su and Roy E Welsch",
• title = "Fuzzy Aggregated Topology Evolution for Cognitive Multi-tasks",
• journal = "Cognitive Computation",
• year = "2021",
• volume = "13",
• pages = "96--107",
• keywords = "genetic algorithms, genetic programming, multi-task optimisation, fuzzy logic, neuroevolution",
• publisher = "Springer US",
• bibsource = "OAI-PMH server at dspace.mit.edu",
• language = "en",
• oai = "oai:dspace.mit.edu:1721.1/131981",
• URL = "https://hdl.handle.net/1721.1/131981",
• DOI = "doi:10.1007/s12559-020-09807-4",
• size = "15 pages",
• abstract = "Evolutionary optimisation aims to tune the hyper-parameters during learning in a computationally fast manner. For optimisation of multi-task problems, evolution is done by creating a unified search space with a dimensionality that can include all the tasks. Multi-task evolution is achieved via selective imitation where two individuals with the same type of skill are encouraged to crossover. Due to the relatedness of the tasks, the resulting offspring may have a skill for a different task. In this way, we can simultaneously evolve a population where different individuals excel in different tasks. In this paper, we consider a type of evolution called Genetic Programming (GP) where the population of genes have a tree-like structure and can be of different lengths and hence can naturally represent multiple tasks. We apply the model to multi-task neuroevolution that aims to determine the optimal hyper-parameters of a neural network such as number of nodes, learning rate, and number of training epochs using evolution. Here each gene is encoded with the hyper parameters for a single neural network. Previously, optimisation was done by enabling or disabling individual connections between neurons during evolution. This method is extremely slow and does not generalise well to new neural architectures such as Seq2Seq. To overcome this limitation, we follow a modular approach where each sub-tree in a GP can be a sub-neural architecture that is preserved during crossover across multiple tasks. Lastly, in order to leverage on the inter-task covariance for faster evolutionary search, we project the features from both tasks to common space using fuzzy membership functions. The proposed model is used to determine the optimal topology of a feed-forward neural network for classification of emotions in physiological heart signals and also a Seq2seq chatbot that can converse with kindergarten children. We can outperform baselines by over 10percent in accuracy.",

}

Genetic Programming entries for Iti Chaturvedi Chit L Su Roy E Welsch

Citations