Csaba Sulyok
ABSTRACT
In this paper we investigate the effect of embedding different levels of musical knowledge in the virtual machine (VM) architectures and phenotype representations of an algorithmic music composition system. We examine two separate instruction sets for a linear genetic programming framework that differ in their knowledge of musical structure: one a Turing-complete register machine, unaware of the nature of its output; the other a domain-specific language tailored to operations typically employed in the composition process. Our phenotype, the output of the VM, is rendered as a musical model comprising a sequence of notes represented by duration and pitch. We compare three different pitch schemes with differing embedded knowledge of tonal concepts, such as key and mode.
To derive a fitness metric, we extract musical features from a corpus of Hungarian folk songs in the form of n-grams and entropy values. Fitness is assessed by extracting those same attributes from the phenotype and finding the maximal similarity with representative corpus features.
With two different VM architectures and three pitch schemes, we present and compare results from a total of six configurations, and analyze whether the domain-specific knowledge impacts the results and the rate of convergence in a beneficial manner.
Supplemental Material
Available for Download
zip
p188-sulyok_suppl.zip (233.3 KB)
Supplemental material.
- David Arthur and Sergei Vassilvitskii. 2007. k-means++: The advantages of careful seeding. In Proceedings of the 18th Annual Symposium on Discrete Algorithms (ACM-SIAM). Society for Industrial and Applied Mathematics, New Orleans, Louisiana, 1027--1035. Google Scholar
Digital Library
- Jon Bentley. 1986. Programming pearls: little languages. Commun. ACM 29, 8 (1986), 711--721. Google ScholarDigital Library
- John A. Biles. 1994. GenJam: A Genetic Algorithm for Generating Jazz Solos. In Proceedings of the 1994 International Computer Music Conference (ICMC). Michigan Publishing, Aarhus, Denmark, 131--137.Google Scholar
- Piero P. Bonissone, Raj Subbu, Neil Eklund, and Thomas R. Kiehl. 2006. Evolutionary algorithms + domain knowledge = real-world evolutionary computation. IEEE Transactions on Evolutionary Computation 10, 3 (2006), 256--280. Google ScholarDigital Library
- Markus F. Brameier and Wolfgang Banzhaf. 2007. Linear genetic programming (1st ed.). Springer Science & Business Media. Google ScholarDigital Library
- Elaine Chew. 2002. The Spiral Array: An Algorithm for Determining Key Boundaries. In Proceedings of the Second International Conference on Music and Artificial Intelligence (ICMAI). Springer Berlin Heidelberg, Edinburgh, Scotland, 18--31. Google ScholarDigital Library
- Ching-Hua Chuan and Elaine Chew. 2005. Polyphonic Audio Key Finding Using the Spiral Array CEG Algorithm. In Proceedings of the 2005 IEEE International Conference on Multimedia and Expo (ICME). IEEE, Amsterdam, The Netherlands, 21--24.Google ScholarCross Ref
- Darrell Conklin. 2003. Music generation from statistical models. In Proceedings of the 2003 Symposium on Artificial Intelligence and Creativity in the Arts and Sciences. AISB, Aberystwyth, Wales, 30--35.Google Scholar
- Dan Costelloe and Conor Ryan. 2007. Towards models of user preferences in interactive musical evolution. In Proceedings of the 9th Genetic and Evolutionary Computation Conference (GECCO). ACM, London, UK, 2254--2254. Google ScholarDigital Library
- Thomas M. Cover and Joy A. Thomas. 2012. Elements of information theory. John Wiley & Sons.Google Scholar
- Kenneth De Jong. 1988. Learning with genetic algorithms: An overview. Machine learning 3, 2--3 (1988), 121--138. Google ScholarDigital Library
- Inderjit S. Dhillon, Yuqiang Guan, and Brian Kulis. 2004. Kernel k-means, spectral clustering and normalized cuts. In Proceedings of the 10th International Conference on Knowledge Discovery and Data Mining (SIGKDD). ACM, Seattle, Washington, USA, 551--556. Google ScholarDigital Library
- Brad Dolin, Maribel García Arenas, and Juan J. Merelo. 2002. Opposites Attract: Complementary Phenotype Selection for Crossover in Genetic Programming. In Proceedings of the 7th International Conference on Parallel Problem Solving from Nature (PPSN) (PPSN VII). Springer-Verlag, London, UK, 142--152. Google ScholarDigital Library
- Patrick Donnelly and John Sheppard. 2011. Evolving Four-Part Harmony Using Genetic Algorithms. In Applications of Evolutionary Computation. Vol. 6625. Springer, Berlin, Heidelberg, 273--282. Google ScholarDigital Library
- Shyamala Doraisamy and Stefan M. Rüger. 2004. A Polyphonic Music Retrieval System Using N-Grams. In Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR). Universitat Pompeu Fabra, Barcelona, Spain, 204--209.Google Scholar
- Richard O. Duda, Peter E. Hart, and David G. Stork. 2000. Pattern classification. John Wiley & Sons. Google ScholarDigital Library
- Arne Eigenfeldt. 2012. Corpus-based recombinant composition using a genetic algorithm. Soft Computing 16, 12 (2012), 2049--2056. Google ScholarDigital Library
- Jose D. Fernández and Francisco Vico. 2013. AI methods in algorithmic composition: A comprehensive survey. Journal of Artificial Intelligence Research 48 (2013), 513--582. Google ScholarCross Ref
- Carlos M. Fonseca and Peter J. Fleming. 1993. Genetic Algorithms for Multiobjective Optimization: Formulation, Discussion and Generalization. In Proceedings of the 5th International Conference on Genetic Algorithms (ICGA). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 416--423. Google ScholarDigital Library
- Martin Fowler. 2010. Domain Specific Languages (1st ed.). Addison-Wesley Professional. Google ScholarDigital Library
- P. M. Gibson and J. A. Byrne. 1991. NEUROGEN, musical composition using genetic algorithms and cooperating neural networks. In Proceedings of the Second International Conference on Artificial Neural Networks (ICANN). IET, Bournemouth, UK, 309--313.Google Scholar
- Per Hartmann. 1990. Natural Selection of Musical Identities. In Proceedings of the 1990 International Computer Music Conference (ICMC). Michigan Publishing, Glasgow, Scotland, 234--236.Google Scholar
- David M. Hofmann. 2015. A Genetic Programming Approach to Generating Musical Compositions. In Proceedings of the 4th International Conference on Evolutionary and Biologically Inspired Music, Sound, Art and Design (EvoMUSART), Vol. 9027. Springer, Cham, Copenhagen, 89--100.Google ScholarCross Ref
- Andrew Horner and David E. Goldberg. 1991. Genetic Algorithms and ComputerAssisted Music Composition.. In Proceedings of the 4th International Conference on Genetic Algorithms (ICGA). Morgan Kaufmann, San Diego, CA, USA, 437--441.Google Scholar
- Brad Johanson and Riccardo Poli. 1998. GP-Music: An Interactive Genetic Programming System for Music Generation with Automated Fitness Raters. In Proceedings of the Third Annual Conference on Genetic Programming. Morgan Kaufmann, University of Wisconsin, Madison, Wisconsin, USA, 181--186.Google Scholar
- John R. Koza. 1992. Genetic programming: on the programming of computers by means of natural selection. MIT Press. Google ScholarDigital Library
- Carol L. Krumhansl. 2001. A key-finding algorithm based on tonal hierarchies. In Cognitive Foundations of Musical Pitch. Oxford University Press, 77--110.Google Scholar
- David Lidov and Jim Gabura. 1973. A Melody Writing Algorithm Using a Formal Language Model. Computers in the Humanities 3--4 (1973), 138--148.Google Scholar
- Adam Lipowski and Dorota Lipowska. 2012. Roulette-wheel selection via stochastic acceptance. Physica A: Statistical Mechanics and its Applications 391, 6 (2012), 2193--2196.Google Scholar
- ManYat Lo and Simon M. Lucas. 2007. N-gram fitness function with a constraint in a musical evolutionary system. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC). IEEE, Singapore, 4246--4251.Google Scholar
- Róisín Loughran, James McDermott, and Michael O'Neill. 2016. Grammatical Music Composition with Dissimilarity Driven Hill Climbing. In Proceedings of the 5th International Conference on Evolutionary and Biologically Inspired Music, Sound, Art and Design (EvoMUSART). Springer, Porto, Portugal, 110--125. Google ScholarDigital Library
- Søren T. Madsen and Gerhard Widmer. 2007. Key-finding with Interval Profiles. In Proceedings of the 2007 International Computer Music Conference (ICMC). Michigan Publishing, Copenhagen, Denmark, 212--215.Google Scholar
- Bill Z. Manaris, Patrick Roos, Penousal Machado, Dwight Krehbiel, Luca Pellicoro, and Juan Romero. 2007. A Corpus-Based Hybrid Approach to Music Analysis and Composition. In Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence. AAAI Press, 839--845. Google ScholarDigital Library
- Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze. 2008. Introduction to information retrieval. Cambridge University Press. Google Scholar
- Christopher D. Manning and Hinrich Schütze. 1999. Foundations of statistical natural language processing. MIT press. Google ScholarDigital Library
- Leonard C. Manzara, Ian H. Witten, and Mark James. 1992. On the Entropy of Music: An Experiment with Bach Chorale Melodies. Leonardo Music Journal 2, 1 (1992), 81.Google ScholarCross Ref
- Nobuo Masataka. 2007. Music, evolution and language. Developmental Science 10, 1 (2007), 35--39.Google ScholarCross Ref
- Jon McCormack. 1996. Grammar based music composition. Complex systems 96 (1996), 321--336.Google Scholar
- Ryan A. McIntyre. 1994. Bach in a box: the evolution of four part Baroque harmony using the genetic algorithm. In Proceedings of the IEEE First World Congress on Computational Intelligence. IEEE, Orlando, Florida, USA, 852--857.Google ScholarCross Ref
- Robert I. McKay, Nguyen X. Hoai, Peter A. Whigham, Yin Shan, and Michael O'Neill. 2010. Grammar-based genetic programming: a survey. Genetic Programming and Evolvable Machines 11, 3--4 (2010), 365--396. Google ScholarDigital Library
- Marjan Mernik, Jan Heering, and Anthony M. Sloane. 2005. When and how to develop domain-specific languages. ACM computing surveys (CSUR) 37, 4 (2005), 316--344. Google ScholarDigital Library
- George A. Miller. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological review 63, 2 (1956), 81.Google Scholar
- Eduardo Reck Miranda and John Al Biles. 2007. Evolutionary Computer Music. Springer-Verlag New York, Inc., Secaucus, NJ, USA. Google ScholarDigital Library
- Artemis Moroni, Jônatas Manzolli, Fernando Von Zuben, and Ricardo Gudwin. 2000. Vox populi: An interactive evolutionary system for algorithmic music composition. Leonardo Music Journal 10 (2000), 49--54.Google ScholarCross Ref
- Peter Nordin, Wolfgang Banzhaf, and Frank D. Francone. 1999. Efficient evolution of machine code for CISC architectures using instruction blocks and homologous crossover. Advances in genetic programming 3 (1999), 275--299. Google ScholarDigital Library
- Alfonso Ortega, Rafael Sánchez Alfonso, and Manuel Alfonseca. 2002. Automatic Composition of Music by Means of Grammatical Evolution. In Proceedings of the 2002 International Conference on APL: Array Processing Languages: Lore, Problems, and Applications. ACM, Madrid, Spain, 148--155. Google ScholarDigital Library
- Marcus T. Pearce. 2005. The construction and evaluation of statistical models of melodic structure in music perception and composition. Ph.D. Dissertation. City University London.Google Scholar
- Somnuk Phon-Amnuaisuk, Andrew Tuson, and Geraint Wiggins. 1999. Evolving Musical Harmonisation. In Proceedings of the 1999 International Conference on Artificial Neural Nets and Genetic Algorithms. Springer, Portorož, Slovenia, 229--234.Google ScholarCross Ref
- R. Plomp and J. M. Levelt. 1965. Tonal Consonance and Critical Bandwidth. The Journal of the Acoustical Society of America 38, 4 (10 1965), 548--560.Google ScholarCross Ref
- Riccardo Poli, William B Langdon, Nicholas F McPhee, and John R Koza. 2008. A field guide to genetic programming. Lulu. com. Google ScholarDigital Library
- John Reddin, James McDermott, and Michael O'Neill. 2009. Elevated Pitch: Automated Grammatical Evolution of Short Compositions. In Applications of Evolutionary Computing. Lecture Notes in Computer Science, Vol. 5484. Springer Berlin Heidelberg, 579--584. Google ScholarDigital Library
- Conor Ryan, John J. Collins, and Michael O'Neill. 1998. Grammatical evolution: Evolving programs for an arbitrary language. In Proceedings of the First European Conference on Genetic Programming (EuroGP). Springer, Paris, France, 83--96. Google ScholarDigital Library
- Eleanor Selfridge-Field. 2004. Music Theory for Computer Applications. (2004). http://www.ccarh.org/courses/254/MusicTheory_ComputerApps2004.htmGoogle Scholar
- Csaba Sulyok, Andrew McPherson, and Christopher Harte. 2019. Evolving the process of a virtual composer. Natural Computing 18, 1 (2019), 47--60. Google ScholarDigital Library
- Joseph P. Swain. 1986. The need for limits in hierarchical theories of music. Music Perception: An Interdisciplinary Journal 4, 1 (1986), 121--147.Google ScholarCross Ref
- David Temperley. 2001. The cognition of basic musical structures. MIT Press. Google ScholarDigital Library
- Nao Tokui and Hitoshi Iba. 2000. Music composition with interactive evolutionary computation. In Proceedings of the Third International Conference on Generative Art, Vol. 17. Milan, Italy, 215--226.Google Scholar
- Esko Ukkonen, Kjell Lemström, and Veli Mäkinen. 2003. Geometric Algorithms for Transposition Invariant Content-Based Music Retrieval. In Proceedings of the 4th International Conference on Music Information Retrieval (ISMIR). Johns Hopkins University Press, Maryland, USA, 193--199.Google Scholar
- Rodney Waschka II. 2007. Composing with Genetic Algorithms: GenDash. In Evolutionary Computer Music. Springer London, 117--136.Google Scholar
- Raymond Whorley and Darrell Conklin. 2016. Music Generation from Statistical Models of Harmony. Journal of New Music Research 45, 2 (2016), 160--183.Google ScholarCross Ref
- Jackie Wiggins. 2007. Compositional process in music. In International handbook of research in arts education. Springer Netherlands, 453--476.Google Scholar
- Jacek Wolkowicz, Malcolm Heywood, and Vlado Keselj. 2009. Evolving indirectly represented melodies with corpus-based fitness evaluation. In Workshops on Applications of Evolutionary Computation. Springer Berlin Heidelberg, Tübingen, Germany, 603--608. Google ScholarDigital Library
- Jacek Wolkowicz, Zbigniew Kulka, and Vlado Keselj. 2008. N-gram-based approach to composer recognition. Archives of Acoustics 33, 1 (2008), 43--55.Google Scholar
- Chia L. Wu, Chien H. Liu, and Chuan K. Ting. 2014. A novel genetic algorithm considering measures and phrases for generating melody. In Proceedings of the 2014 Congress on Evolutionary Computation (CEC). IEEE, Beijing, China, 2101--2107.Google Scholar
Index Terms
- On the impact of domain-specific knowledge in evolutionary music composition
Recommendations
Evolutionary interactive music composition
GECCO '06: Proceedings of the 8th annual conference on Genetic and evolutionary computationThis paper proposes the CFE framework---Composition, Feedback, and Evolution---and presents an interactive music composition system. The system composes short, manageable pieces of music by interacting with users. The most important features of the ...
Music/lyrics composition system considering user's image and music genre
SMC'09: Proceedings of the 2009 IEEE international conference on Systems, Man and CyberneticsThis paper proposes a music/lyrics composition system consisting of two sections, a lyric composing section and a music composing section, which considers user's image of a song and music genre. First of all, a user has an image of music/lyrics to ...
Affective evolutionary music composition with MetaCompose
This paper describes the MetaCompose music generator, a compositional, extensible framework for affective music composition. In this context `affective' refers to the music generator's ability to express emotional information. The main purpose of ...
Comments