All about the money: Cost modeling and optimization of cloud applications

Created by W.Langdon from gp-bibliography.bib Revision:1.7630

@InProceedings{Baltes:2023:GI,

• author = "Sebastian Baltes",
• title = "All about the money: Cost modeling and optimization of cloud applications",
• booktitle = "12th International Workshop on Genetic Improvement @ICSE 2023",
• year = "2023",
• editor = "Vesna Nowack and Markus Wagner and Gabin An and Aymeric Blot and Justyna Petke",
• pages = "x",
• address = "Melbourne, Australia",
• month = "20 " # may,
• publisher = "IEEE",
• note = "Invited Keynote",
• keywords = "genetic algorithms, genetic programming, Genetic Improvement, cloud computing, IaC, IfC, Gartner, AWS, nonfunctional cost optimisation, software engineering, SBSE",
• isbn13 = "979-8-3503-1232-4",
• URL = "http://gpbib.cs.ucl.ac.uk/gi2023/keynote_2023_gi.pdf",
• DOI = "doi:10.1109/GI59320.2023.00008",
• slides_url = "http://gpbib.cs.ucl.ac.uk/gi2023/Sebastian_Baltes_Keynote_Cloud_Cost.pdf",
• slides_url = "https://empirical-software.engineering/talks/#2023",
• video_url = "http://gpbib.cs.ucl.ac.uk/gi2023/GI_ICSE2023_Keynote_Sebastian_Baltes.mp4",
• video_url = "http://gpbib.cs.ucl.ac.uk/gi2023/GI_ICSE2023_Keynote_Sebastian_Baltes.mov",
• video_url = "https://www.youtube.com/watch?v=M8gH0qPcJHQ&list=PLI8fiFpB7BoJLh6cUpGBjyeB1hM9DET1V&index=5",
• size = "1 page",
• abstract = "Cost is an essential non-functional property of cloud applications and is often a primary reason for companies to move to the cloud. One significant advantage of cloud platforms is the possibility to scale compute, storage, and networking resources up and down based on demand. However, as an application scales, so does the cost. Cost transparency of cloud applications is a common problem, and cloud providers have responded by providing means for detecting cost anomalies. However, detecting anomalies after billing is a workaround rather than a solution addressing the core problem. After introducing central cloud computing concepts and typical pricing approaches in the cloud, this talk outlines our vision of a vendor-agnostic cost model enabling reasoning about cost-optimal infrastructure and platform configurations based on expected workloads. The overall goal is to shift cost transparency left, i.e., to the developers and platform engineers who frequently provision cloud environments using web portals or Infrastructure-as-Code (IaC) files. The talk concludes by summarising the current trend towards Infrastructure-from-Code (IfC), where programming languages and cloud infrastructure descriptions converge into one paradigm, intending to automate infrastructure provisioning as much as possible. This area has huge potential for genetic improvement to optimize the IfC code and the provisioning mechanisms while balancing nonfunctional properties such as performance and cost.",
• notes = "GI @ ICSE 2023, part of \cite{Nowack:2023:GI}

  Amazon web services: you have to pay for that, internal cloud networking costs. SAP. duckbillgroup.com, stackoverflow monolithic application, blog post.

  IaaS Infrastructure as a Service: compute, storage and networking. PaaS Platform as a Service. SaaS Software as a Service (just applications that are hosted in the cloud).

  AWS lambda: pay only when used. Use lock-in, that is how they make money.

  Google Cloud: configure by web user interface. Terraform: file based configuration (ideal for GI to optimise?) GitOps: ArgoCD push IaC file, automatically updates your cloud configuration Mitigation (guard rails, prevent doing something really stupid) Infracost. AWS power tuning (optimisation). OpenCost (eg Microsoft).

  Infrastructure-from-Code IfC api.cost. puppet. Serverless, eg JSON. Evolution of workload. SAP database. (so far) little work in software engineering research. Some in cloud research computing, eg Google cloud v. Apache Finc (IC2E 2022)

  Future: mining GitHub. Takeaways 41:00 shifted left, always about tradeoffs 43:00 Q&A.

  Myra B Cohen.

  Need to simplify to start research. Light weight search.

  Bradley Alexander, spot instances. Handle interruptions Amazon EC2. Easier to model spot prices? Hyper-scalars Very complex. You pay for everything.

  Erik Frederics, offline testing, test out before actually run on the cloud.

  Serverless. Estimate cost before actually running. How frequently do prices. Scrape prices from the internet www web.

  Monolithic. SAP. Importance of stable compute platform. micro-services not a solution in themselves. Latency, no easy solutions.",

}

Genetic Programming entries for Sebastian Baltes

Citations