21.10.2020 - by Mirko Kämpf & Matthias Goerens
In a series of 3 blog posts, Confluent and Cloud&Heat explore the use of floating workloads for improving data processing efficiency and streaming data management.
In the future of decentralized digital infrastructure, cloud applications run on a plethora of datacenters that fit their regional legal, technical, and energy requirements. To efficiently orchestrate them, optimizing the energy utilization of the distributed cloud infrastructure globally can be achieved by shifting applications between sites or delaying the execution of applications, depending on ecological factors.
Our solution demonstrates how we combine the Confluent Platform with Krake in a two-layer data plane to manage floating workloads for improving processing efficiency:
This accomplishes the following objectives:
Sounds interesting ? The first part is available on the Confluent blog. It focuses on the overall motivation and objectives and introduces key concepts. Part 2 and part 3 will cover the technical setup used during our experiments and present the results.
Stay tuned !
Confluent is founded by the original creators of Apache Kafka®. The California-based company provides the industry’s only enterprise-ready Event Streaming Platform, driving a new paradigm for application and data infrastructure. With Confluent Platform you can leverage data as a continually updating stream of events rather than as discrete snapshots. Over 60% of the Fortune 100 leverage event streaming – and the majority of those leverage Confluent Platform. Confluent provides a single platform for real-time and historical events, enabling you to build an entirely new category of event-driven applications and gain a universal event pipeline.Confluent Platform makes it easy to build real-time data pipelines and streaming applications by integrating data from multiple sources and locations into a single, central Event Streaming Platform for your company. Confluent Platform lets you focus on how to derive business value from your data rather than worrying about the underlying mechanics such as how data is being transported or massaged between various systems. Specifically, Confluent Platform simplifies connecting data sources to Kafka, building applications with Kafka, as well as securing, monitoring, and managing your Kafka infrastructure.