As you may have heard, we are kicking off an effort called Project Metamorphosis to transform Apache KafkaⓇ into the next-gen event platform. On the first Wednesday of every month for the rest of the year, we will announce a major new set of product features and improvements to Confluent Platform, Confluent Cloud, and OSS Kafka - organized around the foundational traits of cloud-native data systems.
This month is all about:
Elastic Scaling for Apache Kafka
The number of mission-critical apps and the amount of data underpinning them has grown exponentially in the increasingly digital world and there’s no sign of slowing down.
Unfortunately, the rigid data architectures supporting these apps force businesses to spend too much upfront on resources they don’t use and waste time on complex capacity planning to handle unexpected traffic surges. Too often, the provisioned resources still can’t handle unplanned traffic spikes, which hurt application performance and cause downtime. As you know, every millisecond delay could be another lost customer.
Adjusting to the real-time needs of your mission-critical apps is only possible with a data architecture that scales elastically - the cloud-native way.
So, we’ve re-engineered Apache Kafka to create a next-gen event streaming platform that scales elastically and processes real-time data wherever it lives, whether it's on-premises or in the cloud. The following features bring this to life:
Operator -- now available
Simplify deployment and key lifecycle operations for Confluent Platform on Kubernetes.
Tiered Storage -- now in preview
Decouple the compute and storage layers in your cluster and scale each resource independently.
Self-balancing Clusters -- coming soon
Automate partition rebalances to optimize Kafka’s throughput and accelerate broker scaling.
Dedicated cluster self-serve provisioning and expansion -- now available
Quickly spin up and get to GBps scale with Dedicated clusters in Confluent Cloud
Elastic scalability in Confluent Cloud Basic and Standard tiers -- now available
Instantly scale from 0 to 100MBps with Basic and Standard clusters
Usage Based Billing across all cloud tiers -- now available
Leverage usage based billing for all cloud tiers and features incl. KSQL and Connect
Goodbye Zookeeper -- in progress
KIP-500 is well underway. This removes the dependency of Kafka on ZooKeeper, a component that makes elastic operations difficult.
Read more about these features and discover for yourself how Confluent Platform is the only Kafka distribution in the market that offers efficient and elastic operations. Also, find out how we’re bringing elastic scaling to our fully-managed platform, Confluent Cloud, which you can try free today.