Skip to content

WIP: Hazelcast Jet Benchmark/Docker-Compose/Kubernetes implementation

Hazelcast Jet implementation for benchmark use cases (eventually 1-3 or 1-4) with an additional commons project; docker-compose implementation for hazelcast jet; kubernetes implementation for hazelcast jet;

Open points:

  • Add benchmark implementations. This includes
    • UC1
    • UC2
    • UC3
    • UC4
  • Move common logic to a "hazelcastjet-commons" project, similar to those of the other implementations
  • Add docker-compose files for all Hazelcast Jet implementations (might be tackled by a follow-up merge request)
  • Add Kubernetes benchmark definitions for all Hazelcast Jet implementations (might be tackled by a follow-up merge request). This includes:
    • Kubernetes Deployments + Services + maybe other resources
    • A Kubernetes benchmark resource of kind benchmarks.theodolite.com
  • Ensure that record lag can be monitored via Prometheus and Kafka Lag Exporter (@she can assist here)
  • Provide appropriate documentation

TODO for @she:

  • Remove commits from flink-benchmark-def-with-rm-rebalance Branch
Edited by Sören Henning

Merge request reports