7 comments

  • edoceo 17 minutes ago
    Could you add Valkey to the benchmark? Curious about different key-types too, like list and hash. Also, big values (2KB) and small values (<256B)
  • syepes 30 minutes ago
    How does this compare and benchmark with https://github.com/apache/kvrocks
    • murtazayusuf 24 minutes ago
      I haven’t tested against it, that will be next, i will run the benchmarks on the same method and publish the results, or if you want to, you can as well. Even if it performs poorly, I will report that too like we did with dragonfly.
    • sligbad 23 minutes ago
      Well Kvrocks is on disk, not in memory.
  • murtazayusuf 2 hours ago
    Just adding my benchmarking repo, that contains terraform code and scripts using which I performed the benchmarks, helpful for re-evaluating and verifying the numbers published on our website. And possibly to learn where we might have gone wrong.

    https://github.com/kividbio/kivi-benchmark

  • latencyharbor 20 minutes ago
    [flagged]
  • falconBrisk47 1 hour ago
    Pipelined throughput that high usually means the loadgen is the thing you're measuring. Past ~5M ops/sec we needed 3 separate memtier hosts to keep the client off the critical path. Any p99 numbers alongside it?
  • hahahoo 59 minutes ago
    [flagged]
  • saurilabs 48 minutes ago
    Has there been heavy usage of AI in building this?
    • murtazayusuf 27 minutes ago
      Yes, for building test cases, for code refactoring, and commenting, because it writes cleaner code, but yeah design decisions were mine. The benchmarks I ran were what dragonfly advertises, so scripts for those were written with AI. For redis compatibility, we run redis’ own unit test and e2e test suite with every change to make sure I am not breaking anything each change and you can review it in the repo.
    • green-salt 28 minutes ago
      there's a .claude/ in the gitignore