Thoughts on benchmarking streaming systems

from blog Scattered Thoughts, | ↗ original
I spent some time thinking about how to benchmark streaming systems. Though I didn't go through with the project, the notes might still be useful for others. What is the point of benchmarking? Decision making, capacity planning. I have X queries with Y data and Z slo - what software do I use and what hardware do I buy? Focus engineering effort on bottlenecks. Inform the design of future systems by understanding design...