K6 produces a detailed point by point log every second which has been very useful for us to compare against some of our apps in Azure Application Insights. But the problem here is say I use the open model with ramping executors in a k6 test and run the test for 10m producing a load of 5000 rps, the detailed log bloats upto 20+GB.
I believe K6 hasn’t intended this log to provide this measure for large tests - but as I said earlier this has been incredibly useful for us. Is there a way to
- stream these logs than generate it for such a size?
- A way to compress the size of these logs? I believe every line is a multiline JSON with VU details and http-req details - Is there any solution to how we can get a compressed log here? Say you could aggregate this data every minute? Or provide more granular timeframes to aggregate the point by point http-req data?
Again the detailed log has been super useful to detect many specific aspects of our applications like time taken to add more servers vs ramp up VU time etc.