Kafka Cluster 2019(5)WRK Performance Testing

Kafka Cluster 2019(5)WRK Performance Testing

A very simple script to support the POST using LUA
> cat post_message.lua
method="POST"
path = "/kafka/topic1"
batch = 10
request  = function()
   headers = {}
   headers["Content-Type"] = "application/json"
   body = 'message sillycat from mvc'
   -- print(body)
   return wrk.format(method, path, headers, body)
end
response = function(status, headers, body)
   -- print(status)
end

Check the normal servlet driver
> wrk -t4 -c1000 -d60s --timeout 10s -s ./post_message.lua http://ubuntu-master:8082 --latency
Running 1m test @ http://ubuntu-master:8082
  4 threads and 1000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   617.66ms  275.77ms   2.87s    75.73%
    Req/Sec   408.14    107.39   737.00     69.41%
  Latency Distribution
     50%  582.81ms
     75%  774.61ms
     90%  946.28ms
     99%    1.33s
  97320 requests in 1.00m, 11.70MB read
Requests/sec:   1619.96
Transfer/sec:    199.43KB

It is strange that the Reactive Driver does not have better performance in here
> wrk -t4 -c1000 -d60s --timeout 10s -s ./post_message.lua http://ubuntu-master:8083 --latency
Running 1m test @ http://ubuntu-master:8083
  4 threads and 1000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.55s   792.12ms   9.90s    93.56%
    Req/Sec   268.95    269.73     1.49k    84.05%
  Latency Distribution
     50%    1.43s
     75%    1.65s
     90%    2.03s
     99%    5.48s
  37386 requests in 1.00m, 3.07MB read
  Socket errors: connect 0, read 0, write 0, timeout 109
Requests/sec:    622.27
Transfer/sec:     52.26KB


References: