Comparison: Historical Core Benchmarks

Show jobs details
Job Source Filter Repetitions Go Worker Job Info
c04f8c2b-0420-40f9-b71a-33b73ba89f60 main
https://github.com/nats-io/nats-server.git
(85594c8ce6b253d8552efc602360929fc22fd583)		 Benchmark.* 5 x 3s go version go1.25.1 linux/amd64
(/usr/local/go1.25.1/bin/go)		 dev (?)
eu-amsterdam1.nats-demo.equinix.synadia.net
Linux_5.15.0-156-generic-x86_64		 Submitted by at 2025-10-25 00:00:19 +0000 UTC
7958377f-67f7-4a66-ae6e-eda52ee38b86 v2.12.1
https://github.com/nats-io/nats-server.git
(35a616234d8572840a062846c92f10bea0037be7)		 Benchmark.* 5 x 3s go version go1.25.1 linux/amd64
(/usr/local/go1.25.1/bin/go)		 dev (?)
eu-amsterdam1.nats-demo.equinix.synadia.net
Linux_5.15.0-156-generic-x86_64		 Submitted by at 2025-10-14 12:24:50 +0000 UTC

Publish throughput (msg/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*Pub.*Payload.*'

Show results table
main v2.12.1 Δ%
______Pub0b_Payload-16 12.6M ± 0.0M 12.7M ± 0.0M +0.6%
______Pub8b_Payload-16 12.5M ± 0.0M 12.4M ± 0.1M Inconclusive
_____Pub32b_Payload-16 11.6M ± 0.0M 11.4M ± 0.3M Inconclusive
____Pub128B_Payload-16 9.81M ± 0.12M 9.91M ± 0.23M +1.0%
____Pub256B_Payload-16 8.73M ± 0.03M 8.53M ± 0.28M -2.3%
______Pub1K_Payload-16 4.89M ± 0.18M 5.00M ± 0.08M Inconclusive
______Pub4K_Payload-16 1.36M ± 0.16M 1.32M ± 0.07M Inconclusive
______Pub8K_Payload-16 532k ± 48k 548k ± 131k Inconclusive
_____Pub32K_Payload-16 61.6k ± 12.2k 68.9k ± 31.6k Inconclusive
__AuthPub0b_Payload-16 6.98M ± 0.02M 7.00M ± 0.05M Inconclusive

Publish throughput (byte/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*Pub.*Payload.*'

Show results table
main v2.12.1 Δ%
______Pub0b_Payload-16 139MB/s ± 0MB/s 140MB/s ± 0MB/s +0.6%
______Pub8b_Payload-16 237MB/s ± 1MB/s 236MB/s ± 3MB/s Inconclusive
_____Pub32b_Payload-16 508MB/s ± 2MB/s 500MB/s ± 13MB/s Inconclusive
____Pub128B_Payload-16 1.38GB/s ± 0.02GB/s 1.40GB/s ± 0.03GB/s +1.0%
____Pub256B_Payload-16 2.35GB/s ± 0.01GB/s 2.30GB/s ± 0.07GB/s Inconclusive
______Pub1K_Payload-16 5.07GB/s ± 0.19GB/s 5.19GB/s ± 0.08GB/s Inconclusive
______Pub4K_Payload-16 5.57GB/s ± 0.66GB/s 5.41GB/s ± 0.27GB/s Inconclusive
______Pub8K_Payload-16 4.37GB/s ± 0.40GB/s 4.50GB/s ± 1.08GB/s Inconclusive
_____Pub32K_Payload-16 2.02GB/s ± 0.40GB/s 2.26GB/s ± 1.04GB/s Inconclusive
__AuthPub0b_Payload-16 76.8MB/s ± 0.3MB/s 77.0MB/s ± 0.5MB/s Inconclusive

FanOut throughput (msg/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*[^R]FanOut.*'

Show results table
main v2.12.1 Δ%
______FanOut_8x1x10-16 1.07M ± 0.02M 1.07M ± 0.01M Inconclusive
_____FanOut_8x1x100-16 139k ± 2k 141k ± 1k +1.1%
____FanOut_8x10x100-16 7.11k ± 1.89k 6.23k ± 0.51k -13.3%
___FanOut_8x10x1000-16 1.42k ± 0.02k 1.42k ± 0.01k Inconclusive
___FanOut_8x100x100-16 1.13k ± 0.03k 1.15k ± 0.03k Inconclusive
__FanOut_8x100x1000-16 135 ± 1 136 ± 1 +0.8%
__FanOut_8x10x10000-16 131 ± 1 131 ± 1 Inconclusive
___FanOut_8x500x100-16 222 ± 1 221 ± 2 Inconclusive
___FanOut_128x1x100-16 54.2k ± 5.3k 57.4k ± 6.8k Inconclusive
__FanOut_128x10x100-16 4.89k ± 0.36k 4.57k ± 0.20k -6.7%
_FanOut_128x10x1000-16 865 ± 5 859 ± 7 -0.7%
_FanOut_128x100x100-16 735 ± 29 769 ± 12 +4.5%
_FanOut_512x100x100-16 379 ± 25 391 ± 9 Inconclusive
__FanOut_512x100x1k-16 45.1 ± 0.4 45.2 ± 0.9 Inconclusive
____FanOut_1kx10x1k-16 684 ± 4 676 ± 7 -1.2%
__FanOut_1kx100x100-16 605 ± 1 602 ± 2 -0.6%

FanOut throughput (byte/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*[^R]FanOut.*'

Show results table
main v2.12.1 Δ%
______FanOut_8x1x10-16 267MB/s ± 4MB/s 267MB/s ± 1MB/s Inconclusive
_____FanOut_8x1x100-16 323MB/s ± 4MB/s 326MB/s ± 2MB/s +1.1%
____FanOut_8x10x100-16 164MB/s ± 43MB/s 143MB/s ± 12MB/s -12.5%
___FanOut_8x10x1000-16 342MB/s ± 5MB/s 342MB/s ± 3MB/s Inconclusive
___FanOut_8x100x100-16 260MB/s ± 8MB/s 263MB/s ± 8MB/s Inconclusive
__FanOut_8x100x1000-16 323MB/s ± 1MB/s 326MB/s ± 1MB/s +0.8%
__FanOut_8x10x10000-16 328MB/s ± 2MB/s 328MB/s ± 3MB/s Inconclusive
___FanOut_8x500x100-16 255MB/s ± 1MB/s 255MB/s ± 2MB/s Inconclusive
___FanOut_128x1x100-16 794MB/s ± 77MB/s 840MB/s ± 100MB/s Inconclusive
__FanOut_128x10x100-16 710MB/s ± 52MB/s 664MB/s ± 29MB/s -6.5%
_FanOut_128x10x1000-16 1.26GB/s ± 0.01GB/s 1.25GB/s ± 0.01GB/s -0.7%
_FanOut_128x100x100-16 1.07GB/s ± 0.04GB/s 1.11GB/s ± 0.02GB/s +4.6%
_FanOut_512x100x100-16 2.01GB/s ± 0.13GB/s 2.07GB/s ± 0.05GB/s Inconclusive
__FanOut_512x100x1k-16 2.39GB/s ± 0.02GB/s 2.40GB/s ± 0.05GB/s Inconclusive
____FanOut_1kx10x1k-16 7.13GB/s ± 0.05GB/s 7.05GB/s ± 0.07GB/s -1.2%
__FanOut_1kx100x100-16 6.31GB/s ± 0.01GB/s 6.27GB/s ± 0.02GB/s -0.6%

FanOut 2-nodes throughput (msg/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*RFanOut_8.*'

Show results table
main v2.12.1 Δ%
_____RFanOut_8x1x10-16 1.00M ± 0.01M 988k ± 20k Inconclusive
____RFanOut_8x1x100-16 132k ± 3k 133k ± 2k Inconclusive
___RFanOut_8x10x100-16 7.74k ± 1.89k 6.08k ± 0.58k -24.1%
__RFanOut_8x10x1000-16 1.38k ± 0.00k 1.38k ± 0.01k Inconclusive
__RFanOut_8x100x100-16 1.13k ± 0.01k 1.11k ± 0.04k -1.8%
_RFanOut_8x100x1000-16 132 ± 1 132 ± 1 Inconclusive
_RFanOut_8x10x10000-16 127 ± 2 127 ± 2 Inconclusive

FanOut 2-nodes throughput (byte/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*RFanOut_8.*'

Show results table
main v2.12.1 Δ%
_____RFanOut_8x1x10-16 249MB/s ± 4MB/s 246MB/s ± 5MB/s Inconclusive
____RFanOut_8x1x100-16 307MB/s ± 7MB/s 309MB/s ± 4MB/s Inconclusive
___RFanOut_8x10x100-16 178MB/s ± 44MB/s 140MB/s ± 13MB/s -21.5%
__RFanOut_8x10x1000-16 332MB/s ± 1MB/s 331MB/s ± 2MB/s Inconclusive
__RFanOut_8x100x100-16 260MB/s ± 2MB/s 255MB/s ± 8MB/s -1.8%
_RFanOut_8x100x1000-16 316MB/s ± 2MB/s 317MB/s ± 2MB/s Inconclusive
_RFanOut_8x10x10000-16 317MB/s ± 4MB/s 318MB/s ± 4MB/s Inconclusive

FanIn throughput (msg/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*FanIn.*'

Show results table
main v2.12.1 Δ%
_____FanIn_1kx100x1-16 1.94M ± 0.01M 1.94M ± 0.01M Inconclusive
_____FanIn_4kx100x1-16 722k ± 7k 723k ± 9k Inconclusive
_____FanIn_8kx100x1-16 458k ± 4k 459k ± 3k Inconclusive
____FanIn_16kx100x1-16 231k ± 1k 228k ± 2k -1.3%
____FanIn_64kx100x1-16 46.1k ± 0.6k 46.8k ± 0.0k +1.5%

FanIn throughput (byte/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*FanIn.*'

Show results table
main v2.12.1 Δ%
_____FanIn_1kx100x1-16 4.02GB/s ± 0.01GB/s 4.02GB/s ± 0.02GB/s Inconclusive
_____FanIn_4kx100x1-16 5.93GB/s ± 0.05GB/s 5.95GB/s ± 0.07GB/s Inconclusive
_____FanIn_8kx100x1-16 7.51GB/s ± 0.06GB/s 7.54GB/s ± 0.04GB/s Inconclusive
____FanIn_16kx100x1-16 7.59GB/s ± 0.04GB/s 7.49GB/s ± 0.05GB/s -1.3%
____FanIn_64kx100x1-16 6.05GB/s ± 0.08GB/s 6.14GB/s ± 0.00GB/s +1.5%

Gateway throughput (msg/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*GWs.*'

Show results table
main v2.12.1 Δ%
____GWs_Opt_1kx01x0-16 2.86M ± 0.04M 2.98M ± 0.01M +4.2%
____GWs_Opt_2kx01x0-16 2.19M ± 0.03M 2.24M ± 0.01M +2.1%
____GWs_Opt_4kx01x0-16 1.11M ± 0.03M 1.16M ± 0.04M +4.2%
____GWs_Opt_1kx10x0-16 8.20M ± 0.23M 8.04M ± 0.33M Inconclusive
____GWs_Opt_2kx10x0-16 5.85M ± 0.13M 5.87M ± 0.10M Inconclusive
____GWs_Opt_4kx10x0-16 2.86M ± 0.04M 2.85M ± 0.01M Inconclusive
____GWs_Opt_1kx01x1-16 1.39M ± 0.01M 1.40M ± 0.02M +1.2%
____GWs_Opt_2kx01x1-16 1.03M ± 0.01M 1.03M ± 0.03M Inconclusive
____GWs_Opt_4kx01x1-16 598k ± 5k 600k ± 4k Inconclusive
____GWs_Opt_1kx10x1-16 1.48M ± 0.02M 1.48M ± 0.03M Inconclusive
____GWs_Opt_2kx10x1-16 993k ± 5k 989k ± 9k -0.5%
____GWs_Opt_4kx10x1-16 574k ± 6k 571k ± 8k Inconclusive
____GWs_Int_1kx01x0-16 2.77M ± 0.06M 2.84M ± 0.07M +2.5%
____GWs_Int_2kx01x0-16 2.17M ± 0.04M 2.18M ± 0.03M Inconclusive
____GWs_Int_4kx01x0-16 1.09M ± 0.03M 1.13M ± 0.06M +3.9%
____GWs_Int_1kx10x0-16 8.00M ± 0.23M 8.14M ± 0.29M Inconclusive
____GWs_Int_2kx10x0-16 5.86M ± 0.07M 5.83M ± 0.16M Inconclusive
____GWs_Int_4kx10x0-16 2.86M ± 0.04M 2.89M ± 0.03M +1.3%
____GWs_Int_1kx01x1-16 1.37M ± 0.01M 1.40M ± 0.02M +2.1%
____GWs_Int_2kx01x1-16 1.02M ± 0.01M 1.03M ± 0.01M +0.8%
____GWs_Int_4kx01x1-16 596k ± 8k 599k ± 8k Inconclusive
____GWs_Int_1kx10x1-16 1.48M ± 0.00M 1.48M ± 0.01M Inconclusive
____GWs_Int_2kx10x1-16 1.00M ± 0.01M 1.00M ± 0.01M Inconclusive
____GWs_Int_4kx10x1-16 575k ± 5k 577k ± 4k Inconclusive
__GWs_Reqs_1_SubAll-16 1.81M ± 0.01M 1.87M ± 0.01M +3.5%
__GWs_Reqs_1SubEach-16 164k ± 1k 166k ± 3k Inconclusive

Gateway throughput (byte/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*GWs.*'

Show results table
main v2.12.1 Δ%
____GWs_Opt_1kx01x0-16 2.97GB/s ± 0.04GB/s 3.10GB/s ± 0.02GB/s +4.3%
____GWs_Opt_2kx01x0-16 4.52GB/s ± 0.07GB/s 4.62GB/s ± 0.02GB/s +2.1%
____GWs_Opt_4kx01x0-16 4.56GB/s ± 0.12GB/s 4.75GB/s ± 0.18GB/s +4.3%
____GWs_Opt_1kx10x0-16 8.52GB/s ± 0.23GB/s 8.36GB/s ± 0.35GB/s Inconclusive
____GWs_Opt_2kx10x0-16 12.1GB/s ± 0.3GB/s 12.1GB/s ± 0.2GB/s Inconclusive
____GWs_Opt_4kx10x0-16 11.8GB/s ± 0.2GB/s 11.7GB/s ± 0.0GB/s Inconclusive
____GWs_Opt_1kx01x1-16 4.34GB/s ± 0.03GB/s 4.39GB/s ± 0.06GB/s +1.2%
____GWs_Opt_2kx01x1-16 6.37GB/s ± 0.04GB/s 6.41GB/s ± 0.17GB/s Inconclusive
____GWs_Opt_4kx01x1-16 7.38GB/s ± 0.06GB/s 7.41GB/s ± 0.04GB/s Inconclusive
____GWs_Opt_1kx10x1-16 4.63GB/s ± 0.05GB/s 4.64GB/s ± 0.08GB/s Inconclusive
____GWs_Opt_2kx10x1-16 6.15GB/s ± 0.03GB/s 6.13GB/s ± 0.06GB/s Inconclusive
____GWs_Opt_4kx10x1-16 7.08GB/s ± 0.08GB/s 7.05GB/s ± 0.10GB/s Inconclusive
____GWs_Int_1kx01x0-16 2.88GB/s ± 0.06GB/s 2.95GB/s ± 0.07GB/s +2.5%
____GWs_Int_2kx01x0-16 4.47GB/s ± 0.08GB/s 4.51GB/s ± 0.07GB/s Inconclusive
____GWs_Int_4kx01x0-16 4.49GB/s ± 0.13GB/s 4.66GB/s ± 0.23GB/s +4.0%
____GWs_Int_1kx10x0-16 8.32GB/s ± 0.24GB/s 8.46GB/s ± 0.30GB/s Inconclusive
____GWs_Int_2kx10x0-16 12.1GB/s ± 0.1GB/s 12.0GB/s ± 0.3GB/s Inconclusive
____GWs_Int_4kx10x0-16 11.7GB/s ± 0.2GB/s 11.9GB/s ± 0.1GB/s +1.3%
____GWs_Int_1kx01x1-16 4.29GB/s ± 0.05GB/s 4.38GB/s ± 0.07GB/s +2.1%
____GWs_Int_2kx01x1-16 6.31GB/s ± 0.05GB/s 6.37GB/s ± 0.06GB/s +0.8%
____GWs_Int_4kx01x1-16 7.35GB/s ± 0.10GB/s 7.40GB/s ± 0.10GB/s Inconclusive
____GWs_Int_1kx10x1-16 4.62GB/s ± 0.01GB/s 4.61GB/s ± 0.02GB/s Inconclusive
____GWs_Int_2kx10x1-16 6.20GB/s ± 0.04GB/s 6.20GB/s ± 0.05GB/s Inconclusive
____GWs_Int_4kx10x1-16 7.10GB/s ± 0.07GB/s 7.12GB/s ± 0.05GB/s Inconclusive
__GWs_Reqs_1_SubAll-16 184MB/s ± 1MB/s 191MB/s ± 1MB/s +3.6%
__GWs_Reqs_1SubEach-16 29.0MB/s ± 0.2MB/s 29.3MB/s ± 0.6MB/s Inconclusive

Queue throughput (msg/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*Queue.*'

Show results table
main v2.12.1 Δ%
_____PubTwoQueueSub-16 2.51M ± 0.21M 2.67M ± 0.25M Inconclusive
____PubFourQueueSub-16 2.61M ± 0.33M 2.52M ± 0.17M Inconclusive
___PubEightQueueSub-16 2.56M ± 0.21M 2.35M ± 0.14M -8.6%
____Routed2QueueSub-16 2.21M ± 0.08M 2.15M ± 0.08M -2.8%
____Routed4QueueSub-16 2.19M ± 0.06M 2.17M ± 0.09M Inconclusive
____Routed8QueueSub-16 2.18M ± 0.02M 2.15M ± 0.06M Inconclusive
___Routed16QueueSub-16 2.13M ± 0.03M 2.08M ± 0.03M -2.7%

Pub+Sub throughput (msg/s)

Error bars represent 90% confidence interval, benchmarks filter: '.*Pub.*Sub[^(5|_100K)].*'

Show results table
main v2.12.1 Δ%
_____________PubSub-16 2.87M ± 0.31M 2.69M ± 0.07M Inconclusive
_____PubSubTwoConns-16 2.72M ± 0.18M 2.94M ± 0.20M +7.8%
_____PubTwoQueueSub-16 2.51M ± 0.21M 2.67M ± 0.25M Inconclusive
____PubFourQueueSub-16 2.61M ± 0.33M 2.52M ± 0.17M Inconclusive
___PubEightQueueSub-16 2.56M ± 0.21M 2.35M ± 0.14M -8.6%
__DenyMsgNoWCPubSub-16 2.62M ± 0.08M 2.51M ± 0.38M Inconclusive
_DenyMsgYesWCPubSub-16 2.71M ± 0.30M 2.75M ± 0.21M Inconclusive