job1: (g=0): rw=read, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=io_uring, iodepth=64
job2: (g=0): rw=read, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=io_uring, iodepth=64
job3: (g=0): rw=read, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=io_uring, iodepth=64
job4: (g=0): rw=read, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=io_uring, iodepth=64
fio-3.39-30-g58818
Starting 4 processes

job1: (groupid=0, jobs=1): err= 0: pid=3050112: Tue Jun  3 13:03:20 2025
  read: IOPS=54.8k, BW=3427MiB/s (3594MB/s)(66.9GiB/20002msec)
    slat (usec): min=4, max=134, avg= 5.29, stdev= 1.07
    clat (usec): min=574, max=6579, avg=1161.40, stdev=82.85
     lat (usec): min=580, max=6617, avg=1166.69, stdev=82.91
    clat percentiles (usec):
     |  1.00th=[ 1074],  5.00th=[ 1090], 10.00th=[ 1106], 20.00th=[ 1123],
     | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[ 1139], 60.00th=[ 1156],
     | 70.00th=[ 1156], 80.00th=[ 1172], 90.00th=[ 1221], 95.00th=[ 1336],
     | 99.00th=[ 1483], 99.50th=[ 1516], 99.90th=[ 1582], 99.95th=[ 1614],
     | 99.99th=[ 1811]
   bw (  MiB/s): min= 3388, max= 3458, per=43.26%, avg=3427.79, stdev=11.06, samples=40
   iops        : min=54210, max=55336, avg=54844.65, stdev=176.96, samples=40
  lat (usec)   : 750=0.01%, 1000=0.01%
  lat (msec)   : 2=99.98%, 4=0.01%, 10=0.01%
  cpu          : usr=2.38%, sys=29.78%, ctx=743132, majf=0, minf=1031
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1096893,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64
job2: (groupid=0, jobs=1): err= 0: pid=3050113: Tue Jun  3 13:03:20 2025
  read: IOPS=34.8k, BW=2175MiB/s (2281MB/s)(42.5GiB/20002msec)
    slat (nsec): min=3830, max=92830, avg=4903.32, stdev=1052.45
    clat (usec): min=394, max=3887, avg=1833.58, stdev=104.72
     lat (usec): min=415, max=3891, avg=1838.48, stdev=104.65
    clat percentiles (usec):
     |  1.00th=[ 1450],  5.00th=[ 1762], 10.00th=[ 1762], 20.00th=[ 1795],
     | 30.00th=[ 1811], 40.00th=[ 1811], 50.00th=[ 1827], 60.00th=[ 1844],
     | 70.00th=[ 1860], 80.00th=[ 1876], 90.00th=[ 1909], 95.00th=[ 1942],
     | 99.00th=[ 2212], 99.50th=[ 2409], 99.90th=[ 2573], 99.95th=[ 2638],
     | 99.99th=[ 2966]
   bw (  MiB/s): min= 2073, max= 2191, per=27.45%, avg=2175.48, stdev=19.58, samples=40
   iops        : min=33178, max=35066, avg=34807.65, stdev=313.26, samples=40
  lat (usec)   : 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=97.32%, 4=2.67%
  cpu          : usr=1.73%, sys=18.39%, ctx=581555, majf=0, minf=1033
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=696153,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64
job3: (groupid=0, jobs=1): err= 0: pid=3050114: Tue Jun  3 13:03:20 2025
  read: IOPS=23.0k, BW=1438MiB/s (1508MB/s)(28.1GiB/20012msec)
    slat (nsec): min=4070, max=60660, avg=5073.25, stdev=1179.67
    clat (usec): min=682, max=19876, avg=2775.55, stdev=2027.15
     lat (usec): min=693, max=19880, avg=2780.63, stdev=2027.15
    clat percentiles (usec):
     |  1.00th=[ 1434],  5.00th=[ 1483], 10.00th=[ 1565], 20.00th=[ 1844],
     | 30.00th=[ 1893], 40.00th=[ 1958], 50.00th=[ 2057], 60.00th=[ 2180],
     | 70.00th=[ 2376], 80.00th=[ 2638], 90.00th=[ 5997], 95.00th=[ 8225],
     | 99.00th=[10683], 99.50th=[11469], 99.90th=[12125], 99.95th=[12387],
     | 99.99th=[14746]
   bw (  MiB/s): min=  388, max= 2159, per=18.16%, avg=1438.92, stdev=696.13, samples=40
   iops        : min= 6220, max=34558, avg=23022.70, stdev=11138.03, samples=40
  lat (usec)   : 750=0.01%, 1000=0.05%
  lat (msec)   : 2=45.01%, 4=42.32%, 10=11.12%, 20=1.50%
  cpu          : usr=1.27%, sys=13.01%, ctx=367249, majf=0, minf=1032
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=460517,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64
job4: (groupid=0, jobs=1): err= 0: pid=3050115: Tue Jun  3 13:03:20 2025
  read: IOPS=14.2k, BW=886MiB/s (929MB/s)(17.3GiB/20005msec)
    slat (nsec): min=4160, max=85800, avg=5052.13, stdev=916.58
    clat (usec): min=768, max=11482, avg=4508.39, stdev=688.70
     lat (usec): min=785, max=11486, avg=4513.44, stdev=688.61
    clat percentiles (usec):
     |  1.00th=[ 1516],  5.00th=[ 4424], 10.00th=[ 4490], 20.00th=[ 4490],
     | 30.00th=[ 4490], 40.00th=[ 4490], 50.00th=[ 4490], 60.00th=[ 4490],
     | 70.00th=[ 4555], 80.00th=[ 4555], 90.00th=[ 4621], 95.00th=[ 4752],
     | 99.00th=[ 7504], 99.50th=[ 7898], 99.90th=[ 8586], 99.95th=[ 9110],
     | 99.99th=[10290]
   bw (  KiB/s): min=902144, max=910208, per=11.19%, avg=907609.60, stdev=1440.65, samples=40
   iops        : min=14096, max=14222, avg=14181.40, stdev=22.51, samples=40
  lat (usec)   : 1000=0.28%
  lat (msec)   : 2=1.39%, 4=2.61%, 10=95.69%, 20=0.01%
  cpu          : usr=0.82%, sys=8.65%, ctx=283863, majf=0, minf=1031
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=283628,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=7924MiB/s (8309MB/s), 886MiB/s-3427MiB/s (929MB/s-3594MB/s), io=155GiB (166GB), run=20002-20012msec

Disk stats (read/write):
  nvme0n1: ios=1090792/0, sectors=139621376/0, merge=0/0, ticks=1263815/0, in_queue=1263815, util=99.49%
  nvme1n1: ios=692397/0, sectors=88626816/0, merge=0/0, ticks=1267432/0, in_queue=1267432, util=99.51%
  nvme2n1: ios=459754/0, sectors=58848512/0, merge=0/0, ticks=1268928/0, in_queue=1268928, util=99.52%
  nvme3n1: ios=282009/0, sectors=36097152/0, merge=0/0, ticks=1270666/0, in_queue=1270666, util=99.53%
