Brick: 10.32.9.9:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 11 197 9 No. of Writes: 2 5298 50158 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 22 152814 155742 No. of Writes: 10281 141128 229969 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 19592 2856 34807 No. of Writes: 46540 15874 16618 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 41083 7619 43 No. of Writes: 12325 19939 1278 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 1163 RELEASE 0.00 0.00 us 0.00 us 0.00 us 8997 RELEASEDIR 0.01 42.50 us 1.07 us 200.99 us 2015 OPENDIR 0.03 1205.44 us 147.78 us 3219.56 us 160 READDIRP 0.03 38.21 us 19.08 us 7544.91 us 5346 STATFS 0.03 947.57 us 42.15 us 5689.21 us 221 OPEN 0.03 536.56 us 11.61 us 5405.25 us 416 GETXATTR 0.06 42.40 us 15.94 us 3408.97 us 9626 FSTAT 0.06 992.07 us 13.79 us 3583.18 us 440 READDIR 2.07 784.10 us 10.19 us 100292.79 us 17781 LOOKUP 2.58 128.10 us 48.36 us 73127.27 us 135547 FXATTROP 2.75 282.45 us 36.68 us 403763.55 us 65559 FSYNC 5.30 72558.78 us 13.93 us 1840271.15 us 491 INODELK 7.97 450.94 us 75.16 us 368078.53 us 118790 WRITE 24.45 1212.26 us 11.70 us 1850709.72 us 135580 FINODELK 54.60 3082.33 us 72.64 us 387813.52 us 119063 READ Duration: 10748 seconds Data Read: 13585666193 bytes Data Written: 16779903830 bytes Interval 6 Stats: Block Size: 512b+ 1024b+ 4096b+ No. of Reads: 0 0 1151 No. of Writes: 13 2 405 Block Size: 8192b+ 16384b+ 32768b+ No. of Reads: 580 10 0 No. of Writes: 357 115 16 Block Size: 65536b+ 131072b+ 262144b+ No. of Reads: 314 96 0 No. of Writes: 25 19 62 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 9 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.00 42.88 us 11.61 us 65.94 us 6 GETXATTR 0.01 95.97 us 52.28 us 174.48 us 9 OPEN 0.01 43.61 us 1.83 us 68.31 us 25 OPENDIR 0.01 30.47 us 22.02 us 42.78 us 53 STATFS 0.01 291.00 us 148.50 us 772.43 us 6 READDIR 0.01 2255.97 us 2255.97 us 2255.97 us 1 READDIRP 0.03 42.10 us 18.38 us 114.84 us 98 FSTAT 0.10 30.02 us 14.10 us 662.25 us 520 FINODELK 0.18 165.79 us 20.56 us 2137.59 us 173 LOOKUP 0.21 137.80 us 53.21 us 366.07 us 243 FSYNC 0.43 133.43 us 81.66 us 384.37 us 520 FXATTROP 4.53 713.51 us 75.16 us 101590.43 us 1014 WRITE 28.81 102208.45 us 16.11 us 931987.84 us 45 INODELK 65.66 4873.26 us 79.54 us 293295.82 us 2151 READ Duration: 26 seconds Data Read: 42790912 bytes Data Written: 40480256 bytes Brick: 10.32.9.6:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 140764 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 8678 RELEASE 0.00 0.00 us 0.00 us 0.00 us 10636 RELEASEDIR 0.00 21.03 us 16.15 us 34.88 us 8 ENTRYLK 0.00 270.94 us 270.94 us 270.94 us 1 MKNOD 0.01 323.61 us 13.73 us 2466.13 us 80 READDIR 0.02 326.98 us 11.55 us 9174.66 us 83 GETXATTR 0.09 65.78 us 16.75 us 4946.30 us 2332 FLUSH 0.09 85.68 us 1.51 us 4642.85 us 1834 OPENDIR 0.32 227.62 us 41.15 us 64374.98 us 2476 OPEN 0.45 2256.77 us 15.05 us 63381.45 us 347 INODELK 0.97 56.53 us 10.33 us 5526.47 us 29676 FINODELK 1.78 74.73 us 15.84 us 5393.43 us 41433 WRITE 3.57 320.06 us 15.52 us 115626.36 us 19340 LOOKUP 3.89 227.62 us 77.62 us 68580.08 us 29634 FXATTROP 88.81 9879.97 us 149.50 us 367307.05 us 15606 FSYNC Duration: 12346 seconds Data Read: 0 bytes Data Written: 140764 bytes Interval 6 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 174 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 25 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.04 73.34 us 20.62 us 134.34 us 5 GETXATTR 0.24 82.36 us 46.64 us 190.61 us 25 OPEN 0.31 437.89 us 272.99 us 1086.34 us 6 READDIR 0.43 184.47 us 19.85 us 2374.95 us 20 FLUSH 0.47 235.68 us 19.14 us 1331.71 us 17 INODELK 0.58 197.88 us 2.13 us 1981.61 us 25 OPENDIR 1.50 115.21 us 18.93 us 1851.08 us 112 FINODELK 2.46 194.41 us 96.77 us 1656.53 us 109 FXATTROP 5.75 284.33 us 23.78 us 1087.73 us 174 WRITE 6.46 295.65 us 21.14 us 19073.84 us 188 LOOKUP 81.76 12553.12 us 218.24 us 73123.96 us 56 FSYNC Duration: 26 seconds Data Read: 0 bytes Data Written: 174 bytes Brick: 10.32.9.4:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 9195 6 0 No. of Writes: 3 700 2043 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 0 32431 16795 No. of Writes: 623 67451 42803 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 1749 317 6006 No. of Writes: 12604 1347 5850 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 565 3076 3 No. of Writes: 2324 2469 893 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 8579 RELEASE 0.00 0.00 us 0.00 us 0.00 us 8397 RELEASEDIR 0.00 22.96 us 15.97 us 51.06 us 8 ENTRYLK 0.00 260.50 us 260.50 us 260.50 us 1 MKNOD 0.00 93.03 us 16.42 us 2701.10 us 347 INODELK 0.00 128.90 us 7.61 us 1129.71 us 284 GETXATTR 0.01 300.85 us 12.41 us 3140.45 us 290 READDIR 0.01 57.69 us 13.08 us 46431.20 us 2334 FLUSH 0.01 70.20 us 0.94 us 17715.27 us 1939 OPENDIR 0.02 89.64 us 11.70 us 19019.90 us 1691 STAT 0.03 132.06 us 42.23 us 33323.48 us 2478 OPEN 0.03 62.90 us 16.20 us 27740.94 us 5346 STATFS 0.03 202.21 us 119.54 us 17249.34 us 1709 READDIRP 0.36 120.14 us 11.12 us 301165.99 us 29660 FINODELK 1.20 614.44 us 13.29 us 263413.97 us 19453 LOOKUP 1.27 427.97 us 71.48 us 563688.45 us 29634 FXATTROP 9.41 3840.22 us 82.10 us 469183.97 us 24493 READ 27.25 17452.64 us 92.85 us 483169.32 us 15606 FSYNC 60.36 14557.60 us 149.97 us 759284.50 us 41437 WRITE Duration: 10499 seconds Data Read: 2314290390 bytes Data Written: 3195953450 bytes Interval 6 Stats: Block Size: 256b+ 512b+ 4096b+ No. of Reads: 23 0 571 No. of Writes: 0 3 13 Block Size: 8192b+ 16384b+ 32768b+ No. of Reads: 52 0 0 No. of Writes: 128 13 1 Block Size: 65536b+ 131072b+ 262144b+ No. of Reads: 46 0 0 No. of Writes: 7 7 2 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 25 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.01 68.94 us 10.11 us 221.91 us 6 GETXATTR 0.01 30.00 us 15.66 us 54.39 us 20 FLUSH 0.02 44.60 us 20.24 us 95.68 us 15 STAT 0.02 41.06 us 19.29 us 103.84 us 17 INODELK 0.02 162.01 us 110.86 us 228.45 us 6 READDIR 0.03 45.60 us 1.45 us 89.10 us 25 OPENDIR 0.04 75.73 us 44.53 us 190.60 us 25 OPEN 0.04 36.62 us 16.52 us 66.38 us 53 STATFS 0.09 185.21 us 136.70 us 275.71 us 21 READDIRP 0.11 44.70 us 19.04 us 91.96 us 111 FINODELK 0.37 148.06 us 86.69 us 324.91 us 109 FXATTROP 1.53 355.20 us 16.63 us 41956.49 us 188 LOOKUP 25.17 19663.37 us 213.60 us 89492.03 us 56 FSYNC 28.20 7089.90 us 177.90 us 39757.75 us 174 WRITE 44.33 2802.26 us 104.46 us 49721.81 us 692 READ Duration: 26 seconds Data Read: 5790220 bytes Data Written: 4044288 bytes Brick: 10.32.9.5:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 2 458 87 No. of Writes: 3 703 2052 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 54 15030 33939 No. of Writes: 623 68563 43056 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 3940 540 7475 No. of Writes: 12791 1436 5850 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 2395 6141 15 No. of Writes: 22702 2469 893 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 8678 RELEASE 0.00 0.00 us 0.00 us 0.00 us 10597 RELEASEDIR 0.00 158.97 us 158.97 us 158.97 us 1 MKNOD 0.00 393.70 us 9.69 us 2344.17 us 8 ENTRYLK 0.00 126.39 us 10.54 us 281.56 us 80 READDIR 0.00 1956.79 us 6.43 us 155911.98 us 82 GETXATTR 0.00 3315.24 us 139.26 us 170764.63 us 160 READDIRP 0.03 4020.12 us 15.61 us 469284.63 us 1164 FSTAT 0.04 2583.09 us 28.06 us 204742.02 us 2476 OPEN 0.04 2825.94 us 8.33 us 590785.10 us 2332 FLUSH 0.07 5673.25 us 0.80 us 527903.92 us 1832 OPENDIR 0.09 2595.01 us 11.48 us 382537.47 us 5342 STATFS 0.14 59496.60 us 8.34 us 1543417.83 us 347 INODELK 0.40 2031.08 us 6.84 us 1127299.99 us 29607 FINODELK 0.57 4484.44 us 11.60 us 968588.21 us 19334 LOOKUP 2.00 10241.03 us 53.88 us 1880631.52 us 29585 FXATTROP 2.57 29123.91 us 63.31 us 3473303.89 us 13399 READ 11.80 115055.07 us 122.19 us 2279735.88 us 15581 FSYNC 82.25 301692.99 us 98.78 us 4500846.60 us 41400 WRITE Duration: 12343 seconds Data Read: 4270911318 bytes Data Written: 5880060714 bytes Interval 6 Stats: Block Size: 512b+ 4096b+ 8192b+ No. of Reads: 0 29 109 No. of Writes: 3 13 128 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 15 0 47 No. of Writes: 13 1 7 Block Size: 131072b+ 262144b+ No. of Reads: 0 0 No. of Writes: 7 2 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 25 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.00 40.48 us 6.94 us 92.02 us 6 GETXATTR 0.00 28.47 us 10.19 us 50.39 us 20 FLUSH 0.00 53.78 us 31.59 us 76.06 us 12 FSTAT 0.00 129.00 us 88.83 us 161.83 us 6 READDIR 0.00 47.94 us 0.89 us 88.84 us 25 OPENDIR 0.00 1499.83 us 1499.83 us 1499.83 us 1 READDIRP 0.04 1333.68 us 30.78 us 31125.60 us 25 OPEN 0.05 836.76 us 12.08 us 23439.58 us 53 STATFS 0.11 872.63 us 8.21 us 56495.95 us 111 FINODELK 0.88 6920.74 us 68.16 us 625281.67 us 109 FXATTROP 1.02 4614.95 us 13.66 us 348629.63 us 188 LOOKUP 1.65 83057.19 us 12.45 us 658978.30 us 17 INODELK 6.49 27709.93 us 98.14 us 471332.27 us 200 READ 8.08 123206.43 us 267.50 us 979136.22 us 56 FSYNC 81.66 396159.13 us 232.40 us 1353202.04 us 176 WRITE Duration: 26 seconds Data Read: 4341760 bytes Data Written: 4044288 bytes Brick: 10.32.9.7:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 8 146 10 No. of Writes: 0 822 17574 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 12 147605 81020 No. of Writes: 3335 177490 110247 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 12618 1795 18321 No. of Writes: 30013 5366 10235 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 2188 4008 20 No. of Writes: 8375 8875 585 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 608 RELEASE 0.00 0.00 us 0.00 us 0.00 us 8795 RELEASEDIR 0.00 20.59 us 14.68 us 25.91 us 75 FLUSH 0.00 77.89 us 58.31 us 94.39 us 85 REMOVEXATTR 0.00 85.37 us 64.65 us 156.44 us 85 SETATTR 0.00 86.81 us 42.56 us 643.87 us 146 OPEN 0.00 127.62 us 6.67 us 943.71 us 165 GETXATTR 0.00 507.62 us 14.32 us 1787.62 us 201 READDIR 0.01 1235.24 us 26.42 us 3832.88 us 160 READDIRP 0.06 244.53 us 16.13 us 351764.07 us 5346 STATFS 0.10 1171.75 us 1.17 us 1068559.38 us 1895 OPENDIR 0.13 406.39 us 25.42 us 1365160.22 us 7375 FSTAT 0.53 20755.68 us 13.33 us 887933.44 us 564 INODELK 1.46 170.00 us 45.86 us 2503412.21 us 190741 FXATTROP 1.53 178.24 us 11.10 us 3938189.55 us 190604 FINODELK 1.82 425.12 us 32.12 us 663207.46 us 94843 FSYNC 11.43 2187.65 us 72.21 us 4245933.36 us 116005 WRITE 16.73 21132.03 us 14.12 us 4031333.55 us 17576 LOOKUP 66.20 15737.71 us 69.72 us 6429153.50 us 93418 READ Duration: 11011 seconds Data Read: 4863622768 bytes Data Written: 8447544320 bytes Interval 6 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 3 109 5 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 6829 259 5 No. of Writes: 228 230 13 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 175 0 No. of Writes: 4 2 12 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 12 2 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 7 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.00 74.17 us 74.17 us 74.17 us 1 REMOVEXATTR 0.00 89.45 us 89.45 us 89.45 us 1 SETATTR 0.00 33.25 us 16.33 us 64.78 us 4 GETXATTR 0.00 70.61 us 52.42 us 153.99 us 7 OPEN 0.00 37.55 us 1.95 us 64.59 us 25 OPENDIR 0.00 30.14 us 18.44 us 44.04 us 53 STATFS 0.00 275.53 us 155.69 us 765.06 us 6 READDIR 0.00 2352.74 us 2352.74 us 2352.74 us 1 READDIRP 0.01 43.65 us 29.55 us 73.65 us 76 FSTAT 0.05 149.19 us 25.96 us 227.32 us 171 LOOKUP 0.06 25.33 us 11.55 us 59.71 us 1236 FINODELK 0.15 130.28 us 50.48 us 244.99 us 609 FSYNC 0.26 113.48 us 78.80 us 565.69 us 1237 FXATTROP 0.27 237.31 us 80.85 us 2140.21 us 620 WRITE 10.35 142923.57 us 15.02 us 887933.44 us 39 INODELK 88.84 6582.39 us 75.54 us 3820683.07 us 7268 READ Duration: 26 seconds Data Read: 41644032 bytes Data Written: 11333120 bytes Brick: 10.32.9.21:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 583084 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 1 FORGET 0.00 0.00 us 0.00 us 0.00 us 1506 RELEASE 0.00 0.00 us 0.00 us 0.00 us 11330 RELEASEDIR 0.16 41.96 us 1.09 us 174.18 us 2000 OPENDIR 0.53 882.55 us 15.33 us 7388.53 us 313 INODELK 0.61 785.26 us 15.23 us 2483.07 us 410 READDIR 0.78 2944.84 us 50.45 us 13138.61 us 139 OPEN 1.04 1439.59 us 8.75 us 13801.35 us 379 GETXATTR 4.69 28.29 us 10.98 us 51214.69 us 87008 FINODELK 9.29 34.56 us 14.65 us 81798.39 us 141069 WRITE 19.62 601.79 us 13.34 us 82349.56 us 17113 LOOKUP 21.24 128.13 us 74.02 us 5590.59 us 87026 FXATTROP 42.05 509.22 us 38.18 us 285202.84 us 43355 FSYNC Duration: 12343 seconds Data Read: 0 bytes Data Written: 583084 bytes Interval 6 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 820 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 14 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.26 54.89 us 17.77 us 76.95 us 9 GETXATTR 0.54 73.00 us 50.45 us 123.40 us 14 OPEN 0.55 41.66 us 1.43 us 58.76 us 25 OPENDIR 0.88 278.14 us 157.59 us 394.86 us 6 READDIR 0.97 40.13 us 17.39 us 342.49 us 46 INODELK 9.81 34.88 us 16.20 us 3058.74 us 534 FINODELK 14.96 34.64 us 16.51 us 177.38 us 820 WRITE 17.10 168.21 us 24.51 us 323.55 us 193 LOOKUP 17.52 127.46 us 46.97 us 299.68 us 261 FSYNC 37.41 133.00 us 80.38 us 341.49 us 534 FXATTROP Duration: 26 seconds Data Read: 0 bytes Data Written: 820 bytes Brick: 10.32.9.21:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 11 66 2 No. of Writes: 2 5586 50158 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 4 52513 93336 No. of Writes: 10281 142655 230190 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 7241 1565 19639 No. of Writes: 46705 15906 16639 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 1874 4071 24 No. of Writes: 12317 19939 1278 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 1255 RELEASE 0.00 0.00 us 0.00 us 0.00 us 11357 RELEASEDIR 0.03 45.76 us 13.86 us 9356.79 us 1679 STAT 0.03 46.01 us 1.04 us 772.13 us 2000 OPENDIR 0.04 326.97 us 10.29 us 2391.56 us 353 GETXATTR 0.05 51.07 us 29.86 us 540.78 us 2522 FSTAT 0.05 313.16 us 16.18 us 5815.42 us 491 INODELK 0.07 883.53 us 45.88 us 6148.85 us 221 OPEN 0.08 41.10 us 18.98 us 9889.16 us 5346 STATFS 0.12 856.40 us 15.78 us 4414.06 us 410 READDIR 0.14 225.48 us 143.72 us 926.43 us 1710 READDIRP 1.41 29.62 us 10.80 us 110711.59 us 135572 FINODELK 3.66 587.34 us 15.19 us 61302.68 us 17766 LOOKUP 5.95 125.02 us 49.28 us 17686.93 us 135539 FXATTROP 6.44 279.71 us 35.58 us 407061.84 us 65554 FSYNC 19.89 476.93 us 75.41 us 440395.70 us 118787 WRITE 62.04 4088.32 us 78.00 us 503162.29 us 43217 READ Duration: 12343 seconds Data Read: 4610277422 bytes Data Written: 16792466262 bytes Interval 6 Stats: Block Size: 512b+ 1024b+ 4096b+ No. of Reads: 0 0 70 No. of Writes: 13 2 405 Block Size: 8192b+ 16384b+ 32768b+ No. of Reads: 342 5 0 No. of Writes: 357 115 16 Block Size: 65536b+ 131072b+ 262144b+ No. of Reads: 168 0 0 No. of Writes: 25 19 62 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 9 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.01 35.71 us 24.38 us 65.77 us 15 STAT 0.02 44.49 us 1.68 us 67.87 us 25 OPENDIR 0.02 126.43 us 52.25 us 398.25 us 9 OPEN 0.02 51.99 us 32.93 us 109.37 us 26 FSTAT 0.03 256.51 us 145.04 us 360.84 us 6 READDIR 0.03 33.20 us 20.54 us 47.63 us 53 STATFS 0.03 185.61 us 12.72 us 1214.94 us 10 GETXATTR 0.07 94.06 us 17.46 us 2439.30 us 45 INODELK 0.08 213.94 us 177.04 us 383.69 us 21 READDIRP 0.26 29.48 us 15.33 us 71.02 us 521 FINODELK 0.48 159.48 us 21.99 us 327.94 us 173 LOOKUP 1.22 136.16 us 84.01 us 461.36 us 521 FXATTROP 4.60 1098.76 us 46.07 us 205950.17 us 243 FSYNC 8.03 459.44 us 85.85 us 21485.20 us 1014 WRITE 85.10 8442.50 us 119.17 us 309111.15 us 585 READ Duration: 26 seconds Data Read: 14180352 bytes Data Written: 40480256 bytes Brick: 10.32.9.20:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 4 109 21 No. of Writes: 0 460 54715 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 42 45163 54896 No. of Writes: 8883 212986 162092 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 7020 1175 20888 No. of Writes: 48288 16340 24443 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 1408 2923 9 No. of Writes: 19159 26333 792 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 514 RELEASE 0.00 0.00 us 0.00 us 0.00 us 6838 RELEASEDIR 0.00 59.50 us 14.59 us 546.30 us 41 GETXATTR 0.00 220.10 us 16.62 us 988.45 us 50 READDIR 0.00 104.05 us 39.98 us 497.56 us 139 OPEN 0.00 48.49 us 15.80 us 3469.09 us 315 INODELK 0.01 50.94 us 1.65 us 1573.96 us 1820 OPENDIR 0.03 215.71 us 153.61 us 2562.55 us 1710 READDIRP 0.03 69.86 us 18.77 us 125905.96 us 5346 STATFS 0.07 141.42 us 16.04 us 655589.61 us 6984 FSTAT 0.08 659.41 us 12.89 us 523421.21 us 1679 STAT 1.24 1008.30 us 19.19 us 1534952.31 us 16933 LOOKUP 1.30 204.65 us 11.71 us 1749236.34 us 87007 FINODELK 1.48 233.96 us 73.33 us 1784231.76 us 87026 FXATTROP 12.57 3983.58 us 39.91 us 2743546.94 us 43355 FSYNC 41.38 12734.21 us 79.14 us 2966713.52 us 44635 READ 41.80 4069.99 us 77.68 us 2638579.30 us 141069 WRITE Duration: 9900 seconds Data Read: 3717300328 bytes Data Written: 21265203712 bytes Interval 6 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 3 39 2 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 381 294 20 No. of Writes: 83 467 47 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 264 0 No. of Writes: 32 35 41 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 65 6 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 14 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.00 55.58 us 15.93 us 93.98 us 8 GETXATTR 0.00 37.21 us 25.04 us 59.45 us 15 STAT 0.01 69.47 us 46.35 us 141.23 us 14 OPEN 0.01 26.67 us 18.22 us 49.45 us 46 INODELK 0.01 49.56 us 2.58 us 143.98 us 25 OPENDIR 0.01 34.60 us 18.77 us 126.90 us 53 STATFS 0.01 355.56 us 149.60 us 988.45 us 6 READDIR 0.02 41.77 us 21.14 us 73.50 us 72 FSTAT 0.02 215.13 us 169.65 us 274.27 us 21 READDIRP 0.08 29.04 us 13.69 us 66.67 us 534 FINODELK 0.17 160.73 us 23.54 us 321.76 us 193 LOOKUP 0.39 135.86 us 77.40 us 1627.16 us 534 FXATTROP 4.78 1072.78 us 86.42 us 197615.21 us 820 WRITE 19.40 13686.01 us 47.75 us 1796049.15 us 261 FSYNC 75.09 14420.80 us 94.10 us 2221701.71 us 959 READ Duration: 26 seconds Data Read: 21602304 bytes Data Written: 49301504 bytes Brick: 10.32.9.20:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 549022 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 1065 RELEASE 0.00 0.00 us 0.00 us 0.00 us 6838 RELEASEDIR 0.01 53.35 us 12.82 us 228.91 us 57 GETXATTR 0.02 194.83 us 14.90 us 878.82 us 50 READDIR 0.04 43.27 us 15.72 us 322.38 us 491 INODELK 0.04 97.28 us 41.17 us 432.99 us 221 OPEN 0.16 53.03 us 1.74 us 501.22 us 1820 OPENDIR 7.40 33.07 us 11.38 us 68417.92 us 135575 FINODELK 9.15 46.66 us 14.70 us 55440.51 us 118787 WRITE 26.84 925.03 us 16.53 us 280142.79 us 17586 LOOKUP 27.29 252.34 us 34.94 us 251521.50 us 65555 FSYNC 29.08 130.03 us 50.81 us 55731.00 us 135539 FXATTROP Duration: 9900 seconds Data Read: 0 bytes Data Written: 549022 bytes Interval 6 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 1014 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 9 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.11 43.98 us 15.40 us 84.40 us 5 GETXATTR 0.44 95.58 us 51.84 us 164.84 us 9 OPEN 0.62 48.41 us 2.33 us 70.35 us 25 OPENDIR 0.72 31.10 us 17.28 us 117.76 us 45 INODELK 0.98 318.59 us 154.88 us 878.82 us 6 READDIR 9.45 35.24 us 14.72 us 2246.13 us 521 FINODELK 14.32 160.73 us 22.70 us 316.55 us 173 LOOKUP 17.04 135.61 us 56.40 us 1874.03 us 244 FSYNC 19.01 36.40 us 16.78 us 2947.68 us 1014 WRITE 37.30 139.06 us 85.48 us 1078.96 us 521 FXATTROP Duration: 26 seconds Data Read: 0 bytes Data Written: 1014 bytes Brick: 10.32.9.8:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 372917 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 608 RELEASE 0.00 0.00 us 0.00 us 0.00 us 8719 RELEASEDIR 0.00 23.65 us 15.42 us 47.19 us 75 FLUSH 0.01 86.28 us 57.99 us 148.82 us 85 REMOVEXATTR 0.01 90.74 us 67.34 us 130.94 us 85 SETATTR 0.01 73.83 us 11.11 us 236.42 us 133 GETXATTR 0.02 83.84 us 41.98 us 499.27 us 146 OPEN 0.03 33.97 us 12.62 us 315.20 us 564 INODELK 0.06 316.19 us 16.57 us 1296.89 us 141 READDIR 0.13 49.96 us 1.25 us 911.95 us 1865 OPENDIR 7.61 27.61 us 11.45 us 86619.65 us 190604 FINODELK 9.35 55.71 us 14.57 us 117405.17 us 116005 WRITE 25.18 183.50 us 32.55 us 187376.40 us 94843 FSYNC 25.95 1022.20 us 15.51 us 136924.46 us 17546 LOOKUP 31.63 114.64 us 48.10 us 68557.92 us 190742 FXATTROP Duration: 11059 seconds Data Read: 0 bytes Data Written: 372917 bytes Interval 6 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 620 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 7 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.02 96.14 us 96.14 us 96.14 us 1 SETATTR 0.02 102.92 us 102.92 us 102.92 us 1 REMOVEXATTR 0.13 84.08 us 51.75 us 221.40 us 7 OPEN 0.13 61.82 us 16.08 us 159.35 us 10 GETXATTR 0.25 46.62 us 1.88 us 77.92 us 25 OPENDIR 0.27 32.45 us 17.59 us 152.92 us 39 INODELK 0.34 261.02 us 153.06 us 363.57 us 6 READDIR 4.63 34.65 us 16.37 us 80.81 us 620 WRITE 5.77 156.66 us 22.46 us 304.56 us 171 LOOKUP 7.34 27.58 us 14.15 us 781.04 us 1236 FINODELK 31.07 116.50 us 78.86 us 261.81 us 1238 FXATTROP 50.02 381.21 us 39.71 us 149969.67 us 609 FSYNC Duration: 26 seconds Data Read: 0 bytes Data Written: 620 bytes Brick: 10.32.9.8:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 8 1096 109 No. of Writes: 0 460 54715 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 115 111912 132663 No. of Writes: 8883 212986 162092 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 27012 2879 35570 No. of Writes: 48288 16340 24443 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 3743 7207 32 No. of Writes: 19159 26333 792 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 1 FORGET 0.00 0.00 us 0.00 us 0.00 us 1137 RELEASE 0.00 0.00 us 0.00 us 0.00 us 8740 RELEASEDIR 0.00 43.88 us 10.83 us 250.84 us 124 GETXATTR 0.00 120.62 us 44.65 us 762.18 us 139 OPEN 0.01 206.40 us 12.21 us 864.86 us 141 READDIR 0.02 43.05 us 1.44 us 452.74 us 1865 OPENDIR 0.05 2104.16 us 1920.14 us 2569.20 us 85 READDIRP 0.05 36.26 us 19.25 us 347.13 us 5346 STATFS 0.08 35.13 us 16.14 us 340.33 us 8148 FSTAT 0.63 27.73 us 11.02 us 73986.88 us 87007 FINODELK 1.53 134.48 us 38.31 us 90956.10 us 43355 FSYNC 1.73 388.39 us 15.69 us 62037.95 us 16978 LOOKUP 2.63 31993.13 us 16.10 us 888210.80 us 314 INODELK 2.93 128.32 us 73.56 us 45501.15 us 87026 FXATTROP 8.70 235.34 us 76.95 us 172924.48 us 141069 WRITE 81.65 3612.62 us 74.71 us 427304.61 us 86246 READ Duration: 11059 seconds Data Read: 8285158628 bytes Data Written: 21265203712 bytes Interval 6 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 3 39 2 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 4976 418 10 No. of Writes: 83 467 47 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 264 0 No. of Writes: 32 35 41 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 65 6 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 14 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.00 51.92 us 14.43 us 92.40 us 9 GETXATTR 0.01 40.96 us 1.87 us 66.77 us 25 OPENDIR 0.01 75.90 us 55.90 us 118.42 us 14 OPEN 0.01 236.50 us 152.98 us 361.08 us 6 READDIR 0.01 32.60 us 22.90 us 46.88 us 53 STATFS 0.01 2244.32 us 2244.32 us 2244.32 us 1 READDIRP 0.02 38.95 us 19.17 us 88.64 us 84 FSTAT 0.10 28.63 us 16.14 us 161.63 us 534 FINODELK 0.20 160.39 us 23.30 us 348.09 us 193 LOOKUP 0.38 226.64 us 49.98 us 20602.07 us 261 FSYNC 0.47 137.09 us 84.61 us 5477.48 us 534 FXATTROP 0.97 181.82 us 86.92 us 637.73 us 820 WRITE 28.68 96252.17 us 18.55 us 888210.80 us 46 INODELK 69.12 1882.74 us 79.08 us 157169.15 us 5668 READ Duration: 26 seconds Data Read: 41271296 bytes Data Written: 49301504 bytes Brick: 10.32.9.3:/data/gfs/bricks/brick3/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 4 131 8 No. of Writes: 0 822 17574 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 16 35286 49422 No. of Writes: 3335 177490 110247 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 12220 1028 23348 No. of Writes: 30013 5366 10235 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 974 1858 19 No. of Writes: 8375 8875 585 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 772 RELEASE 0.00 0.00 us 0.00 us 0.00 us 10592 RELEASEDIR 0.00 76.27 us 14.39 us 255.33 us 38 GETXATTR 0.00 56.50 us 19.21 us 185.55 us 75 FLUSH 0.00 150.43 us 76.71 us 292.39 us 85 REMOVEXATTR 0.00 157.91 us 97.76 us 237.19 us 85 SETATTR 0.00 308.86 us 26.64 us 1991.99 us 51 READDIR 0.01 183.93 us 62.86 us 1362.63 us 146 OPEN 0.01 73.43 us 23.05 us 777.89 us 564 INODELK 0.03 75.13 us 23.73 us 337.63 us 1679 STAT 0.03 89.35 us 1.99 us 1982.01 us 1820 OPENDIR 0.09 79.36 us 24.79 us 805.05 us 5346 STATFS 0.11 106.63 us 41.73 us 1740.16 us 5044 FSTAT 0.15 262.43 us 91.17 us 4453.28 us 2680 READDIRP 2.38 58.64 us 13.90 us 26031.44 us 190605 FINODELK 3.35 898.17 us 25.36 us 119501.01 us 17501 LOOKUP 6.60 326.75 us 45.00 us 283828.60 us 94843 FSYNC 7.89 194.27 us 67.03 us 157955.41 us 190743 FXATTROP 17.21 696.94 us 97.07 us 340140.18 us 116005 WRITE 62.13 7751.59 us 110.31 us 596087.45 us 37647 READ Duration: 12343 seconds Data Read: 3321340984 bytes Data Written: 8447544320 bytes Interval 6 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 3 109 5 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 187 225 13 No. of Writes: 228 230 13 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 185 0 No. of Writes: 4 2 12 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 12 2 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 7 RELEASE 0.00 0.00 us 0.00 us 0.00 us 25 RELEASEDIR 0.00 173.56 us 173.56 us 173.56 us 1 REMOVEXATTR 0.00 190.79 us 190.79 us 190.79 us 1 SETATTR 0.01 80.71 us 20.92 us 143.06 us 5 GETXATTR 0.01 163.10 us 113.71 us 277.38 us 7 OPEN 0.01 76.13 us 26.98 us 125.17 us 15 STAT 0.02 77.17 us 1.99 us 133.67 us 25 OPENDIR 0.03 61.12 us 30.85 us 227.60 us 39 INODELK 0.05 656.71 us 271.17 us 1991.99 us 6 READDIR 0.05 75.47 us 32.20 us 361.18 us 53 STATFS 0.07 110.87 us 59.06 us 160.47 us 52 FSTAT 0.11 249.69 us 108.39 us 447.56 us 34 READDIRP 0.50 231.83 us 29.43 us 677.06 us 171 LOOKUP 0.91 58.52 us 20.49 us 999.15 us 1238 FINODELK 2.45 319.84 us 67.30 us 4499.21 us 609 FSYNC 2.79 356.93 us 114.39 us 4840.74 us 620 WRITE 3.02 193.78 us 110.23 us 2600.12 us 1239 FXATTROP 89.95 11709.07 us 151.63 us 198748.33 us 610 READ Duration: 26 seconds Data Read: 14946304 bytes Data Written: 11333120 bytes