Brick: 10.32.9.9:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 11 200 9 No. of Writes: 2 31538 326701 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 22 319528 527228 No. of Writes: 53880 1409021 1140345 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 27747 3229 120201 No. of Writes: 479690 114939 144204 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 209766 7725 43 No. of Writes: 105320 165416 8915 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 6728 RELEASE 0.00 0.00 us 0.00 us 0.00 us 42179 RELEASEDIR 0.01 44.17 us 1.07 us 1288.76 us 2914 OPENDIR 0.02 697.13 us 42.15 us 5689.21 us 322 OPEN 0.02 411.08 us 8.60 us 5405.25 us 606 GETXATTR 0.02 1209.66 us 147.78 us 3219.56 us 234 READDIRP 0.03 38.80 us 19.08 us 7544.91 us 7757 STATFS 0.04 826.28 us 13.79 us 3583.18 us 616 READDIR 0.07 61.83 us 15.94 us 131142.59 us 13989 FSTAT 2.03 137.78 us 48.36 us 235353.97 us 172712 FXATTROP 2.16 983.89 us 10.19 us 660025.30 us 25674 LOOKUP 2.90 406.99 us 36.68 us 756289.17 us 83397 FSYNC 4.63 67941.30 us 13.93 us 1840271.15 us 798 INODELK 7.81 576.74 us 75.16 us 422586.52 us 158680 WRITE 40.09 2713.33 us 11.70 us 1850709.72 us 173111 FINODELK 40.16 3587.78 us 72.64 us 729965.74 us 131143 READ Duration: 58768 seconds Data Read: 45226370705 bytes Data Written: 133611506006 bytes Interval 9 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 394 387 86 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 141 1093 13 No. of Writes: 5905 10055 2308 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 15 515 2595 No. of Writes: 763 1465 1637 Block Size: 262144b+ 524288b+ No. of Reads: 2 0 No. of Writes: 2759 73 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 70 RELEASE 0.00 0.00 us 0.00 us 0.00 us 503 RELEASEDIR 0.00 172.94 us 46.56 us 620.23 us 70 OPEN 0.01 153.42 us 11.38 us 855.47 us 111 GETXATTR 0.01 49.63 us 1.23 us 1288.76 us 503 OPENDIR 0.01 434.10 us 27.72 us 2015.25 us 88 READDIR 0.02 1208.37 us 152.54 us 2434.77 us 46 READDIRP 0.02 43.13 us 20.02 us 2030.66 us 1361 STATFS 0.04 45.66 us 18.57 us 284.28 us 2431 FSTAT 1.20 154.41 us 75.97 us 84525.06 us 23005 FXATTROP 2.86 1865.08 us 14.26 us 212498.60 us 4518 LOOKUP 3.78 1006.27 us 38.86 us 756289.17 us 11072 FSYNC 4.27 60261.87 us 17.32 us 1437527.90 us 209 INODELK 8.19 935.38 us 76.82 us 422586.52 us 25832 WRITE 20.67 13949.32 us 89.67 us 707765.19 us 4374 READ 58.93 7494.13 us 12.88 us 1607033.18 us 23206 FINODELK Duration: 740 seconds Data Read: 385507328 bytes Data Written: 1776420864 bytes Brick: 10.32.9.5:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 2 458 87 No. of Writes: 3 4507 33740 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 54 34013 110867 No. of Writes: 6056 341153 234627 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 7430 587 28255 No. of Writes: 70451 12767 34177 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 2417 6164 15 No. of Writes: 40925 27615 4342 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 49432 RELEASE 0.00 0.00 us 0.00 us 0.00 us 40899 RELEASEDIR 0.00 158.97 us 158.97 us 158.97 us 1 MKNOD 0.00 393.70 us 9.69 us 2344.17 us 8 ENTRYLK 0.00 129.60 us 10.54 us 296.61 us 112 READDIR 0.00 1299.61 us 6.43 us 155911.98 us 125 GETXATTR 0.00 3928.24 us 139.26 us 240788.91 us 236 READDIRP 0.03 3784.28 us 15.61 us 469284.63 us 1686 FSTAT 0.04 2368.24 us 28.06 us 242169.67 us 3623 OPEN 0.05 2811.93 us 8.13 us 1250845.84 us 3381 FLUSH 0.06 4385.28 us 0.80 us 527903.92 us 2653 OPENDIR 0.09 2315.69 us 11.48 us 816339.95 us 7750 STATFS 0.18 55337.88 us 8.34 us 1543417.83 us 648 INODELK 0.37 1462.23 us 6.84 us 1127299.99 us 49902 FINODELK 0.57 3924.78 us 11.60 us 968588.21 us 28256 LOOKUP 1.91 7500.40 us 53.88 us 2738720.92 us 49870 FXATTROP 2.21 30153.49 us 63.31 us 3473303.89 us 14319 READ 14.57 110289.45 us 122.19 us 3055911.44 us 25864 FSYNC 79.91 262383.20 us 98.78 us 4500846.60 us 59632 WRITE Duration: 60363 seconds Data Read: 6417030998 bytes Data Written: 27570997546 bytes Interval 9 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 59 2334 441 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 13 331 7 No. of Writes: 4519 1752 790 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 145 0 No. of Writes: 84 399 151 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 214 31 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 615 RELEASE 0.00 0.00 us 0.00 us 0.00 us 467 RELEASEDIR 0.00 45.52 us 8.46 us 78.57 us 25 GETXATTR 0.00 144.98 us 13.50 us 296.61 us 16 READDIR 0.01 7894.70 us 180.57 us 240788.91 us 46 READDIRP 0.03 1404.57 us 1.00 us 94678.96 us 467 OPENDIR 0.06 4985.90 us 17.46 us 403210.36 us 294 FSTAT 0.06 2453.17 us 35.05 us 242169.67 us 615 OPEN 0.10 3976.83 us 9.70 us 1250845.84 us 591 FLUSH 0.10 33579.24 us 10.59 us 937670.52 us 73 INODELK 0.12 2132.57 us 14.22 us 816339.95 us 1361 STATFS 0.29 617.29 us 8.19 us 164742.40 us 11477 FINODELK 0.69 3379.94 us 17.79 us 622513.08 us 5053 LOOKUP 0.84 42003.14 us 160.61 us 1495939.39 us 496 READ 1.66 3575.85 us 68.64 us 1688509.25 us 11476 FXATTROP 22.52 95429.52 us 126.22 us 3055911.44 us 5823 FSYNC 73.52 168379.58 us 110.01 us 4058537.96 us 10773 WRITE Duration: 740 seconds Data Read: 12386304 bytes Data Written: 217700864 bytes Brick: 10.32.9.6:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 789986 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 49432 RELEASE 0.00 0.00 us 0.00 us 0.00 us 40938 RELEASEDIR 0.00 21.03 us 16.15 us 34.88 us 8 ENTRYLK 0.00 270.94 us 270.94 us 270.94 us 1 MKNOD 0.01 261.74 us 11.55 us 9174.66 us 116 GETXATTR 0.01 297.48 us 13.73 us 2466.13 us 112 READDIR 0.07 64.73 us 15.29 us 4946.30 us 3382 FLUSH 0.07 82.72 us 1.51 us 4642.85 us 2661 OPENDIR 0.22 193.05 us 39.92 us 64374.98 us 3624 OPEN 0.25 1255.82 us 14.35 us 63381.45 us 648 INODELK 0.89 57.44 us 10.33 us 8940.33 us 50009 FINODELK 1.44 77.62 us 15.84 us 31914.28 us 59679 WRITE 2.59 294.62 us 15.52 us 115626.36 us 28267 LOOKUP 3.49 224.71 us 77.62 us 98174.30 us 49948 FXATTROP 90.95 11273.35 us 78.67 us 453079.55 us 25908 FSYNC Duration: 60366 seconds Data Read: 0 bytes Data Written: 789986 bytes Interval 9 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 10774 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 615 RELEASE 0.00 0.00 us 0.00 us 0.00 us 467 RELEASEDIR 0.00 85.11 us 12.25 us 434.77 us 14 GETXATTR 0.00 42.29 us 17.37 us 500.84 us 73 INODELK 0.00 205.10 us 15.46 us 509.24 us 16 READDIR 0.04 57.10 us 15.29 us 1829.07 us 591 FLUSH 0.05 79.87 us 1.78 us 1854.43 us 467 OPENDIR 0.11 144.84 us 45.31 us 17419.60 us 615 OPEN 0.79 55.64 us 13.17 us 8940.33 us 11478 FINODELK 0.93 69.84 us 16.64 us 6779.39 us 10774 WRITE 1.79 286.71 us 16.91 us 24721.64 us 5053 LOOKUP 3.09 218.15 us 81.40 us 54774.50 us 11476 FXATTROP 93.19 12944.68 us 111.22 us 453079.55 us 5825 FSYNC Duration: 740 seconds Data Read: 0 bytes Data Written: 10774 bytes Brick: 10.32.9.4:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 52412 6 0 No. of Writes: 3 4504 33731 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 0 66342 53000 No. of Writes: 6056 340041 234374 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 2686 356 12946 No. of Writes: 70264 12678 34177 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 602 3108 3 No. of Writes: 20547 27615 4342 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 49333 RELEASE 0.00 0.00 us 0.00 us 0.00 us 40379 RELEASEDIR 0.00 22.96 us 15.97 us 51.06 us 8 ENTRYLK 0.00 260.50 us 260.50 us 260.50 us 1 MKNOD 0.00 77.42 us 16.00 us 2701.10 us 648 INODELK 0.00 144.50 us 7.61 us 1702.83 us 428 GETXATTR 0.01 285.11 us 12.41 us 3140.45 us 406 READDIR 0.01 51.02 us 13.08 us 46431.20 us 3384 FLUSH 0.01 65.58 us 0.94 us 17715.27 us 2808 OPENDIR 0.01 80.40 us 11.70 us 19019.90 us 2445 STAT 0.03 118.76 us 40.23 us 33323.48 us 3626 OPEN 0.03 57.81 us 15.15 us 27740.94 us 7757 STATFS 0.04 197.89 us 119.38 us 17249.34 us 2481 READDIRP 0.36 99.03 us 11.12 us 301165.99 us 49989 FINODELK 1.08 526.62 us 13.29 us 263413.97 us 28422 LOOKUP 1.23 341.69 us 71.48 us 563688.45 us 49950 FXATTROP 7.47 3998.57 us 82.10 us 469183.97 us 25947 READ 35.02 18777.53 us 92.85 us 483169.32 us 25908 FSYNC 54.69 12727.00 us 149.97 us 759284.50 us 59684 WRITE Duration: 58519 seconds Data Read: 3261956842 bytes Data Written: 24886890282 bytes Interval 9 Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 665 0 0 No. of Writes: 0 59 2334 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 0 7 103 No. of Writes: 441 4519 1752 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 2 3 17 No. of Writes: 790 84 399 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 0 0 0 No. of Writes: 151 214 31 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 615 RELEASE 0.00 0.00 us 0.00 us 0.00 us 488 RELEASEDIR 0.00 39.06 us 18.17 us 225.32 us 73 INODELK 0.00 76.36 us 9.68 us 297.33 us 46 GETXATTR 0.01 222.65 us 21.02 us 593.11 us 58 READDIR 0.01 45.45 us 12.62 us 289.83 us 417 STAT 0.01 36.42 us 13.83 us 918.21 us 591 FLUSH 0.01 53.38 us 0.99 us 474.56 us 488 OPENDIR 0.02 87.38 us 40.23 us 5527.50 us 615 OPEN 0.03 49.03 us 18.83 us 3866.60 us 1361 STATFS 0.04 189.02 us 122.54 us 990.42 us 435 READDIRP 0.33 63.39 us 13.25 us 128981.30 us 11477 FINODELK 0.74 321.28 us 13.43 us 37963.21 us 5074 LOOKUP 0.98 186.47 us 80.20 us 43834.36 us 11476 FXATTROP 2.30 6321.31 us 154.25 us 110020.47 us 797 READ 39.43 8011.27 us 168.50 us 404368.45 us 10774 WRITE 56.08 21071.37 us 152.03 us 325318.37 us 5826 FSYNC Duration: 740 seconds Data Read: 2502580 bytes Data Written: 217700864 bytes Brick: 10.32.9.8:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 2836841 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 3501 RELEASE 0.00 0.00 us 0.00 us 0.00 us 39501 RELEASEDIR 0.00 23.26 us 15.42 us 47.19 us 110 FLUSH 0.01 85.78 us 57.99 us 148.82 us 124 REMOVEXATTR 0.01 90.83 us 67.34 us 158.33 us 124 SETATTR 0.01 67.66 us 10.50 us 368.03 us 194 GETXATTR 0.02 84.14 us 41.98 us 499.27 us 250 OPEN 0.04 36.99 us 12.62 us 398.57 us 944 INODELK 0.06 280.66 us 14.10 us 1296.89 us 197 READDIR 0.14 49.60 us 1.25 us 911.95 us 2704 OPENDIR 8.05 27.51 us 11.45 us 86619.65 us 270887 FINODELK 8.60 50.28 us 14.57 us 117405.17 us 158241 WRITE 22.34 810.95 us 15.51 us 136924.46 us 25499 LOOKUP 26.84 184.15 us 32.55 us 187376.40 us 134874 FSYNC 33.87 115.65 us 48.10 us 68557.92 us 271003 FXATTROP Duration: 59079 seconds Data Read: 0 bytes Data Written: 2836841 bytes Interval 9 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 25110 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 84 RELEASE 0.00 0.00 us 0.00 us 0.00 us 482 RELEASEDIR 0.00 22.68 us 15.95 us 30.51 us 22 FLUSH 0.02 81.94 us 66.17 us 121.51 us 24 REMOVEXATTR 0.02 92.75 us 73.22 us 158.33 us 24 SETATTR 0.02 50.76 us 10.50 us 198.71 us 52 GETXATTR 0.06 88.22 us 47.47 us 347.92 us 84 OPEN 0.07 200.12 us 17.43 us 366.16 us 46 READDIR 0.10 43.88 us 12.88 us 398.57 us 298 INODELK 0.17 46.60 us 1.30 us 95.78 us 482 OPENDIR 6.89 35.71 us 14.98 us 8325.56 us 25110 WRITE 8.62 243.97 us 17.27 us 13438.88 us 4599 LOOKUP 9.62 26.97 us 12.23 us 10471.02 us 46438 FINODELK 32.58 183.27 us 33.33 us 182520.02 us 23144 FSYNC 41.83 117.30 us 57.85 us 1991.12 us 46424 FXATTROP Duration: 740 seconds Data Read: 0 bytes Data Written: 25110 bytes Brick: 10.32.9.8:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 8 1097 109 No. of Writes: 0 2901 273197 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 115 238693 440909 No. of Writes: 36872 1361504 875644 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 37900 3346 141710 No. of Writes: 293109 93776 162079 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 3889 7281 33 No. of Writes: 161749 236364 7941 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 1 FORGET 0.00 0.00 us 0.00 us 0.00 us 3720 RELEASE 0.00 0.00 us 0.00 us 0.00 us 39522 RELEASEDIR 0.00 46.19 us 10.83 us 328.71 us 167 GETXATTR 0.00 107.36 us 42.28 us 762.18 us 195 OPEN 0.01 203.17 us 12.21 us 864.86 us 197 READDIR 0.03 43.02 us 1.32 us 452.74 us 2704 OPENDIR 0.06 2113.84 us 1920.14 us 2569.20 us 124 READDIRP 0.06 36.11 us 17.79 us 347.13 us 7757 STATFS 0.09 35.61 us 16.14 us 340.33 us 11844 FSTAT 0.73 27.99 us 11.02 us 73986.88 us 118371 FINODELK 1.77 136.85 us 37.39 us 121066.77 us 58862 FSYNC 1.88 346.99 us 15.01 us 77684.23 us 24658 LOOKUP 3.34 128.87 us 55.07 us 45501.15 us 118386 FXATTROP 5.55 52717.08 us 16.10 us 2004661.60 us 480 INODELK 9.40 234.45 us 75.18 us 172924.48 us 182886 WRITE 77.09 3911.50 us 74.71 us 427304.61 us 89909 READ Duration: 59079 seconds Data Read: 18550783716 bytes Data Written: 169056832000 bytes Interval 9 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 28 1201 202 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 88 1012 13 No. of Writes: 11370 7637 1887 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 13 723 0 No. of Writes: 518 690 1562 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 2221 50 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 21 RELEASE 0.00 0.00 us 0.00 us 0.00 us 473 RELEASEDIR 0.00 63.17 us 11.55 us 328.71 us 24 GETXATTR 0.00 85.37 us 47.47 us 218.02 us 21 OPEN 0.01 191.44 us 20.33 us 506.91 us 28 READDIR 0.05 42.27 us 1.32 us 103.43 us 473 OPENDIR 0.12 35.99 us 17.79 us 312.67 us 1361 STATFS 0.13 2137.12 us 1993.74 us 2312.10 us 24 READDIRP 0.19 36.56 us 16.68 us 182.58 us 2058 FSTAT 1.46 28.28 us 11.78 us 4920.38 us 20656 FINODELK 3.09 283.99 us 16.10 us 77684.23 us 4368 LOOKUP 3.43 134.79 us 38.66 us 46317.56 us 10211 FSYNC 6.69 129.92 us 55.07 us 1519.44 us 20670 FXATTROP 15.38 225.45 us 75.18 us 166890.53 us 27366 WRITE 18.50 114198.06 us 16.67 us 2004661.60 us 65 INODELK 50.94 11055.19 us 133.17 us 355082.08 us 1849 READ Duration: 740 seconds Data Read: 57180160 bytes Data Written: 1466518016 bytes Brick: 10.32.9.7:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 8 146 10 No. of Writes: 0 5640 191078 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 12 275838 263894 No. of Writes: 29947 1275560 712585 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 17182 2303 69829 No. of Writes: 286032 45424 94648 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 2287 4034 20 No. of Writes: 88659 100478 6790 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 3501 RELEASE 0.00 0.00 us 0.00 us 0.00 us 40057 RELEASEDIR 0.00 20.98 us 14.68 us 31.79 us 110 FLUSH 0.00 82.04 us 58.17 us 510.84 us 124 REMOVEXATTR 0.00 86.21 us 62.72 us 156.44 us 124 SETATTR 0.00 268.84 us 6.67 us 2674.39 us 259 GETXATTR 0.00 321.60 us 41.89 us 3004.61 us 250 OPEN 0.01 475.40 us 14.32 us 1787.62 us 281 READDIR 0.01 1249.13 us 26.42 us 3832.88 us 234 READDIRP 0.05 178.77 us 16.13 us 351764.07 us 7757 STATFS 0.09 822.57 us 1.17 us 1068559.38 us 2746 OPENDIR 0.12 292.98 us 25.31 us 1365160.22 us 10719 FSTAT 0.90 25010.58 us 13.33 us 887933.44 us 941 INODELK 1.38 133.53 us 11.10 us 3938189.55 us 270885 FINODELK 1.68 162.21 us 45.86 us 2503412.21 us 271003 FXATTROP 2.03 394.43 us 31.20 us 756176.42 us 134874 FSYNC 12.66 2092.21 us 72.21 us 4245933.36 us 158241 WRITE 14.29 14633.42 us 10.75 us 4031333.55 us 25543 LOOKUP 66.78 18236.84 us 69.72 us 6429153.50 us 95797 READ Duration: 59031 seconds Data Read: 10396155504 bytes Data Written: 84404067328 bytes Interval 9 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 64 279 45 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 172 529 10 No. of Writes: 14494 5264 1377 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 5 351 0 No. of Writes: 316 548 1064 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 1620 39 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 84 RELEASE 0.00 0.00 us 0.00 us 0.00 us 494 RELEASEDIR 0.00 22.20 us 17.97 us 31.79 us 22 FLUSH 0.00 81.91 us 68.21 us 101.65 us 24 REMOVEXATTR 0.00 89.38 us 72.10 us 128.30 us 24 SETATTR 0.01 43.26 us 1.29 us 153.44 us 494 OPENDIR 0.01 427.33 us 15.79 us 1319.22 us 70 READDIR 0.02 33.36 us 19.57 us 258.67 us 1361 STATFS 0.02 561.73 us 9.55 us 2674.39 us 86 GETXATTR 0.02 1283.75 us 28.25 us 3720.17 us 46 READDIRP 0.03 790.46 us 41.89 us 3004.61 us 84 OPEN 0.03 42.33 us 25.31 us 308.87 us 1862 FSTAT 0.53 27.26 us 11.92 us 22788.88 us 46436 FINODELK 0.61 316.49 us 10.75 us 100131.38 us 4611 LOOKUP 2.25 231.96 us 37.46 us 540421.26 us 23144 FSYNC 2.97 152.85 us 51.13 us 541193.18 us 46424 FXATTROP 4.89 39428.07 us 14.19 us 881646.99 us 296 INODELK 18.93 1799.80 us 72.85 us 3118991.86 us 25110 WRITE 69.67 155845.21 us 130.17 us 4885484.01 us 1067 READ Duration: 740 seconds Data Read: 28553216 bytes Data Written: 1032566784 bytes Brick: 10.32.9.21:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 3513729 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 1 FORGET 0.00 0.00 us 0.00 us 0.00 us 4089 RELEASE 0.00 0.00 us 0.00 us 0.00 us 44272 RELEASEDIR 0.18 42.97 us 1.09 us 1138.82 us 2893 OPENDIR 0.42 611.92 us 15.33 us 7388.53 us 479 INODELK 0.56 679.34 us 15.23 us 2483.07 us 574 READDIR 0.61 2170.81 us 48.25 us 13138.61 us 195 OPEN 0.82 1066.87 us 8.75 us 13801.35 us 535 GETXATTR 4.89 28.84 us 10.98 us 51214.69 us 118373 FINODELK 9.18 35.04 us 14.64 us 81798.39 us 182886 WRITE 18.04 506.78 us 12.31 us 165781.70 us 24847 LOOKUP 22.07 130.09 us 53.80 us 40959.22 us 118386 FXATTROP 43.23 512.45 us 38.18 us 285202.84 us 58862 FSYNC Duration: 60363 seconds Data Read: 0 bytes Data Written: 3513729 bytes Interval 9 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 27366 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 21 RELEASE 0.00 0.00 us 0.00 us 0.00 us 500 RELEASEDIR 0.02 82.18 us 48.25 us 161.40 us 21 OPEN 0.02 41.30 us 16.13 us 156.19 us 65 INODELK 0.08 136.77 us 13.02 us 909.03 us 66 GETXATTR 0.20 43.34 us 1.27 us 277.72 us 500 OPENDIR 0.33 428.51 us 15.42 us 1215.07 us 82 READDIR 5.70 29.84 us 11.88 us 2949.68 us 20656 FINODELK 9.15 36.14 us 14.64 us 4606.43 us 27366 WRITE 11.51 283.22 us 12.31 us 53047.02 us 4395 LOOKUP 26.02 136.12 us 53.80 us 40959.22 us 20670 FXATTROP 46.96 497.27 us 40.09 us 274185.32 us 10211 FSYNC Duration: 740 seconds Data Read: 0 bytes Data Written: 27366 bytes Brick: 10.32.9.21:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 11 66 2 No. of Writes: 2 31826 326701 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 4 116933 302613 No. of Writes: 53880 1410548 1140566 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 11546 1749 76356 No. of Writes: 479855 114971 144225 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 1906 4093 24 No. of Writes: 105312 165416 8915 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 6820 RELEASE 0.00 0.00 us 0.00 us 0.00 us 44299 RELEASEDIR 0.03 42.29 us 13.86 us 9356.79 us 2425 STAT 0.04 46.94 us 1.04 us 772.13 us 2893 OPENDIR 0.04 314.86 us 10.29 us 2391.56 us 479 GETXATTR 0.05 207.42 us 14.29 us 5815.42 us 799 INODELK 0.05 51.40 us 28.18 us 540.78 us 3666 FSTAT 0.09 39.82 us 18.62 us 9889.16 us 7757 STATFS 0.12 1358.64 us 43.37 us 233429.90 us 322 OPEN 0.14 851.72 us 15.78 us 4414.06 us 574 READDIR 0.16 224.28 us 143.72 us 3249.69 us 2482 READDIRP 1.46 30.22 us 10.80 us 110711.59 us 173110 FINODELK 4.32 601.98 us 15.19 us 91847.23 us 25659 LOOKUP 6.30 130.39 us 49.28 us 232146.00 us 172711 FXATTROP 8.84 378.85 us 35.58 us 430356.59 us 83395 FSYNC 23.35 525.84 us 73.80 us 494782.91 us 158694 WRITE 55.01 4360.84 us 78.00 us 503162.29 us 45075 READ Duration: 60363 seconds Data Read: 10404548654 bytes Data Written: 133624068438 bytes Interval 9 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 394 387 86 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 31 563 12 No. of Writes: 5905 10055 2308 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 7 368 1 No. of Writes: 763 1465 1637 Block Size: 262144b+ 524288b+ No. of Reads: 1 0 No. of Writes: 2759 73 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 70 RELEASE 0.00 0.00 us 0.00 us 0.00 us 500 RELEASEDIR 0.02 42.46 us 14.29 us 589.73 us 210 INODELK 0.03 34.11 us 20.98 us 177.92 us 413 STAT 0.04 298.66 us 10.97 us 1498.98 us 63 GETXATTR 0.06 48.48 us 1.17 us 120.46 us 500 OPENDIR 0.08 52.55 us 31.44 us 108.17 us 637 FSTAT 0.12 37.70 us 18.62 us 406.46 us 1361 STATFS 0.17 871.79 us 16.50 us 2028.77 us 82 READDIR 0.23 227.43 us 145.28 us 3249.69 us 435 READDIRP 0.56 3427.01 us 43.37 us 233429.90 us 70 OPEN 1.62 30.00 us 11.97 us 3260.32 us 23206 FINODELK 8.55 159.50 us 72.57 us 232146.00 us 23005 FXATTROP 8.94 849.78 us 16.81 us 91847.23 us 4515 LOOKUP 24.77 959.75 us 38.69 us 430356.59 us 11072 FSYNC 24.89 10859.72 us 153.99 us 250511.54 us 983 READ 29.91 496.71 us 73.80 us 453768.34 us 25832 WRITE Duration: 740 seconds Data Read: 30142464 bytes Data Written: 1776420864 bytes Brick: 10.32.9.20:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 3979583 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 FORGET 0.00 0.00 us 0.00 us 0.00 us 6630 RELEASE 0.00 0.00 us 0.00 us 0.00 us 36900 RELEASEDIR 0.01 57.48 us 12.65 us 329.66 us 84 GETXATTR 0.02 193.66 us 14.90 us 878.82 us 70 READDIR 0.05 105.94 us 41.17 us 683.04 us 322 OPEN 0.06 54.19 us 15.72 us 5135.95 us 800 INODELK 0.19 54.37 us 1.60 us 1035.48 us 2641 OPENDIR 7.68 32.94 us 11.38 us 68417.92 us 173114 FINODELK 9.52 44.57 us 14.70 us 55440.51 us 158694 WRITE 24.39 712.95 us 16.53 us 280142.79 us 25407 LOOKUP 27.40 243.98 us 34.94 us 251521.50 us 83395 FSYNC 30.68 131.93 us 50.81 us 55731.00 us 172711 FXATTROP Duration: 57920 seconds Data Read: 0 bytes Data Written: 3979583 bytes Interval 9 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 25832 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 70 RELEASE 0.00 0.00 us 0.00 us 0.00 us 464 RELEASEDIR 0.01 62.34 us 15.20 us 116.82 us 17 GETXATTR 0.02 199.99 us 16.79 us 778.14 us 10 READDIR 0.10 114.77 us 46.50 us 683.04 us 70 OPEN 0.22 86.24 us 16.71 us 5135.95 us 211 INODELK 0.32 56.51 us 1.98 us 1035.48 us 464 OPENDIR 8.88 31.82 us 12.28 us 7988.05 us 23206 FINODELK 11.60 37.32 us 15.06 us 2981.61 us 25832 WRITE 12.08 224.23 us 20.07 us 39256.75 us 4479 LOOKUP 28.45 213.58 us 40.22 us 94343.80 us 11072 FSYNC 38.31 138.39 us 69.94 us 3069.85 us 23005 FXATTROP Duration: 740 seconds Data Read: 0 bytes Data Written: 25832 bytes Brick: 10.32.9.20:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 4 109 21 No. of Writes: 0 2901 273197 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 42 112256 166124 No. of Writes: 36872 1361504 875644 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 12144 1370 69995 No. of Writes: 293109 93776 162079 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 1466 2942 9 No. of Writes: 161749 236364 7941 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 3097 RELEASE 0.00 0.00 us 0.00 us 0.00 us 36900 RELEASEDIR 0.00 53.86 us 12.74 us 546.30 us 60 GETXATTR 0.00 211.97 us 16.62 us 988.45 us 70 READDIR 0.00 101.31 us 39.98 us 497.56 us 195 OPEN 0.00 46.92 us 14.96 us 3469.09 us 481 INODELK 0.01 52.86 us 1.65 us 1573.96 us 2641 OPENDIR 0.03 216.49 us 152.23 us 2562.55 us 2482 READDIRP 0.03 73.86 us 18.77 us 125905.96 us 7757 STATFS 0.06 111.91 us 16.04 us 655589.61 us 10152 FSTAT 0.07 542.53 us 12.89 us 523421.21 us 2425 STAT 1.10 803.43 us 18.50 us 1534952.31 us 24595 LOOKUP 1.16 177.03 us 11.27 us 1749236.34 us 118375 FINODELK 1.44 218.66 us 58.80 us 1784231.76 us 118390 FXATTROP 13.72 4194.48 us 39.91 us 2743546.94 us 58865 FSYNC 36.03 14004.46 us 79.14 us 2966713.52 us 46303 READ 46.33 4558.98 us 77.68 us 2638579.30 us 182887 WRITE Duration: 57920 seconds Data Read: 8237195368 bytes Data Written: 169056832000 bytes Interval 9 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 28 1201 202 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 131 256 14 No. of Writes: 11370 7637 1887 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 2 277 4 No. of Writes: 518 690 1562 Block Size: 262144b+ 524288b+ No. of Reads: 2 0 No. of Writes: 2221 50 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 21 RELEASE 0.00 0.00 us 0.00 us 0.00 us 464 RELEASEDIR 0.00 47.44 us 13.63 us 73.33 us 12 GETXATTR 0.00 212.66 us 19.17 us 803.07 us 10 READDIR 0.00 118.97 us 59.03 us 352.73 us 21 OPEN 0.00 45.59 us 20.23 us 248.98 us 65 INODELK 0.01 56.79 us 1.86 us 1008.29 us 464 OPENDIR 0.03 48.42 us 20.11 us 1484.22 us 1764 FSTAT 0.04 214.84 us 152.23 us 558.38 us 435 READDIRP 0.06 113.06 us 19.98 us 96371.03 us 1361 STATFS 0.07 470.41 us 15.68 us 177048.08 us 413 STAT 0.61 369.50 us 21.75 us 98568.83 us 4359 LOOKUP 0.84 107.63 us 11.27 us 422960.68 us 20656 FINODELK 1.50 191.62 us 58.80 us 669097.82 us 20670 FXATTROP 15.43 59246.36 us 108.59 us 2819788.24 us 686 READ 15.75 4062.95 us 40.23 us 1993844.42 us 10211 FSYNC 65.65 6319.81 us 80.06 us 2441596.43 us 27366 WRITE Duration: 740 seconds Data Read: 22843392 bytes Data Written: 1466518016 bytes Brick: 10.32.9.3:/data/gfs/bricks/brick3/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 4 131 8 No. of Writes: 0 5640 191078 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 16 81419 161095 No. of Writes: 29947 1275560 712585 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 17291 1342 103864 No. of Writes: 286032 45424 94648 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 1022 1870 19 No. of Writes: 88659 100478 6790 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 3665 RELEASE 0.00 0.00 us 0.00 us 0.00 us 40654 RELEASEDIR 0.00 77.86 us 14.39 us 255.33 us 58 GETXATTR 0.00 55.93 us 18.71 us 185.55 us 110 FLUSH 0.00 148.39 us 76.71 us 306.67 us 124 REMOVEXATTR 0.00 156.41 us 94.69 us 237.19 us 124 SETATTR 0.00 282.94 us 26.64 us 1991.99 us 72 READDIR 0.01 249.61 us 62.86 us 1608.99 us 250 OPEN 0.02 108.18 us 23.05 us 1656.32 us 942 INODELK 0.03 73.13 us 23.73 us 337.63 us 2425 STAT 0.04 93.83 us 1.99 us 17101.96 us 2641 OPENDIR 0.10 78.77 us 24.79 us 1132.37 us 7757 STATFS 0.14 108.18 us 41.73 us 4078.40 us 7332 FSTAT 0.18 262.35 us 91.17 us 5148.11 us 3890 READDIRP 2.78 59.76 us 13.90 us 60015.05 us 270884 FINODELK 3.23 739.71 us 25.36 us 119501.01 us 25436 LOOKUP 7.72 333.10 us 45.00 us 283828.60 us 134874 FSYNC 9.10 195.46 us 67.03 us 157955.41 us 271003 FXATTROP 19.48 716.64 us 94.11 us 340140.18 us 158241 WRITE 57.15 8361.71 us 110.31 us 596087.45 us 39783 READ Duration: 60363 seconds Data Read: 9818510392 bytes Data Written: 84404067328 bytes Interval 9 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 64 279 45 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 83 367 8 No. of Writes: 14494 5264 1377 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 4 586 0 No. of Writes: 316 548 1064 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 1620 39 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 84 RELEASE 0.00 0.00 us 0.00 us 0.00 us 464 RELEASEDIR 0.00 84.14 us 26.99 us 150.82 us 9 GETXATTR 0.00 52.66 us 18.71 us 108.64 us 22 FLUSH 0.00 187.96 us 35.03 us 565.44 us 11 READDIR 0.01 139.45 us 77.67 us 239.13 us 24 REMOVEXATTR 0.01 152.96 us 94.69 us 236.75 us 24 SETATTR 0.05 67.18 us 24.77 us 302.92 us 413 STAT 0.06 395.71 us 67.77 us 1608.99 us 84 OPEN 0.06 82.30 us 2.19 us 210.85 us 464 OPENDIR 0.09 186.01 us 24.60 us 1656.32 us 297 INODELK 0.18 78.19 us 27.95 us 1050.83 us 1361 STATFS 0.25 117.05 us 45.04 us 4078.40 us 1274 FSTAT 0.30 264.20 us 102.02 us 5148.11 us 682 READDIRP 2.07 271.71 us 35.32 us 22720.97 us 4581 LOOKUP 4.81 62.33 us 16.26 us 6962.45 us 46436 FINODELK 12.97 337.03 us 54.20 us 221094.08 us 23144 FSYNC 15.31 198.37 us 91.04 us 5197.06 us 46424 FXATTROP 24.57 588.49 us 97.75 us 228091.00 us 25110 WRITE 39.26 22524.25 us 112.00 us 551619.18 us 1048 READ Duration: 740 seconds Data Read: 42180608 bytes Data Written: 1032566784 bytes