Brick: 10.32.9.9:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 81 581 23 No. of Writes: 22 114648 2126034 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 74 756105 2121318 No. of Writes: 230303 3407835 2831147 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 55128 5886 597082 No. of Writes: 1305603 651321 587366 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 896988 13299 23 No. of Writes: 500273 543969 37269 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 22 FORGET 0.00 0.00 us 0.00 us 0.00 us 54315 RELEASE 0.00 0.00 us 0.00 us 0.00 us 226853 RELEASEDIR 0.00 53.53 us 8.36 us 315.49 us 454 GETXATTR 0.01 240.05 us 16.77 us 1009.51 us 242 READDIR 0.01 858.36 us 156.91 us 2362.55 us 78 READDIRP 0.02 106.44 us 1.36 us 56000.57 us 872 OPENDIR 0.02 50.05 us 22.34 us 21749.20 us 1910 STATFS 0.03 1142.42 us 45.59 us 157629.81 us 149 OPEN 0.04 45.23 us 17.29 us 5019.97 us 4374 FSTAT 2.77 2274.94 us 14.48 us 211178.76 us 6293 LOOKUP 2.83 158.06 us 71.87 us 311176.61 us 92593 FXATTROP 2.86 338.68 us 34.95 us 614074.06 us 43634 WRITE 6.21 701.18 us 39.52 us 709861.24 us 45779 FSYNC 11.71 96134.62 us 11.84 us 1476999.56 us 630 INODELK 35.79 2708.93 us 18.12 us 677119.90 us 68329 READ 37.70 2100.66 us 11.24 us 1972584.83 us 92815 FINODELK Duration: 223094 seconds Data Read: 184889025999 bytes Data Written: 467737857714 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 110 14 2 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 9573 2532 4 No. of Writes: 1484 1040 667 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 1667 728 No. of Writes: 312 949 644 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 431 22 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 75 RELEASE 0.00 0.00 us 0.00 us 0.00 us 160 RELEASEDIR 0.00 52.51 us 13.26 us 152.97 us 87 GETXATTR 0.01 82.71 us 45.59 us 392.61 us 75 OPEN 0.01 42.42 us 1.48 us 99.39 us 160 OPENDIR 0.01 794.49 us 168.92 us 2155.23 us 10 READDIRP 0.01 246.91 us 148.35 us 928.80 us 42 READDIR 0.01 38.83 us 22.99 us 119.17 us 367 STATFS 0.04 45.20 us 18.89 us 975.88 us 872 FSTAT 1.60 292.94 us 34.95 us 275029.11 us 5675 WRITE 2.28 192.71 us 77.58 us 240647.10 us 12322 FXATTROP 2.45 1908.70 us 14.94 us 52757.44 us 1335 LOOKUP 4.43 758.89 us 39.52 us 473183.30 us 6073 FSYNC 21.49 70086.07 us 11.84 us 1469758.09 us 319 INODELK 30.00 2151.99 us 18.78 us 611767.24 us 14504 READ 37.67 3169.96 us 13.66 us 1785611.71 us 12363 FINODELK Duration: 206 seconds Data Read: 264687616 bytes Data Written: 399364608 bytes Brick: 10.32.9.5:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 0 0 0 No. of Writes: 3 199 394 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 0 27483 2900 No. of Writes: 44 5830 4558 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 10 0 1579 No. of Writes: 1936 844 1133 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 282 0 0 No. of Writes: 149669 1471 260 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 979 FORGET 0.00 0.00 us 0.00 us 0.00 us 38325 RELEASE 0.00 0.00 us 0.00 us 0.00 us 3860 RELEASEDIR 0.00 58.02 us 25.24 us 240.12 us 60 OPEN 0.00 53.39 us 18.50 us 111.16 us 432 FSTAT 0.01 691.87 us 122.47 us 1860.85 us 47 READDIRP 0.01 45.50 us 0.65 us 1483.53 us 884 OPENDIR 0.01 90.87 us 6.57 us 2207.38 us 446 GETXATTR 0.02 44.30 us 12.96 us 1203.70 us 1896 STATFS 0.03 581.08 us 10.75 us 3807.82 us 272 READDIR 0.05 41.49 us 7.35 us 4001.69 us 5872 FINODELK 0.09 80.96 us 16.20 us 5130.33 us 5019 WRITE 0.14 115.76 us 8.20 us 12597.45 us 5824 LOOKUP 0.59 470.64 us 46.21 us 577533.95 us 5872 FXATTROP 2.35 58583.77 us 9.47 us 1064586.48 us 187 INODELK 7.82 4782.08 us 8.91 us 736472.73 us 7630 READ 88.87 140820.23 us 256.65 us 1325487.13 us 2943 FSYNC Duration: 4365 seconds Data Read: 276934656 bytes Data Written: 20662491400 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 4096b+ No. of Reads: 0 0 1832 No. of Writes: 10 12 500 Block Size: 8192b+ 16384b+ 32768b+ No. of Reads: 103 0 0 No. of Writes: 280 132 97 Block Size: 65536b+ 131072b+ 262144b+ No. of Reads: 64 0 0 No. of Writes: 142 288 16 Block Size: 524288b+ No. of Reads: 0 No. of Writes: 2 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 RELEASE 0.00 0.00 us 0.00 us 0.00 us 160 RELEASEDIR 0.00 49.46 us 31.20 us 67.73 us 2 OPEN 0.00 649.63 us 149.89 us 1149.55 us 4 READDIRP 0.00 53.60 us 8.15 us 367.55 us 77 GETXATTR 0.00 50.57 us 24.14 us 93.65 us 91 FSTAT 0.01 41.35 us 0.65 us 98.38 us 160 OPENDIR 0.01 256.96 us 66.29 us 600.47 us 42 READDIR 0.02 45.74 us 14.11 us 1189.03 us 367 STATFS 0.06 41.75 us 9.98 us 4001.69 us 1417 FINODELK 0.12 84.31 us 21.84 us 5130.33 us 1479 WRITE 0.12 110.89 us 8.80 us 413.79 us 1126 LOOKUP 0.16 28383.82 us 16.21 us 170164.11 us 6 INODELK 0.89 655.73 us 52.49 us 178934.94 us 1417 FXATTROP 4.36 2266.06 us 9.19 us 314001.14 us 1999 READ 94.24 134667.72 us 270.81 us 1325487.13 us 727 FSYNC Duration: 206 seconds Data Read: 12541952 bytes Data Written: 79627264 bytes Brick: 10.32.9.6:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 2198418 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 4894 FORGET 0.00 0.00 us 0.00 us 0.00 us 6116385 RELEASE 0.00 0.00 us 0.00 us 0.00 us 235330 RELEASEDIR 0.00 189.94 us 66.96 us 1096.33 us 12 FSTAT 0.07 162.96 us 18.21 us 1541.69 us 187 INODELK 0.07 521.52 us 46.42 us 2875.68 us 60 OPEN 0.24 130.58 us 1.22 us 6306.57 us 829 OPENDIR 0.30 875.25 us 13.58 us 27456.34 us 158 READDIR 0.50 550.91 us 11.32 us 27402.91 us 414 GETXATTR 0.88 79.87 us 16.73 us 4854.01 us 5021 WRITE 1.25 97.65 us 14.65 us 10098.50 us 5876 FINODELK 2.80 221.04 us 15.10 us 13285.77 us 5788 LOOKUP 5.82 453.22 us 85.99 us 214925.73 us 5876 FXATTROP 88.07 13679.59 us 177.53 us 343112.67 us 2945 FSYNC Duration: 217306 seconds Data Read: 0 bytes Data Written: 2198418 bytes Interval 4 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 1479 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 RELEASE 0.00 0.00 us 0.00 us 0.00 us 142 RELEASEDIR 0.00 85.12 us 68.99 us 101.24 us 2 OPEN 0.00 32.92 us 19.82 us 42.09 us 6 INODELK 0.01 93.18 us 66.96 us 172.72 us 7 FSTAT 0.01 229.64 us 199.98 us 270.98 us 6 READDIR 0.05 111.05 us 15.58 us 1714.25 us 51 GETXATTR 0.18 145.40 us 1.97 us 5950.85 us 142 OPENDIR 1.03 78.36 us 16.77 us 3255.89 us 1479 WRITE 1.12 88.85 us 14.83 us 6246.21 us 1417 FINODELK 2.16 218.71 us 27.40 us 4974.83 us 1108 LOOKUP 2.72 215.35 us 93.97 us 6500.48 us 1417 FXATTROP 92.70 14297.42 us 200.95 us 343112.67 us 727 FSYNC Duration: 206 seconds Data Read: 0 bytes Data Written: 1479 bytes Brick: 10.32.9.4:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 25 79 15 No. of Writes: 20 5780 299170 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 28 159932 367657 No. of Writes: 31347 729634 597568 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 10162 1991 74531 No. of Writes: 194763 65156 74670 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 992328 2020 3 No. of Writes: 84932 100608 14770 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 4874 FORGET 0.00 0.00 us 0.00 us 0.00 us 6116385 RELEASE 0.00 0.00 us 0.00 us 0.00 us 227745 RELEASEDIR 0.00 108.92 us 72.33 us 157.93 us 12 FSTAT 0.00 64.06 us 38.53 us 129.19 us 60 OPEN 0.01 44.39 us 15.40 us 1015.84 us 187 INODELK 0.02 64.02 us 9.62 us 443.58 us 342 GETXATTR 0.02 191.51 us 11.80 us 1170.03 us 116 READDIR 0.03 43.53 us 14.23 us 411.97 us 841 STAT 0.04 62.62 us 1.15 us 1998.92 us 808 OPENDIR 0.08 55.27 us 17.45 us 3392.47 us 1908 STATFS 0.11 199.39 us 116.58 us 1642.73 us 729 READDIRP 0.24 52.03 us 11.73 us 3161.79 us 5876 FINODELK 0.43 110.51 us 30.41 us 4137.40 us 5021 WRITE 0.67 148.53 us 12.93 us 5151.72 us 5765 LOOKUP 0.73 158.90 us 76.53 us 10183.56 us 5876 FXATTROP 6.57 1348.30 us 23.30 us 271231.54 us 6222 READ 91.05 39496.80 us 299.08 us 482265.88 us 2945 FSYNC Duration: 218405 seconds Data Read: 139899900606 bytes Data Written: 85201599836 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 4096b+ No. of Reads: 0 0 15 No. of Writes: 10 12 500 Block Size: 8192b+ 16384b+ 32768b+ No. of Reads: 264 0 0 No. of Writes: 280 132 97 Block Size: 65536b+ 131072b+ 262144b+ No. of Reads: 101 0 0 No. of Writes: 142 288 16 Block Size: 524288b+ No. of Reads: 0 No. of Writes: 2 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 2 RELEASE 0.00 0.00 us 0.00 us 0.00 us 142 RELEASEDIR 0.00 85.09 us 65.36 us 104.82 us 2 OPEN 0.00 43.11 us 25.29 us 54.39 us 6 INODELK 0.00 98.57 us 73.39 us 157.12 us 7 FSTAT 0.00 211.50 us 118.04 us 455.35 us 6 READDIR 0.01 57.67 us 12.28 us 105.56 us 51 GETXATTR 0.02 41.74 us 16.35 us 97.37 us 175 STAT 0.03 61.45 us 1.28 us 889.87 us 142 OPENDIR 0.06 53.16 us 20.15 us 1346.88 us 367 STATFS 0.09 202.60 us 126.81 us 1594.26 us 138 READDIRP 0.28 59.18 us 11.73 us 3161.79 us 1417 FINODELK 0.52 106.99 us 33.90 us 1034.33 us 1479 WRITE 0.54 149.05 us 23.08 us 3096.22 us 1108 LOOKUP 0.76 163.75 us 79.75 us 6095.18 us 1417 FXATTROP 4.03 3217.50 us 42.84 us 36760.67 us 380 READ 93.64 39122.32 us 299.08 us 285276.19 us 727 FSYNC Duration: 206 seconds Data Read: 8843264 bytes Data Written: 79627264 bytes Brick: 10.32.9.20:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 12335790 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 22 FORGET 0.00 0.00 us 0.00 us 0.00 us 54314 RELEASE 0.00 0.00 us 0.00 us 0.00 us 224618 RELEASEDIR 0.06 112.30 us 46.61 us 545.60 us 149 OPEN 0.10 57.95 us 9.24 us 387.23 us 484 GETXATTR 0.13 42.67 us 1.39 us 198.21 us 859 OPENDIR 0.16 72.06 us 15.44 us 1155.49 us 630 INODELK 0.18 226.44 us 15.87 us 1255.79 us 220 READDIR 6.62 42.21 us 15.62 us 70469.86 us 43631 WRITE 8.70 26.06 us 10.74 us 5048.18 us 92806 FINODELK 12.14 537.55 us 14.73 us 177302.65 us 6278 LOOKUP 33.45 203.23 us 33.98 us 253046.65 us 45774 FSYNC 38.45 115.50 us 63.09 us 5012.42 us 92583 FXATTROP Duration: 223094 seconds Data Read: 0 bytes Data Written: 12335790 bytes Interval 4 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 5675 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 75 RELEASE 0.00 0.00 us 0.00 us 0.00 us 178 RELEASEDIR 0.15 38.53 us 1.51 us 198.21 us 178 OPENDIR 0.24 146.96 us 46.61 us 545.60 us 75 OPEN 0.26 69.93 us 12.17 us 387.23 us 168 GETXATTR 0.40 233.61 us 143.34 us 769.90 us 78 READDIR 0.75 107.87 us 16.70 us 656.52 us 319 INODELK 4.76 38.37 us 15.76 us 1057.49 us 5675 WRITE 7.53 27.85 us 12.15 us 5048.18 us 12365 FINODELK 15.54 524.94 us 15.44 us 88901.93 us 1353 LOOKUP 31.61 117.24 us 72.63 us 4070.15 us 12324 FXATTROP 38.75 291.54 us 42.49 us 239370.18 us 6074 FSYNC Duration: 206 seconds Data Read: 0 bytes Data Written: 5675 bytes Brick: 10.32.9.20:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 22 22822 676 No. of Writes: 0 5529 1773688 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 271 324954 461246 No. of Writes: 153604 3341821 2170265 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 27584 3553 157458 No. of Writes: 1152682 651840 735734 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 2098 4326 14 No. of Writes: 771192 940386 34117 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 208357 RELEASE 0.00 0.00 us 0.00 us 0.00 us 224539 RELEASEDIR 0.00 29.53 us 24.51 us 34.55 us 2 ENTRYLK 0.00 29.99 us 21.22 us 48.20 us 25 INODELK 0.01 31.38 us 15.41 us 4179.83 us 832 FLUSH 0.01 34853.80 us 34853.80 us 34853.80 us 1 MKNOD 0.01 141.86 us 10.95 us 1554.09 us 269 GETXATTR 0.02 73.34 us 51.75 us 2055.27 us 838 OPEN 0.02 36.75 us 18.46 us 142.61 us 1910 STATFS 0.03 743.84 us 15.29 us 1748.89 us 116 READDIR 0.03 38.36 us 16.19 us 212.34 us 2520 FSTAT 0.05 216.46 us 153.85 us 2309.86 us 690 READDIRP 0.06 231.18 us 14.78 us 84703.10 us 841 STAT 0.60 34.02 us 11.66 us 289255.11 us 53806 FINODELK 0.79 2952.61 us 1.30 us 1174503.58 us 808 OPENDIR 1.48 104.72 us 31.13 us 10966.39 us 43009 WRITE 2.18 122.86 us 63.21 us 89844.70 us 53805 FXATTROP 2.39 1054.84 us 16.27 us 1352631.28 us 6878 LOOKUP 37.52 4077.58 us 15.89 us 3415833.75 us 27929 READ 54.79 6181.75 us 38.93 us 3558711.29 us 26902 FSYNC Duration: 223094 seconds Data Read: 18510193935 bytes Data Written: 692323895296 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 21 0 0 No. of Writes: 17 123 48 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 74 604 1 No. of Writes: 3858 1226 1038 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 660 0 No. of Writes: 617 657 1052 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 433 26 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 164 RELEASE 0.00 0.00 us 0.00 us 0.00 us 139 RELEASEDIR 0.01 57.77 us 38.47 us 80.92 us 35 GETXATTR 0.01 29.37 us 17.28 us 739.17 us 164 FLUSH 0.01 31.40 us 16.45 us 69.88 us 175 STAT 0.02 59.49 us 29.75 us 1951.11 us 139 OPENDIR 0.03 72.63 us 54.98 us 421.89 us 164 OPEN 0.04 38.44 us 24.78 us 125.88 us 367 STATFS 0.05 38.61 us 17.16 us 212.34 us 504 FSTAT 0.07 198.66 us 165.38 us 353.63 us 129 READDIRP 0.61 175.08 us 61.45 us 10665.69 us 1300 LOOKUP 0.85 28.96 us 12.39 us 3778.31 us 10989 FINODELK 2.46 100.91 us 31.13 us 3093.40 us 9095 WRITE 3.63 123.47 us 76.95 us 4074.46 us 10989 FXATTROP 45.22 3072.65 us 45.83 us 1965060.39 us 5501 FSYNC 46.99 12915.23 us 34.26 us 2336077.31 us 1360 READ Duration: 206 seconds Data Read: 48541587 bytes Data Written: 481960448 bytes Brick: 10.32.9.7:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 40 511 34 No. of Writes: 0 9544 1162843 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 59 431351 644479 No. of Writes: 125436 3141260 1522929 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 28676 10720 173922 No. of Writes: 803834 313050 387188 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 3311 5928 12 No. of Writes: 398678 405638 28319 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 38 FORGET 0.00 0.00 us 0.00 us 0.00 us 31984 RELEASE 0.00 0.00 us 0.00 us 0.00 us 222575 RELEASEDIR 0.00 19.71 us 14.96 us 25.75 us 26 FLUSH 0.00 79.77 us 67.54 us 109.07 us 29 REMOVEXATTR 0.00 82.82 us 69.53 us 107.74 us 29 SETATTR 0.01 64.97 us 8.22 us 551.06 us 357 GETXATTR 0.01 39.21 us 1.12 us 352.86 us 848 OPENDIR 0.02 302.90 us 17.55 us 1109.58 us 195 READDIR 0.03 38.11 us 20.12 us 9187.69 us 1910 STATFS 0.03 637.27 us 26.32 us 2688.05 us 117 READDIRP 0.04 41.72 us 26.21 us 333.45 us 2657 FSTAT 0.05 447.25 us 37.11 us 118853.72 us 316 OPEN 1.30 23.52 us 10.67 us 2942.35 us 144377 FINODELK 1.42 579.91 us 15.05 us 109587.03 us 6400 LOOKUP 3.57 201.73 us 29.10 us 1736756.84 us 46403 WRITE 5.91 107.35 us 55.25 us 73854.38 us 144295 FXATTROP 12.51 44914.12 us 12.80 us 1791555.28 us 730 INODELK 19.09 694.56 us 35.16 us 2757013.41 us 72061 FSYNC 56.01 2511.03 us 17.92 us 4430587.67 us 58463 READ Duration: 223094 seconds Data Read: 22707896368 bytes Data Written: 330308412416 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 31 3117 546 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 11765 988 0 No. of Writes: 3623 985 490 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 368 0 No. of Writes: 222 516 528 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 176 15 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 93 RELEASE 0.00 0.00 us 0.00 us 0.00 us 184 RELEASEDIR 0.00 18.43 us 17.68 us 19.15 us 3 FLUSH 0.00 73.29 us 71.21 us 76.81 us 3 REMOVEXATTR 0.00 82.01 us 77.54 us 89.56 us 3 SETATTR 0.01 31.83 us 1.20 us 66.95 us 184 OPENDIR 0.01 71.67 us 41.10 us 223.85 us 93 OPEN 0.01 72.13 us 9.32 us 426.45 us 121 GETXATTR 0.02 458.79 us 34.97 us 2466.41 us 22 READDIRP 0.02 32.98 us 20.88 us 57.69 us 367 STATFS 0.04 41.85 us 26.89 us 110.66 us 529 FSTAT 0.05 323.18 us 142.79 us 832.07 us 91 READDIR 0.40 176.60 us 15.05 us 32846.09 us 1319 LOOKUP 1.19 23.16 us 12.30 us 253.92 us 30313 FINODELK 1.69 96.86 us 30.47 us 33333.10 us 10249 WRITE 5.45 105.63 us 56.83 us 5303.22 us 30294 FXATTROP 22.33 866.54 us 36.27 us 1848517.17 us 15142 FSYNC 26.96 64938.50 us 15.25 us 1791555.28 us 244 INODELK 41.82 1872.96 us 22.02 us 3050665.82 us 13121 READ Duration: 206 seconds Data Read: 80400384 bytes Data Written: 256965120 bytes Brick: 10.32.9.8:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 36 179447 1575 No. of Writes: 0 5529 1773688 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 135 696823 1280705 No. of Writes: 153604 3341821 2170265 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 39715 6779 410036 No. of Writes: 1152682 651840 735734 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 3698 9015 7 No. of Writes: 771192 940386 34117 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 208357 RELEASE 0.00 0.00 us 0.00 us 0.00 us 239096 RELEASEDIR 0.00 22.54 us 20.68 us 24.41 us 2 ENTRYLK 0.00 93.22 us 93.22 us 93.22 us 1 STAT 0.02 14197.50 us 14197.50 us 14197.50 us 1 MKNOD 0.03 24.77 us 15.81 us 231.82 us 832 FLUSH 0.05 39.40 us 1.13 us 130.46 us 848 OPENDIR 0.09 72.46 us 50.87 us 237.68 us 838 OPEN 0.10 1096.09 us 201.07 us 3459.37 us 60 READDIRP 0.12 41.03 us 22.29 us 5137.03 us 1910 STATFS 0.14 284.24 us 11.50 us 4141.36 us 323 GETXATTR 0.16 37.26 us 16.39 us 232.89 us 2940 FSTAT 0.44 1510.28 us 17.12 us 4082.20 us 194 READDIR 2.34 29.01 us 11.27 us 48148.33 us 53817 FINODELK 3.61 96150.50 us 22.29 us 1469404.38 us 25 INODELK 4.35 419.30 us 14.68 us 100058.90 us 6920 LOOKUP 7.06 109.39 us 31.73 us 27186.36 us 43025 WRITE 10.48 129.83 us 64.88 us 16928.34 us 53816 FXATTROP 12.42 307.86 us 36.39 us 206033.44 us 26906 FSYNC 58.59 515.75 us 16.43 us 319097.03 us 75743 READ Duration: 223094 seconds Data Read: 46205935749 bytes Data Written: 692323895296 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 164 0 0 No. of Writes: 17 123 48 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 5819 1689 1 No. of Writes: 3858 1226 1038 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 576 0 No. of Writes: 617 657 1052 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 433 26 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 164 RELEASE 0.00 0.00 us 0.00 us 0.00 us 139 RELEASEDIR 0.00 93.22 us 93.22 us 93.22 us 1 STAT 0.02 54.35 us 38.34 us 93.78 us 35 GETXATTR 0.04 26.47 us 17.73 us 231.82 us 164 FLUSH 0.05 43.54 us 31.71 us 84.54 us 139 OPENDIR 0.07 789.26 us 208.57 us 2125.16 us 10 READDIRP 0.11 73.95 us 52.19 us 237.68 us 164 OPEN 0.13 39.40 us 25.13 us 383.40 us 367 STATFS 0.20 37.91 us 16.95 us 232.89 us 588 FSTAT 2.69 232.14 us 72.97 us 87136.76 us 1300 LOOKUP 3.17 32.42 us 12.38 us 48148.33 us 10989 FINODELK 8.40 103.82 us 32.51 us 1753.23 us 9095 WRITE 12.81 130.97 us 78.14 us 2144.52 us 10989 FXATTROP 14.61 298.47 us 43.87 us 106182.90 us 5500 FSYNC 57.70 785.98 us 28.74 us 212348.46 us 8249 READ Duration: 206 seconds Data Read: 75563132 bytes Data Written: 481960448 bytes Brick: 10.32.9.8:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 8298719 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 38 FORGET 0.00 0.00 us 0.00 us 0.00 us 31985 RELEASE 0.00 0.00 us 0.00 us 0.00 us 239341 RELEASEDIR 0.00 23.06 us 17.16 us 29.19 us 26 FLUSH 0.01 86.42 us 68.85 us 108.72 us 29 REMOVEXATTR 0.01 91.36 us 77.48 us 105.01 us 29 SETATTR 0.10 42.19 us 1.04 us 179.09 us 938 OPENDIR 0.75 417.61 us 13.69 us 6993.25 us 729 INODELK 0.80 1029.52 us 45.62 us 6979.55 us 316 OPEN 1.00 592.66 us 10.46 us 6030.75 us 685 GETXATTR 1.59 1720.66 us 18.97 us 6724.20 us 374 READDIR 4.36 38.01 us 14.83 us 29966.31 us 46403 WRITE 9.47 26.56 us 11.52 us 31334.92 us 144377 FINODELK 11.74 732.25 us 10.87 us 134098.26 us 6490 LOOKUP 27.88 156.64 us 36.32 us 153141.90 us 72062 FSYNC 42.30 118.68 us 57.67 us 37098.87 us 144296 FXATTROP Duration: 223094 seconds Data Read: 0 bytes Data Written: 8298719 bytes Interval 4 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 10249 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 93 RELEASE 0.00 0.00 us 0.00 us 0.00 us 229 RELEASEDIR 0.00 22.45 us 19.53 us 26.81 us 3 FLUSH 0.00 85.45 us 68.85 us 99.28 us 3 REMOVEXATTR 0.00 97.36 us 92.57 us 103.58 us 3 SETATTR 0.09 31.63 us 1.04 us 93.68 us 229 OPENDIR 0.29 256.28 us 47.84 us 1544.93 us 93 OPEN 0.41 138.98 us 15.62 us 2597.42 us 241 INODELK 1.67 649.05 us 10.46 us 5389.02 us 212 GETXATTR 4.37 263.43 us 14.22 us 40030.50 us 1364 LOOKUP 4.81 2197.27 us 145.93 us 6724.20 us 180 READDIR 4.82 38.65 us 15.16 us 3340.57 us 10249 WRITE 9.81 26.59 us 11.52 us 3781.07 us 30313 FINODELK 30.25 164.12 us 39.17 us 110913.01 us 15143 FSYNC 43.46 117.86 us 59.40 us 4813.66 us 30295 FXATTROP Duration: 206 seconds Data Read: 0 bytes Data Written: 10249 bytes Brick: 10.32.9.3:/data/gfs/bricks/brick3/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 10 279 0 No. of Writes: 0 9544 1162843 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 0 229769 304242 No. of Writes: 125436 3141260 1522929 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 10248 271 293474 No. of Writes: 803834 313050 387188 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 418 663 4 No. of Writes: 398678 405638 28319 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 1 FORGET 0.00 0.00 us 0.00 us 0.00 us 31985 RELEASE 0.00 0.00 us 0.00 us 0.00 us 234839 RELEASEDIR 0.00 54.23 us 23.41 us 101.36 us 26 FLUSH 0.00 163.21 us 111.02 us 236.26 us 29 SETATTR 0.00 164.92 us 103.62 us 260.77 us 29 REMOVEXATTR 0.04 70.19 us 26.43 us 1370.08 us 841 STAT 0.06 81.68 us 1.47 us 1443.59 us 914 OPENDIR 0.09 278.38 us 11.76 us 2642.00 us 419 GETXATTR 0.12 491.13 us 52.86 us 2922.65 us 316 OPEN 0.12 82.93 us 30.57 us 2659.17 us 1910 STATFS 0.14 104.70 us 47.77 us 359.10 us 1820 FSTAT 0.21 298.43 us 49.82 us 3132.58 us 914 READDIRP 0.24 437.05 us 23.94 us 3035.74 us 731 INODELK 0.29 1167.91 us 66.63 us 2866.15 us 330 READDIR 2.87 584.06 us 25.12 us 87943.26 us 6466 LOOKUP 6.02 170.94 us 46.87 us 242977.99 us 46393 WRITE 6.57 59.89 us 15.59 us 39769.17 us 144375 FINODELK 21.30 194.39 us 74.58 us 29241.17 us 144294 FXATTROP 22.79 416.42 us 45.02 us 688846.30 us 72062 FSYNC 39.13 2947.31 us 26.16 us 714894.79 us 17481 READ Duration: 223094 seconds Data Read: 23183427212 bytes Data Written: 330308412416 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 31 3117 546 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 7269 522 0 No. of Writes: 3623 985 490 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 613 0 No. of Writes: 222 516 528 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 176 15 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 93 RELEASE 0.00 0.00 us 0.00 us 0.00 us 217 RELEASEDIR 0.00 51.60 us 35.95 us 70.81 us 3 FLUSH 0.00 139.98 us 111.02 us 161.70 us 3 SETATTR 0.00 197.01 us 163.53 us 252.72 us 3 REMOVEXATTR 0.04 67.96 us 26.97 us 175.29 us 175 STAT 0.05 61.29 us 1.47 us 702.15 us 217 OPENDIR 0.11 334.24 us 73.57 us 1600.23 us 93 OPEN 0.12 84.81 us 30.57 us 378.49 us 367 STATFS 0.13 98.53 us 47.77 us 276.10 us 364 FSTAT 0.15 161.62 us 25.44 us 2186.79 us 244 INODELK 0.18 345.37 us 11.76 us 2642.00 us 143 GETXATTR 0.18 298.92 us 100.00 us 1177.33 us 166 READDIRP 0.70 1217.47 us 180.35 us 2866.15 us 156 READDIR 1.59 318.31 us 26.84 us 87943.26 us 1352 LOOKUP 6.23 164.44 us 50.03 us 69340.39 us 10249 WRITE 6.26 55.81 us 17.16 us 2534.56 us 30313 FINODELK 20.99 187.33 us 74.58 us 7378.33 us 30295 FXATTROP 23.97 427.99 us 56.59 us 688846.30 us 15143 FSYNC 39.29 1264.15 us 50.98 us 530622.28 us 8404 READ Duration: 206 seconds Data Read: 74223616 bytes Data Written: 256965120 bytes Brick: 10.32.9.21:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 8229198 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 151823 RELEASE 0.00 0.00 us 0.00 us 0.00 us 140439 RELEASEDIR 0.00 32.02 us 26.16 us 37.89 us 2 ENTRYLK 0.00 35.43 us 14.27 us 102.02 us 25 INODELK 0.12 23431.80 us 23431.80 us 23431.80 us 1 MKNOD 0.13 29.01 us 16.03 us 2672.31 us 832 FLUSH 0.16 96.60 us 6.39 us 1162.48 us 309 GETXATTR 0.20 45.75 us 1.09 us 3049.41 us 836 OPENDIR 0.32 73.80 us 52.65 us 822.23 us 838 OPEN 0.42 476.51 us 14.96 us 1307.44 us 170 READDIR 7.73 27.59 us 11.37 us 4160.45 us 53817 FINODELK 9.45 42.22 us 15.84 us 16803.65 us 43025 WRITE 10.94 304.26 us 16.72 us 26781.53 us 6908 LOOKUP 34.16 121.98 us 64.61 us 46772.07 us 53816 FXATTROP 36.37 259.80 us 33.74 us 227164.48 us 26906 FSYNC Duration: 163386 seconds Data Read: 0 bytes Data Written: 8229198 bytes Interval 4 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 9095 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 164 RELEASE 0.00 0.00 us 0.00 us 0.00 us 139 RELEASEDIR 0.05 61.66 us 41.09 us 110.63 us 35 GETXATTR 0.11 26.25 us 18.34 us 87.50 us 164 FLUSH 0.15 45.27 us 28.66 us 100.77 us 139 OPENDIR 0.30 74.31 us 55.30 us 135.42 us 164 OPEN 5.83 182.33 us 75.19 us 15804.25 us 1300 LOOKUP 7.74 28.62 us 12.12 us 3004.19 us 10989 FINODELK 8.42 37.62 us 16.04 us 2583.43 us 9095 WRITE 33.50 123.85 us 77.50 us 8703.20 us 10989 FXATTROP 43.89 324.22 us 37.15 us 86830.13 us 5500 FSYNC Duration: 206 seconds Data Read: 0 bytes Data Written: 9095 bytes Brick: 10.32.9.21:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 4 1161 5 No. of Writes: 14 83786 1541410 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 12 3956 331050 No. of Writes: 172359 2443102 1860060 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 3580 2790 979 No. of Writes: 940167 450045 395288 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 890 4657 9 No. of Writes: 426513 389617 21024 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 14 FORGET 0.00 0.00 us 0.00 us 0.00 us 37833 RELEASE 0.00 0.00 us 0.00 us 0.00 us 140447 RELEASEDIR 0.00 72.72 us 58.30 us 89.25 us 5 READ 0.06 59.82 us 11.00 us 795.96 us 397 GETXATTR 0.08 36.57 us 14.72 us 1754.14 us 841 STAT 0.08 208.58 us 43.60 us 5913.81 us 149 OPEN 0.11 48.39 us 1.24 us 2100.70 us 842 OPENDIR 0.12 262.80 us 15.90 us 966.60 us 183 READDIR 0.21 42.92 us 21.23 us 3994.76 us 1910 STATFS 0.33 200.45 us 15.15 us 100581.63 us 630 INODELK 0.38 209.82 us 146.07 us 2177.71 us 699 READDIRP 5.84 360.86 us 11.27 us 56019.20 us 6263 LOOKUP 6.33 26.38 us 11.62 us 40259.46 us 92815 FINODELK 13.29 117.79 us 32.52 us 230863.19 us 43634 WRITE 28.07 117.27 us 65.23 us 64714.66 us 92593 FXATTROP 45.10 381.12 us 38.43 us 483988.80 us 45779 FSYNC Duration: 163390 seconds Data Read: 5490474515 bytes Data Written: 337572468058 bytes Interval 4 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 110 14 2 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 0 0 0 No. of Writes: 1484 1040 667 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 0 0 No. of Writes: 312 949 644 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 431 22 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 75 RELEASE 0.00 0.00 us 0.00 us 0.00 us 139 RELEASEDIR 0.05 58.92 us 43.51 us 91.22 us 50 GETXATTR 0.09 31.54 us 15.27 us 62.78 us 175 STAT 0.14 62.99 us 29.24 us 2100.70 us 139 OPENDIR 0.23 39.73 us 24.05 us 394.27 us 367 STATFS 0.39 340.28 us 47.68 us 5913.81 us 75 OPEN 0.40 198.37 us 161.15 us 310.02 us 132 READDIRP 1.80 364.82 us 15.15 us 100581.63 us 319 INODELK 5.34 27.98 us 12.16 us 4003.43 us 12365 FINODELK 16.16 184.39 us 34.29 us 230863.19 us 5675 WRITE 16.46 811.01 us 79.80 us 16323.71 us 1314 LOOKUP 23.05 121.07 us 74.19 us 14994.32 us 12324 FXATTROP 35.90 382.67 us 38.43 us 221379.00 us 6074 FSYNC Duration: 206 seconds Data Read: 0 bytes Data Written: 399364608 bytes