Brick: 10.32.9.9:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 81 592 23 No. of Writes: 22 117571 2169916 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 74 1034487 2233962 No. of Writes: 235898 3456485 2870220 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 65251 6589 648138 No. of Writes: 1323254 660043 596178 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 918392 13798 77 No. of Writes: 509370 553745 37834 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 22 FORGET 0.00 0.00 us 0.00 us 0.00 us 55091 RELEASE 0.00 0.00 us 0.00 us 0.00 us 231672 RELEASEDIR 0.00 54.11 us 8.36 us 329.70 us 1132 GETXATTR 0.01 230.83 us 16.77 us 1009.51 us 609 READDIR 0.01 854.69 us 145.86 us 2982.28 us 198 READDIRP 0.01 522.77 us 40.90 us 157629.81 us 361 OPEN 0.02 43.61 us 21.69 us 21749.20 us 4694 STATFS 0.02 141.57 us 1.32 us 153722.09 us 2134 OPENDIR 0.04 43.56 us 15.66 us 5019.97 us 10643 FSTAT 2.15 174.90 us 66.94 us 535224.04 us 155033 FXATTROP 2.31 1977.48 us 13.12 us 328127.45 us 14719 LOOKUP 2.60 411.62 us 31.96 us 614074.06 us 79651 WRITE 4.94 823.21 us 39.11 us 1098916.55 us 75776 FSYNC 14.72 123154.27 us 11.84 us 1960047.15 us 1509 INODELK 22.97 1866.64 us 11.24 us 1972584.83 us 155392 FINODELK 50.20 2716.82 us 18.12 us 1484214.51 us 233289 READ Duration: 228966 seconds Data Read: 193542274511 bytes Data Written: 475540432562 bytes Interval 7 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 92 10 3 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 8701 6102 12 No. of Writes: 2635 1122 508 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 3444 672 No. of Writes: 207 333 474 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 693 17 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 53 RELEASE 0.00 0.00 us 0.00 us 0.00 us 189 RELEASEDIR 0.00 83.47 us 51.46 us 188.75 us 53 OPEN 0.01 34.08 us 1.32 us 81.25 us 189 OPENDIR 0.01 52.69 us 11.21 us 283.74 us 159 GETXATTR 0.01 38.55 us 23.07 us 228.28 us 352 STATFS 0.01 815.47 us 168.93 us 2384.07 us 19 READDIRP 0.02 225.10 us 18.55 us 800.34 us 118 READDIR 0.03 42.23 us 18.67 us 104.33 us 812 FSTAT 0.81 706.95 us 13.12 us 55898.69 us 1232 LOOKUP 2.04 358.38 us 31.96 us 294188.50 us 6094 WRITE 2.15 181.59 us 71.12 us 204919.83 us 12720 FXATTROP 5.00 864.63 us 47.64 us 629092.38 us 6194 FSYNC 17.66 1485.51 us 11.92 us 1921947.90 us 12742 FINODELK 34.03 147677.35 us 15.76 us 1768762.60 us 247 INODELK 38.22 2164.18 us 19.71 us 723022.46 us 18931 READ Duration: 190 seconds Data Read: 399626240 bytes Data Written: 434216960 bytes Brick: 10.32.9.5:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 0 46 1 No. of Writes: 3 391 1068 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 932 124657 17583 No. of Writes: 136 12683 11906 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 1590 213 5317 No. of Writes: 4055 1293 1596 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 815 241 68 No. of Writes: 150200 1902 319 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 979 FORGET 0.00 0.00 us 0.00 us 0.00 us 38661 RELEASE 0.00 0.00 us 0.00 us 0.00 us 9096 RELEASEDIR 0.00 70.94 us 25.24 us 297.89 us 116 OPEN 0.01 58.03 us 18.50 us 4009.60 us 1037 FSTAT 0.01 682.74 us 116.45 us 1860.85 us 122 READDIRP 0.01 44.53 us 0.58 us 1843.72 us 2206 OPENDIR 0.01 116.92 us 4.65 us 8029.52 us 1154 GETXATTR 0.02 44.45 us 11.91 us 1203.70 us 4668 STATFS 0.05 41.54 us 6.77 us 4498.69 us 12027 FINODELK 0.06 830.69 us 10.75 us 27551.90 us 746 READDIR 0.07 77.44 us 16.20 us 5130.33 us 9390 WRITE 0.16 118.97 us 8.20 us 23026.26 us 13731 LOOKUP 0.49 408.51 us 45.40 us 823697.54 us 12027 FXATTROP 1.90 49208.65 us 9.47 us 1064586.48 us 385 INODELK 10.18 1402.67 us 8.24 us 736472.73 us 72206 READ 87.02 146759.76 us 256.65 us 1571791.21 us 5901 FSYNC Duration: 10237 seconds Data Read: 1301960192 bytes Data Written: 21140207880 bytes Interval 7 Stats: Block Size: 1024b+ 4096b+ 8192b+ No. of Reads: 0 12612 590 No. of Writes: 7 144 243 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 3 0 254 No. of Writes: 120 18 45 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 0 0 0 No. of Writes: 89 93 1 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 8 RELEASE 0.00 0.00 us 0.00 us 0.00 us 150 RELEASEDIR 0.00 100.33 us 41.57 us 175.73 us 8 OPEN 0.01 54.35 us 19.05 us 88.84 us 79 FSTAT 0.01 64.39 us 6.66 us 367.82 us 83 GETXATTR 0.01 43.21 us 0.65 us 120.27 us 150 OPENDIR 0.01 692.23 us 124.88 us 1310.30 us 13 READDIRP 0.02 313.05 us 39.88 us 657.82 us 40 READDIR 0.02 42.04 us 11.91 us 78.78 us 352 STATFS 0.05 45.27 us 10.88 us 4498.69 us 849 FINODELK 0.08 79.87 us 17.47 us 220.10 us 760 WRITE 0.12 108.43 us 47.40 us 1767.08 us 849 FXATTROP 0.15 110.07 us 10.26 us 1504.18 us 1066 LOOKUP 2.90 86057.38 us 13.63 us 690581.53 us 26 INODELK 17.78 1018.38 us 17.85 us 702511.68 us 13459 READ 78.85 147909.88 us 7860.29 us 773434.92 us 411 FSYNC Duration: 190 seconds Data Read: 73187328 bytes Data Written: 60779520 bytes Brick: 10.32.9.4:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 25 79 15 No. of Writes: 20 5972 299844 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 28 216143 388485 No. of Writes: 31439 736487 604916 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 11069 2123 77588 No. of Writes: 196882 65605 75133 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 992423 2082 14 No. of Writes: 85463 101039 14829 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 4874 FORGET 0.00 0.00 us 0.00 us 0.00 us 6116721 RELEASE 0.00 0.00 us 0.00 us 0.00 us 232471 RELEASEDIR 0.00 110.85 us 72.33 us 165.66 us 17 FSTAT 0.00 70.92 us 38.53 us 318.05 us 126 OPEN 0.01 44.91 us 15.40 us 1015.84 us 423 INODELK 0.02 65.37 us 8.71 us 731.08 us 867 GETXATTR 0.02 189.99 us 11.80 us 1170.03 us 332 READDIR 0.04 46.26 us 14.16 us 2026.78 us 2332 STAT 0.04 59.04 us 1.06 us 1998.92 us 2000 OPENDIR 0.10 55.34 us 17.45 us 3392.47 us 4690 STATFS 0.14 207.12 us 114.84 us 1676.61 us 1778 READDIRP 0.23 52.09 us 11.73 us 6602.88 us 12062 FINODELK 0.37 105.46 us 27.17 us 10066.54 us 9413 WRITE 0.73 144.97 us 11.71 us 5151.72 us 13567 LOOKUP 0.73 164.20 us 75.27 us 21259.97 us 12062 FXATTROP 13.95 1400.48 us 16.18 us 271231.54 us 26904 READ 83.61 38141.05 us 193.79 us 482265.88 us 5919 FSYNC Duration: 224277 seconds Data Read: 140568580798 bytes Data Written: 85679316316 bytes Interval 7 Stats: Block Size: 1024b+ 4096b+ 8192b+ No. of Reads: 0 2390 1041 No. of Writes: 7 144 243 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 9 0 158 No. of Writes: 120 18 45 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 0 0 0 No. of Writes: 89 93 1 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 8 RELEASE 0.00 0.00 us 0.00 us 0.00 us 132 RELEASEDIR 0.00 74.81 us 74.81 us 74.81 us 1 FSTAT 0.00 25.98 us 13.95 us 31.73 us 4 READDIR 0.00 71.29 us 40.65 us 200.17 us 8 OPEN 0.01 46.86 us 15.82 us 153.09 us 26 INODELK 0.02 64.42 us 12.22 us 100.65 us 51 GETXATTR 0.04 57.38 us 1.60 us 241.13 us 132 OPENDIR 0.05 46.60 us 16.42 us 118.19 us 195 STAT 0.11 56.36 us 22.09 us 1000.84 us 352 STATFS 0.13 196.56 us 116.64 us 349.56 us 123 READDIRP 0.23 50.07 us 13.85 us 446.49 us 849 FINODELK 0.51 125.52 us 32.22 us 10066.54 us 760 WRITE 0.69 150.22 us 79.89 us 411.93 us 849 FXATTROP 0.80 141.93 us 32.30 us 542.51 us 1048 LOOKUP 20.99 1084.81 us 16.18 us 159076.79 us 3598 READ 76.43 34505.72 us 5968.10 us 281112.42 us 412 FSYNC Duration: 190 seconds Data Read: 28827648 bytes Data Written: 60779520 bytes Brick: 10.32.9.6:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 2217629 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 4894 FORGET 0.00 0.00 us 0.00 us 0.00 us 6116721 RELEASE 0.00 0.00 us 0.00 us 0.00 us 240266 RELEASEDIR 0.00 170.58 us 66.96 us 1096.33 us 17 FSTAT 0.05 373.76 us 41.21 us 5929.08 us 120 OPEN 0.05 123.82 us 16.76 us 5883.16 us 405 INODELK 0.25 114.04 us 1.08 us 6306.57 us 2064 OPENDIR 0.30 624.12 us 12.73 us 27456.34 us 458 READDIR 0.33 314.80 us 9.49 us 27402.91 us 999 GETXATTR 0.86 86.38 us 16.73 us 9583.52 us 9407 WRITE 1.24 96.57 us 13.95 us 10098.50 us 12048 FINODELK 3.18 219.34 us 12.67 us 13285.77 us 13626 LOOKUP 4.34 338.71 us 79.87 us 214925.73 us 12048 FXATTROP 89.38 14207.72 us 163.65 us 455654.58 us 5913 FSYNC Duration: 223178 seconds Data Read: 0 bytes Data Written: 2217629 bytes Interval 7 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 760 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 8 RELEASE 0.00 0.00 us 0.00 us 0.00 us 132 RELEASEDIR 0.00 22.75 us 13.50 us 33.36 us 4 READDIR 0.00 123.51 us 123.51 us 123.51 us 1 FSTAT 0.01 105.32 us 63.80 us 165.26 us 8 OPEN 0.02 52.49 us 19.09 us 209.36 us 26 INODELK 0.13 195.47 us 13.08 us 5295.54 us 51 GETXATTR 0.20 120.49 us 1.61 us 3644.09 us 132 OPENDIR 0.70 72.23 us 20.82 us 2999.01 us 760 WRITE 1.17 107.66 us 16.94 us 6995.62 us 849 FINODELK 2.38 218.90 us 84.52 us 4930.04 us 849 FXATTROP 2.58 192.31 us 18.84 us 3617.35 us 1048 LOOKUP 92.80 17540.17 us 187.84 us 455654.58 us 413 FSYNC Duration: 190 seconds Data Read: 0 bytes Data Written: 760 bytes Brick: 10.32.9.7:/data/gfs/bricks/brick1/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 40 511 34 No. of Writes: 0 10193 1182536 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 59 599487 676745 No. of Writes: 127548 3204930 1556027 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 33827 11040 184913 No. of Writes: 812230 318033 394074 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 3576 6117 12 No. of Writes: 406882 412639 28818 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 38 FORGET 0.00 0.00 us 0.00 us 0.00 us 32624 RELEASE 0.00 0.00 us 0.00 us 0.00 us 227232 RELEASEDIR 0.00 19.91 us 14.96 us 25.75 us 66 FLUSH 0.00 78.30 us 64.46 us 109.07 us 74 REMOVEXATTR 0.00 84.85 us 66.89 us 139.63 us 74 SETATTR 0.01 62.74 us 7.85 us 551.06 us 812 GETXATTR 0.02 40.32 us 1.12 us 352.86 us 2038 OPENDIR 0.03 316.67 us 14.67 us 1109.58 us 405 READDIR 0.03 348.04 us 37.11 us 118853.72 us 428 OPEN 0.03 36.17 us 20.12 us 9187.69 us 4694 STATFS 0.04 657.87 us 26.32 us 2688.05 us 282 READDIRP 0.05 41.65 us 26.04 us 333.45 us 6463 FSTAT 1.21 23.86 us 10.67 us 76296.18 us 256683 FINODELK 1.29 447.72 us 10.11 us 454695.37 us 14627 LOOKUP 2.53 160.45 us 29.10 us 1736756.84 us 79917 WRITE 5.47 108.08 us 50.39 us 77531.55 us 256566 FXATTROP 7.70 36299.32 us 12.80 us 2032526.59 us 1074 INODELK 26.44 1046.27 us 33.24 us 3238567.53 us 128013 FSYNC 55.14 2212.85 us 15.40 us 4709750.17 us 126212 READ Duration: 228966 seconds Data Read: 24587251760 bytes Data Written: 336286618112 bytes Interval 7 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 4 2540 417 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 2893 1359 0 No. of Writes: 2686 798 262 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 790 0 No. of Writes: 105 200 341 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 408 9 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 6 RELEASE 0.00 0.00 us 0.00 us 0.00 us 135 RELEASEDIR 0.00 19.59 us 18.12 us 20.88 us 6 FLUSH 0.00 72.37 us 58.97 us 95.00 us 6 OPEN 0.00 77.31 us 69.88 us 83.88 us 7 REMOVEXATTR 0.00 84.55 us 70.72 us 92.39 us 7 SETATTR 0.00 26.91 us 19.44 us 37.23 us 28 INODELK 0.01 122.64 us 14.67 us 350.82 us 10 READDIR 0.01 49.94 us 11.93 us 67.68 us 47 GETXATTR 0.02 41.96 us 1.21 us 79.02 us 135 OPENDIR 0.05 34.38 us 22.16 us 112.21 us 352 STATFS 0.06 888.97 us 27.27 us 2356.37 us 17 READDIRP 0.09 41.72 us 26.04 us 195.46 us 494 FSTAT 0.79 173.41 us 15.35 us 18077.46 us 1071 LOOKUP 2.22 22.19 us 11.86 us 162.94 us 23652 FINODELK 3.19 97.25 us 32.76 us 69028.26 us 7770 WRITE 10.40 104.06 us 57.76 us 17822.50 us 23645 FXATTROP 39.34 1845.90 us 18.75 us 890342.88 us 5042 READ 43.81 878.63 us 33.71 us 3238567.53 us 11795 FSYNC Duration: 190 seconds Data Read: 74756096 bytes Data Written: 275888640 bytes Brick: 10.32.9.8:/data0/gfs/bricks/brick1/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 36 184147 1575 No. of Writes: 0 5886 1786396 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 135 900766 1341027 No. of Writes: 154693 3372286 2198807 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 51583 7238 432880 No. of Writes: 1172137 661473 747713 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 3995 9267 7 No. of Writes: 788337 953337 34635 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 213539 RELEASE 0.00 0.00 us 0.00 us 0.00 us 244245 RELEASEDIR 0.00 22.54 us 20.68 us 24.41 us 2 ENTRYLK 0.00 92.69 us 78.09 us 116.60 us 13 STAT 0.01 14197.50 us 14197.50 us 14197.50 us 1 MKNOD 0.03 25.22 us 15.81 us 231.82 us 2044 FLUSH 0.05 41.61 us 1.12 us 2783.53 us 2120 OPENDIR 0.09 1116.32 us 196.49 us 3459.37 us 146 READDIRP 0.10 88.24 us 41.37 us 1724.00 us 2127 OPEN 0.13 50.32 us 22.29 us 43482.69 us 4694 STATFS 0.15 293.94 us 11.50 us 4141.36 us 927 GETXATTR 0.16 39.62 us 16.10 us 1967.53 us 7140 FSTAT 0.41 1291.61 us 13.62 us 5418.56 us 578 READDIR 1.46 29.16 us 11.27 us 48148.33 us 90329 FINODELK 3.68 405.35 us 14.68 us 100058.90 us 16380 LOOKUP 4.87 120.38 us 31.73 us 27186.36 us 72929 WRITE 6.61 131.97 us 64.88 us 28044.53 us 90328 FXATTROP 8.44 338.78 us 36.39 us 290160.49 us 44920 FSYNC 13.74 115242.22 us 16.89 us 1901682.48 us 215 INODELK 60.08 548.42 us 15.89 us 363897.70 us 197586 READ Duration: 228966 seconds Data Read: 49384772873 bytes Data Written: 703001672704 bytes Interval 7 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 154 0 0 No. of Writes: 3 387 60 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 7579 2845 3 No. of Writes: 876 826 1034 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 1342 0 No. of Writes: 648 589 446 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 569 15 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 154 RELEASE 0.00 0.00 us 0.00 us 0.00 us 132 RELEASEDIR 0.00 28.82 us 19.56 us 39.85 us 4 READDIR 0.00 86.79 us 82.51 us 91.07 us 2 STAT 0.02 52.56 us 14.93 us 90.78 us 43 GETXATTR 0.04 24.40 us 16.75 us 45.62 us 154 FLUSH 0.06 44.34 us 2.39 us 93.94 us 132 OPENDIR 0.12 71.41 us 52.52 us 105.25 us 154 OPEN 0.15 1536.38 us 212.69 us 2351.65 us 9 READDIRP 0.15 39.50 us 24.54 us 149.70 us 352 STATFS 0.22 37.74 us 16.97 us 264.49 us 546 FSTAT 2.48 28.34 us 13.79 us 3389.22 us 8150 FINODELK 3.27 248.74 us 21.80 us 25230.41 us 1221 LOOKUP 6.72 114.53 us 45.75 us 753.77 us 5453 WRITE 11.46 130.68 us 79.02 us 1471.76 us 8150 FXATTROP 12.02 275.26 us 45.53 us 29227.31 us 4058 FSYNC 63.29 493.49 us 17.62 us 208353.13 us 11923 READ Duration: 190 seconds Data Read: 142467638 bytes Data Written: 429134848 bytes Brick: 10.32.9.8:/data/gfs/bricks/bricka/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 8453910 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 38 FORGET 0.00 0.00 us 0.00 us 0.00 us 32625 RELEASE 0.00 0.00 us 0.00 us 0.00 us 244400 RELEASEDIR 0.00 23.73 us 17.16 us 31.02 us 66 FLUSH 0.01 88.93 us 68.85 us 121.91 us 74 REMOVEXATTR 0.01 95.23 us 77.48 us 136.73 us 74 SETATTR 0.12 46.36 us 1.04 us 275.93 us 2210 OPENDIR 0.39 301.73 us 13.69 us 6993.25 us 1073 INODELK 0.40 789.46 us 45.62 us 6979.55 us 428 OPEN 0.77 510.83 us 8.75 us 6030.75 us 1268 GETXATTR 1.46 1606.34 us 18.97 us 6724.20 us 763 READDIR 3.60 37.86 us 14.83 us 29966.31 us 79892 WRITE 8.19 26.78 us 11.35 us 31334.92 us 256631 FINODELK 8.88 503.49 us 10.87 us 168344.01 us 14797 LOOKUP 36.62 119.80 us 52.74 us 97676.34 us 256513 FXATTROP 39.54 259.26 us 36.32 us 422732.07 us 127988 FSYNC Duration: 228966 seconds Data Read: 0 bytes Data Written: 8453910 bytes Interval 7 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 7770 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 6 RELEASE 0.00 0.00 us 0.00 us 0.00 us 132 RELEASEDIR 0.00 27.89 us 19.84 us 36.61 us 4 READDIR 0.00 22.72 us 17.68 us 28.15 us 6 FLUSH 0.01 73.89 us 65.86 us 85.39 us 6 OPEN 0.01 86.53 us 75.20 us 94.66 us 7 REMOVEXATTR 0.01 92.63 us 87.04 us 98.25 us 7 SETATTR 0.01 31.45 us 21.32 us 72.74 us 28 INODELK 0.04 57.69 us 13.54 us 82.32 us 43 GETXATTR 0.11 52.81 us 1.82 us 105.35 us 132 OPENDIR 3.84 228.13 us 19.02 us 51899.02 us 1068 LOOKUP 4.44 36.21 us 16.08 us 2241.49 us 7770 WRITE 9.50 25.48 us 11.93 us 3425.23 us 23652 FINODELK 38.86 208.86 us 42.79 us 236373.08 us 11795 FSYNC 43.17 115.75 us 65.48 us 19002.35 us 23645 FXATTROP Duration: 190 seconds Data Read: 0 bytes Data Written: 7770 bytes Brick: 10.32.9.3:/data/gfs/bricks/brick3/ovirt-data --------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 10 279 0 No. of Writes: 0 10193 1182536 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 0 296931 334649 No. of Writes: 127548 3204930 1556027 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 12835 408 311811 No. of Writes: 812230 318033 394074 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 557 756 4 No. of Writes: 406882 412639 28818 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 1 FORGET 0.00 0.00 us 0.00 us 0.00 us 32625 RELEASE 0.00 0.00 us 0.00 us 0.00 us 239790 RELEASEDIR 0.00 52.45 us 23.41 us 113.11 us 66 FLUSH 0.00 167.19 us 111.02 us 259.37 us 74 SETATTR 0.00 167.22 us 103.62 us 309.76 us 74 REMOVEXATTR 0.06 74.58 us 23.80 us 1370.08 us 2326 STAT 0.06 418.52 us 52.86 us 2922.65 us 428 OPEN 0.07 86.60 us 1.47 us 3915.72 us 2162 OPENDIR 0.09 249.52 us 11.76 us 2642.00 us 989 GETXATTR 0.12 328.35 us 23.94 us 3035.74 us 1075 INODELK 0.14 86.36 us 30.57 us 2659.17 us 4694 STATFS 0.16 106.34 us 46.69 us 2115.82 us 4420 FSTAT 0.24 308.36 us 49.82 us 3132.58 us 2230 READDIRP 0.27 1153.33 us 24.96 us 6804.78 us 669 READDIR 3.99 774.85 us 22.19 us 200289.74 us 14750 LOOKUP 5.01 179.69 us 46.87 us 622403.52 us 79882 WRITE 5.38 60.08 us 15.45 us 39769.17 us 256628 FINODELK 17.51 195.71 us 74.58 us 80527.99 us 256511 FXATTROP 20.11 450.53 us 45.02 us 688846.30 us 127988 FSYNC 46.79 2307.30 us 26.16 us 714894.79 us 58143 READ Duration: 228966 seconds Data Read: 25012409996 bytes Data Written: 336286618112 bytes Interval 7 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 4 2540 417 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 4492 1122 1 No. of Writes: 2686 798 262 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 1125 0 No. of Writes: 105 200 341 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 408 9 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 6 RELEASE 0.00 0.00 us 0.00 us 0.00 us 132 RELEASEDIR 0.00 54.70 us 33.88 us 85.35 us 4 READDIR 0.00 42.83 us 31.68 us 58.55 us 6 FLUSH 0.00 150.07 us 114.26 us 217.75 us 6 OPEN 0.01 148.76 us 130.62 us 183.04 us 7 SETATTR 0.01 180.98 us 109.68 us 309.76 us 7 REMOVEXATTR 0.01 70.85 us 40.67 us 158.97 us 28 INODELK 0.02 109.88 us 23.07 us 199.05 us 43 GETXATTR 0.06 89.44 us 2.99 us 172.93 us 132 OPENDIR 0.08 76.58 us 31.55 us 167.38 us 195 STAT 0.15 85.11 us 31.09 us 250.42 us 352 STATFS 0.18 106.10 us 46.69 us 221.08 us 338 FSTAT 0.26 317.12 us 84.77 us 2967.85 us 162 READDIRP 1.52 280.09 us 73.12 us 34101.65 us 1069 LOOKUP 5.94 150.44 us 50.67 us 1898.22 us 7770 WRITE 6.73 55.98 us 16.86 us 2658.04 us 23652 FINODELK 22.91 190.54 us 76.54 us 17289.99 us 23645 FXATTROP 26.69 444.98 us 49.31 us 231640.35 us 11795 FSYNC 35.42 1033.37 us 27.89 us 297550.98 us 6740 READ Duration: 190 seconds Data Read: 101335040 bytes Data Written: 275888640 bytes Brick: 10.32.9.20:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 12530536 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 22 FORGET 0.00 0.00 us 0.00 us 0.00 us 55090 RELEASE 0.00 0.00 us 0.00 us 0.00 us 229371 RELEASEDIR 0.07 95.10 us 37.37 us 545.60 us 361 OPEN 0.11 54.74 us 9.24 us 387.23 us 1087 GETXATTR 0.15 51.21 us 14.51 us 1155.49 us 1510 INODELK 0.18 44.62 us 1.39 us 567.77 us 2098 OPENDIR 0.23 222.37 us 15.87 us 1255.79 us 538 READDIR 6.00 39.59 us 15.30 us 70469.86 us 79641 WRITE 7.78 26.33 us 10.74 us 5048.18 us 155372 FINODELK 11.41 408.14 us 14.73 us 177302.65 us 14687 LOOKUP 35.30 119.66 us 63.09 us 81430.51 us 155009 FXATTROP 38.78 268.96 us 33.98 us 293274.53 us 75764 FSYNC Duration: 228966 seconds Data Read: 0 bytes Data Written: 12530536 bytes Interval 7 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 6094 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 53 RELEASE 0.00 0.00 us 0.00 us 0.00 us 171 RELEASEDIR 0.14 88.88 us 53.87 us 211.96 us 53 OPEN 0.18 51.40 us 12.21 us 152.30 us 121 GETXATTR 0.19 38.72 us 1.65 us 97.41 us 171 OPENDIR 0.27 36.93 us 15.38 us 519.56 us 248 INODELK 0.54 226.17 us 19.82 us 770.51 us 82 READDIR 6.39 36.11 us 15.30 us 621.88 us 6094 WRITE 6.74 190.64 us 17.31 us 24946.60 us 1218 LOOKUP 9.68 26.17 us 12.19 us 2357.39 us 12742 FINODELK 31.81 176.86 us 40.04 us 149489.65 us 6194 FSYNC 44.06 119.29 us 73.78 us 3856.64 us 12720 FXATTROP Duration: 190 seconds Data Read: 0 bytes Data Written: 6094 bytes Brick: 10.32.9.20:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 22 23483 678 No. of Writes: 0 5886 1786396 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 271 379523 492045 No. of Writes: 154693 3372286 2198807 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 37538 3867 177768 No. of Writes: 1172137 661473 747713 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 2601 4641 92 No. of Writes: 788337 953337 34635 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 213539 RELEASE 0.00 0.00 us 0.00 us 0.00 us 229298 RELEASEDIR 0.00 29.53 us 24.51 us 34.55 us 2 ENTRYLK 0.00 41.97 us 14.56 us 194.97 us 215 INODELK 0.01 34853.80 us 34853.80 us 34853.80 us 1 MKNOD 0.01 28.65 us 13.18 us 4179.83 us 2044 FLUSH 0.02 139.48 us 9.53 us 1760.61 us 738 GETXATTR 0.03 72.98 us 42.80 us 2055.27 us 2127 OPEN 0.03 42.17 us 18.46 us 4922.86 us 4694 STATFS 0.04 39.73 us 16.19 us 217.20 us 6120 FSTAT 0.04 108.39 us 14.78 us 84703.10 us 2328 STAT 0.05 799.29 us 15.29 us 2073.30 us 345 READDIR 0.06 219.03 us 153.85 us 2309.86 us 1684 READDIRP 0.40 1218.80 us 1.17 us 1174503.58 us 2002 OPENDIR 0.48 31.98 us 11.58 us 289255.11 us 90318 FINODELK 1.41 117.15 us 31.13 us 10966.39 us 72913 WRITE 1.86 124.75 us 63.21 us 89844.70 us 90317 FXATTROP 2.41 896.65 us 12.72 us 3110260.12 us 16260 LOOKUP 42.00 5656.16 us 35.46 us 3558711.29 us 44916 FSYNC 51.15 3994.34 us 15.89 us 4002723.92 us 77449 READ Duration: 228966 seconds Data Read: 20749111836 bytes Data Written: 703001672704 bytes Interval 7 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 19 0 0 No. of Writes: 3 387 60 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 480 1306 3 No. of Writes: 876 826 1034 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 1126 0 No. of Writes: 648 589 446 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 569 15 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 154 RELEASE 0.00 0.00 us 0.00 us 0.00 us 132 RELEASEDIR 0.00 26.24 us 16.68 us 34.42 us 4 READDIR 0.01 57.33 us 14.16 us 76.19 us 43 GETXATTR 0.01 25.05 us 16.57 us 48.11 us 154 FLUSH 0.02 46.79 us 2.01 us 79.28 us 132 OPENDIR 0.02 33.63 us 15.82 us 80.19 us 196 STAT 0.03 71.58 us 54.66 us 115.19 us 154 OPEN 0.05 44.70 us 25.24 us 1862.67 us 352 STATFS 0.06 40.91 us 18.77 us 101.30 us 468 FSTAT 0.08 228.23 us 154.60 us 2130.38 us 121 READDIRP 0.68 28.54 us 13.44 us 1957.42 us 8150 FINODELK 1.83 114.09 us 47.17 us 5336.45 us 5453 WRITE 3.00 125.35 us 74.60 us 4824.96 us 8150 FXATTROP 3.15 877.41 us 18.90 us 737190.85 us 1221 LOOKUP 43.09 3616.75 us 35.46 us 2804230.66 us 4058 FSYNC 47.98 5569.97 us 37.76 us 2164938.42 us 2934 READ Duration: 190 seconds Data Read: 86522245 bytes Data Written: 429134848 bytes Brick: 10.32.9.21:/data/gfs/bricks/bricka/ovirt-data ---------------------------------------------------- Cumulative Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 8374040 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 157005 RELEASE 0.00 0.00 us 0.00 us 0.00 us 145438 RELEASEDIR 0.00 32.02 us 26.16 us 37.89 us 2 ENTRYLK 0.04 82.38 us 14.27 us 739.52 us 215 INODELK 0.05 23431.80 us 23431.80 us 23431.80 us 1 MKNOD 0.12 27.19 us 15.00 us 2672.31 us 2044 FLUSH 0.19 42.52 us 1.09 us 3049.41 us 2081 OPENDIR 0.22 118.38 us 6.39 us 2555.92 us 859 GETXATTR 0.37 80.61 us 45.88 us 4970.41 us 2127 OPEN 0.62 572.96 us 14.96 us 2755.12 us 500 READDIR 5.48 27.97 us 11.32 us 4160.45 us 90329 FINODELK 6.42 40.58 us 15.61 us 16803.65 us 72929 WRITE 11.63 328.22 us 14.64 us 211581.15 us 16340 LOOKUP 24.44 124.72 us 64.61 us 76237.77 us 90328 FXATTROP 50.42 517.48 us 33.74 us 308402.79 us 44920 FSYNC Duration: 169258 seconds Data Read: 0 bytes Data Written: 8374040 bytes Interval 7 Stats: Block Size: 1b+ No. of Reads: 0 No. of Writes: 5453 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 154 RELEASE 0.00 0.00 us 0.00 us 0.00 us 132 RELEASEDIR 0.00 30.64 us 19.84 us 42.54 us 4 READDIR 0.06 56.48 us 15.93 us 117.69 us 43 GETXATTR 0.10 24.85 us 16.45 us 52.68 us 154 FLUSH 0.14 42.93 us 1.89 us 77.41 us 132 OPENDIR 0.28 72.04 us 56.21 us 123.13 us 154 OPEN 5.35 38.72 us 17.62 us 3013.68 us 5453 WRITE 5.81 28.18 us 12.04 us 3003.17 us 8150 FINODELK 10.03 324.70 us 21.73 us 90086.03 us 1220 LOOKUP 25.28 122.54 us 76.67 us 3134.60 us 8150 FXATTROP 52.95 515.40 us 40.26 us 279727.26 us 4058 FSYNC Duration: 190 seconds Data Read: 0 bytes Data Written: 5453 bytes Brick: 10.32.9.21:/data0/gfs/bricks/brick1/ovirt-data ----------------------------------------------------- Cumulative Stats: Block Size: 256b+ 512b+ 1024b+ No. of Reads: 4 1371 5 No. of Writes: 14 86709 1585292 Block Size: 2048b+ 4096b+ 8192b+ No. of Reads: 12 4066 331078 No. of Writes: 177954 2491752 1899133 Block Size: 16384b+ 32768b+ 65536b+ No. of Reads: 3736 2826 1064 No. of Writes: 957818 458767 404100 Block Size: 131072b+ 262144b+ 524288b+ No. of Reads: 1049 4720 27 No. of Writes: 435610 399393 21589 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 14 FORGET 0.00 0.00 us 0.00 us 0.00 us 38609 RELEASE 0.00 0.00 us 0.00 us 0.00 us 145446 RELEASEDIR 0.06 1624.70 us 52.88 us 24603.53 us 25 READ 0.09 161.87 us 43.60 us 5913.81 us 361 OPEN 0.11 66.60 us 7.15 us 795.96 us 1054 GETXATTR 0.12 34.45 us 12.55 us 1754.14 us 2326 STAT 0.14 45.36 us 1.14 us 2100.70 us 2096 OPENDIR 0.24 296.37 us 13.84 us 1481.15 us 531 READDIR 0.25 111.60 us 13.17 us 100581.63 us 1509 INODELK 0.29 41.10 us 21.23 us 3994.76 us 4694 STATFS 0.55 212.52 us 141.43 us 2251.12 us 1699 READDIRP 6.14 276.43 us 11.27 us 167040.32 us 14687 LOOKUP 6.18 26.29 us 11.42 us 40259.46 us 155380 FINODELK 14.73 122.30 us 32.52 us 230863.19 us 79644 WRITE 27.82 118.71 us 60.53 us 64714.66 us 155019 FXATTROP 43.28 377.81 us 38.43 us 483988.80 us 75769 FSYNC Duration: 169262 seconds Data Read: 5562339859 bytes Data Written: 345375042906 bytes Interval 7 Stats: Block Size: 512b+ 1024b+ 2048b+ No. of Reads: 0 0 0 No. of Writes: 92 10 3 Block Size: 4096b+ 8192b+ 16384b+ No. of Reads: 0 0 0 No. of Writes: 2635 1122 508 Block Size: 32768b+ 65536b+ 131072b+ No. of Reads: 0 0 0 No. of Writes: 207 333 474 Block Size: 262144b+ 524288b+ No. of Reads: 0 0 No. of Writes: 693 17 %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop --------- ----------- ----------- ----------- ------------ ---- 0.00 0.00 us 0.00 us 0.00 us 53 RELEASE 0.00 0.00 us 0.00 us 0.00 us 135 RELEASEDIR 0.03 140.83 us 15.48 us 353.64 us 10 READDIR 0.06 53.30 us 11.79 us 71.73 us 55 GETXATTR 0.09 80.82 us 46.37 us 204.09 us 53 OPEN 0.12 30.44 us 13.95 us 57.91 us 195 STAT 0.13 45.14 us 1.92 us 111.18 us 135 OPENDIR 0.17 33.36 us 15.84 us 213.61 us 247 INODELK 0.27 37.56 us 23.33 us 151.71 us 352 STATFS 0.52 212.43 us 164.65 us 2109.46 us 117 READDIRP 4.54 184.61 us 17.18 us 36715.65 us 1182 LOOKUP 6.59 24.86 us 11.54 us 678.17 us 12742 FINODELK 19.11 150.80 us 35.37 us 146890.28 us 6094 WRITE 30.03 113.56 us 71.60 us 2814.53 us 12720 FXATTROP 38.34 297.73 us 44.05 us 159834.32 us 6194 FSYNC Duration: 190 seconds Data Read: 0 bytes Data Written: 434216960 bytes