Resource Usage

This page shows the resource consumption during our experiments.
  • All
  • Query 24
  • Query 27
  • Query 31
  • Query 37
  • Query 40
  • Query 46
  • Query 73
  • Query 82
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 15.8642 8.8527 22.4411 21.362 20.4896
Memory (GB) 15.1928 6.8477 6.7445 6.813 6.7349
Disk - Read (KB/s) 2.1757 97.8665 745.9167 441.1706 564.7389
Disk - Write (KB/s) 72.4789 2479.2842 10252.5909 10316.8624 8264.1561
Network - Recv (MB/s) 711.1342 1320.9259 7445.4152 6348.6474 6354.0057
Network - Send (MB/s) 4.8602 1.1766 5.393 5.6442 5.2091
SafeSpark-SGX CPU (%) 12.4418 15.3037 23.7581 11.0389 23.8615
Memory (GB) 15.7911 7.049 7.123 6.3664 7.1949
Disk - Read (KB/s) 1.6939 445.4875 636.8549 258.1925 942.8194
Disk - Write (KB/s) 71.945 2498.8194 3825.4532 884.3795 4954.6189
Network - Recv (MB/s) 463.852 1752.5244 9814.7065 9337.1325 3645.4139
Network - Send (MB/s) 5.2976 4.285 4.3223 6.9589 2.116
SafeSpark-OPE CPU (%) 10.1983 19.9322 21.5114 19.0263 17.9323
Memory (GB) 16.1012 7.1343 7.2558 7.1247 7.1305
Disk - Read (KB/s) 0.5268 319.6441 406.7549 725.9865 647.6503
Disk - Write (KB/s) 68.4612 3295.399 14770.7931 12485.2553 11002.4855
Network - Recv (MB/s) 381.4648 836.2435 8914.2541 8242.168 8290.222
Network - Send (MB/s) 2.8895 2.3516 8.3208 6.8707 6.4184
SafeSpark-DET CPU (%) 9.127 22.2678 15.2612 23.7768 27.5221
Memory (GB) 16.0584 6.5355 6.8008 6.8996 6.7716
Disk - Read (KB/s) 2.2394 836.9628 428.7601 998.1013 782.2991
Disk - Write (KB/s) 69.246 6273.6371 12707.0057 14636.8185 13478.0628
Network - Recv (MB/s) 352.1603 13446.9096 4391.526 7991.3629 4669.0231
Network - Send (MB/s) 4.7435 1.3698 7.9015 6.2463 8.0422
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 18.6542 11.1417 24.2252 22.3891 14.3263
Memory (GB) 14.892 6.6054 5.6854 5.8449 5.8466
Disk - Read (KB/s) 0.9288 68.8878 1346.7251 869.444 1274.6278
Disk - Write (KB/s) 87.1549 2144.5383 4820.1505 6035.0855 4516.1562
Network - Recv (MB/s) 289.8541 2920.2454 6900.9638 4666.49 2539.98
Network - Send (MB/s) 8.641 0.6408 2.8207 2.8899 2.3096
SafeSpark-SGX CPU (%) 19.5548 7.0673 25.1792 6.9986 27.328
Memory (GB) 15.7561 6.5634 6.4189 6.1993 6.2815
Disk - Read (KB/s) 1.4074 1230.1666 2978.3756 542.3078 1192.7973
Disk - Write (KB/s) 91.4494 3770.7666 7787.3816 4509.9179 4775.3883
Network - Recv (MB/s) 138.1268 5772.0403 4194.8559 4145.172 7268.1116
Network - Send (MB/s) 7.6448 3.1431 2.9733 4.2897 1.2807
SafeSpark-OPE CPU (%) 17.8323 9.0394 16.114 24.7968 22.3339
Memory (GB) 15.7929 6.6834 4.843 5.3973 5.4614
Disk - Read (KB/s) 1.4734 263.664 3038.779 1157.1975 905.0974
Disk - Write (KB/s) 85.3021 3377.0526 5053.0309 9334.9444 8082.1914
Network - Recv (MB/s) 229.7597 4566.9597 6192.7856 5728.4392 5032.5952
Network - Send (MB/s) 6.0137 4.4632 2.3525 3.629 3.3189
SafeSpark-DET CPU (%) 14.0965 14.0666 19.3392 18.4889 18.0311
Memory (GB) 15.7606 6.7301 7.5799 4.3715 5.02
Disk - Read (KB/s) 2.036 1111.4772 2478.868 1571.9098 1289.8506
Disk - Write (KB/s) 74.0967 3798.5741 8561.0861 7145.5392 11917.0446
Network - Recv (MB/s) 223.0938 5853.6454 4808.2915 4230.9936 5782.201
Network - Send (MB/s) 16.5057 0.3811 2.3995 2.3933 3.8049
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 19.9822 18.9465 21.0943 25.51 21.6055
Memory (GB) 15.0555 6.913 5.8821 6.0745 6.153
Disk - Read (KB/s) 1.7468 351.2321 512.8258 1056.3319 687.782
Disk - Write (KB/s) 97.2656 3648.2046 4224.9526 5458.7282 4470.6255
Network - Recv (MB/s) 656.8757 3916.6932 4276.7662 4802.6145 4023.9325
Network - Send (MB/s) 7.1714 1.4195 2.7472 3.8541 2.5005
SafeSpark-SGX CPU (%) 16.1867 14.1209 19.3941 26.5121 12.5032
Memory (GB) 15.8346 6.8065 6.3066 6.6595 5.8637
Disk - Read (KB/s) 1.2576 656.9483 625.6276 1769.4149 1149.3889
Disk - Write (KB/s) 83.6273 7390.1346 4759.1291 3229.008 3164.5147
Network - Recv (MB/s) 194.1238 658.2433 8589.6106 3039.9478 7511.8081
Network - Send (MB/s) 5.8088 1.4689 4.6565 2.3671 4.1011
SafeSpark-OPE CPU (%) 15.4668 16.8083 22.0308 17.9502 25.8971
Memory (GB) 16.0289 7.0866 5.7385 5.6843 5.6469
Disk - Read (KB/s) 0.813 1766.4193 1064.9659 957.8146 827.2426
Disk - Write (KB/s) 73.3006 2487.3013 3981.2824 6800.959 6529.6301
Network - Recv (MB/s) 380.3854 4773.7087 5471.8543 5770.3374 6387.1998
Network - Send (MB/s) 4.133 7.3281 2.8462 1.7684 1.7339
SafeSpark-DET CPU (%) 14.3798 22.0328 36.5943 24.5589 36.2409
Memory (GB) 15.905 5.4056 5.5168 5.6502 5.6538
Disk - Read (KB/s) 4.4701 598.927 1252.5242 1343.8981 1250.8221
Disk - Write (KB/s) 78.0295 7864.9806 8274.3585 8810.3632 8210.0129
Network - Recv (MB/s) 470.1219 6167.0566 5647.6812 5792.0818 6410.037
Network - Send (MB/s) 15.171 0.7547 2.8109 3.8196 1.927
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 20.6197 16.2795 15.5397 18.3994 15.7362
Memory (GB) 14.8478 6.6201 5.5984 5.754 5.8532
Disk - Read (KB/s) 1.0314 925.2678 1297.5454 1770.5779 1393.2101
Disk - Write (KB/s) 95.0629 2757.017 2488.1443 2936.1337 2611.599
Network - Recv (MB/s) 232.9241 3479.0045 3719.7681 4014.0202 3604.1037
Network - Send (MB/s) 10.3824 0.8779 1.0195 1.5125 1.1734
SafeSpark-SGX CPU (%) 14.3901 5.7543 25.1031 14.713 27.9887
Memory (GB) 15.8009 6.5438 6.6638 6.4049 6.9692
Disk - Read (KB/s) 2.5341 124.3863 1729.3222 3681.4733 1044.1554
Disk - Write (KB/s) 72.5289 1232.033 10541.5 2934.7125 2869.4902
Network - Recv (MB/s) 335.0094 1959.7081 3346.2732 9176.9606 3614.1566
Network - Send (MB/s) 5.6548 0.0922 5.0388 3.1292 6.1582
SafeSpark-OPE CPU (%) 12.4587 15.7202 22.6108 17.4703 15.2012
Memory (GB) 15.7999 7.076 6.0633 5.9595 5.772
Disk - Read (KB/s) 1.1653 1006.1777 2557.03 1492.5706 4558.3174
Disk - Write (KB/s) 85.006 3995.2356 4382.1206 3329.6687 2804.3369
Network - Recv (MB/s) 126.6076 8023.3952 3115.807 2468.7218 2580.8124
Network - Send (MB/s) 5.3239 3.9204 1.7903 3.3135 1.1967
SafeSpark-DET CPU (%) 12.9596 15.1607 21.9763 27.448 27.0281
Memory (GB) 15.7327 5.2293 5.4522 5.5628 5.4946
Disk - Read (KB/s) 5.9354 1925.8922 2065.9706 2346.8961 2191.4428
Disk - Write (KB/s) 80.4296 2952.6443 5164.9003 3744.4787 5205.0812
Network - Recv (MB/s) 188.1205 5385.1391 6245.396 6439.0172 6397.7431
Network - Send (MB/s) 19.4448 0.9948 1.4566 1.3007 1.4513
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 16.0114 15.1935 11.0484 15.3929 15.8961
Memory (GB) 14.9233 6.8423 5.7558 6.1962 6.2305
Disk - Read (KB/s) 0.8899 218.4296 381.6264 476.7256 677.2843
Disk - Write (KB/s) 86.9244 6103.3938 4284.2483 6473.9646 7008.1697
Network - Recv (MB/s) 215.0038 3578.8113 2003.8465 3076.0266 2638.9692
Network - Send (MB/s) 7.2801 1.793 0.6379 0.9849 0.7541
SafeSpark-SGX CPU (%) 12.5461 11.8769 24.6003 18.0441 17.7463
Memory (GB) 15.7682 6.9978 5.8979 6.2029 6.2845
Disk - Read (KB/s) 1.1867 1331.1139 214.1403 884.6156 473.3703
Disk - Write (KB/s) 85.3387 4926.2212 7840.379 7038.5282 7798.0744
Network - Recv (MB/s) 398.5448 2498.2303 4030.5806 2153.9437 2813.628
Network - Send (MB/s) 5.3508 1.5303 1.8681 3.5786 1.1202
SafeSpark-OPE CPU (%) 13.6972 6.7964 20.6983 21.0429 20.7
Memory (GB) 15.8315 6.5656 6.5453 6.5338 6.3159
Disk - Read (KB/s) 1.1893 161.9369 894.3792 938.4673 850.5937
Disk - Write (KB/s) 88.8946 2150.6714 8444.7127 8639.9765 8051.4258
Network - Recv (MB/s) 175.6464 1102.9512 5672.5227 5548.0843 5593.678
Network - Send (MB/s) 5.3908 0.1891 4.1154 4.3051 4.1233
SafeSpark-DET CPU (%) 10.5216 19.1258 24.9165 17.7267 24.1673
Memory (GB) 15.811 5.4072 5.5265 6.1075 5.5489
Disk - Read (KB/s) 2.5603 909.1856 982.7815 901.9128 471.8179
Disk - Write (KB/s) 76.3051 6723.27 10234.4491 9331.9192 10443.4172
Network - Recv (MB/s) 170.4963 3922.6437 4756.2476 5461.6609 4728.6061
Network - Send (MB/s) 14.1831 0.9002 1.0604 1.5983 1.334
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 17.377 7.4209 9.2443 19.3066 19.4002
Memory (GB) 14.9433 6.493 5.6632 6.1778 6.2878
Disk - Read (KB/s) 0.7371 1.4466 193.8864 686.1608 594.8523
Disk - Write (KB/s) 95.358 2702.7372 2413.6521 6918.7421 6987.6048
Network - Recv (MB/s) 304.0743 1570.5195 1939.3665 3012.9535 3083.1472
Network - Send (MB/s) 7.4198 0.2773 0.5224 0.6432 0.9878
SafeSpark-SGX CPU (%) 15.9244 14.9619 22.9438 18.3038 18.2155
Memory (GB) 16.0205 6.9879 5.3308 5.9648 6.1133
Disk - Read (KB/s) 0.8633 516.3323 909.5235 656.1914 975.8701
Disk - Write (KB/s) 78.7285 3057.1835 17998.9813 12228.2482 985.3136
Network - Recv (MB/s) 127.2082 1528.6698 3329.2015 2319.1394 3114.2189
Network - Send (MB/s) 4.2695 0.6232 2.9612 2.3537 1.7183
SafeSpark-OPE CPU (%) 16.6679 8.0565 22.0606 27.3705 14.8832
Memory (GB) 15.8195 6.6635 6.2973 6.3827 5.735
Disk - Read (KB/s) 1.6809 190.475 852.8871 493.2269 1206.1066
Disk - Write (KB/s) 80.1097 3586.2738 5389.1902 7225.7642 8433.6094
Network - Recv (MB/s) 357.2945 1411.796 4140.7719 5023.2897 2449.3073
Network - Send (MB/s) 6.0652 1.1343 2.0184 2.6493 1.5065
SafeSpark-DET CPU (%) 12.7926 16.2622 18.554 15.204 26.561
Memory (GB) 15.8026 5.1569 5.3133 4.7015 5.5362
Disk - Read (KB/s) 9.1798 113.2106 1145.3259 942.1659 535.1192
Disk - Write (KB/s) 71.7854 8609.7111 9141.1977 9590.4027 10260.5162
Network - Recv (MB/s) 301.4892 4308.9531 4501.5096 4467.5976 4853.1694
Network - Send (MB/s) 15.6759 0.5168 0.6274 0.9378 0.615
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 20.0867 13.1147 11.9543 18.8964 13.9649
Memory (GB) 14.8907 6.5348 5.6481 5.9422 5.97
Disk - Read (KB/s) 0.9002 20.4925 220.7594 148.907 131.0562
Disk - Write (KB/s) 97.634 2377.3704 2113.422 2936.9631 2583.7192
Network - Recv (MB/s) 305.2486 2617.3421 1993.9004 2687.1207 2567.0971
Network - Send (MB/s) 8.9681 0.275 0.2194 0.3347 0.2849
SafeSpark-SGX CPU (%) 14.8462 6.5702 13.039 25.9292 26.9713
Memory (GB) 15.7708 6.6237 4.376 5.6226 6.1997
Disk - Read (KB/s) 1.8895 70.5118 287.8005 44.514 446.3708
Disk - Write (KB/s) 74.9941 2808.8082 3210.3895 2741.0659 10265.8213
Network - Recv (MB/s) 397.6256 746.3465 5435.8481 6881.5055 3351.2449
Network - Send (MB/s) 6.0729 0.402 1.7544 3.7128 4.3972
SafeSpark-OPE CPU (%) 19.2002 8.8836 21.9062 19.2311 16.9834
Memory (GB) 15.7625 6.56 6.3017 6.1175 5.7355
Disk - Read (KB/s) 1.633 120.7305 341.3109 369.3907 179.5557
Disk - Write (KB/s) 71.0416 2613.8963 3591.6325 3625.7732 2499.9426
Network - Recv (MB/s) 261.6199 2064.2654 3000.8803 5760.4163 2287.6763
Network - Send (MB/s) 7.596 0.2053 2.9293 0.9159 0.666
SafeSpark-DET CPU (%) 13.8392 21.8858 12.5031 21.2297 15.6611
Memory (GB) 15.7514 5.1043 5.1107 6.6779 4.8703
Disk - Read (KB/s) 11.602 125.4262 281.1585 296.907 169.7937
Disk - Write (KB/s) 74.4898 9010.8667 4036.6847 2064.9145 4125.3546
Network - Recv (MB/s) 236.2334 4504.9774 2248.504 5104.2801 5198.1169
Network - Send (MB/s) 13.722 0.4766 0.285 0.3875 0.3378
Resource Master Worker #1 Worker #2 Worker #3 Worker #4
Spark Vanilla CPU (%) 20.4484 16.3797 17.7438 20.7514 15.228
Memory (GB) 14.8369 6.4895 5.7057 5.9703 5.9389
Disk - Read (KB/s) 1.1435 217.3096 553.4761 1186.0024 667.4984
Disk - Write (KB/s) 84.1208 2726.6377 2783.3906 2791.0412 2149.1888
Network - Recv (MB/s) 230.4729 3624.4889 4635.7599 4409.9697 3276.2103
Network - Send (MB/s) 10.3158 1.0811 1.4955 1.9274 1.2462
SafeSpark-SGX CPU (%) 10.7094 15.712 26.1455 21.486 18.113
Memory (GB) 13.1132 7.0507 7.5622 7.1945 7.1049
Disk - Read (KB/s) 0.568 375.1719 511.1284 504.3222 3067.5696
Disk - Write (KB/s) 77.0669 4221.9839 4137.8043 9059.336 2729.8311
Network - Recv (MB/s) 233.4889 5290.9801 7317.4096 6592.4729 5850.4276
Network - Send (MB/s) 3.0294 2.2098 10.3978 7.2737 6.1507
SafeSpark-OPE CPU (%) 12.5662 17.11 20.4133 19.3468 23.3073
Memory (GB) 13.812 6.873 6.7592 6.687 6.6337
Disk - Read (KB/s) 1.2343 2068.553 1142.8094 737.8679 966.3688
Disk - Write (KB/s) 91.9354 3114.1468 3807.3392 3457.5307 4661.2379
Network - Recv (MB/s) 129.9346 9217.8526 3135.4188 3193.0004 4376.609
Network - Send (MB/s) 5.3636 5.8188 2.0689 4.6463 2.2049
SafeSpark-DET CPU (%) 12.716 19.8927 22.1083 22.2895 18.7453
Memory (GB) 15.744 5.6446 5.6528 7.319 5.564
Disk - Read (KB/s) 5.8093 788.0006 1875.26 941.4218 801.3257
Disk - Write (KB/s) 83.7095 11354.3653 165.2893 160.5975 8961.2302
Network - Recv (MB/s) 181.835 5473.569 6370.1873 6412.8011 6417.7381
Network - Send (MB/s) 19.0677 0.977 1.6622 1.5809 1.5694