{"id":5360,"date":"2019-10-26T15:03:46","date_gmt":"2019-10-26T17:03:46","guid":{"rendered":"http:\/\/nubo.ai\/?p=5360"},"modified":"2019-10-26T15:04:02","modified_gmt":"2019-10-26T17:04:02","slug":"a-performance-comparison-of-container-based-virtualization-systems-for-mapreduce-clusters","status":"publish","type":"post","link":"https:\/\/nubo.ai\/?p=5360","title":{"rendered":"A Performance Comparison of Container-Based Virtualization Systems for MapReduce Clusters"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"5360\" class=\"elementor elementor-5360\" data-elementor-settings=\"[]\">\n\t\t\t<div class=\"elementor-inner\">\n\t\t\t\t<div class=\"elementor-section-wrap\">\n\t\t\t\t\t\t\t<section class=\"elementor-element elementor-element-67fb4b02 elementor-section-boxed elementor-section-height-default elementor-section-height-default elementor-section elementor-top-section\" data-id=\"67fb4b02\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t<div class=\"elementor-row\">\n\t\t\t\t<div class=\"elementor-element elementor-element-16f4ec7 elementor-column elementor-col-100 elementor-top-column\" data-id=\"16f4ec7\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-column-wrap  elementor-element-populated\">\n\t\t\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t<div class=\"elementor-element elementor-element-100db479 elementor-widget elementor-widget-text-editor\" data-id=\"100db479\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-text-editor elementor-clearfix\"><div class=\"abstract-text row\">\n<div class=\"col-12\">\n<div class=\"u-mb-1\"><strong>Abstract:<\/strong>\n<div>Virtualization as a platform for resource-intensive applications, such as MapReduce (MR), has been the subject of many studies in the last years, as it has brought benefits such as better manageability, overall resource utilization, security and scalability. Nevertheless, because of the performance overheads, virtualization has traditionally been avoided in computing environments where performance is a critical factor. In this context, container-based virtualization can be considered a lightweight alternative to the traditional hypervisor-based virtualization systems. In fact, there is a trend towards using containers in MR clusters in order to provide resource sharing and performance isolation (e.g., Mesos and YARN). However, there are still no studies evaluating the performance overhead of the current container-based systems and their ability to provide performance isolation when running MR applications. In this work, we conducted experiments to effectively compare and contrast the current container-based systems (Linux VServer, OpenVZ and Linux Containers (LXC)) in terms of performance and manageability when running on MR clusters. Our results showed that although all container-based systems reach a near-native performance for MapReduce workloads, LXC is the one that offers the best relationship between performance and management capabilities (specially regarding to performance isolation).<\/div>\n<div>\u00a0<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"u-pb-1 stats-document-abstract-publishedIn\" data-tealium_data=\"{&quot;docType&quot;: &quot;Conference&quot;}\"><strong>Published in:\u00a0<\/strong><a href=\"https:\/\/ieeexplore.ieee.org\/xpl\/conhome\/6786619\/proceeding\">2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing<\/a><\/div><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"Abstract: Virtualization as a platform for resource-intensive applications, such as MapReduce (MR), has been the subject of many studies in the last years, as it has brought benefits such as better manageability, overall resource utilization, security and scalability. Nevertheless, because of the performance overheads, virtualization has traditionally been avoided in computing environments where performance is&#8230;","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":""},"categories":[49],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/nubo.ai\/index.php?rest_route=\/wp\/v2\/posts\/5360"}],"collection":[{"href":"https:\/\/nubo.ai\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nubo.ai\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nubo.ai\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nubo.ai\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5360"}],"version-history":[{"count":2,"href":"https:\/\/nubo.ai\/index.php?rest_route=\/wp\/v2\/posts\/5360\/revisions"}],"predecessor-version":[{"id":5362,"href":"https:\/\/nubo.ai\/index.php?rest_route=\/wp\/v2\/posts\/5360\/revisions\/5362"}],"wp:attachment":[{"href":"https:\/\/nubo.ai\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5360"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nubo.ai\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5360"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nubo.ai\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5360"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}