如何在Mesos群集上运行Hadoop？

问题描述

我试图建立一个Apache Mesos集群并在其上运行Hadoop-Job。 的文档不在我的级别，因此我无法理解，也许这里有人可以解释我：

首先应该设置一个可用的Hadoop集群？或者先建立一个Mesos集群？
我在哪里指定奴隶？在Hadoop-slaves文件或注册的Mesos中只能使用奴隶？

解决方案

Mesos的目标是运行抽象集群，其中Hadoop只是其中的一项服务。为了实现这个目标，您需要首先将Mesos集群设置为主要组件，然后您可以使用Mesos抽象将Hadoop等服务添加到此集群。

一个很好的教程，你应该看看，并且它详细解释了如何在Mesos上运行Hadoop，所以这将是一个很好的开始。

另外，该公司最近开始为，类似于Amazon的Elastic MapReduce。因此，如果您想快速开始使用Hadoop on Mesos，而不必经历配置一切的痛苦，那么这是一个很好的开始。

I am trying to set up a Apache Mesos Cluster and run Hadoop-Job on it. The documentation here is not at my level, so that i am not able to understand and maybe someone here can explain me:

First should I set up a working Hadoop Cluster? Or first set up a Mesos cluster?where do I point the slaves? in Hadoop-slaves file or registered Mesos slaves should only be used?

解决方案

The goal of Mesos is to run an abstraction for your cluster, where Hadoop would just be 1 service among others. In order for this to work, you need to first setup your Mesos cluster as the primary component, and then you can start adding services like Hadoop to this cluster using the Mesos abstraction.

There is an excellent tutorial from Mesosphere that you should take a look at, and it explains in details how to run Hadoop on top of Mesos, so this would be a good place to start.

Alternatively, this company recently started a serviced for Elastic Mesos, similar in nature to Amazon's Elastic MapReduce. So if you want to get started quickly with Hadoop on Mesos without having to go through the pain of configuring everything, this is a good place to start.

这篇关于如何在Mesos群集上运行Hadoop？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！