问题描述
在星火独立模式后,有主节点和工作节点。
- 2是否例如工人有平均2工作进程一名工人节点?
- 是否每个工人的实例保持特定的应用程序(管理存储,任务),或者一个工作节点各执一份遗嘱执行人执行人?
- 有一个流程图讲解火花运行,比如word怎么算?
我建议您阅读第一,但更是让这个Cloudera博客文章解释这些模式。
您的第一个问题取决于你的意思是实例是什么。节点是一台机器,而且也没有一个很好的理由来运行每台机器多个工人。所以,两个工作节点通常是指两台机器,每个工人星火
工人容纳许多执行人,对于许多应用。一个应用程序有很多工人执行者。
您的第三个问题是不明确的。
In Spark Standalone mode, there are master node and worker nodes.
- Does 2 worker instance mean one worker node with 2 worker processes?
- Does every worker instance hold an executor for specific application (which manages storage, task) or one worker node holds one executor?
- Is there a flow chart explain how spark runtime,such as word count?
I suggest reading the Spark cluster docs first, but even more so this Cloudera blog post explaining these modes.
Your first question depends on what you mean by 'instances'. A node is a machine, and there's not a good reason to run more than one worker per machine. So two worker nodes typically means two machines, each a Spark worker.
Workers hold many executors, for many applications. One application has executors on many workers.
Your third question is not clear.
这篇关于什么是工人,工人实例和执行者之间的关系?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!