问题描述
我正在使用Zeppelins Spark解释器的隔离"模式,在此模式下,它将为Spark集群中的每个笔记本启动一个新作业.我想在笔记本执行完毕后通过齐柏林飞艇取消工作.为此,我做了sc.stop
这停止了sparkContext,并且作业也从spark集群中停止了.但是下一次当我尝试运行笔记本时,它不会再次启动sparkContext
.那怎么办呢?
I am using Isolated mode of zeppelins spark interpreter, with this mode it will start a new job for each notebook in spark cluster. I want to kill the job via zeppelin when the notebook execution is completed. For this I did sc.stop
this stopped the sparkContext and the job is also stopped from spark cluster. But next time when I try to run the notebook its not starting the sparkContext
again. So how to do that?
推荐答案
有点直观,但是您需要访问解释器菜单选项卡,而不是直接停止SparkContext
:
It's a bit counter intuitive but you need to access the interpreter menu tab instead of stopping SparkContext
directly:
-
转到解释器列表.
go to interpreter list.
找到Spark解释器,然后单击右上角的:
find Spark interpreter and click in the right upper corner:
这篇关于Zeppelin:如何在Zeppelin中重新启动sparkContext的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!