本文介绍了增加水槽MaxHeap的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

下午好,我无法增加Flume的堆大小.结果,我得到:

Good Afternoon,I'm having trouble increasing the Heap Size for Flume. As a result, I get:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space

我增加了在"flume-env.sh"以及Hadoop/Yarn中定义的堆.没有运气.

I've increased the heap defined in "flume-env.sh" as well as Hadoop/Yarn. No luck.

需要注意的一点是,在启动水槽时,Exec(processbuilder?)似乎将堆定义为20Mb.关于如何覆盖它的任何想法?

One thing to notice, on starting flume, the Exec (processbuilder?) seems to be defining heap as 20Mb. Any ideas on how to override it?

Info: Including Hadoop libraries found via (/usr/local/hadoop/bin/hadoop) for HDFS access
Info: Including Hive libraries found via () for Hive access
+ exec /usr/lib/jvm/java-9-openjdk-amd64/bin/java -Xmx20m -cp 'conf:/usr/local/flume/lib/* :
........

最终,我试图将Heapsize设置为1512MB.

Ultimately I'm trying to set Heapsize to 1512MB.

推荐答案

增加"flume_env.sh"中的堆应该可行.您也可以尝试执行Flume代理,如下所示:

Increasing the heap in "flume_env.sh" should work. You can also try executing your Flume agent as follows:

flume-ng代理-n myagent -Xmx512m

flume-ng agent -n myagent -Xmx512m

Flume能够从命令行读取-D和-X选项.

Flume is able to read -D and -X options from the command line.

这篇关于增加水槽MaxHeap的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!

09-11 06:52