问题描述
下午好,我无法增加Flume的堆大小.结果,我得到:
Good Afternoon,I'm having trouble increasing the Heap Size for Flume. As a result, I get:
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
我增加了在"flume-env.sh"以及Hadoop/Yarn中定义的堆.没有运气.
I've increased the heap defined in "flume-env.sh" as well as Hadoop/Yarn. No luck.
需要注意的一点是,在启动水槽时,Exec(processbuilder?)似乎将堆定义为20Mb.关于如何覆盖它的任何想法?
One thing to notice, on starting flume, the Exec (processbuilder?) seems to be defining heap as 20Mb. Any ideas on how to override it?
Info: Including Hadoop libraries found via (/usr/local/hadoop/bin/hadoop) for HDFS access
Info: Including Hive libraries found via () for Hive access
+ exec /usr/lib/jvm/java-9-openjdk-amd64/bin/java -Xmx20m -cp 'conf:/usr/local/flume/lib/* :
........
最终,我试图将Heapsize设置为1512MB.
Ultimately I'm trying to set Heapsize to 1512MB.
推荐答案
增加"flume_env.sh"中的堆应该可行.您也可以尝试执行Flume代理,如下所示:
Increasing the heap in "flume_env.sh" should work. You can also try executing your Flume agent as follows:
flume-ng代理-n myagent -Xmx512m
flume-ng agent -n myagent -Xmx512m
Flume能够从命令行读取-D和-X选项.
Flume is able to read -D and -X options from the command line.
这篇关于增加水槽MaxHeap的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!