我是hadoop和yarn的新手,并尝试在配置单元2蜂行上运行配置单元插入查询。我得到的信息是:
信息:尚未创建Tez session 。开幕式
而且我的系统似乎被挂起了。
我尝试检查YARN UI 8088端口上的日志,并且能够看到我的工作被杀
User: hive
Name: HIVE-e5f3af53-8861-4095-b6ea-4b6f28300ccc
Application Type: TEZ
Application Tags:
Application Priority: 0 (Higher Integer value indicates higher priority)
YarnApplicationState: KILLED
Queue: default
FinalStatus Reported by AM: KILLED
Started: Wed Jan 23 17:15:07 +0530 2019
Elapsed: 8mins, 33sec
Tracking URL: History
Log Aggregation Status: NOT_START
Application Timeout (Remaining Time): Unlimited
Diagnostics: Application application_1546858571448_0008 was killed by user hive at 10.5.3.113
Unmanaged Application: false
Application Node Label expression: <Not set>
AM container Node Label expression: <DEFAULT_PARTITION>
在hdfs中检查vi gc.log-201901071626文件中的日志状态后
我可以看到GC分配失败
2019-01-08T09:56:45.906+0530: 63044.883: [GC (Allocation Failure) 2019-01-08T09:56:45.906+0530: 63044.883: [ParNew: 106452K->1675K(118016K), 0.0137290 secs] 133048K->28271K(1035520K), 0.0138677 secs] [Times: user=0.03 sys=0.00, real=0.02 secs]
2019-01-08T12:45:45.849+0530: 73184.825: [GC (Allocation Failure) 2019-01-08T12:45:45.849+0530: 73184.826: [ParNew: 106635K->940K(118016K), 0.0119422 secs] 133231K->27986K(1035520K), 0.0121155 secs] [Times: user=0.04 sys=0.00, real=0.02 secs]
请帮助我找到适当的解决方案
我尝试将引擎更改为Mr,但是不支持
最佳答案
hiveserver上是否安装了tez客户端?这是一个要求。
您也可以尝试降低tez.am.resource.memory.mb
关于hadoop - tez session 没有在 hive 中开始,我们在Stack Overflow上找到一个类似的问题:https://stackoverflow.com/questions/54327800/