本文介绍了Bigtable导入错误的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！
问题描述
我使用配置单元生成了一个序列文件，并试图以bigtable格式导入它，我的导入作业失败并显示下面的错误消息。
I generated a sequence file using hive and trying to import it in bigtable, my import job is failing with the error below.
2015-06-21 00:05:42,584 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1434843251631_0007_m_000000_1: Error: java.lang.ClassCastException: org.apache.hadoop.io.BytesWritable cannot be cast to org.apache.hadoop.hbase.io.ImmutableBytesWritable
at com.google.cloud.bigtable.mapreduce.Import$Importer.map(Import.java:127)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
我使用下面的hive表定义和参数来生成序列文件。
I am using the hive table definition and parameters below for generating the sequence file.
create table ilv_bigtable_test(
item_id int
)
stored as sequencefile
LOCATION 'gs://zxx/xx/aa1_temp/ilv_bigtable_test/'
TBLPROPERTIES('serialization.null.format'='')
;
SET hive.exec.compress.output=true;
SET mapred.max.split.size=256000000;
SET mapred.output.compression.type=BLOCK;
insert overwrite table ilv_bigtable_test
select
item_id
FROM xxx
;
下面是hbase create table语句
Below is the hbase create table statement
create 'test', 'item_id'
推荐答案
您需要更高版本的Apache Hive - 1.1.0是第一个支持Cloud Bigtable需要的HBase 1.0的版本。您至少可以尝试使用Hive 1.2.1。
You need a much later version of Apache Hive – 1.1.0 is the first version to support HBase 1.0 which Cloud Bigtable requires. You can try with Hive 1.2.1 at least.
这篇关于Bigtable导入错误的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！