Apache Giraph - 由于一次只有1个任务，因此无法在拆分主/从模式下运行

问题描述

我使用PageRank Benchmark示例以hadoop 2.2.0运行Giraph 1.0.0

突然间，我得到了这个错误结果：

When I changed the number of workers to 1, I got:

Any solutions?

解决方案

Hi I assume you are not running on a cluster? If I run in our demo VMs I get the same error.

You can disable the split master worker behaviour in giraph-site.xml

giraph.SplitMasterWorker=false

If you just want to disable this during a one-shot exeuction you can also pass it as a command-line parameter to your program.

-ca giraph.SplitMasterWorker=false

For instance I run a demo for my Big Data lecture like this:

#!/bin/bash

yarn jar /root/giraph-0.0.1-SNAPSHOT-jar-with-dependencies.jar org.apache.giraph.GiraphRunner at.jku.tk.steinbauer.bigdata.giraph.MaxInDegreeComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /user/hue/graph/tinygraph.txt -of org.apache.giraph.io.formats.IdWithValueTextOutputFormat  -op /user/hue/graph/degree -w 1 -ca giraph.SplitMasterWorker=false

这篇关于Apache Giraph - 由于一次只有1个任务，因此无法在拆分主/从模式下运行的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！