我正在尝试运行此project,在按照说明进行操作后,他们提供了:
安装Java 1.8
获取Spark 2.2.x:下载并解压缩,然后设置环境
变量:export SPARK_HOME =
克隆TransmogrifAI存储库:git clone
https://github.com/salesforce/TransmogrifAI.git
建立项目:cd TransmogrifAI && ./gradlew compileTestScala
installDist
直到我收到此消息:
Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use --status for details
> Task :scalaStyle
Found 0 warnings
Found 0 errors
BUILD SUCCESSFUL in 43s
8 actionable tasks: 6 executed, 2 up-to-date
之后,我想尝试以下一种模型:
https://docs.transmogrif.ai/en/stable/examples/Titanic-Binary-Classification.html
但是在运行命令期间:
cd helloworld
./gradlew compileTestScala installDist
./gradlew -q sparkSubmit -Dmain=com.salesforce.hw.OpTitanicSimple -Dargs="\
`pwd`/src/main/resources/TitanicDataset/TitanicPassengersTrainData.csv"
我收到此错误:
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sparkSubmit'.
> A problem occurred starting process 'command 'null/bin/spark-submit''
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 2s
我试图找出答案,但对此一无所知,我该如何解决这个问题?
最佳答案
启动过程'命令'null / bin / spark-submit'发生问题
“ null / bin / spark-submit”中的“ null”部分显示未设置“ SPARK_HOME”位置。
您提到在安装的第二步中设置环境变量。
因此,您可以检查SPARK_HOME环境变量是否设置正确吗?