本文介绍了如何设置mesos上独立的OS / X上运行的火花的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我想做一个Mac上星火计划的测试。星火正在运行,并且我的火花斯卡拉程序编译:但有一个库( mesos 的。所以?)在运行时错误:

I want to do testing of Spark programs on a Mac. Spark is running and my spark scala program compiles: but there is a library (mesos.so ?) error at runtime:

Exception in thread "main" java.lang.UnsatisfiedLinkError: no mesos in java.library.path
    at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1758)
    at java.lang.Runtime.loadLibrary0(Runtime.java:823)
    at java.lang.System.loadLibrary(System.java:1045)
    at org.apache.mesos.MesosNativeLibrary.load(MesosNativeLibrary.java:46)
    at spark.SparkContext.<init>(SparkContext.scala:170)
    at com.blazedb.scala.ccp.spark.LoadRDD$.main(LoadRDD.scala:14)

什么设​​置上需要超越的火花服务器本身mesos OS / X来运行的火花客户端程序?

What setup is required on os/x beyond the spark server itself for mesos in order to run a spark client program?

推荐答案

如果你想使用与Mesos星火,还有的说明,包括如何找到在OS X的路径Mesos库笔记。

If you want to use Spark with Mesos, there are instructions on the project website, including notes on how to find the path to the Mesos library on OS X.

当你已经注意到,有如果你不想升级。

Based on your stacktrace, it looks like you might be using an older version of Spark. Since Spark 0.8.0+, the packages have been moved into the org.apache.spark namespace, so you might need to use earlier versions of the docs if you don't want to upgrade.

这篇关于如何设置mesos上独立的OS / X上运行的火花的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!

09-24 11:46