rest - Building spark-jobserver Using SBT and Scala -
can suggest me better documentation spark-jobserver. have gone through url spark-jobserver unable follow same. great if 1 explain step step instruction on how use spark-jobserver.
tools used in building project.
- sbt launcher version 0.13.5
- scala code runner version 2.11.6
with above mentioned tools getting errors while building spark-jobserver.
here steps used install:
- clone jobserver repo.
- get sbt using
wget https://dl.bintray.com/sbt/native-packages/sbt/0.13.8/sbt-0.13.8.tgz
- move "sbt-launch.jar" in sbt/bin /bin
- create script /bin/sbt, contents found here, making sure change pointer java if necessary
- make above script executable
- now cd spark jobserver directory, , run
sbt publish-local
- assuming above successful, run
sbt
in same directory - finally, use command
re-start
, , if succeeds server running!
Comments
Post a Comment