Versions Compared

Old Version 13

changes.mady.by.user Jason Brown

Saved on

compared with

New Version 14

changes.mady.by.user Matt Zimmerman

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
titleInstall the Apache Toree kernel with geomesa compute jar
{
  "argv": [
    "/usr/local/share/jupyter/kernels/apache_toree_scala/bin/run.sh",
    "--profile",
    "{connection_file}"
  ],
  "language": "scala211",
  "env": {
    "PYTHON_EXEC": "python",
    "__TOREE_OPTS__": "",
    "PYTHONPATH": "/opt/spark-1.6.1-bin-hadoop2.6//python:/opt/spark-1.6.1-bin-hadoop2.6//python/lib/py4j-0.9-src.zip",
    "DEFAULT_INTERPRETER": "Scala",
    "SPARK_HOME": "/opt/spark-1.6.1-bin-hadoop2.6/",
    "__TOREE_SPARK_OPTS__": ""
  },
  "display_name": "Apache Toree - Scala"
}

Installing Vegas for graphing

To download the JARs for Vegas:

Code Block
languagebash
$ curl -L -O 'http://search.maven.org/remotecontent?filepath=org/apache/ivy/ivy/2.3.0/ivy-2.3.0.jar'
$ java -jar ivy-2.3.0.tar -dependency org.vegas-viz vegas-spark_2.11 0.3.6 -retrieve "lib/[artifact]-[revision](-[classifier]).[ext]"
$ sudo cp lib/* $SPARK_HOME/jars

Then within the Jupyter notebook, add the following imports:

Code Block
languagescala
import vegas._
import vegas.render.HTMLRenderer._
import vegas.sparkExt._

Configure Jupyter

Prepare the notebook server for public use: use a password and bind to IPs.

...