cnvrg allows users to run jobs on a spark cluster either with python or scala.

Use scala in Notebooks

  • Go to your project
  • Click on Notebooks tab
  • Start a Jupyter on Spark Notebook
  • Click on New
  • Click on Scala
  • The scala Kernel will start and you can start using scala inside the spark cluster

Use scala in Experiments

  • Go to your project
  • Sync your experiment files and jar files
  • Click on Experiments tab
  • Start a new experiment using spark-submit, i.e.:
  • Your experiment will run on your spark cluster using scala:

Did this answer your question?