Lightning-fast unified analytics engine

New repository service for spark-packages

The spark-packages team has spun up a new repository service at https://repos.spark-packages.org and it will be the new home for the artifacts on spark-packages.

Bintray, the original repository service used for https://spark-packages.org/, is in its sunset process, and will no longer be available from May 1st. To consume artifacts from the new repository service, please replace “dl.bintray.com/spark-packages/maven” with “repos.spark-packages.org” in the Maven pom files or sbt build files in your repositories.

If you are using --packages to specify artifacts on spark-packages, with spark-submit, spark-shell, etc., you need to set the environment variable DEFAULT_ARTIFACT_REPOSITORY to https://repos.spark-packages.org/, before Spark 2.4.8, 3.0.3 and 3.1.2 are released.

If you have any questions for using the new repository service, or any general questions for spark-packages, please reach out to feedback@spark-packages.org.


Spark News Archive