Spark 3.3.2 is a maintenance release containing stability fixes. This release is based on the branch-3.3 maintenance branch of Spark. We strongly recommend all 3.3 users to upgrade to this stable release.
.newInstance()in K8s module
spark.scheduler.mode=FAIRshould provide FAIR scheduler
build/sbtshould allow SBT_OPTS to override JVM memory setting
README.mdfrom triggering CIs
lintjob by skipping PySpark and SparkR docs if unchanged
flake8tests if the command is not available
random data test
[SPARK-41185]: Remove ARM limitation for YuniKorn from docs
While being a maintenance release we did still upgrade some dependencies in this release they are:
You can consult JIRA for the detailed changes.
We would like to acknowledge all community members for contributing patches to this release.