Description
In Apache Spark versions prior to 3.4.0, applications using spark-submit can specify a 'proxy-user' to run as, limiting privileges. The application can execute code with the privileges of the submitting user, however, by providing malicious configuration-related classes on the classpath. This affects architectures relying on proxy-user, for example those using Apache Livy to manage submitted applications.
Update to Apache Spark 3.4.0 or later, and ensure that
spark.submit.proxyUser.allowCustomClasspathInClusterMode is set to its
default of "false", and is not overridden by submitted applications.
Affected products
| Vendor | Product | Affected | Fixed |
|---|---|---|---|
| Apache Software Foundation | Apache Spark | < 3.4.0 | 3.4.0 |
Affected packages
| Ecosystem | Package | Affected | Fixed | Record |
|---|---|---|---|---|
| Maven | org.apache.spark:spark-core_2.12 | < 3.3.3 | 3.3.3 | GHSA-329j-jfvr-rhr6 |
| Maven | org.apache.spark:spark-core_2.13 | < 3.3.3 | 3.3.3 | GHSA-329j-jfvr-rhr6 |
| PyPI | pyspark | < 3.4.0 | 3.4.0 | PYSEC-2023-44 |
| PyPI | pyspark | < 3.3.2 | 3.3.2 | GHSA-329j-jfvr-rhr6 |
Advisories 1
- WID-SEC-2023-2675 Oracle Financial Services Applications: Mehrere Schwachstellen BSI CERT-Bund (WID) · Oct 17, 2023
References
- https://lists.apache.org/thread/yllfl25xh5tbotjmg93zrq4bzwhqc0gv vendor-advisory