"Fossies" - the Fresh Open Source Software Archive  

Source code changes report for "spark" between the packages
spark-3.0.1.tgz and spark-3.0.2.tgz

About: Apache Spark is a fast and general engine for large-scale data processing (especially for use in Hadoop clusters; supports Scala, Java and Python). 3.0 branch.

Summary:

The "spark" source code changed by about 0.7% and now consists of 16256 regular files (+75) and 1862 directories (+22).

Related Informations:

None found by Fossies.

Changes In Files (According File Type):

File TypeTotalAddedRemovedChanged
C program 130 0 0 10
Assembler program 8 0 0 1
Java program 1171 0 0 21
Python program 367 1 0 44
Shell program 81 0 0 5
Ruby program 3 0 0 0
Configuration file 4 0 0 0
Initialization file 1 0 0 1
JavaScript file 38 0 0 4
JSON file 141 6 0 2
Makefile 3 0 0 0
Man page 1 0 0 0
SGML document 6 0 0 1
XML document 49 1 0 37
PE Binary file 75 0 0 0
Command file 16 0 0 0
CSS style sheet 20 0 0 1
CSV file 27 0 0 0
DOS Batch file 3 0 0 0
Git file 6 0 0 0
HTML page 95 0 0 4
Log file 2 0 0 0
MS office document 1 0 0 0
Property file 28 0 0 0
Resource file 7 0 0 0
RST file 7 0 0 0
SQL file 383 0 0 7
TeX document 8 0 0 0
YAML file 14 1 0 3
Data file 259 32 0 11
Image file 82 0 0 0
Directory 1862 22 0 0
Archive 30 1 0 0
Information file 28 16 0 1
License 24 0 0 0
Readme file 17 0 0 1
Text file 9573 9 2 337
Other 3550 10 0 0
Total Files18120992491



C Programs (10 of 130):

NameStatusDeltaVisual Diff
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala changed 4.8% diff
examples/src/main/scala/org/apache/spark/examples/DFSReadWriteTest.scala changed 3.2% diff
examples/src/main/scala/org/apache/spark/examples/streaming/CustomReceiver.scala changed 2.0% diff
examples/src/main/scala/org/apache/spark/examples/streaming/NetworkWordCount.scala changed 3.1% diff
examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala changed 1.2% diff
examples/src/main/scala/org/apache/spark/examples/streaming/SqlNetworkWordCount.scala changed 2.1% diff
examples/src/main/scala/org/apache/spark/examples/streaming/StatefulNetworkWordCount.scala changed 2.6% diff
external/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala changed 1.7% diff
sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLCLIDriver.scala changed 9.4% diff
streaming/src/main/scala/org/apache/spark/streaming/util/RawTextSender.scala changed 4.7% diff

Assembler Programs (1 of 8):

NameStatusDeltaVisual Diff
core/src/main/scala/org/apache/spark/internal/config/package.scala changed 0.3% diff

Java Programs (21 of 1171):

NameStatusDeltaVisual Diff
common/kvstore/src/main/java/org/apache/spark/util/kvstore/InMemoryStore.java changed 1.2% diff
common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java changed 0.2% diff
core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java changed 5.6% diff
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java changed 23.2% diff
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeInMemorySorter.java changed 8.9% diff
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterIterator.java changed 4.0% diff
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillMerger.java changed 3.3% diff
core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeSorterSpillReader.java changed 2.1% diff
core/src/test/java/org/apache/spark/unsafe/map/AbstractBytesToBytesMapSuite.java changed 0.4% diff
core/src/test/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorterSuite.java changed 8.6% diff
core/src/test/java/org/apache/spark/util/collection/unsafe/sort/UnsafeInMemorySorterSuite.java changed 11.1% diff
core/src/test/java/test/org/apache/spark/JavaSparkContextSuite.java changed 14.4% diff
examples/src/main/java/org/apache/spark/examples/streaming/JavaCustomReceiver.java changed 1.5% diff
examples/src/main/java/org/apache/spark/examples/streaming/JavaNetworkWordCount.java changed 2.5% diff
examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java changed 1.0% diff
examples/src/main/java/org/apache/spark/examples/streaming/JavaSqlNetworkWordCount.java changed 1.8% diff
external/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java changed 0.8% diff
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/RowBasedKeyValueBatch.java changed 4.7% diff
sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedColumnReader.ja
va
changed 5.5% diff
sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java changed 0.5% diff
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVectorUtils.java changed 2.9% diff

Python Programs (45 of 367):

NameStatusDeltaVisual Diff
dev/run-tests.py changed 2.4% diff
dev/sparktestsupport/modules.py changed 0.2% diff
docs/sql-data-sources-avro.md changed 0.4% diff
docs/sql-ref-datatypes.md changed 0.3% diff
docs/structured-streaming-programming-guide.md changed 0.3% diff
examples/src/main/python/ml/train_validation_split.py changed 1.1% diff
examples/src/main/python/sql/arrow.py changed 1.7% diff
examples/src/main/python/sql/datasource.py changed 0.8% diff
examples/src/main/python/streaming/recoverable_network_wordcount.py changed 1.7% diff
examples/src/main/python/streaming/sql_network_wordcount.py changed 2.4% diff
external/kinesis-asl/src/main/python/examples/streaming/kinesis_wordcount_asl.py changed 1.9% diff
python/pyspark/context.py changed 0.2% diff
python/pyspark/ml/classification.py changed 1.8% diff
python/pyspark/ml/feature.py changed 0.1% diff
python/pyspark/ml/param/__init__.py changed 1.1% diff
python/pyspark/ml/pipeline.py changed 16.2% diff
python/pyspark/ml/tests/test_feature.py changed 0.5% diff
python/pyspark/ml/tests/test_tuning.py changed 7.1% diff
python/pyspark/ml/tests/test_util.py added
python/pyspark/ml/tuning.py changed 13.2% diff
python/pyspark/ml/util.py changed 8.6% diff
python/pyspark/sql/context.py changed 0.8% diff
python/pyspark/sql/functions.py changed 0.3% diff
python/pyspark/sql/pandas/serializers.py changed 5.6% diff
python/pyspark/sql/readwriter.py changed 0.3% diff
python/pyspark/sql/tests/test_arrow.py changed 1.7% diff
python/pyspark/sql/tests/test_context.py changed 37.4% diff
python/pyspark/sql/tests/test_functions.py changed 30.0% diff
python/pyspark/sql/tests/test_pandas_cogrouped_map.py changed 4.6% diff
python/pyspark/sql/tests/test_pandas_grouped_map.py changed 2.3% diff
python/pyspark/sql/tests/test_pandas_map.py changed 7.4% diff
python/pyspark/sql/tests/test_types.py changed 1.2% diff
python/pyspark/tests/test_taskcontext.py changed 1.6% diff
python/pyspark/tests/test_worker.py changed 6.3% diff
python/pyspark/version.py changed 2.9% diff
python/pyspark/worker.py changed 0.2% diff
python/run-tests.py changed 5.0% diff
python/setup.py changed 0.5% diff
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnClusterSuite.scala changed 0.7% diff
sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala changed 0.3% diff
sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala changed 0.4% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala changed 1.3% diff
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala changed 0.8% diff
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala changed 1.0% diff
sql/hive/src/test/resources/data/scripts/test_transform.py changed 100.0% diff

Shell Programs (5 of 81):

NameStatusDeltaVisual Diff
build/spark-build-info changed 6.4% diff
dev/check-license changed 0.7% diff
dev/create-release/release-build.sh changed 0.4% diff
dev/run-tests-jenkins changed 1.9% diff
sql/create-docs.sh changed 7.5% diff

Initialization Files (all 1):

NameStatusDeltaVisual Diff
dev/tox.ini changed 12.1% diff

JavaScript Files (4 of 38):

NameStatusDeltaVisual Diff
core/src/main/resources/org/apache/spark/ui/static/sorttable.js changed 3.0% diff
core/src/main/resources/org/apache/spark/ui/static/stagepage.js changed 1.1% diff
core/src/main/resources/org/apache/spark/ui/static/timeline-view.js changed 16.2% diff
core/src/main/resources/org/apache/spark/ui/static/utils.js changed 4.2% diff

JSON Files (8 of 141):

NameStatusDeltaVisual Diff
core/src/test/resources/HistoryServerExpectations/executor_memory_usage_expectation.json changed 0.6% diff
core/src/test/resources/HistoryServerExpectations/executor_node_blacklisting_expectation.json changed 0.6% diff
mllib/src/test/resources/ml-models/dtc-2.4.7/metadata/part-00000 added
mllib/src/test/resources/ml-models/dtr-2.4.7/metadata/part-00000 added
mllib/src/test/resources/ml-models/gbtc-2.4.7/metadata/part-00000 added
mllib/src/test/resources/ml-models/gbtr-2.4.7/metadata/part-00000 added
mllib/src/test/resources/ml-models/rfc-2.4.7/metadata/part-00000 added
mllib/src/test/resources/ml-models/rfr-2.4.7/metadata/part-00000 added

SGML Documents (1 of 6):

NameStatusDeltaVisual Diff
sql/core/src/test/resources/sql-functions/sql-expression-schema.md changed 1.1% diff

XML Documents (38 of 49):

NameStatusDeltaVisual Diff
assembly/pom.xml changed 0.3% diff
common/kvstore/pom.xml changed 0.9% diff
common/network-common/pom.xml changed 0.6% diff
common/network-shuffle/pom.xml changed 0.9% diff
common/network-yarn/pom.xml changed 0.4% diff
common/sketch/pom.xml changed 1.1% diff
common/tags/pom.xml changed 1.6% diff
common/unsafe/pom.xml changed 0.8% diff
core/pom.xml changed 0.2% diff
core/src/test/resources/hive-site.xml added
examples/pom.xml changed 0.5% diff
external/avro/pom.xml changed 1.0% diff
external/docker-integration-tests/pom.xml changed 13.7% diff
external/kafka-0-10-assembly/pom.xml changed 0.5% diff
external/kafka-0-10-sql/pom.xml changed 0.5% diff
external/kafka-0-10-token-provider/pom.xml changed 1.0% diff
external/kafka-0-10/pom.xml changed 0.6% diff
external/kinesis-asl-assembly/pom.xml changed 0.4% diff
external/kinesis-asl/pom.xml changed 0.7% diff
external/spark-ganglia-lgpl/pom.xml changed 1.6% diff
graphx/pom.xml changed 0.9% diff
hadoop-cloud/pom.xml changed 0.3% diff
launcher/pom.xml changed 0.9% diff
mllib-local/pom.xml changed 1.0% diff
mllib/pom.xml changed 0.4% diff
pom.xml changed 0.7% diff
repl/pom.xml changed 0.5% diff
resource-managers/kubernetes/core/pom.xml changed 0.8% diff
resource-managers/kubernetes/integration-tests/pom.xml changed 0.3% diff
resource-managers/mesos/pom.xml changed 0.7% diff
resource-managers/yarn/pom.xml changed 0.4% diff
sql/catalyst/pom.xml changed 0.4% diff
sql/core/pom.xml changed 0.4% diff
sql/core/src/test/resources/hive-site.xml changed 17.4% diff
sql/hive-thriftserver/pom.xml changed 0.6% diff
sql/hive/pom.xml changed 0.4% diff
streaming/pom.xml changed 0.6% diff
tools/pom.xml changed 1.1% diff

CSS Style Sheets (1 of 20):

NameStatusDeltaVisual Diff
docs/css/main.css changed 1.0% diff

HTML Pages (4 of 95):

NameStatusDeltaVisual Diff
core/src/main/scala/org/apache/spark/ui/JettyUtils.scala changed 0.004%
docs/monitoring.md changed 0.002%
docs/sql-performance-tuning.md changed 0.1%
docs/sql-ref-null-semantics.md changed 0.01%

SQL Files (7 of 383):

NameStatusDeltaVisual Diff
sql/core/src/test/resources/sql-tests/inputs/except.sql changed 26.2% diff
sql/core/src/test/resources/sql-tests/inputs/group-by.sql changed 4.3% diff
sql/core/src/test/resources/sql-tests/inputs/having.sql changed 35.8% diff
sql/core/src/test/resources/sql-tests/inputs/higher-order-functions.sql changed 4.2% diff
sql/core/src/test/resources/sql-tests/inputs/intersect-all.sql changed 12.4% diff
sql/core/src/test/resources/sql-tests/inputs/interval.sql changed 5.4% diff
sql/core/src/test/resources/sql-tests/inputs/union.sql changed 23.8% diff

YAML Files (4 of 14):

NameStatusDeltaVisual Diff
.github/workflows/build_and_test.yml changed 59.4% diff
.github/workflows/publish_snapshot.yml added
docs/_config.yml changed 8.0% diff
docs/_data/menu-sql.yaml changed 0.8% diff

Data Files (43 of 259):

NameStatusDeltaVisual Diff
mllib/src/test/resources/ml-models/dtc-2.4.7/data/._SUCCESS.crc added
mllib/src/test/resources/ml-models/dtc-2.4.7/data/.part-00000-bd7ae42f-c890-406c-894c-ca4eac67c690-
c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/dtc-2.4.7/metadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/dtc-2.4.7/metadata/.part-00000.crc added
mllib/src/test/resources/ml-models/dtr-2.4.7/data/._SUCCESS.crc added
mllib/src/test/resources/ml-models/dtr-2.4.7/data/.part-00000-39b027f0-a437-4b3d-84af-d861adcb9ca8-
c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/dtr-2.4.7/metadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/dtr-2.4.7/metadata/.part-00000.crc added
mllib/src/test/resources/ml-models/gbtc-2.4.7/data/._SUCCESS.crc added
mllib/src/test/resources/ml-models/gbtc-2.4.7/data/.part-00000-dacbde64-c861-41c7-91c0-6da8cc01fb43
-c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/gbtc-2.4.7/metadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/gbtc-2.4.7/metadata/.part-00000.crc added
mllib/src/test/resources/ml-models/gbtc-2.4.7/treesMetadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/gbtc-2.4.7/treesMetadata/.part-00000-81137d9f-31e3-4a90-813c-ddc
394101e21-c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/gbtr-2.4.7/data/._SUCCESS.crc added
mllib/src/test/resources/ml-models/gbtr-2.4.7/data/.part-00000-3b5433ff-d346-4511-9aab-639288bfae6d
-c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/gbtr-2.4.7/metadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/gbtr-2.4.7/metadata/.part-00000.crc added
mllib/src/test/resources/ml-models/gbtr-2.4.7/treesMetadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/gbtr-2.4.7/treesMetadata/.part-00000-6b9124f5-87fe-4fd8-ad9c-4be
239c2215a-c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/rfc-2.4.7/data/._SUCCESS.crc added
mllib/src/test/resources/ml-models/rfc-2.4.7/data/.part-00000-e41a7b98-91f8-4485-b112-25b4b11c9009-
c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/rfc-2.4.7/metadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/rfc-2.4.7/metadata/.part-00000.crc added
mllib/src/test/resources/ml-models/rfc-2.4.7/treesMetadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/rfc-2.4.7/treesMetadata/.part-00000-21082d24-b666-4c4e-a823-70c7
afdcbdc5-c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/rfr-2.4.7/data/._SUCCESS.crc added
mllib/src/test/resources/ml-models/rfr-2.4.7/data/.part-00000-4a69607d-6edb-40fc-b681-981caaeca996-
c000.snappy.parquet.crc
added
mllib/src/test/resources/ml-models/rfr-2.4.7/metadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/rfr-2.4.7/metadata/.part-00000.crc added
mllib/src/test/resources/ml-models/rfr-2.4.7/treesMetadata/._SUCCESS.crc added
mllib/src/test/resources/ml-models/rfr-2.4.7/treesMetadata/.part-00000-dfe4db51-d349-447a-9b86-d95e
daabcde8-c000.snappy.parquet.crc
added
sql/core/src/test/resources/sql-tests/results/ansi/datetime.sql.out changed 0.7% diff
sql/core/src/test/resources/sql-tests/results/ansi/higher-order-functions.sql.out changed 7.1% diff
sql/core/src/test/resources/sql-tests/results/ansi/interval.sql.out changed 14.9% diff
sql/core/src/test/resources/sql-tests/results/except.sql.out changed 38.1% diff
sql/core/src/test/resources/sql-tests/results/group-by.sql.out changed 7.1% diff
sql/core/src/test/resources/sql-tests/results/having.sql.out changed 36.9% diff
sql/core/src/test/resources/sql-tests/results/higher-order-functions.sql.out changed 7.7% diff
sql/core/src/test/resources/sql-tests/results/intersect-all.sql.out changed 12.3% diff
sql/core/src/test/resources/sql-tests/results/interval.sql.out changed 12.8% diff
sql/core/src/test/resources/sql-tests/results/show-tables.sql.out changed 2.2% diff
sql/core/src/test/resources/sql-tests/results/union.sql.out changed 22.4% diff

Directories (22 of 1862):

NameStatus
mllib/src/test/resources/ml-models/dtc-2.4.7 added
mllib/src/test/resources/ml-models/dtc-2.4.7/data added
mllib/src/test/resources/ml-models/dtc-2.4.7/metadata added
mllib/src/test/resources/ml-models/dtr-2.4.7 added
mllib/src/test/resources/ml-models/dtr-2.4.7/data added
mllib/src/test/resources/ml-models/dtr-2.4.7/metadata added
mllib/src/test/resources/ml-models/gbtc-2.4.7 added
mllib/src/test/resources/ml-models/gbtc-2.4.7/data added
mllib/src/test/resources/ml-models/gbtc-2.4.7/metadata added
mllib/src/test/resources/ml-models/gbtc-2.4.7/treesMetadata added
mllib/src/test/resources/ml-models/gbtr-2.4.7 added
mllib/src/test/resources/ml-models/gbtr-2.4.7/data added
mllib/src/test/resources/ml-models/gbtr-2.4.7/metadata added
mllib/src/test/resources/ml-models/gbtr-2.4.7/treesMetadata added
mllib/src/test/resources/ml-models/rfc-2.4.7 added
mllib/src/test/resources/ml-models/rfc-2.4.7/data added
mllib/src/test/resources/ml-models/rfc-2.4.7/metadata added
mllib/src/test/resources/ml-models/rfc-2.4.7/treesMetadata added
mllib/src/test/resources/ml-models/rfr-2.4.7 added
mllib/src/test/resources/ml-models/rfr-2.4.7/data added
mllib/src/test/resources/ml-models/rfr-2.4.7/metadata added
mllib/src/test/resources/ml-models/rfr-2.4.7/treesMetadata added

Archives (1 of 30):

NameStatusDeltaVisual Diff
sql/core/src/test/resources/test-data/percentile_approx-input.csv.bz2 added

Information Files (17 of 28):

NameStatusDeltaVisual Diff
mllib/src/test/resources/ml-models/dtc-2.4.7/data/_SUCCESS added
mllib/src/test/resources/ml-models/dtc-2.4.7/metadata/_SUCCESS added
mllib/src/test/resources/ml-models/dtr-2.4.7/data/_SUCCESS added
mllib/src/test/resources/ml-models/dtr-2.4.7/metadata/_SUCCESS added
mllib/src/test/resources/ml-models/gbtc-2.4.7/data/_SUCCESS added
mllib/src/test/resources/ml-models/gbtc-2.4.7/metadata/_SUCCESS added
mllib/src/test/resources/ml-models/gbtc-2.4.7/treesMetadata/_SUCCESS added
mllib/src/test/resources/ml-models/gbtr-2.4.7/data/_SUCCESS added
mllib/src/test/resources/ml-models/gbtr-2.4.7/metadata/_SUCCESS added
mllib/src/test/resources/ml-models/gbtr-2.4.7/treesMetadata/_SUCCESS added
mllib/src/test/resources/ml-models/rfc-2.4.7/data/_SUCCESS added
mllib/src/test/resources/ml-models/rfc-2.4.7/metadata/_SUCCESS added
mllib/src/test/resources/ml-models/rfc-2.4.7/treesMetadata/_SUCCESS added
mllib/src/test/resources/ml-models/rfr-2.4.7/data/_SUCCESS added
mllib/src/test/resources/ml-models/rfr-2.4.7/metadata/_SUCCESS added
mllib/src/test/resources/ml-models/rfr-2.4.7/treesMetadata/_SUCCESS added
R/pkg/DESCRIPTION changed 1.1% diff

Readme Files (1 of 17):

NameStatusDeltaVisual Diff
docs/README.md changed 3.1% diff

Text Files (348 of 9573):

NameStatusDeltaVisual Diff
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala changed 0.2% diff
core/src/main/scala/org/apache/spark/api/python/PythonUtils.scala changed 4.3% diff
core/src/main/scala/org/apache/spark/api/r/RUtils.scala changed 1.5% diff
core/src/main/scala/org/apache/spark/broadcast/TorrentBroadcast.scala changed 6.6% diff
core/src/main/scala/org/apache/spark/ContextAwareIterator.scala added
core/src/main/scala/org/apache/spark/deploy/history/EventLogFileReaders.scala changed 4.5% diff
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala changed 2.2% diff
core/src/main/scala/org/apache/spark/deploy/master/Master.scala changed 0.2% diff
core/src/main/scala/org/apache/spark/deploy/master/ui/MasterPage.scala changed 2.2% diff
core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala changed 1.9% diff
core/src/main/scala/org/apache/spark/deploy/security/HadoopFSDelegationTokenProvider.scala changed 20.1% diff
core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala changed 3.7% diff
core/src/main/scala/org/apache/spark/deploy/StandaloneResourceUtils.scala changed 4.5% diff
core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala changed 5.7% diff
core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala changed 0.1% diff
core/src/main/scala/org/apache/spark/executor/Executor.scala changed 2.4% diff
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala changed 1.0% diff
core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala changed 4.6% diff
core/src/main/scala/org/apache/spark/internal/io/SparkHadoopWriter.scala changed 1.7% diff
core/src/main/scala/org/apache/spark/internal/io/SparkHadoopWriterUtils.scala changed 16.5% diff
core/src/main/scala/org/apache/spark/metrics/sink/PrometheusServlet.scala changed 1.2% diff
core/src/main/scala/org/apache/spark/rdd/SubtractedRDD.scala changed 1.5% diff
core/src/main/scala/org/apache/spark/resource/ResourceUtils.scala changed 1.5% diff
core/src/main/scala/org/apache/spark/rpc/netty/Inbox.scala changed 9.4% diff
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala changed 0.6% diff
core/src/main/scala/org/apache/spark/scheduler/cluster/ExecutorData.scala changed 6.7% diff
core/src/main/scala/org/apache/spark/scheduler/cluster/StandaloneSchedulerBackend.scala changed 3.8% diff
core/src/main/scala/org/apache/spark/scheduler/dynalloc/ExecutorMonitor.scala changed 0.5% diff
core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala changed 1.1% diff
core/src/main/scala/org/apache/spark/SparkConf.scala changed 0.3% diff
core/src/main/scala/org/apache/spark/SparkContext.scala changed 0.7% diff
core/src/main/scala/org/apache/spark/status/api/v1/api.scala changed 3.1% diff
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala changed 0.9% diff
core/src/main/scala/org/apache/spark/TestUtils.scala changed 3.4% diff
core/src/main/scala/org/apache/spark/ui/jobs/JobPage.scala changed 0.2% diff
core/src/main/scala/org/apache/spark/util/Utils.scala changed 0.2% diff
core/src/test/scala/org/apache/spark/benchmark/Benchmark.scala changed 0.4% diff
core/src/test/scala/org/apache/spark/deploy/DeployTestUtils.scala changed 0.8% diff
core/src/test/scala/org/apache/spark/deploy/history/EventLogFileWritersSuite.scala changed 2.0% diff
core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala changed 3.2% diff
core/src/test/scala/org/apache/spark/deploy/LogUrlsStandaloneSuite.scala changed 4.5% diff
core/src/test/scala/org/apache/spark/deploy/master/MasterSuite.scala changed 1.9% diff
core/src/test/scala/org/apache/spark/deploy/worker/DriverRunnerTest.scala changed 1.6% diff
core/src/test/scala/org/apache/spark/executor/ExecutorSuite.scala changed 7.3% diff
core/src/test/scala/org/apache/spark/HeartbeatReceiverSuite.scala changed 5.1% diff
core/src/test/scala/org/apache/spark/internal/io/SparkHadoopWriterUtilsSuite.scala added
core/src/test/scala/org/apache/spark/memory/TestMemoryManager.scala changed 6.8% diff
core/src/test/scala/org/apache/spark/metrics/sink/StatsdSinkSuite.scala changed 20.3% diff
core/src/test/scala/org/apache/spark/rpc/netty/InboxSuite.scala changed 10.8% diff
core/src/test/scala/org/apache/spark/SparkContextSuite.scala changed 4.5% diff
core/src/test/scala/org/apache/spark/status/api/v1/ExecutorSummarySuite.scala added
core/src/test/scala/org/apache/spark/storage/BlockManagerReplicationSuite.scala changed 0.6% diff
core/src/test/scala/org/apache/spark/ui/UISeleniumSuite.scala changed 1.6% diff
core/src/test/scala/org/apache/spark/ui/UISuite.scala changed 3.5% diff
core/src/test/scala/org/apache/spark/util/FileAppenderSuite.scala changed 0.6% diff
core/src/test/scala/org/apache/spark/util/MutableURLClassLoaderSuite.scala changed 3.1% diff
dev/.rat-excludes changed 9.8% diff
dev/deps/spark-deps-hadoop-2.7-hive-1.2 changed 1.5% diff
dev/deps/spark-deps-hadoop-2.7-hive-2.3 changed 1.4% diff
dev/deps/spark-deps-hadoop-3.2-hive-2.3 changed 1.3% diff
docs/configuration.md changed 1.3% diff
docs/job-scheduling.md changed 4.9% diff
docs/quick-start.md changed 0.2% diff
docs/running-on-kubernetes.md changed 0.4% diff
docs/running-on-yarn.md changed 3.2% diff
docs/sql-data-sources-parquet.md changed 1.0% diff
docs/sql-migration-guide.md changed 2.3% diff
docs/sql-ref-ansi-compliance.md changed 1.3% diff
docs/sql-ref-syntax-aux-show-table.md changed 1.8% diff
docs/sql-ref-syntax-ddl-create-function.md changed 2.0% diff
docs/sql-ref-syntax-ddl-create-table-datasource.md changed 7.2% diff
docs/sql-ref-syntax-ddl-create-table-hiveformat.md changed 18.6% diff
docs/sql-ref-syntax-qry-select-file.md added
docs/sql-ref-syntax-qry-select.md changed 1.4% diff
docs/sql-ref-syntax-qry.md changed 1.8% diff
docs/sql-ref-syntax.md changed 1.0% diff
docs/structured-streaming-kafka-integration.md changed 0.1% diff
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroDeserializer.scala changed 3.4% diff
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala changed 1.1% diff
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroLogicalTypeSuite.scala changed 0.3% diff
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala changed 3.1% diff
external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/DockerJDBCIntegrationSui
te.scala
changed 5.8% diff
external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/MsSqlServerIntegrationSu
ite.scala
changed 78.6% diff
external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.s
cala
changed 5.0% diff
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPool.scala changed 3.1% diff
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/consumer/KafkaDataConsumer.sca
la
changed 3.8% diff
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchStream.scala changed 1.1% diff
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala changed 0.8% diff
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/consumer/FetchedDataPoolSuite.
scala
changed 5.1% diff
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaContinuousSourceSuite.sca
la
changed 1.4% diff
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.sca
la
changed 0.5% diff
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaRelationSuite.scala changed 0.4% diff
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSourceOffsetSuite.scala changed 2.9% diff
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaTestUtils.scala changed 1.0% diff
external/kafka-0-10-token-provider/src/main/scala/org/apache/spark/kafka010/KafkaTokenUtil.scala changed 1.3% diff
external/kafka-0-10/src/test/scala/org/apache/spark/streaming/kafka010/KafkaRDDSuite.scala changed 0.9% diff
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisUtilsPythonHelper.sca
la
changed 2.6% diff
graphx/src/test/scala/org/apache/spark/graphx/lib/PageRankSuite.scala changed 0.9% diff
mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala changed 1.8% diff
mllib/src/main/scala/org/apache/spark/ml/tree/treeModels.scala changed 7.0% diff
mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/RowMatrix.scala changed 0.7% diff
mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala changed 1.3% diff
mllib/src/test/scala/org/apache/spark/ml/classification/DecisionTreeClassifierSuite.scala changed 2.5% diff
mllib/src/test/scala/org/apache/spark/ml/classification/GBTClassifierSuite.scala changed 2.5% diff
mllib/src/test/scala/org/apache/spark/ml/classification/MultilayerPerceptronClassifierSuite.scala changed 0.4% diff
mllib/src/test/scala/org/apache/spark/ml/classification/NaiveBayesSuite.scala changed 0.3% diff
mllib/src/test/scala/org/apache/spark/ml/classification/RandomForestClassifierSuite.scala changed 4.5% diff
mllib/src/test/scala/org/apache/spark/ml/feature/HashingTFSuite.scala changed 0.9% diff
mllib/src/test/scala/org/apache/spark/ml/feature/StringIndexerSuite.scala changed 0.2% diff
mllib/src/test/scala/org/apache/spark/ml/regression/DecisionTreeRegressorSuite.scala changed 6.0% diff
mllib/src/test/scala/org/apache/spark/ml/regression/GBTRegressorSuite.scala changed 3.0% diff
mllib/src/test/scala/org/apache/spark/ml/regression/RandomForestRegressorSuite.scala changed 5.2% diff
mllib/src/test/scala/org/apache/spark/ml/source/libsvm/LibSVMRelationSuite.scala changed 21.5% diff
mllib/src/test/scala/org/apache/spark/mllib/classification/NaiveBayesSuite.scala changed 1.3% diff
mllib/src/test/scala/org/apache/spark/mllib/linalg/distributed/RowMatrixSuite.scala changed 4.4% diff
mllib/src/test/scala/org/apache/spark/mllib/regression/StreamingLinearRegressionSuite.scala changed 0.6% diff
project/MimaExcludes.scala changed 0.4% diff
R/pkg/R/DataFrame.R changed 0.03% diff
R/pkg/R/functions.R changed 0.3% diff
R/pkg/tests/fulltests/test_sparkSQL_arrow.R changed 46.0% diff
R/pkg/tests/run-all.R changed 34.2% diff
repl/src/test/scala/org/apache/spark/repl/ExecutorClassLoaderSuite.scala changed 0.4% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala changed 5.4% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Constants.scala changed 1.2% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/PodTemplateCo
nfigMapStep.scala
changed 5.3% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesClien
tApplication.scala
changed 15.3% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/LoggingPodStatu
sWatcher.scala
changed 29.5% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPod
sAllocator.scala
changed 1.3% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPod
sLifecycleManager.scala
changed 20.6% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPod
sSnapshot.scala
changed 40.6% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPod
sSnapshotsStoreImpl.scala
changed 9.5% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesC
lusterManager.scala
changed 2.1% diff
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesC
lusterSchedulerBackend.scala
changed 3.0% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/features/PodTemplateCo
nfigMapStepSuite.scala
changed 8.1% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/submit/ClientSuite.sca
la
changed 1.4% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/Determinist
icExecutorPodsSnapshotsStore.scala
changed 13.7% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorLif
ecycleTestUtils.scala
changed 24.1% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPod
sLifecycleManagerSuite.scala
changed 18.6% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPod
sSnapshotsStoreSuite.scala
changed 20.9% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPod
sSnapshotSuite.scala
changed 69.8% diff
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesC
lusterSchedulerBackendSuite.scala
changed 7.2% diff
resource-managers/kubernetes/docker/src/main/dockerfiles/spark/bindings/R/Dockerfile changed 42.6% diff
resource-managers/kubernetes/docker/src/main/dockerfiles/spark/Dockerfile changed 1.4% diff
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrati
ontest/backend/minikube/Minikube.scala
changed 15.5% diff
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrati
ontest/KubernetesSuite.scala
changed 0.4% diff
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedS
chedulerBackend.scala
changed 0.7% diff
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBacke
ndUtil.scala
changed 0.5% diff
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala changed 0.5% diff
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/LocalityPlacementStrategySuite.s
cala
changed 16.4% diff
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnAllocatorSuite.scala changed 0.7% diff
sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 changed 0.8% diff
sql/catalyst/src/main/scala-2.12/org/apache/spark/sql/catalyst/expressions/AttributeMap.scala changed 3.4% diff
sql/catalyst/src/main/scala-2.13/org/apache/spark/sql/catalyst/expressions/AttributeMap.scala changed 3.4% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala changed 3.2% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala changed 3.4% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogUtils.scala changed 5.5% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/InMemoryCatalog.scala changed 7.2% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala changed 2.8% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala changed 0.1% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/ApproximatePercenti
le.scala
changed 6.4% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/CallMethodViaReflection.scala changed 2.7% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala changed 0.1% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala changed 0.6% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateOrdering.scal
a
changed 2.9% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala changed 0.7% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala changed 0.8% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala changed 1.1% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala changed 0.2% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala changed 1.2% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala changed 2.1% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala changed 13.0% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/finishAnalysis.scala changed 3.8% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NormalizeFloatingNumbers.scala changed 9.2% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala changed 0.7% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/PropagateEmptyRelation.scala changed 2.1% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala changed 1.0% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParserUtils.scala changed 1.5% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/AnalysisHelper.scala changed 8.0% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/SizeInBytes
OnlyStatsPlanVisitor.scala
changed 2.0% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala changed 7.3% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/QueryPlan.scala changed 29.7% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala changed 2.1% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala changed 0.9% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/HyperLogLogPlusPlusHelper.scala changed 0.5% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala changed 0.9% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/QuantileSummaries.scala changed 0.5% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/SQLOrderingUtil.scala added
sql/catalyst/src/main/scala/org/apache/spark/sql/Encoders.scala changed 1.0% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala changed 2.3% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/sources/filters.scala changed 0.5% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/types/DataType.scala changed 1.8% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/types/DoubleType.scala changed 3.7% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/types/FloatType.scala changed 3.6% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/types/numerics.scala changed 3.9% diff
sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala changed 9.5% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala changed 11.7% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/DataSourceV2AnalysisSuite.scala changed 4.6% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercionSuite.scala changed 1.2% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationsSuite.scala changed 0.4% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala changed 0.8% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/aggregate/HyperLogLogPlusPlus
Suite.scala
changed 17.1% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala changed 3.5% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CollectionExpressionsSuite.sc
ala
changed 1.6% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala changed 3.5% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/LiteralExpressionSuite.scala changed 0.7% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/LiteralGenerator.scala changed 10.7% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/PredicateSuite.scala changed 22.4% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/EliminateSortsSuite.scala changed 31.0% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FoldablePropagationSuite.scala changed 7.8% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/JoinReorderSuite.scala changed 3.2% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/LikeSimplificationSuite.scala changed 45.1% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/PropagateEmptyRelationSuite.sca
la
changed 2.7% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/StarJoinCostBasedReorderSuite.s
cala
changed 1.9% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/plans/QueryPlanSuite.scala changed 35.5% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/JoinEstimationSuite.scala changed 3.0% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/StatsEstimationTestBase.s
cala
changed 11.3% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/trees/TreeNodeSuite.scala changed 4.4% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala changed 3.6% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/IntervalUtilsSuite.scala changed 5.0% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/SQLOrderingUtilSuite.scala added
sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala changed 1.9% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/RandomDataGenerator.scala changed 1.2% diff
sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala changed 18.7% diff
sql/core/src/main/scala/org/apache/spark/sql/api/python/PythonSQLUtils.scala changed 13.0% diff
sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala changed 1.0% diff
sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala changed 0.3% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/AdaptiveSparkPlanExec.scala changed 0.5% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/AlreadyOptimized.scala removed
sql/core/src/main/scala/org/apache/spark/sql/execution/analysis/DetectAmbiguousSelfJoin.scala changed 10.6% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala changed 0.3% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/command/CommandUtils.scala changed 0.5% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala changed 2.6% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/command/functions.scala changed 2.6% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala changed 3.4% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala changed 3.0% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVDataSource.scala changed 1.1% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala changed 2.5% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala changed 2.6% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala changed 4.2% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InsertIntoHadoopFsRelationComman
d.scala
changed 2.5% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala changed 2.6% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonDataSource.scala changed 1.2% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala changed 1.0% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcUtils.scala changed 2.4% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRowConverter.scal
a
changed 4.9% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala changed 0.3% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala changed 1.6% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/FileTable.scala changed 5.3% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/orc/OrcPartitionReaderFactory
.scala
changed 1.3% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/RefreshTableExec.scala changed 43.4% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/SetCatalogAndNamespaceExec.sc
ala
changed 8.3% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V1FallbackWriters.scala changed 5.5% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala changed 3.1% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/debug/package.scala changed 2.4% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/EnsureRequirements.scala changed 6.4% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala changed 0.1% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashJoin.scala changed 6.5% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/python/EvalPythonExec.scala changed 4.0% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/python/MapInPandasExec.scala changed 6.5% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/QueryExecution.scala changed 4.7% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/RemoveRedundantSorts.scala added
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala changed 1.4% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala changed 0.7% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala changed 2.1% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala changed 2.3% diff
sql/core/src/main/scala/org/apache/spark/sql/execution/subquery.scala changed 6.3% diff
sql/core/src/main/scala/org/apache/spark/sql/expressions/Aggregator.scala changed 3.5% diff
sql/core/src/main/scala/org/apache/spark/sql/functions.scala changed 0.2% diff
sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala changed 2.4% diff
sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala changed 6.3% diff
sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala changed 6.3% diff
sql/core/src/main/scala/org/apache/spark/sql/jdbc/MsSqlServerDialect.scala changed 13.7% diff
sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala changed 0.2% diff
sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala changed 1.0% diff
sql/core/src/test/scala/org/apache/spark/sql/ApproximatePercentileQuerySuite.scala changed 6.5% diff
sql/core/src/test/scala/org/apache/spark/sql/BenchmarkQueryTest.scala changed 7.8% diff
sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala changed 14.3% diff
sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2SQLSuite.scala changed 0.5% diff
sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2Suite.scala changed 1.4% diff
sql/core/src/test/scala/org/apache/spark/sql/connector/DataSourceV2UtilsSuite.scala changed 6.7% diff
sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala changed 2.6% diff
sql/core/src/test/scala/org/apache/spark/sql/DataFrameJoinSuite.scala changed 9.1% diff
sql/core/src/test/scala/org/apache/spark/sql/DataFrameSelfJoinSuite.scala changed 3.8% diff
sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala changed 1.7% diff
sql/core/src/test/scala/org/apache/spark/sql/DataFrameWriterV2Suite.scala changed 14.5% diff
sql/core/src/test/scala/org/apache/spark/sql/DynamicPartitionPruningSuite.scala changed 5.0% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala changed 1.7% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/AlreadyOptimizedSuite.scala removed
sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala changed 12.2% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/compression/PassThroughEncodingSuit
e.scala
changed 0.9% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala changed 3.3% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/command/ShowPartitionsSuiteBase.scala added
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala changed 0.7% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/HadoopFileLinesReaderSuite.scala changed 1.6% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala changed 0.6% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.
scala
changed 85.9% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcSourceSuite.scala changed 3.1% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala changed 0.1% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetIOSuite.scala changed 5.7% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaPruningSuit
e.scala
changed 2.8% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/joins/BroadcastJoinSuite.scala changed 7.4% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/joins/HashedRelationSuite.scala changed 6.4% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala changed 1.7% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/QueryExecutionSuite.scala changed 6.0% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/RemoveRedundantSortsSuite.scala added
sql/core/src/test/scala/org/apache/spark/sql/execution/SortSuite.scala changed 8.7% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala changed 5.5% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/SQLExecutionSuite.scala changed 35.4% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala changed 2.7% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecutionSuite.scala changed 100.0% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala changed 3.1% diff
sql/core/src/test/scala/org/apache/spark/sql/execution/UnsafeKVExternalSorterSuite.scala changed 30.7% diff
sql/core/src/test/scala/org/apache/spark/sql/ExplainSuite.scala changed 3.3% diff
sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala changed 1.1% diff
sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCWriteSuite.scala changed 10.8% diff
sql/core/src/test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala changed 3.2% diff
sql/core/src/test/scala/org/apache/spark/sql/ShowCreateTableSuite.scala changed 10.5% diff
sql/core/src/test/scala/org/apache/spark/sql/sources/BucketedReadSuite.scala changed 3.3% diff
sql/core/src/test/scala/org/apache/spark/sql/sources/InsertSuite.scala changed 4.0% diff
sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala changed 5.1% diff
sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala changed 0.2% diff
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryListenerSuite.scala changed 0.3% diff
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala changed 2.6% diff
sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamTest.scala changed 0.6% diff
sql/core/src/test/scala/org/apache/spark/sql/streaming/test/DataStreamReaderWriterSuite.scala changed 5.8% diff
sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala changed 3.8% diff
sql/core/src/test/scala/org/apache/spark/sql/TypedImperativeAggregateSuite.scala changed 1.2% diff
sql/core/src/test/scala/org/apache/spark/sql/UserDefinedTypeSuite.scala changed 3.8% diff
sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala changed 5.1% diff
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala changed 1.4% diff
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala changed 0.6% diff
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveDirCommand.scala changed 4.7% diff
sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala changed 1.2% diff
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala changed 2.1% diff
sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala changed 1.2% diff
sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFileFormat.scala changed 0.6% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/CachedTableSuite.scala changed 35.2% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/client/HivePartitionFilteringSuite.scala changed 3.3% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/client/VersionsSuite.scala changed 2.0% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCommandSuite.scala changed 0.5% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala changed 2.1% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala changed 3.7% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogVersionsSuite.scala changed 3.7% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSchemaInferenceSuite.scala changed 1.1% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionedTablePerfStatsSuite.scala changed 1.0% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionProviderCompatibilitySuite.scala changed 1.9% diff
sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala changed 1.7% diff
streaming/src/main/scala/org/apache/spark/streaming/util/HdfsUtils.scala changed 5.0% diff

Other Files (10 of 3550):

NameStatusDeltaVisual Diff
mllib/src/test/resources/ml-models/dtc-2.4.7/data/part-00000-bd7ae42f-c890-406c-894c-ca4eac67c690-c
000.snappy.parquet
added
mllib/src/test/resources/ml-models/dtr-2.4.7/data/part-00000-39b027f0-a437-4b3d-84af-d861adcb9ca8-c
000.snappy.parquet
added
mllib/src/test/resources/ml-models/gbtc-2.4.7/data/part-00000-dacbde64-c861-41c7-91c0-6da8cc01fb43-
c000.snappy.parquet
added
mllib/src/test/resources/ml-models/gbtc-2.4.7/treesMetadata/part-00000-81137d9f-31e3-4a90-813c-ddc3
94101e21-c000.snappy.parquet
added
mllib/src/test/resources/ml-models/gbtr-2.4.7/data/part-00000-3b5433ff-d346-4511-9aab-639288bfae6d-
c000.snappy.parquet
added
mllib/src/test/resources/ml-models/gbtr-2.4.7/treesMetadata/part-00000-6b9124f5-87fe-4fd8-ad9c-4be2
39c2215a-c000.snappy.parquet
added
mllib/src/test/resources/ml-models/rfc-2.4.7/data/part-00000-e41a7b98-91f8-4485-b112-25b4b11c9009-c
000.snappy.parquet
added
mllib/src/test/resources/ml-models/rfc-2.4.7/treesMetadata/part-00000-21082d24-b666-4c4e-a823-70c7a
fdcbdc5-c000.snappy.parquet
added
mllib/src/test/resources/ml-models/rfr-2.4.7/data/part-00000-4a69607d-6edb-40fc-b681-981caaeca996-c
000.snappy.parquet
added
mllib/src/test/resources/ml-models/rfr-2.4.7/treesMetadata/part-00000-dfe4db51-d349-447a-9b86-d95ed
aabcde8-c000.snappy.parquet
added

Packages Compared:

spark-3.0.1.tgz
spark-3.0.2.tgz


Home  |  About  |  Features  |  All  |  Newest  |  Dox  |  Diffs  |  RSS Feeds  |  Screenshots  |  Comments  |  Imprint  |  Privacy  |  HTTP(S)