[SPARK-42408][CORE] Register DoubleType to KryoSerializer

### What changes were proposed in this pull request? This PR aims to register `DoubleType` to `KryoSerializer` ### Why are the changes needed? There was an exception when running a TPCDS 3TB test. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Test manually. Closes apache#39978 from williamhyun/double. Authored-by: William Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
TJX2014 · Feb 12, 2023 · 559c1f8 · 559c1f8
1 parent b5bf332
commit 559c1f8
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala b/core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala
@@ -530,6 +530,8 @@ private[serializer] object KryoSerializer {
       "org.apache.spark.sql.types.IntegerType",
       "org.apache.spark.sql.types.IntegerType$",
       "org.apache.spark.sql.types.LongType$",
+      "org.apache.spark.sql.types.DoubleType",
+      "org.apache.spark.sql.types.DoubleType$",
       "org.apache.spark.sql.types.Metadata",
       "org.apache.spark.sql.types.StringType$",
       "org.apache.spark.sql.types.StructField",