Skip to content

Commit

Permalink
[SPARK-7550] [SQL] [MINOR] Fixes logs when persisting DataFrames
Browse files Browse the repository at this point in the history
Author: Cheng Lian <[email protected]>

Closes apache#8021 from liancheng/spark-7550/fix-logs and squashes the following commits:

b7bd0ed [Cheng Lian] Fixes logs

(cherry picked from commit f0cda58)
Signed-off-by: Reynold Xin <[email protected]>
  • Loading branch information
liancheng authored and rxin committed Aug 7, 2015
1 parent e902c4f commit aedc8f3
Showing 1 changed file with 2 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -317,19 +317,17 @@ private[hive] class HiveMetastoreCatalog(val client: ClientInterface, hive: Hive

case (Some(serde), relation: HadoopFsRelation) if relation.partitionColumns.nonEmpty =>
logWarning {
val paths = relation.paths.mkString(", ")
"Persisting partitioned data source relation into Hive metastore in " +
s"Spark SQL specific format, which is NOT compatible with Hive. Input path(s): " +
paths.mkString("\n", "\n", "")
relation.paths.mkString("\n", "\n", "")
}
newSparkSQLSpecificMetastoreTable()

case (Some(serde), relation: HadoopFsRelation) =>
logWarning {
val paths = relation.paths.mkString(", ")
"Persisting data source relation with multiple input paths into Hive metastore in " +
s"Spark SQL specific format, which is NOT compatible with Hive. Input paths: " +
paths.mkString("\n", "\n", "")
relation.paths.mkString("\n", "\n", "")
}
newSparkSQLSpecificMetastoreTable()

Expand Down

0 comments on commit aedc8f3

Please sign in to comment.