Skip to content

Commit

Permalink
添加hive/text数据源
Browse files Browse the repository at this point in the history
allwefantasy committed Nov 6, 2018
1 parent ab8432e commit e216e5d
Showing 1 changed file with 4 additions and 0 deletions.
Original file line number Diff line number Diff line change
@@ -104,6 +104,10 @@ class BatchLoadAdaptor(scriptSQLExecListener: ScriptSQLExecListener,
}
import sparkSession.implicits._
table = reader.json(sparkSession.createDataset[String](items))
case "hive" =>
table = reader.table(cleanStr(path))
case "text" =>
table = reader.text(cleanStr(path).split(","): _*)
case _ =>

// calculate resource real absolute path

0 comments on commit e216e5d

Please sign in to comment.