Skip to content

Commit

Permalink
[SPARK-8657] [YARN] Fail to upload resource to viewfs
Browse files Browse the repository at this point in the history
Fail to upload resource to viewfs in spark-1.4
JIRA Link: https://issues.apache.org/jira/browse/SPARK-8657

Author: Tao Li <[email protected]>

Closes apache#7125 from litao-buptsse/SPARK-8657-for-master and squashes the following commits:

65b13f4 [Tao Li] [SPARK-8657] [YARN] Fail to upload resource to viewfs
  • Loading branch information
litao-buptsse authored and srowen committed Jul 8, 2015
1 parent f61c989 commit 26d9b6b
Showing 1 changed file with 2 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -321,8 +321,9 @@ private[spark] class Client(
val linkname = targetDir.map(_ + "/").getOrElse("") +
destName.orElse(Option(localURI.getFragment())).getOrElse(localPath.getName())
val destPath = copyFileToRemote(dst, localPath, replication)
val destFs = FileSystem.get(destPath.toUri(), hadoopConf)
distCacheMgr.addResource(
fs, hadoopConf, destPath, localResources, resType, linkname, statCache,
destFs, hadoopConf, destPath, localResources, resType, linkname, statCache,
appMasterOnly = appMasterOnly)
(false, linkname)
} else {
Expand Down

0 comments on commit 26d9b6b

Please sign in to comment.