Skip to content

Commit

Permalink
Initial commit
Browse files Browse the repository at this point in the history
  • Loading branch information
LuoTailong committed Jun 16, 2019
0 parents commit 19d6090
Show file tree
Hide file tree
Showing 332 changed files with 1,762 additions and 0 deletions.
13 changes: 13 additions & 0 deletions .idea/compiler.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 6 additions & 0 deletions .idea/encodings.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 6 additions & 0 deletions .idea/inspectionProfiles/Project_Default.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

58 changes: 58 additions & 0 deletions .idea/misc.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

11 changes: 11 additions & 0 deletions .idea/scala_compiler.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions .idea/spark.iml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

124 changes: 124 additions & 0 deletions .idea/uiDesigner.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Binary file added ck/.checkpoint-1545878800000.bk.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878800000.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878805000.bk.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878805000.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878810000.bk.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878810000.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878815000.bk.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878815000.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878820000.bk.crc
Binary file not shown.
Binary file added ck/.checkpoint-1545878820000.crc
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file added ck/checkpoint-1545878800000
Binary file not shown.
Binary file added ck/checkpoint-1545878800000.bk
Binary file not shown.
Binary file added ck/checkpoint-1545878805000
Binary file not shown.
Binary file added ck/checkpoint-1545878805000.bk
Binary file not shown.
Binary file added ck/checkpoint-1545878810000
Binary file not shown.
Binary file added ck/checkpoint-1545878810000.bk
Binary file not shown.
Binary file added ck/checkpoint-1545878815000
Binary file not shown.
Binary file added ck/checkpoint-1545878815000.bk
Binary file not shown.
Binary file added ck/checkpoint-1545878820000
Binary file not shown.
Binary file added ck/checkpoint-1545878820000.bk
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
6 changes: 6 additions & 0 deletions data/student.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
1 zhangsan 20
2 lisi 29
3 wangwu 25
4 zhaoliu 30
5 tianqi 35
6 kobe 40
67 changes: 67 additions & 0 deletions dependency-reduced-pom.xml
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>com.itcast</groupId>
<artifactId>spark</artifactId>
<version>1.0-SNAPSHOT</version>
<build>
<sourceDirectory>src/main/scala</sourceDirectory>
<testSourceDirectory>src/test/scala</testSourceDirectory>
<plugins>
<plugin>
<groupId>net.alchim31.maven</groupId>
<artifactId>scala-maven-plugin</artifactId>
<version>3.2.2</version>
<executions>
<execution>
<goals>
<goal>compile</goal>
<goal>testCompile</goal>
</goals>
<configuration>
<args>
<arg>-dependencyfile</arg>
<arg>${project.build.directory}/.scala_dependencies</arg>
</args>
</configuration>
</execution>
</executions>
</plugin>
<plugin>
<artifactId>maven-shade-plugin</artifactId>
<version>2.3</version>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>shade</goal>
</goals>
<configuration>
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>META-INF/*.SF</exclude>
<exclude>META-INF/*.DSA</exclude>
<exclude>META-INF/*.RSA</exclude>
</excludes>
</filter>
</filters>
<transformers>
<transformer>
<mainClass />
</transformer>
</transformers>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
</build>
<properties>
<scala.version>2.11.8</scala.version>
<hadoop.version>2.7.4</hadoop.version>
<spark.version>2.0.2</spark.version>
</properties>
</project>

13 changes: 13 additions & 0 deletions derby.log
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
----------------------------------------------------------------
Tue Dec 25 10:38:29 CST 2018:
Booting Derby version The Apache Software Foundation - Apache Derby - 10.10.2.0 - (1582446): instance a816c00e-0167-e33a-504a-000008939228
on database directory C:\Users\Administrator\IdeaProjects\spark\metastore_db with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@1a3e5f23
Loaded from file:/C:/Program%20Files/repository_maven/org/apache/derby/derby/10.10.2.0/derby-10.10.2.0.jar
java.vendor=Oracle Corporation
java.runtime.version=1.8.0_181-b13
user.dir=C:\Users\Administrator\IdeaProjects\spark
os.name=Windows 10
os.arch=amd64
os.version=10.0
derby.system.home=null
Database Class Loader started - derby.database.classpath=''
9 changes: 9 additions & 0 deletions metastore_db/README_DO_NOT_TOUCH_FILES.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@

# *************************************************************************
# *** DO NOT TOUCH FILES IN THIS DIRECTORY! ***
# *** FILES IN THIS DIRECTORY AND SUBDIRECTORIES CONSTITUTE A DERBY ***
# *** DATABASE, WHICH INCLUDES THE DATA (USER AND SYSTEM) AND THE ***
# *** FILES NECESSARY FOR DATABASE RECOVERY. ***
# *** EDITING, ADDING, OR DELETING ANY OF THESE FILES MAY CAUSE DATA ***
# *** CORRUPTION AND LEAVE THE DATABASE IN A NON-RECOVERABLE STATE. ***
# *************************************************************************
Binary file added metastore_db/db.lck
Binary file not shown.
8 changes: 8 additions & 0 deletions metastore_db/log/README_DO_NOT_TOUCH_FILES.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@

# *************************************************************************
# *** DO NOT TOUCH FILES IN THIS DIRECTORY! ***
# *** FILES IN THIS DIRECTORY ARE USED BY THE DERBY DATABASE RECOVERY ***
# *** SYSTEM. EDITING, ADDING, OR DELETING FILES IN THIS DIRECTORY ***
# *** WILL CAUSE THE DERBY RECOVERY SYSTEM TO FAIL, LEADING TO ***
# *** NON-RECOVERABLE CORRUPT DATABASES. ***
# *************************************************************************
Binary file added metastore_db/log/log.ctrl
Binary file not shown.
Binary file added metastore_db/log/log1.dat
Binary file not shown.
Binary file added metastore_db/log/logmirror.ctrl
Binary file not shown.
8 changes: 8 additions & 0 deletions metastore_db/seg0/README_DO_NOT_TOUCH_FILES.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@

# *************************************************************************
# *** DO NOT TOUCH FILES IN THIS DIRECTORY! ***
# *** FILES IN THIS DIRECTORY ARE USED BY THE DERBY DATABASE TO STORE ***
# *** USER AND SYSTEM DATA. EDITING, ADDING, OR DELETING FILES IN THIS ***
# *** DIRECTORY WILL CORRUPT THE ASSOCIATED DERBY DATABASE AND MAKE ***
# *** IT NON-RECOVERABLE. ***
# *************************************************************************
Binary file added metastore_db/seg0/c10.dat
Binary file not shown.
Binary file added metastore_db/seg0/c101.dat
Binary file not shown.
Binary file added metastore_db/seg0/c111.dat
Binary file not shown.
Binary file added metastore_db/seg0/c121.dat
Binary file not shown.
Binary file added metastore_db/seg0/c130.dat
Binary file not shown.
Binary file added metastore_db/seg0/c141.dat
Binary file not shown.
Binary file added metastore_db/seg0/c150.dat
Binary file not shown.
Binary file added metastore_db/seg0/c161.dat
Binary file not shown.
Binary file added metastore_db/seg0/c171.dat
Binary file not shown.
Binary file added metastore_db/seg0/c180.dat
Binary file not shown.
Binary file added metastore_db/seg0/c191.dat
Binary file not shown.
Binary file added metastore_db/seg0/c1a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c1b1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c1c0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c1d1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c1e0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c1f1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c20.dat
Binary file not shown.
Binary file added metastore_db/seg0/c200.dat
Binary file not shown.
Binary file added metastore_db/seg0/c211.dat
Binary file not shown.
Binary file added metastore_db/seg0/c221.dat
Binary file not shown.
Binary file added metastore_db/seg0/c230.dat
Binary file not shown.
Binary file added metastore_db/seg0/c241.dat
Binary file not shown.
Binary file added metastore_db/seg0/c251.dat
Binary file not shown.
Binary file added metastore_db/seg0/c260.dat
Binary file not shown.
Binary file added metastore_db/seg0/c271.dat
Binary file not shown.
Binary file added metastore_db/seg0/c281.dat
Binary file not shown.
Binary file added metastore_db/seg0/c290.dat
Binary file not shown.
Binary file added metastore_db/seg0/c2a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c2b1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c2c1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c2d0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c2e1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c2f0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c300.dat
Binary file not shown.
Binary file added metastore_db/seg0/c31.dat
Binary file not shown.
Binary file added metastore_db/seg0/c311.dat
Binary file not shown.
Binary file added metastore_db/seg0/c321.dat
Binary file not shown.
Binary file added metastore_db/seg0/c331.dat
Binary file not shown.
Binary file added metastore_db/seg0/c340.dat
Binary file not shown.
Binary file added metastore_db/seg0/c351.dat
Binary file not shown.
Binary file added metastore_db/seg0/c361.dat
Binary file not shown.
Binary file added metastore_db/seg0/c371.dat
Binary file not shown.
Binary file added metastore_db/seg0/c380.dat
Binary file not shown.
Binary file added metastore_db/seg0/c391.dat
Binary file not shown.
Binary file added metastore_db/seg0/c3a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c3b1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c3c0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c3d1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c3e1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c3f1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c400.dat
Binary file not shown.
Binary file added metastore_db/seg0/c41.dat
Binary file not shown.
Binary file added metastore_db/seg0/c411.dat
Binary file not shown.
Binary file added metastore_db/seg0/c421.dat
Binary file not shown.
Binary file added metastore_db/seg0/c430.dat
Binary file not shown.
Binary file added metastore_db/seg0/c441.dat
Binary file not shown.
Binary file added metastore_db/seg0/c451.dat
Binary file not shown.
Binary file added metastore_db/seg0/c461.dat
Binary file not shown.
Binary file added metastore_db/seg0/c470.dat
Binary file not shown.
Binary file added metastore_db/seg0/c481.dat
Binary file not shown.
Binary file added metastore_db/seg0/c490.dat
Binary file not shown.
Binary file added metastore_db/seg0/c4a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c4b0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c4c1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c4d1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c4e1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c4f0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c501.dat
Binary file not shown.
Binary file added metastore_db/seg0/c51.dat
Binary file not shown.
Binary file added metastore_db/seg0/c510.dat
Binary file not shown.
Binary file added metastore_db/seg0/c521.dat
Binary file not shown.
Binary file added metastore_db/seg0/c530.dat
Binary file not shown.
Binary file added metastore_db/seg0/c541.dat
Binary file not shown.
Binary file added metastore_db/seg0/c550.dat
Binary file not shown.
Binary file added metastore_db/seg0/c561.dat
Binary file not shown.
Binary file added metastore_db/seg0/c570.dat
Binary file not shown.
Binary file added metastore_db/seg0/c581.dat
Binary file not shown.
Binary file added metastore_db/seg0/c590.dat
Binary file not shown.
Binary file added metastore_db/seg0/c5a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c5b0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c5c1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c5d0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c5e1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c5f0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c60.dat
Binary file not shown.
Binary file added metastore_db/seg0/c601.dat
Binary file not shown.
Binary file added metastore_db/seg0/c610.dat
Binary file not shown.
Binary file added metastore_db/seg0/c621.dat
Binary file not shown.
Binary file added metastore_db/seg0/c630.dat
Binary file not shown.
Binary file added metastore_db/seg0/c641.dat
Binary file not shown.
Binary file added metastore_db/seg0/c650.dat
Binary file not shown.
Binary file added metastore_db/seg0/c661.dat
Binary file not shown.
Binary file added metastore_db/seg0/c670.dat
Binary file not shown.
Binary file added metastore_db/seg0/c681.dat
Binary file not shown.
Binary file added metastore_db/seg0/c690.dat
Binary file not shown.
Binary file added metastore_db/seg0/c6a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c6b0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c6c1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c6d0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c6e1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c6f0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c701.dat
Binary file not shown.
Binary file added metastore_db/seg0/c71.dat
Binary file not shown.
Binary file added metastore_db/seg0/c711.dat
Binary file not shown.
Binary file added metastore_db/seg0/c721.dat
Binary file not shown.
Binary file added metastore_db/seg0/c731.dat
Binary file not shown.
Binary file added metastore_db/seg0/c741.dat
Binary file not shown.
Binary file added metastore_db/seg0/c751.dat
Binary file not shown.
Binary file added metastore_db/seg0/c761.dat
Binary file not shown.
Binary file added metastore_db/seg0/c771.dat
Binary file not shown.
Binary file added metastore_db/seg0/c781.dat
Binary file not shown.
Binary file added metastore_db/seg0/c791.dat
Binary file not shown.
Binary file added metastore_db/seg0/c7a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c7b1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c7c1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c7d1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c7e1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c7f1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c801.dat
Binary file not shown.
Binary file added metastore_db/seg0/c81.dat
Binary file not shown.
Binary file added metastore_db/seg0/c811.dat
Binary file not shown.
Binary file added metastore_db/seg0/c821.dat
Binary file not shown.
Binary file added metastore_db/seg0/c831.dat
Binary file not shown.
Binary file added metastore_db/seg0/c840.dat
Binary file not shown.
Binary file added metastore_db/seg0/c851.dat
Binary file not shown.
Binary file added metastore_db/seg0/c860.dat
Binary file not shown.
Binary file added metastore_db/seg0/c871.dat
Binary file not shown.
Binary file added metastore_db/seg0/c880.dat
Binary file not shown.
Binary file added metastore_db/seg0/c891.dat
Binary file not shown.
Binary file added metastore_db/seg0/c8a0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c8b1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c8c1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c8d1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c8e1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c8f1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c90.dat
Binary file not shown.
Binary file added metastore_db/seg0/c901.dat
Binary file not shown.
Binary file added metastore_db/seg0/c911.dat
Binary file not shown.
Binary file added metastore_db/seg0/c920.dat
Binary file not shown.
Binary file added metastore_db/seg0/c931.dat
Binary file not shown.
Binary file added metastore_db/seg0/c940.dat
Binary file not shown.
Binary file added metastore_db/seg0/c951.dat
Binary file not shown.
Binary file added metastore_db/seg0/c960.dat
Binary file not shown.
Binary file added metastore_db/seg0/c971.dat
Binary file not shown.
Binary file added metastore_db/seg0/c981.dat
Binary file not shown.
Binary file added metastore_db/seg0/c990.dat
Binary file not shown.
Binary file added metastore_db/seg0/c9a1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c9b1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c9c0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c9d1.dat
Binary file not shown.
Binary file added metastore_db/seg0/c9e0.dat
Binary file not shown.
Binary file added metastore_db/seg0/c9f1.dat
Binary file not shown.
Binary file added metastore_db/seg0/ca01.dat
Binary file not shown.
Binary file added metastore_db/seg0/ca1.dat
Binary file not shown.
Binary file added metastore_db/seg0/ca11.dat
Binary file not shown.
Binary file added metastore_db/seg0/ca21.dat
Binary file not shown.
Binary file added metastore_db/seg0/cb1.dat
Binary file not shown.
Binary file added metastore_db/seg0/cc0.dat
Binary file not shown.
Binary file added metastore_db/seg0/cd1.dat
Binary file not shown.
Binary file added metastore_db/seg0/ce1.dat
Binary file not shown.
Binary file added metastore_db/seg0/cf0.dat
Binary file not shown.
23 changes: 23 additions & 0 deletions metastore_db/service.properties
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
#C:\Users\Administrator\IdeaProjects\spark\metastore_db
# ********************************************************************
# *** Please do NOT edit this file. ***
# *** CHANGING THE CONTENT OF THIS FILE MAY CAUSE DATA CORRUPTION. ***
# ********************************************************************
#Tue Dec 25 10:38:29 CST 2018
SysschemasIndex2Identifier=225
SyscolumnsIdentifier=144
SysconglomeratesIndex1Identifier=49
SysconglomeratesIdentifier=32
SyscolumnsIndex2Identifier=177
SysschemasIndex1Identifier=209
SysconglomeratesIndex3Identifier=81
SystablesIndex2Identifier=129
SyscolumnsIndex1Identifier=161
derby.serviceProtocol=org.apache.derby.database.Database
SysschemasIdentifier=192
derby.storage.propertiesId=16
SysconglomeratesIndex2Identifier=65
derby.serviceLocale=zh_CN
SystablesIdentifier=96
SystablesIndex1Identifier=113
#--- last line, don't put anything after this line ---
Loading

0 comments on commit 19d6090

Please sign in to comment.