azkaban跑sqoop脚本(集群开启了kerberos认证)

/ azkabankerberos / 没有评论 / 31浏览

在服务器上跑sqoop脚本(之前已经kinit过了),完全没问题。但是在azkaban上跑却一直报错:26-09-2018 16:24:36 CST test INFO - 18/09/26 16:24:36 WARN ipc.Client: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]

job定义

定义的test.job如下

type=command
command=bash test.sh

其中test.sh

sqoop import --hive-import --connect jdbc:mysql://erphdp01:3306/test --username root --password @WSXzse4   -m 1 --delete-target-dir  --table user  --hive-table  test.user

问题

打包上传到azkaban,执行报错,问题是服务器上已经kinit了

手动调用sqoop命令没有任何问题!!!

排查

修改test.sh脚本,手动klist看看是否能获取到kerberos认证信息

klist

sqoop import --hive-import --connect jdbc:mysql://erphdp01:3306/test --username root --password @WSXzse4 -m 1 --delete-target-dir --table user --hive-table test.user

运行后发现如下问题

26-09-2018 16:24:31 CST test INFO - Starting job test at 1537950271630
26-09-2018 16:24:31 CST test INFO - azkaban.webserver.url property was not set
26-09-2018 16:24:31 CST test INFO - job JVM args: -Dazkaban.flowid=test -Dazkaban.execid=27580 -Dazkaban.jobid=test
26-09-2018 16:24:31 CST test INFO - Building command job executor. 
26-09-2018 16:24:31 CST test INFO - 1 commands to execute.
26-09-2018 16:24:31 CST test INFO - effective user is: azkaban
26-09-2018 16:24:31 CST test INFO - Command: bash test.sh
26-09-2018 16:24:31 CST test INFO - Environment variables: {JOB_OUTPUT_PROP_FILE=/usr/local/azkaban/azkaban-exec-server-3.9.0-31-g534cfe20/executions/27580/test_output_1661895387627954618_tmp, JOB_PROP_FILE=/usr/local/azkaban/azkaban-exec-server-3.9.0-31-g534cfe20/executions/27580/test_props_2368841655089910331_tmp, KRB5CCNAME=/tmp/krb5cc__kerberos-test__test__test__27580__azkaban, JOB_NAME=test}
26-09-2018 16:24:31 CST test INFO - Working directory: /usr/local/azkaban/azkaban-exec-server-3.9.0-31-g534cfe20/executions/27580
26-09-2018 16:24:31 CST test DEBUG - Spawned thread with process id 22896
26-09-2018 16:24:31 CST test INFO - klist: No credentials cache found (filename: /tmp/krb5cc__kerberos-test__test__test__27580__azkaban)
26-09-2018 16:24:31 CST test INFO - /usr/local/azkaban/azkaban-exec-server-3.9.0-31-g534cfe20/executions/27580
26-09-2018 16:24:31 CST test INFO - Warning: /usr/hdp/2.6.0.3-8/accumulo does not exist! Accumulo imports will fail.
26-09-2018 16:24:31 CST test INFO - Please set $ACCUMULO_HOME to the root of your Accumulo installation.
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.6.0.3-8
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO tool.CodeGenTool: Beginning code generation
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user` AS t LIMIT 1
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user` AS t LIMIT 1
26-09-2018 16:24:33 CST test INFO - 18/09/26 16:24:33 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hdp/2.6.0.3-8/hadoop-mapreduce
26-09-2018 16:24:35 CST test INFO - Note: /tmp/sqoop-hap/compile/6f40dc1f469d768800b839fca6b35db9/user.java uses or overrides a deprecated API.
26-09-2018 16:24:35 CST test INFO - Note: Recompile with -Xlint:deprecation for details.
26-09-2018 16:24:35 CST test INFO - 18/09/26 16:24:35 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hap/compile/6f40dc1f469d768800b839fca6b35db9/user.jar
26-09-2018 16:24:36 CST test INFO - 18/09/26 16:24:36 WARN ipc.Client: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
26-09-2018 16:24:36 CST test INFO - 18/09/26 16:24:36 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "erphdp01/10.24.35.101"; destination host is: "erphdp01":8020; 
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:782)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1558)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client.call(Client.java:1498)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client.call(Client.java:1398)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
26-09-2018 16:24:36 CST test INFO - 	at com.sun.proxy.$Proxy11.getFileInfo(Unknown Source)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:818)
26-09-2018 16:24:36 CST test INFO - 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
26-09-2018 16:24:36 CST test INFO - 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
26-09-2018 16:24:36 CST test INFO - 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
26-09-2018 16:24:36 CST test INFO - 	at java.lang.reflect.Method.invoke(Method.java:498)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:291)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:203)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:185)
26-09-2018 16:24:36 CST test INFO - 	at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2165)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1442)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1438)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1438)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1447)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.tool.ImportTool.deleteTargetDir(ImportTool.java:539)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:503)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:615)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.sqoop.Sqoop.main(Sqoop.java:243)
26-09-2018 16:24:36 CST test INFO - Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:720)
26-09-2018 16:24:36 CST test INFO - 	at java.security.AccessController.doPrivileged(Native Method)
26-09-2018 16:24:36 CST test INFO - 	at javax.security.auth.Subject.doAs(Subject.java:422)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:683)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:770)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client$Connection.access$3200(Client.java:397)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client.getConnection(Client.java:1620)
26-09-2018 16:24:36 CST test INFO - 	at org.apache.hadoop.ipc.Client.call(Client.java:1451)
26-09-2018 16:24:36 CST test INFO - 	... 27 more

可以看到klist获取不到认证信息,而且缓存文件也被修改了/tmp/krb5cc__kerberos-test__test__test__27580__azkaban

26-09-2018 16:24:31 CST test INFO - klist: No credentials cache found (filename: /tmp/krb5cc__kerberos-test__test__test__27580__azkaban)

查看源码发现,azkaban把每一个job execution的kerberos cachefilename都修改了 源码

所以,我们在脚本里面再手动kinit下。

脚本kinit

修改test.sh

kinit -k  cmccapp -t /cmcc/kettle/source/rpone/cmccapp.keytab

klist

sqoop import --hive-import --connect jdbc:mysql://erphdp01:3306/test --username root --password @WSXzse4   -m 1 --delete-target-dir  --table user  --hive-table  test.user

问题解决

26-09-2018 21:14:00 CST test INFO - Starting job test at 1537967640154
26-09-2018 21:14:00 CST test INFO - azkaban.webserver.url property was not set
26-09-2018 21:14:00 CST test INFO - job JVM args: -Dazkaban.flowid=test -Dazkaban.execid=27604 -Dazkaban.jobid=test
26-09-2018 21:14:00 CST test INFO - Building command job executor. 
26-09-2018 21:14:00 CST test INFO - 1 commands to execute.
26-09-2018 21:14:00 CST test INFO - effective user is: azkaban
26-09-2018 21:14:00 CST test INFO - Command: bash test.sh
26-09-2018 21:14:00 CST test INFO - Environment variables: {JOB_OUTPUT_PROP_FILE=/usr/local/azkaban/azkaban-exec-server-3.9.0-31-g534cfe20/executions/27604/test_output_6405353251031807929_tmp, JOB_PROP_FILE=/usr/local/azkaban/azkaban-exec-server-3.9.0-31-g534cfe20/executions/27604/test_props_2369395757412645887_tmp, KRB5CCNAME=/tmp/krb5cc__kerberos-test__test__test__27604__azkaban, JOB_NAME=test}
26-09-2018 21:14:00 CST test INFO - Working directory: /usr/local/azkaban/azkaban-exec-server-3.9.0-31-g534cfe20/executions/27604
26-09-2018 21:14:00 CST test DEBUG - Spawned thread with process id 29627
26-09-2018 21:14:00 CST test INFO - Ticket cache: FILE:/tmp/krb5cc__kerberos-test__test__test__27604__azkaban
26-09-2018 21:14:00 CST test INFO - Default principal: cmccapp@HADOOP.COM
26-09-2018 21:14:00 CST test INFO - 
26-09-2018 21:14:00 CST test INFO - Valid starting       Expires              Service principal
26-09-2018 21:14:00 CST test INFO - 09/26/2018 21:14:00  09/27/2018 21:14:00  krbtgt/HADOOP.COM@HADOOP.COM
26-09-2018 21:14:00 CST test INFO - Warning: /usr/hdp/2.6.0.3-8/accumulo does not exist! Accumulo imports will fail.
26-09-2018 21:14:00 CST test INFO - Please set $ACCUMULO_HOME to the root of your Accumulo installation.
26-09-2018 21:14:01 CST test INFO - 18/09/26 21:14:01 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.6.0.3-8
26-09-2018 21:14:01 CST test INFO - 18/09/26 21:14:01 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
26-09-2018 21:14:01 CST test INFO - 18/09/26 21:14:01 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
26-09-2018 21:14:01 CST test INFO - 18/09/26 21:14:01 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
26-09-2018 21:14:01 CST test INFO - 18/09/26 21:14:01 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
26-09-2018 21:14:01 CST test INFO - 18/09/26 21:14:01 INFO tool.CodeGenTool: Beginning code generation
26-09-2018 21:14:02 CST test INFO - 18/09/26 21:14:02 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user` AS t LIMIT 1
26-09-2018 21:14:02 CST test INFO - 18/09/26 21:14:02 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user` AS t LIMIT 1
26-09-2018 21:14:02 CST test INFO - 18/09/26 21:14:02 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hdp/2.6.0.3-8/hadoop-mapreduce
26-09-2018 21:14:03 CST test INFO - Note: /tmp/sqoop-hap/compile/3d05397ed72c45c357e1cb3f888b4c4a/user.java uses or overrides a deprecated API.
26-09-2018 21:14:03 CST test INFO - Note: Recompile with -Xlint:deprecation for details.
26-09-2018 21:14:03 CST test INFO - 18/09/26 21:14:03 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hap/compile/3d05397ed72c45c357e1cb3f888b4c4a/user.jar
26-09-2018 21:14:04 CST test INFO - 18/09/26 21:14:04 INFO tool.ImportTool: Destination directory user is not present, hence not deleting.
26-09-2018 21:14:04 CST test INFO - 18/09/26 21:14:04 WARN manager.MySQLManager: It looks like you are importing from mysql.
26-09-2018 21:14:04 CST test INFO - 18/09/26 21:14:04 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
26-09-2018 21:14:04 CST test INFO - 18/09/26 21:14:04 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
26-09-2018 21:14:04 CST test INFO - 18/09/26 21:14:04 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
26-09-2018 21:14:04 CST test INFO - 18/09/26 21:14:04 INFO mapreduce.ImportJobBase: Beginning import of user
26-09-2018 21:14:05 CST test INFO - 18/09/26 21:14:05 INFO client.RMProxy: Connecting to ResourceManager at erphdp02/10.24.35.102:8050
26-09-2018 21:14:05 CST test INFO - 18/09/26 21:14:05 INFO client.AHSProxy: Connecting to Application History server at erphdp02/10.24.35.102:10200
26-09-2018 21:14:05 CST test INFO - 18/09/26 21:14:05 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 1018 for cmccapp on 10.24.35.101:8020
26-09-2018 21:14:05 CST test INFO - 18/09/26 21:14:05 INFO security.TokenCache: Got dt for hdfs://erphdp01:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 10.24.35.101:8020, Ident: (HDFS_DELEGATION_TOKEN token 1018 for cmccapp)
26-09-2018 21:14:06 CST test INFO - 18/09/26 21:14:06 INFO db.DBInputFormat: Using read commited transaction isolation
26-09-2018 21:14:06 CST test INFO - 18/09/26 21:14:06 INFO mapreduce.JobSubmitter: number of splits:1
26-09-2018 21:14:06 CST test INFO - 18/09/26 21:14:06 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1537431685284_0757
26-09-2018 21:14:06 CST test INFO - 18/09/26 21:14:06 INFO mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: 10.24.35.101:8020, Ident: (HDFS_DELEGATION_TOKEN token 1018 for cmccapp)
26-09-2018 21:14:07 CST test INFO - 18/09/26 21:14:07 INFO impl.TimelineClientImpl: Timeline service address: http://erphdp02:8188/ws/v1/timeline/
26-09-2018 21:14:07 CST test INFO - 18/09/26 21:14:07 INFO impl.YarnClientImpl: Submitted application application_1537431685284_0757
26-09-2018 21:14:07 CST test INFO - 18/09/26 21:14:07 INFO mapreduce.Job: The url to track the job: http://erphdp02:15021/proxy/application_1537431685284_0757/
26-09-2018 21:14:07 CST test INFO - 18/09/26 21:14:07 INFO mapreduce.Job: Running job: job_1537431685284_0757
26-09-2018 21:15:29 CST test INFO - 18/09/26 21:15:29 INFO mapreduce.Job: Job job_1537431685284_0757 running in uber mode : false
26-09-2018 21:15:29 CST test INFO - 18/09/26 21:15:29 INFO mapreduce.Job:  map 0% reduce 0%
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO mapreduce.Job:  map 100% reduce 0%
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO mapreduce.Job: Job job_1537431685284_0757 completed successfully
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO mapreduce.Job: Counters: 30
26-09-2018 21:15:37 CST test INFO - 	File System Counters
26-09-2018 21:15:37 CST test INFO - 		FILE: Number of bytes read=0
26-09-2018 21:15:37 CST test INFO - 		FILE: Number of bytes written=168676
26-09-2018 21:15:37 CST test INFO - 		FILE: Number of read operations=0
26-09-2018 21:15:37 CST test INFO - 		FILE: Number of large read operations=0
26-09-2018 21:15:37 CST test INFO - 		FILE: Number of write operations=0
26-09-2018 21:15:37 CST test INFO - 		HDFS: Number of bytes read=87
26-09-2018 21:15:37 CST test INFO - 		HDFS: Number of bytes written=4
26-09-2018 21:15:37 CST test INFO - 		HDFS: Number of read operations=4
26-09-2018 21:15:37 CST test INFO - 		HDFS: Number of large read operations=0
26-09-2018 21:15:37 CST test INFO - 		HDFS: Number of write operations=2
26-09-2018 21:15:37 CST test INFO - 	Job Counters 
26-09-2018 21:15:37 CST test INFO - 		Launched map tasks=1
26-09-2018 21:15:37 CST test INFO - 		Other local map tasks=1
26-09-2018 21:15:37 CST test INFO - 		Total time spent by all maps in occupied slots (ms)=29345
26-09-2018 21:15:37 CST test INFO - 		Total time spent by all reduces in occupied slots (ms)=0
26-09-2018 21:15:37 CST test INFO - 		Total time spent by all map tasks (ms)=5869
26-09-2018 21:15:37 CST test INFO - 		Total vcore-milliseconds taken by all map tasks=5869
26-09-2018 21:15:37 CST test INFO - 		Total megabyte-milliseconds taken by all map tasks=60098560
26-09-2018 21:15:37 CST test INFO - 	Map-Reduce Framework
26-09-2018 21:15:37 CST test INFO - 		Map input records=2
26-09-2018 21:15:37 CST test INFO - 		Map output records=2
26-09-2018 21:15:37 CST test INFO - 		Input split bytes=87
26-09-2018 21:15:37 CST test INFO - 		Spilled Records=0
26-09-2018 21:15:37 CST test INFO - 		Failed Shuffles=0
26-09-2018 21:15:37 CST test INFO - 		Merged Map outputs=0
26-09-2018 21:15:37 CST test INFO - 		GC time elapsed (ms)=56
26-09-2018 21:15:37 CST test INFO - 		CPU time spent (ms)=1690
26-09-2018 21:15:37 CST test INFO - 		Physical memory (bytes) snapshot=351461376
26-09-2018 21:15:37 CST test INFO - 		Virtual memory (bytes) snapshot=10867818496
26-09-2018 21:15:37 CST test INFO - 		Total committed heap usage (bytes)=337641472
26-09-2018 21:15:37 CST test INFO - 	File Input Format Counters 
26-09-2018 21:15:37 CST test INFO - 		Bytes Read=0
26-09-2018 21:15:37 CST test INFO - 	File Output Format Counters 
26-09-2018 21:15:37 CST test INFO - 		Bytes Written=4
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO mapreduce.ImportJobBase: Transferred 4 bytes in 92.386 seconds (0.0433 bytes/sec)
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO mapreduce.ImportJobBase: Retrieved 2 records.
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user` AS t LIMIT 1
26-09-2018 21:15:37 CST test INFO - 18/09/26 21:15:37 INFO hive.HiveImport: Loading uploaded data into Hive
26-09-2018 21:15:37 CST test INFO - 
26-09-2018 21:15:37 CST test INFO - Logging initialized using configuration in jar:file:/usr/hdp/2.6.0.3-8/hive/lib/hive-common-1.2.1000.2.6.0.3-8.jar!/hive-log4j.properties