Hadoop 시리즈. Hive metastore 2버전 설치

 

이번 포스팅에서는 hive의 메타스토어 2버전 설치를 진행해보려고 합니다. 이전 포스팅인 hive metastore 3버전 설치와 방법은 유사하지만 2 버전에서는 standalone 바이너리 제공을 하지 않기 때문에, 하이브 바이너리를 설치하고 메타스토어를 실행하여야 합니다.

Hadoop 시리즈. Hive metastore 3버전 설치

 

Step 1. 준비

# jdk 설치

sudo apt-get install openjdk-8-jdk -y

 

# hive binary

'https://hive.apache.org/downloads.html' 사이트에서 2.3.2 버전을 설치하였습니다.

## decompress
sudo tar -zxvf apache-hive-2.3.2-bin.tar.gz -C /opt/
 
## symbolic link
sudo ln -s /opt/apache-hive-2.3.2-bin /opt/hive
 
## owner
sudo chown -R deploy. /opt/hive/

 

 

# hadoop binary

hadoop binary도 이전 포스팅에 많이 적어두었기 때문에 생략합니다. 2.10.1 버전을 사용하였습니다.

# 압축 해제
sudo tar -zxvf hadoop-3.2.2.tar.gz -C /opt/

# symbolic link
sudo ln -s /opt/hadoop-3.2.2 /opt/hadoop

# chown
sudo chown -R deploy. /opt/hadoop/

 

# mysql

위 링크로 제공되는 hive3 metastore와 동일한 서버를 이용하였습니다.

 

Step 2. Configuration

# hive-site.xml

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?><!--
   Licensed to the Apache Software Foundation (ASF) under one or more
   contributor license agreements.  See the NOTICE file distributed with
   this work for additional information regarding copyright ownership.
   The ASF licenses this file to You under the Apache License, Version 2.0
   (the "License"); you may not use this file except in compliance with
   the License.  You may obtain a copy of the License at
  
       http://www.apache.org/licenses/LICENSE-2.0
  
   Unless required by applicable law or agreed to in writing, software
   distributed under the License is distributed on an "AS IS" BASIS,
   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   See the License for the specific language governing permissions and
   limitations under the License.
-->
<!-- These are default values meant to allow easy smoke testing of the metastore.  You will
likely need to add a number of new values. -->
<configuration>
  <property>
    <name>metastore.thrift.uris</name>
    <value>thrift://localhost:9083</value>
    <description>Thrift URI for the remote metastore. Used by metastore client to connect to remote metastore.</description>
  </property>
  <property>
    <name>metastore.task.threads.always</name>
    <value>org.apache.hadoop.hive.metastore.events.EventCleanerTask</value>
  </property>
  <property>
    <name>metastore.expression.proxy</name>
    <value>org.apache.hadoop.hive.metastore.DefaultPartitionExpressionProxy</value>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionURL</name>
    <value>jdbc:mysql://localhost:59306/meta2?createDatabaseIfNotExist=true</value>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionDriverName</name>
    <value>com.mysql.cj.jdbc.Driver</value>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionUserName</name>
    <value>hive</value>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionPassword</name>
    <value>hive</value>
  </property>
  <property>
    <name>hive.metastore.warehouse.dir</name>
    <value>hdfs://story-shadoop-master-1/apps/hive/warehouse</value>
  </property>
</configuration>

 

# hive-env.sh

HADOOP_HOME=/opt/hadoop

 

# hadoop-env.sh

JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-amd64

 

Step 3. Schema Init

/opt/hive/bin/schematool -dbType mysql -initSchema

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/apache-hive-2.3.2-bin/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.10.1/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL:    jdbc:mysql://localhost:59306/meta2?createDatabaseIfNotExist=true
Metastore Connection Driver :    com.mysql.cj.jdbc.Driver
Metastore connection User:   hive
Starting metastore schema initialization to 2.3.0
Initialization script hive-schema-2.3.0.mysql.sql
Initialization script completed
schemaTool completed

 

# mysql 확인

mysql> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| hive               |
| meta2              |
| mysql              |
| performance_schema |
| sys                |
+--------------------+
6 rows in set (0.00 sec)
 
mysql> use meta2;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
 
Database changed
mysql> show tables;
+---------------------------+
| Tables_in_meta2           |
+---------------------------+
| AUX_TABLE                 |
| BUCKETING_COLS            |
| CDS                       |
| COLUMNS_V2                |
| COMPACTION_QUEUE          |
| COMPLETED_COMPACTIONS     |
| COMPLETED_TXN_COMPONENTS  |
| DATABASE_PARAMS           |
| DBS                       |
| DB_PRIVS                  |
| DELEGATION_TOKENS         |
| FUNCS                     |
| FUNC_RU                   |
| GLOBAL_PRIVS              |
| HIVE_LOCKS                |
| IDXS                      |
| INDEX_PARAMS              |
| KEY_CONSTRAINTS           |
| MASTER_KEYS               |
| NEXT_COMPACTION_QUEUE_ID  |
| NEXT_LOCK_ID              |
| NEXT_TXN_ID               |
| NOTIFICATION_LOG          |
| NOTIFICATION_SEQUENCE     |
| NUCLEUS_TABLES            |
| PARTITIONS                |
| PARTITION_EVENTS          |
| PARTITION_KEYS            |
| PARTITION_KEY_VALS        |
| PARTITION_PARAMS          |
| PART_COL_PRIVS            |
| PART_COL_STATS            |
| PART_PRIVS                |
| ROLES                     |
| ROLE_MAP                  |
| SDS                       |
| SD_PARAMS                 |
| SEQUENCE_TABLE            |
| SERDES                    |
| SERDE_PARAMS              |
| SKEWED_COL_NAMES          |
| SKEWED_COL_VALUE_LOC_MAP  |
| SKEWED_STRING_LIST        |
| SKEWED_STRING_LIST_VALUES |
| SKEWED_VALUES             |
| SORT_COLS                 |
| TABLE_PARAMS              |
| TAB_COL_STATS             |
| TBLS                      |
| TBL_COL_PRIVS             |
| TBL_PRIVS                 |
| TXNS                      |
| TXN_COMPONENTS            |
| TYPES                     |
| TYPE_FIELDS               |
| VERSION                   |
| WRITE_SET                 |
+---------------------------+
57 rows in set (0.00 sec)

 

Step 4. Run

nohup /opt/hive/bin/hive --service metastore 2>&1 &

2021-12-28 08:11:59: Starting Hive Metastore Server
/opt/hive/bin/ext/metastore.sh: line 29: export: ` -Dproc_metastore  -Dlog4j.configurationFile=hive-log4j2.properties  -Djava.util.logging.config.file=/opt/hive/conf/parquet-logging.properties  ': not a valid identifier
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/apache-hive-2.3.2-bin/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.10.1/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2021-12-28T08:12:01,035 INFO [main] org.apache.hadoop.hive.conf.HiveConf - Found configuration file file:/opt/apache-hive-2.3.2-bin/conf/hive-site.xml
2021-12-28T08:12:02,848 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting HiveMetaStore
STARTUP_MSG:   host = localhost.localdomain/127.0.0.1
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 2.3.2
STARTUP_MSG:   classpath = /opt/hive/conf:/opt/hive/lib/HikariCP-2.5.1.jar:/opt/hive/lib/RoaringBitmap-0.5.18.jar:/opt/hive/lib/ST4-4.0.4.jar:/opt/hive/lib/accumulo-core-1.6.0.jar:/opt/hive/lib/accumulo-fate-1.6.0.jar:/opt/hive/lib/accumulo-start-1.6.0.jar:/opt/hive/lib/accumulo-trace-1.6.0.jar:/opt/hive/lib/activation-1.1.jar:/opt/hive/lib/aether-api-0.9.0.M2.jar:/opt/hive/lib/aether-connector-file-0.9.0.M2.jar:/opt/hive/lib/aether-connector-okhttp-0.0.9.jar:/opt/hive/lib/aether-impl-0.9.0.M2.jar:/opt/hive/lib/aether-spi-0.9.0.M2.jar:/opt/hive/lib/aether-util-0.9.0.M2.jar:/opt/hive/lib/aircompressor-0.3.jar:/opt/hive/lib/airline-0.7.jar:/opt/hive/lib/ant-1.6.5.jar:/opt/hive/lib/ant-1.9.1.jar:/opt/hive/lib/ant-launcher-1.9.1.jar:/opt/hive/lib/antlr-runtime-3.5.2.jar:/opt/hive/lib/antlr4-runtime-4.5.jar:/opt/hive/lib/asm-3.1.jar:/opt/hive/lib/asm-commons-3.1.jar:/opt/hive/lib/asm-tree-3.1.jar:/opt/hive/lib/avatica-1.8.0.jar:/opt/hive/lib/avatica-metrics-1.8.0.jar:/opt/hive/lib/avro-1.7.7.jar:/opt/hive/lib/bonecp-0.8.0.RELEASE.jar:/opt/hive/lib/bytebuffer-collections-0.2.5.jar:/opt/hive/lib/calcite-core-1.10.0.jar:/opt/hive/lib/calcite-druid-1.10.0.jar:/opt/hive/lib/calcite-linq4j-1.10.0.jar:/opt/hive/lib/classmate-1.0.0.jar:/opt/hive/lib/commons-cli-1.2.jar:/opt/hive/lib/commons-codec-1.4.jar:/opt/hive/lib/commons-collections-3.2.2.jar:/opt/hive/lib/commons-compiler-2.7.6.jar:/opt/hive/lib/commons-compress-1.9.jar:/opt/hive/lib/commons-dbcp-1.4.jar:/opt/hive/lib/commons-dbcp2-2.0.1.jar:/opt/hive/lib/commons-el-1.0.jar:/opt/hive/lib/commons-httpclient-3.0.1.jar:/opt/hive/lib/commons-io-2.4.jar:/opt/hive/lib/commons-lang-2.6.jar:/opt/hive/lib/commons-lang3-3.1.jar:/opt/hive/lib/commons-logging-1.2.jar:/opt/hive/lib/commons-math-2.2.jar:/opt/hive/lib/commons-math3-3.6.1.jar:/opt/hive/lib/commons-pool-1.5.4.jar:/opt/hive/lib/commons-pool2-2.2.jar:/opt/hive/lib/commons-vfs2-2.0.jar:/opt/hive/lib/compress-lzf-1.0.3.jar:/opt/hive/lib/config-magic-0.9.jar:/opt/hive/lib/curator-client-2.7.1.jar:/opt/hive/lib/curator-framework-2.7.1.jar:/opt/hive/lib/curator-recipes-2.7.1.jar:/opt/hive/lib/curator-x-discovery-2.11.0.jar:/opt/hive/lib/datanucleus-api-jdo-4.2.4.jar:/opt/hive/lib/datanucleus-core-4.1.17.jar:/opt/hive/lib/datanucleus-rdbms-4.1.19.jar:/opt/hive/lib/derby-10.10.2.0.jar:/opt/hive/lib/derbyclient-10.11.1.1.jar:/opt/hive/lib/derbynet-10.11.1.1.jar:/opt/hive/lib/disruptor-3.3.0.jar:/opt/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/opt/hive/lib/druid-api-0.9.2.jar:/opt/hive/lib/druid-common-0.9.2.jar:/opt/hive/lib/druid-console-0.0.2.jar:/opt/hive/lib/druid-hdfs-storage-0.9.2.jar:/opt/hive/lib/druid-processing-0.9.2.jar:/opt/hive/lib/druid-server-0.9.2.jar:/opt/hive/lib/eigenbase-properties-1.1.5.jar:/opt/hive/lib/emitter-0.3.6.jar:/opt/hive/lib/extendedset-1.3.10.jar:/opt/hive/lib/findbugs-annotations-1.3.9-1.jar:/opt/hive/lib/geoip2-0.4.0.jar:/opt/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/opt/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/opt/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/opt/hive/lib/google-http-client-jackson2-1.15.0-rc.jar:/opt/hive/lib/groovy-all-2.4.4.jar:/opt/hive/lib/gson-2.2.4.jar:/opt/hive/lib/guava-14.0.1.jar:/opt/hive/lib/guice-multibindings-4.1.0.jar:/opt/hive/lib/guice-servlet-4.1.0.jar:/opt/hive/lib/hbase-annotations-1.1.1.jar:/opt/hive/lib/hbase-client-1.1.1.jar:/opt/hive/lib/hbase-common-1.1.1-tests.jar:/opt/hive/lib/hbase-common-1.1.1.jar:/opt/hive/lib/hbase-hadoop-compat-1.1.1.jar:/opt/hive/lib/hbase-hadoop2-compat-1.1.1-tests.jar:/opt/hive/lib/hbase-hadoop2-compat-1.1.1.jar:/opt/hive/lib/hbase-prefix-tree-1.1.1.jar:/opt/hive/lib/hbase-procedure-1.1.1.jar:/opt/hive/lib/hbase-protocol-1.1.1.jar:/opt/hive/lib/hbase-server-1.1.1.jar:/opt/hive/lib/hibernate-validator-5.1.3.Final.jar:/opt/hive/lib/hive-accumulo-handler-2.3.2.jar:/opt/hive/lib/hive-beeline-2.3.2.jar:/opt/hive/lib/hive-cli-2.3.2.jar:/opt/hive/lib/hive-common-2.3.2.jar:/opt/hive/lib/hive-contrib-2.3.2.jar:/opt/hive/lib/hive-druid-handler-2.3.2.jar:/opt/hive/lib/hive-exec-2.3.2.jar:/opt/hive/lib/hive-hbase-handler-2.3.2.jar:/opt/hive/lib/hive-hcatalog-core-2.3.2.jar:/opt/hive/lib/hive-hcatalog-server-extensions-2.3.2.jar:/opt/hive/lib/hive-hplsql-2.3.2.jar:/opt/hive/lib/hive-jdbc-2.3.2.jar:/opt/hive/lib/hive-jdbc-handler-2.3.2.jar:/opt/hive/lib/hive-llap-client-2.3.2.jar:/opt/hive/lib/hive-llap-common-2.3.2-tests.jar:/opt/hive/lib/hive-llap-common-2.3.2.jar:/opt/hive/lib/hive-llap-ext-client-2.3.2.jar:/opt/hive/lib/hive-llap-server-2.3.2.jar:/opt/hive/lib/hive-llap-tez-2.3.2.jar:/opt/hive/lib/hive-metastore-2.3.2.jar:/opt/hive/lib/hive-serde-2.3.2.jar:/opt/hive/lib/hive-service-2.3.2.jar:/opt/hive/lib/hive-service-rpc-2.3.2.jar:/opt/hive/lib/hive-shims-0.23-2.3.2.jar:/opt/hive/lib/hive-shims-2.3.2.jar:/opt/hive/lib/hive-shims-common-2.3.2.jar:/opt/hive/lib/hive-shims-scheduler-2.3.2.jar:/opt/hive/lib/hive-storage-api-2.4.0.jar:/opt/hive/lib/hive-testutils-2.3.2.jar:/opt/hive/lib/hive-vector-code-gen-2.3.2.jar:/opt/hive/lib/htrace-core-3.1.0-incubating.jar:/opt/hive/lib/http-client-1.0.4.jar:/opt/hive/lib/httpclient-4.4.jar:/opt/hive/lib/httpcore-4.4.jar:/opt/hive/lib/icu4j-4.8.1.jar:/opt/hive/lib/irc-api-1.0-0014.jar:/opt/hive/lib/ivy-2.4.0.jar:/opt/hive/lib/jackson-annotations-2.6.0.jar:/opt/hive/lib/jackson-core-2.6.5.jar:/opt/hive/lib/jackson-databind-2.6.5.jar:/opt/hive/lib/jackson-dataformat-smile-2.4.6.jar:/opt/hive/lib/jackson-datatype-guava-2.4.6.jar:/opt/hive/lib/jackson-datatype-joda-2.4.6.jar:/opt/hive/lib/jackson-jaxrs-1.9.13.jar:/opt/hive/lib/jackson-jaxrs-base-2.4.6.jar:/opt/hive/lib/jackson-jaxrs-json-provider-2.4.6.jar:/opt/hive/lib/jackson-jaxrs-smile-provider-2.4.6.jar:/opt/hive/lib/jackson-module-jaxb-annotations-2.4.6.jar:/opt/hive/lib/jackson-xc-1.9.13.jar:/opt/hive/lib/jamon-runtime-2.3.1.jar:/opt/hive/lib/janino-2.7.6.jar:/opt/hive/lib/jasper-compiler-5.5.23.jar:/opt/hive/lib/jasper-runtime-5.5.23.jar:/opt/hive/lib/java-util-0.27.10.jar:/opt/hive/lib/javax.el-3.0.0.jar:/opt/hive/lib/javax.el-api-3.0.0.jar:/opt/hive/lib/javax.inject-1.jar:/opt/hive/lib/javax.jdo-3.2.0-m3.jar:/opt/hive/lib/javax.servlet-3.0.0.v201112011016.jar:/opt/hive/lib/javax.servlet-api-3.1.0.jar:/opt/hive/lib/javolution-5.5.1.jar:/opt/hive/lib/jboss-logging-3.1.3.GA.jar:/opt/hive/lib/jcodings-1.0.8.jar:/opt/hive/lib/jcommander-1.32.jar:/opt/hive/lib/jdbi-2.63.1.jar:/opt/hive/lib/jdo-api-3.0.1.jar:/opt/hive/lib/jersey-client-1.9.jar:/opt/hive/lib/jersey-guice-1.19.jar:/opt/hive/lib/jersey-server-1.14.jar:/opt/hive/lib/jettison-1.1.jar:/opt/hive/lib/jetty-6.1.26.jar:/opt/hive/lib/jetty-all-7.6.0.v20120127.jar:/opt/hive/lib/jetty-client-9.2.5.v20141112.jar:/opt/hive/lib/jetty-continuation-9.2.5.v20141112.jar:/opt/hive/lib/jetty-http-9.2.5.v20141112.jar:/opt/hive/lib/jetty-io-9.2.5.v20141112.jar:/opt/hive/lib/jetty-proxy-9.2.5.v20141112.jar:/opt/hive/lib/jetty-security-9.2.5.v20141112.jar:/opt/hive/lib/jetty-server-9.2.5.v20141112.jar:/opt/hive/lib/jetty-servlet-9.2.5.v20141112.jar:/opt/hive/lib/jetty-servlets-9.2.5.v20141112.jar:/opt/hive/lib/jetty-sslengine-6.1.26.jar:/opt/hive/lib/jetty-util-6.1.26.jar:/opt/hive/lib/jetty-util-9.2.5.v20141112.jar:/opt/hive/lib/jline-2.12.jar:/opt/hive/lib/joda-time-2.8.1.jar:/opt/hive/lib/joni-2.1.2.jar:/opt/hive/lib/jpam-1.1.jar:/opt/hive/lib/json-1.8.jar:/opt/hive/lib/json-path-2.1.0.jar:/opt/hive/lib/jsp-2.1-6.1.14.jar:/opt/hive/lib/jsp-api-2.0.jar:/opt/hive/lib/jsp-api-2.1-6.1.14.jar:/opt/hive/lib/jsp-api-2.1.jar:/opt/hive/lib/jsr305-3.0.0.jar:/opt/hive/lib/jta-1.1.jar:/opt/hive/lib/libfb303-0.9.3.jar:/opt/hive/lib/libthrift-0.9.3.jar:/opt/hive/lib/log4j-1.2-api-2.6.2.jar:/opt/hive/lib/log4j-api-2.6.2.jar:/opt/hive/lib/log4j-core-2.6.2.jar:/opt/hive/lib/log4j-jul-2.5.jar:/opt/hive/lib/log4j-slf4j-impl-2.6.2.jar:/opt/hive/lib/log4j-web-2.6.2.jar:/opt/hive/lib/lz4-1.3.0.jar:/opt/hive/lib/mail-1.4.1.jar:/opt/hive/lib/mapdb-1.0.8.jar:/opt/hive/lib/maven-aether-provider-3.1.1.jar:/opt/hive/lib/maven-model-3.1.1.jar:/opt/hive/lib/maven-model-builder-3.1.1.jar:/opt/hive/lib/maven-repository-metadata-3.1.1.jar:/opt/hive/lib/maven-scm-api-1.4.jar:/opt/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/opt/hive/lib/maven-scm-provider-svnexe-1.4.jar:/opt/hive/lib/maven-settings-3.1.1.jar:/opt/hive/lib/maven-settings-builder-3.1.1.jar:/opt/hive/lib/maxminddb-0.2.0.jar:/opt/hive/lib/metrics-core-2.2.0.jar:/opt/hive/lib/metrics-core-3.1.0.jar:/opt/hive/lib/metrics-json-3.1.0.jar:/opt/hive/lib/metrics-jvm-3.1.0.jar:/opt/hive/lib/mysql-connector-java.jar:/opt/hive/lib/mysql-metadata-storage-0.9.2.jar:/opt/hive/lib/netty-3.6.2.Final.jar:/opt/hive/lib/netty-all-4.0.52.Final.jar:/opt/hive/lib/okhttp-1.0.2.jar:/opt/hive/lib/opencsv-2.3.jar:/opt/hive/lib/orc-core-1.3.3.jar:/opt/hive/lib/org.abego.treelayout.core-1.0.1.jar:/opt/hive/lib/paranamer-2.3.jar:/opt/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/opt/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/opt/hive/lib/plexus-interpolation-1.19.jar:/opt/hive/lib/plexus-utils-3.0.15.jar:/opt/hive/lib/postgresql-9.4.1208.jre7.jar:/opt/hive/lib/postgresql-metadata-storage-0.9.2.jar:/opt/hive/lib/protobuf-java-2.5.0.jar:/opt/hive/lib/regexp-1.3.jar:/opt/hive/lib/rhino-1.7R5.jar:/opt/hive/lib/server-metrics-0.2.8.jar:/opt/hive/lib/servlet-api-2.4.jar:/opt/hive/lib/servlet-api-2.5-6.1.14.jar:/opt/hive/lib/slider-core-0.90.2-incubating.jar:/opt/hive/lib/snappy-java-1.0.5.jar:/opt/hive/lib/spymemcached-2.11.7.jar:/opt/hive/lib/stax-api-1.0.1.jar:/opt/hive/lib/super-csv-2.2.0.jar:/opt/hive/lib/tempus-fugit-1.1.jar:/opt/hive/lib/tesla-aether-0.0.5.jar:/opt/hive/lib/transaction-api-1.1.jar:/opt/hive/lib/validation-api-1.1.0.Final.jar:/opt/hive/lib/velocity-1.5.jar:/opt/hive/lib/wagon-provider-api-2.4.jar:/opt/hive/lib/zookeeper-3.4.6.jar::/opt/hadoop/share/hadoop/tools/lib/hadoop-distcp-2.10.1.jar:/contrib/capacity-scheduler/*.jar:/opt/hadoop-2.10.1/etc/hadoop:/opt/hadoop-2.10.1/share/hadoop/common/lib/hadoop-annotations-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/mockito-all-1.8.5.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/stax-api-1.0-2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/curator-recipes-2.13.0.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-digester-1.8.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/curator-client-2.13.0.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jersey-json-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/spotbugs-annotations-3.1.9.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-codec-1.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jersey-server-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-io-2.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/snappy-java-1.0.5.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/asm-3.2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/curator-framework-2.13.0.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/junit-4.11.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jersey-core-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/hadoop-auth-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jsr305-3.0.2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/activation-1.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/httpcore-4.4.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-lang3-3.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/xmlenc-0.52.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-lang-2.6.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/nimbus-jose-jwt-7.9.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/guava-11.0.2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/json-smart-1.3.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jets3t-0.9.0.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/netty-3.10.6.Final.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jetty-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/stax2-api-3.1.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/zookeeper-3.4.14.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-configuration-1.6.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-net-3.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/jsch-0.1.55.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/httpclient-4.5.2.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/servlet-api-2.5.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/commons-compress-1.19.jar:/opt/hadoop-2.10.1/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop-2.10.1/share/hadoop/common/hadoop-nfs-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/hadoop-common-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/common/hadoop-common-2.10.1-tests.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/commons-io-2.4.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/netty-all-4.1.50.Final.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/asm-3.2.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jackson-core-2.9.10.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jackson-annotations-2.9.10.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/guava-11.0.2.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/xercesImpl-2.12.0.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/jackson-databind-2.9.10.6.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/xml-apis-1.4.01.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/okio-1.6.0.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.1-tests.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-nfs-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.1-tests.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-native-client-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-2.10.1-tests.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-client-2.10.1-tests.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-rbf-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/hdfs/hadoop-hdfs-client-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jettison-1.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/java-util-1.9.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-math3-3.1.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/curator-recipes-2.13.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/json-io-2.5.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-digester-1.8.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/metrics-core-3.0.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/curator-client-2.13.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jersey-json-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jetty-sslengine-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/spotbugs-annotations-3.1.9.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-codec-1.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/audience-annotations-0.5.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jersey-server-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-io-2.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/api-util-1.0.0-M20.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/snappy-java-1.0.5.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-cli-1.2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jsp-api-2.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/asm-3.2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/log4j-1.2.17.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/curator-framework-2.13.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/guice-3.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jersey-client-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jersey-core-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jsr305-3.0.2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/paranamer-2.3.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/activation-1.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/httpcore-4.4.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-lang3-3.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/xmlenc-0.52.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/gson-2.2.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-lang-2.6.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/nimbus-jose-jwt-7.9.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/guava-11.0.2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/json-smart-1.3.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jets3t-0.9.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/netty-3.10.6.Final.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jetty-6.1.26.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/stax2-api-3.1.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/zookeeper-3.4.14.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-configuration-1.6.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/avro-1.7.7.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-net-3.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/apacheds-i18n-2.0.0-M15.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/jsch-0.1.55.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/java-xmlbuilder-0.4.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/httpclient-4.5.2.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/woodstox-core-5.0.3.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/fst-2.50.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/servlet-api-2.5.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/commons-compress-1.19.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/lib/api-asn1-api-1.0.0-M20.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-router-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-common-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-client-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-common-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-registry-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/yarn/hadoop-yarn-api-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/hadoop-annotations-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/javax.inject-1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/snappy-java-1.0.5.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/asm-3.2.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/guice-3.0.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/netty-3.10.6.Final.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/avro-1.7.7.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/lib/commons-compress-1.19.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.1-tests.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.10.1.jar:/opt/hadoop-2.10.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.10.1.jar
STARTUP_MSG:   build = git://stakiar-MBP.local/Users/stakiar/Desktop/scratch-space/apache-hive -r 857a9fd8ad725a53bd95c1b2d6612f9b1155f44d; compiled by 'stakiar' on Thu Nov 9 09:11:39 PST 2017
************************************************************/
2021-12-28T08:12:02,893 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - Starting hive metastore on port 9083
2021-12-28T08:12:03,012 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-12-28T08:12:06,113 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - Added admin role in metastore
2021-12-28T08:12:06,125 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - Added public role in metastore
2021-12-28T08:12:06,201 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - No user is added in admin role, since config is empty
2021-12-28T08:12:06,358 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - Starting DB backed MetaStore Server with SetUGI enabled
2021-12-28T08:12:06,366 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - Started the new metaserver on port [9083]...
2021-12-28T08:12:06,366 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - Options.minWorkerThreads = 200
2021-12-28T08:12:06,366 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - Options.maxWorkerThreads = 1000
2021-12-28T08:12:06,366 INFO [main] org.apache.hadoop.hive.metastore.HiveMetaStore - TCP keepalive = true

 

# Port check

$ netstat -ln  | grep ":9083"
tcp        0      0 0.0.0.0:9083            0.0.0.0:*               LISTEN