如何使用用于HDP3的蜂巢房屋连接器启动Spark Shell会话?

问题描述 投票:0回答:1

我正在尝试将Spark Shell与Hive Warehouse Connector API连接,以从Spark访问任何托管Hive表。

apache-spark hive connector spark-shell warehouse
1个回答
0
投票

使用以下spark-shell命令将Spark Shell与Hive Warehouse Connector API连接以从Spark访问任何托管Hive表时使用

spark-shell --master yarn \
--jars /../../<hdp-version>/hive_warehouse_connector/hive-warehouse-connector-assembly-1.x.x.x.x.x-xx.jar \
--conf spark.security.credentials.hiveserver2.enabled=false \
--conf spark.hadoop.hive.llap.daemon.service.hosts='llap-name' \
--conf spark.sql.hive.hiveserver2.jdbc.url='hive-server2-jdbc-url' \
--conf spark.datasource.hive.warehouse.metastoreUri='thrift://hostname:post' \
--conf spark.hadoop.hive.zookeeper.quorum='<zookeeper.quorum>' 
© www.soinside.com 2019 - 2024. All rights reserved.