Kafka to Snowflake-无法找到实现连接器的任何类

问题描述 投票:1回答:1

[尝试连接到Kafka群集并将数据从主题写入Snowflake。

我得到的错误是:

java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches com.snowflake.kafka.connector.SnowflakeSinkConnector

available connectors are: PluginDesc{klass=class com.snowflake.kafka.connector.SnowflakeSinkConnector, name='com.snowflake.kafka.connector.SnowflakeSinkConnector', version='1.0.0', encodedVersion=1.0.0, type=sink, typeName='sink', location='file:path_to_kafka/kafka_2.12-2.3.0/libs/snowflakeinc-snowflake-kafka-connector/'}

我正在运行的命令(不包括标准的zookeeper / kafka启动命令):

/path_to_kafka/kafka_2.12-2.3.0/bin/connect-standalone.sh /path_to_kafka/kafka_2.12-2.3.0/config/connect-standalone.properties /path_to_kafka/kafka_2.12-2.3.0/config/snowflake_properties.properties

到目前为止我所做的:

/path_to_kafka/kafka_2.12-2.3.0/config/connect-standalone.properties中的更新的plugin.path

with

plugin.path=/usr/share/java,/path_to_kafka/kafka_2.12-2.3.0/libs,/path_to_kafka/kafka_2.12-2.3.0/libs/snowflakeinc-snowflake-kafka-connector

我已经在线研究了类似的案例,但是尽管其中许多是收到相同错误消息的用户,但对于我来说,所需的连接器并未列在可用连接器列表中。

我最初尝试将雪花罐直接放置在libs文件夹中,然后再次放置为整个程序包结构,但均无效。

[每次尝试后,我都停止了zookeeper / kafka并重新启动它们,但仍然收到相同的错误。

我已经完成了将jar路径添加到PATH的测试,但是我收到了同样的失败结果。

我看过的地方:

https://docs.confluent.io/3.1.1/connect/userguide.html#installing-connector-plugins

Kafka Connect can't find connector

Kafka Connect cant' find class of developed plugin

Kafka Connect failed to add MySqlConnector

https://github.com/DataReply/kafka-connect-mongodb/issues/23

https://github.com/confluentinc/kafka-connect-jdbc/issues/476

https://github.com/wepay/kafka-connect-bigquery/issues/109

How to copy or configure kafka connect plugin files?

我在哪里下载连接器:https://mvnrepository.com/artifact/com.snowflake/snowflake-kafka-connector/1.0.0

我已经参加了几天,我觉得我已经尝试了所有这些建议。但是,他们都不适合我,我也不知道我在做什么错。

apache-kafka apache-kafka-connect snowflake-data-warehouse
1个回答
0
投票

connector documentation

将下载的JAR文件[…]复制到/ libs文件夹。

要使其成为Kafka命令的Java运行时类路径,则jar必须直接位于您的/path_to_kafka/kafka_2.12-2.3.0/libs/目录下。根据您的描述,它们似乎位于子目录(/path_to_kafka/kafka_2.12-2.3.0/libs/snowflakeinc-snowflake-kafka-connector/)中。

© www.soinside.com 2019 - 2024. All rights reserved.