[由ambari添加连接器插件kafka

Question

即时通讯是apache环境中的新功能，它让我真的很纳闷。我的kafka是通过ambari安装的。因此一切都可以通过ambari的GUI启动。当通过ambari安装kafka时，它包括kafka-connect。但是如果没有我需要的连接器怎么办呢？这是其中包含的一些连接器。

/etc/kafka-connect-activemq
/etc/kafka-connect-elasticsearch
/etc/kafka-connect-ibmmq
/etc/kafka-connect-jdbc
/etc/kafka-connect-jms
/etc/kafka-connect-replicator
/etc/kafka-connect-s3
/etc/kafka-connect-storage-common
/etc/kafka-connect-activemq/ActiveMQSourceConnector.properties
/etc/kafka-connect-activemq/connect-avro-localhost.properties
/etc/kafka-connect-elasticsearch/quickstart-elasticsearch.properties
/etc/kafka-connect-ibmmq/IbmMQSourceConnector.properties
/etc/kafka-connect-ibmmq/connect-avro-localhost.properties
/etc/kafka-connect-jdbc/sink-quickstart-sqlite.properties
/etc/kafka-connect-jdbc/source-quickstart-sqlite.properties
/etc/kafka-connect-jms/ActiveMQSourceConnector.properties
/etc/kafka-connect-jms/JMSSourceConnector.properties
/etc/kafka-connect-jms/connect-avro-localhost.properties
/etc/kafka-connect-replicator/quickstart-replicator-unicluster.properties
/etc/kafka-connect-replicator/quickstart-replicator.properties
/etc/kafka-connect-replicator/replicator-connect-distributed.properties
/etc/kafka-connect-replicator/replicator-connect-standalone.properties
/etc/kafka-connect-replicator/replicator-log4j.properties
/etc/kafka-connect-replicator/replicator.properties
/etc/kafka-connect-s3/quickstart-s3.properties
/etc/kafka-connect-s3/quickstart-schema-source-for-s3.properties

但是我需要的是hdfs3-sink。我如何才能做到无融合？

任何建议将不胜感激。谢谢

Answer 1

我知道的Kafka Connect唯一的HDFS 3连接器是Confluent的连接器：https://www.confluent.io/hub/confluentinc/kafka-connect-hdfs3/。

要安装它，您可以直接下载JAR，或使用confluent-hub CLI工具来安装它。