设置 S3 Source Connector 时找不到类

问题描述 投票:0回答:0

我正在尝试设置我的 Kafka S3 源连接器以从我的 S3 存储桶中提取文件。但是,当我在连接时检查连接器的状态时,我将此作为错误响应

error_code: 500 Failed to find any class that implements Connector and which name matches io.confluent.connect.s3.source.S3SourceConnector, available connectors are:...
因此我添加了s3源库
confluent-hub install confluentinc/kafka-connect-s3-source:2.5.1
。这在某种程度上连接了我的源,但是它破坏了我的接收器连接器,给出了错误警告
FAILED, org.apache.kafka.common.config.ConfigException: Invalid value io.confluent.connect.jdnc.sink.JdbcSinkTask for configuration task.class: Class io.confluent.connect.jdbc.sink.JdbcSinkTask could not be found
。我向我的 s3 连接器添加了一个插件路径,但仍然错误显示 500 class not found 消息日志。有人可以指导我让我的接收器和源连接器都处于运行状态所缺少的东西吗?

这是我的配置

"tasks.max":"1",
"connector.class":"io.confluent.connect.s3.source.S3SourceConnector",
"topic.dir":"abc_",
"topic.regex.list":"abc:.\\.json",
"s3.poll.interval.ms":"300000",
"s3.region":"us-west-2",
"s3.bucket.name":"bucket-name",
"s3.credentials.provider.class":"com.amazonaws.auth.DefaultAWSCredentialsProviderChain",
"aws.access.key.id":"ACCESS_KEY",
"aws.secret.access.key":"SECRET_KEY",
"format.class":"io.confluent.connect.s3.format.json.JsonFormat",
"partitioner.class":"io.confluent.connect.storage.partitioner.TimeBasedPartitioner",
"locale":"en",
"timezone":"America/Los_Angeles",
"path.format":"YYYY-MM-dd:HH",
"errors.tolerance":"all",
"errors.log.enable":true,
"errors.log.include.messages":true
amazon-s3 jdbc apache-kafka apache-kafka-streams s3-kafka-connector
© www.soinside.com 2019 - 2024. All rights reserved.