按kafka connect中的特定值过滤记录

问题描述 投票:3回答:1

我一直试图在debezium源sql连接器中找到一种包含丢弃具有特定值的记录的过滤器的方法。可以说,我有JSON:{“ id”:0,“ name”:“ muj”},我想将所有具有“ name”值字段的记录都丢弃为“ muj”。有没有一种方法可以不必使用融合平台?

json sql-server apache-kafka apache-kafka-connect debezium
1个回答
0
投票

我从未使用过debezium源sql连接器,但是看起来源conf接受查询,为什么不在confs本身中尝试查询参数。

{
  "schema": {
    "type": "struct",
    "name": "io.debezium.connector.mysql.SchemaChangeValue",
    "optional": false,
    "fields": [
      {
        "field": "databaseName",
        "type": "string",
        "optional": false
      },
      {
        "field": "ddl",
        "type": "string",
        "optional": false
      },
      {
        "field": "source",
        "type": "struct",
        "name": "io.debezium.connector.mysql.Source",
        "optional": false,
        "fields": [
          {
            "type": "string",
            "optional": true,
            "field": "version"
          }
        ]
      }
    ]
  },
  "payload": {
    "databaseName": "inventory",
    "ddl": "CREATE TABLE products ( id INTEGER NOT NULL AUTO_INCREMENT PRIMARY KEY, name VARCHAR(255) NOT NULL, description VARCHAR(512), weight FLOAT ); ALTER TABLE products AUTO_INCREMENT = 101;",
    "source" : {
      "version": "{debezium-version}",
      "name": "mysql-server-1",
      "server_id": 0,
      "ts_sec": 0,
      "gtid": null,
      "file": "mysql-bin.000003",
      "pos": 154,
      "row": 0,
      "snapshot": true,
      "thread": null,
      "db": null,
      "table": null,
      "query": "INSERT INTO customers where name = muj "
    }
  }
}
© www.soinside.com 2019 - 2024. All rights reserved.