如何将数据发送到EventHub设置PartitionId而不是PartitionKey(Python)

问题描述 投票:0回答:2

我在Microsoft Docs上看到,有一种方法可以通过设置PartitionId而不是PartitionKey(使用C#)将数据发送到我想要的分区。

创建PartitionSender(String)创建一个可以将事件数据直接发布到特定EventHub分区的分区发件人。

但是,我在Python中找不到相同的东西。

有什么办法吗?

python azure azure-eventhub
2个回答
0
投票

有两种方法可以将数据发送到Azure事件中心,即HTTP REST API和AMQP 1.0协议。

对于使用HTTP REST API或Azure EventHub Python Client Library,只有partitionId参数支持将新事件发送到事件中心中的指定分区,如下所示。

  1. REST API Send partition event需要端点partitionId中的https://{servicebusNamespace}.servicebus.windows.net/{eventHubPath}/partitions/{partitionId}/messages参数,并且它是唯一一个支持发送分区功能的REST API。
  2. Sender.py的源代码注释解释了partition参数如下。 :param partition: The specific partition ID to send to. Default is None, in which case the service will assign to all partitions using round-robin. :type partition: str

实际上,您不能使用partitionKey值将事件发送到指定的EventHub分区,除非在Python中使用AMQP 1.0。要使用AMQP 1.0,请参阅官方文档AMQP 1.0 in Azure Service Bus and Event Hubs protocol guide并在页面上搜索单词partition-key,结果如下。

enter image description here


0
投票

我不是很确定但是使用python,这是打开连接的方法

def open(self):
        """
        Open the Sender using the supplied conneciton.
        If the handler has previously been redirected, the redirect
        context will be used to create a new handler before opening it.
        :param connection: The underlying client shared connection.
        :type: connection: ~uamqp.connection.Connection
        """
        self.running = True
        if self.redirected:
            self.target = self.redirected.address
            self._handler = SendClient(
                self.target,
                auth=self.client.get_auth(),
                debug=self.client.debug,
                msg_timeout=self.timeout,
                error_policy=self.retry_policy,
                keep_alive_interval=self.keep_alive,
                client_name=self.name,
                properties=self.client.create_properties())
        self._handler.open()
        while not self._handler.client_ready():
            time.sleep(0.05)

这是Init

def __init__(self, client, target, partition=None, send_timeout=60, keep_alive=None, auto_reconnect=True):
        """
        Instantiate an EventHub event Sender handler.
        :param client: The parent EventHubClient.
        :type client: ~azure.eventhub.client.EventHubClient.
        :param target: The URI of the EventHub to send to.
        :type target: str
        :param partition: The specific partition ID to send to. Default is None, in which case the service
         will assign to all partitions using round-robin.
        :type partition: str
        :param send_timeout: The timeout in seconds for an individual event to be sent from the time that it is
         queued. Default value is 60 seconds. If set to 0, there will be no timeout.
        :type send_timeout: int
        :param keep_alive: The time interval in seconds between pinging the connection to keep it alive during
         periods of inactivity. The default value is None, i.e. no keep alive pings.
        :type keep_alive: int
        :param auto_reconnect: Whether to automatically reconnect the sender if a retryable error occurs.
         Default value is `True`.
        :type auto_reconnect: bool
        """
        self.running = False
        self.client = client
        self.target = target
        self.partition = partition
        self.timeout = send_timeout
        self.redirected = None
        self.error = None
        self.keep_alive = keep_alive
        self.auto_reconnect = auto_reconnect
        self.retry_policy = errors.ErrorPolicy(max_retries=3, on_error=_error_handler)
        self.reconnect_backoff = 1
        self.name = "EHSender-{}".format(uuid.uuid4())
        if partition:
            self.target += "/Partitions/" + partition
            self.name += "-partition{}".format(partition)
        self._handler = SendClient(
            self.target,
            auth=self.client.get_auth(),
            debug=self.client.debug,
            msg_timeout=self.timeout,
            error_policy=self.retry_policy,
            keep_alive_interval=self.keep_alive,
            client_name=self.name,
            properties=self.client.create_properties())
        self._outcome = None
        self._condition = None

我相信,下面的函数行只会创建一个分区发送者

if partition:
                self.target += "/Partitions/" + partition
                self.name += "-partition{}".format(partition)

参考

https://github.com/Azure/azure-event-hubs-python/blob/master/azure/eventhub/sender.py

希望能帮助到你。

© www.soinside.com 2019 - 2024. All rights reserved.