Unpicklingerror when trying to load model weights received as udp package

问题描述 投票:0回答:0

我想进行一个涉及网络多播的实验。为此,我有一个服务器将一些处理过的模型权重(ndarrays 元组)发送回客户端。当尝试使用 pickle.save() 和 pickle.load() 序列化和反序列化接收到的权重时,我总是收到以下错误 _pickle.UnpicklingError:无效的加载密钥,'XXX' 其中 XXX 是转储中的某个密钥。

我正在使用 python 3.10

发射器:


message = new_weights
multicast_group = (group_ip_address, port)

# Create UDP socket
sock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)

# bind to selected address
sock.bind((source_ip, source_port))


# Set the time-to-live for messages to  so they do not go past the
# local network segment.
ttl = struct.pack('b', 2)
sock.setsockopt(socket.IPPROTO_IP, socket.IP_MULTICAST_TTL, ttl)

try:
    BUFFER_SIZE = 4096

    # Send data to the multicast group
    print(sys.getsizeof(message))
    print('sending "%s"' % message)
    serialized = pickle.dumps(message)
    for i in range(0,len(serialized), BUFFER_SIZE):
        data =serialized[i:i+BUFFER_SIZE]
        sock.sendto(data,multicast_group)

        while True:
            sock.settimeout(1)
            print('waiting to receive acknowledgment')
            try:

                data, server = sock.recvfrom(BUFFER_SIZE)
            except socket.timeout:
                print('timed out, resending package')
                sock.sendto(data, multicast_group)
            else:
                print('received "%s" from %s' % (data, server))
                break
    # tell edge server to stop the recv loop
    sock.sendto(b'END',multicast_group)
  


finally:
    print('closing socket')
    sock.close()

接收器:


BUFFER_SIZE= 4096
packets = []
while True:
    data, address = sock.recvfrom(BUFFER_SIZE)
    print(data)
    if not data or data.endswith(b'END'):
        break
    packets.append(data)
    sock.sendto(b'ack',address)
    #print('received %s bytes from %s' % (len(data), address))
    #print('total : %s' % len(packets))

bytes= b''.join(packets)
new_aggregated_parameters = pickle.loads(bytes)
print(type(new_aggregated_parameters))
print('sending acknowledgement to', address)
sock.sendto(b'ack', address)

python sockets network-programming udp pickle
© www.soinside.com 2019 - 2024. All rights reserved.