在grpc调用中使用时,Tensorflow模型无法正常工作

问题描述 投票:1回答:1

使用grpc创建了一个rpc服务。当我尝试在grpc调用内调用张量流预测函数(预测)。我得到一个张量流相关的错误,发现tf.global_variables()变空。这是代码

class ModelServiceServicer(modelService_pb2_grpc.ModelServiceServicer):
"""Provides methods that implement functionality of route guide 
   server."""

def __init__(self, model_dir_path, metrics_enabled, metrics_service):
    self.metrics_enabled = metrics_enabled
    self.metrics_service = metrics_service
    self.serialized_model = TfContainer(model_dir_path)
    self.input = ["""#input"""]        
    **#this works**
    print(self.serialized_model.handle_predict(self.input))        
    print("intialized")
    print(tf.global_variables())


def predict(self, request, context):
    print("request is ")
    #print(request)
    print(context)
    start_time = datetime.now()
    print(self.input)
    print(self.serialized_model)
    try:
        **#this becomes empty**
        print(tf.global_variables())
        **#this does not work.**
        print(self.serialized_model.handle_predict(self.input))
    except:
        traceback.print_stack()
        print('------')
        traceback.print_exc()      **
    print(self.serialized_model.handle_predict(self.input))        
    print("intialized")
    print(tf.global_variables())  

帮助将非常感谢!

python-3.x tensorflow grpc tensorflow-serving grpc-python
1个回答
0
投票

实际的Servicer方法调用确实发生在另一个线程中,特别是在初始化服务器时提供的ThreadPool中。根据TensorFlow document tf.global_variables似乎没有直接绑定线程,不像tf.local_variables。您能否提供有关tf.global_variables的预期价值的更多信息?或者一个可重复性最小的片段甚至更好!

© www.soinside.com 2019 - 2024. All rights reserved.