ai平台+ gsutil权限错误:AttributeError:'GFile'对象没有属性'可读'

问题描述 投票:0回答:2

[开始读取从gcs传输的csv文件3/13/2020时遇到错误。下载后在ai平台上检查文件权限

相关文档:https://www.tensorflow.org/api_docs/python/tf/io/gfile/GFile(似乎可读属性已被删除...)

命令:

sh.gsutil('cp',GCS_PATH,raw_rating_path)
with tf.io.gfile.GFile(raw_rating_path) as f:
   df = pd.read_csv(f)

已验证文件是本地文件,并具有以下权限:

-rw-rw-rw- 1 root root 32617551 Apr  1 20:24 /tmp/placeScores.csv

错误(从原始的AI平台日志中清除了一点:

File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 676, in parser_f
return _read(filepath_or_buffer, kwds)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 448, in _read
parser = TextFileReader(fp_or_buf, **kwds)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 880, in __init__
self._make_engine(self.engine)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 1114, in _make_engine
self._engine = CParserWrapper(self.f, **self.options)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 1880, in __init__
src = TextIOWrapper(src, encoding=encoding, newline="")
AttributeError: 'GFile' object has no attribute 'readable'
tensorflow tensorflow2.0 gsutil gcp-ai-platform-training
2个回答
1
投票

阅读Tensor Flow文档,似乎您忘记了函数“ tf.io.gfile.GFile(raw_rating_path)”中的参数“ mode”,根据该文档,它应该是“ tf.io.gfile.GFile( raw_rating_path,mode ='r')“。


0
投票

已删除tf.io.gfile.GFile线程锁定,并能够再次成功读取数据。不清楚ai平台上出了什么问题,因为它是使用tf.io.gfile.GFile在本地运行的。在ai平台tensorflow版本2.1上安装tf可能是一个问题

df = data_io.read_csv(raw_rating_path)
# with tf.io.gfile.GFile(raw_rating_path, 'r') as f:
#   df = pd.read_csv(f)
© www.soinside.com 2019 - 2024. All rights reserved.