[开始读取从gcs传输的csv文件3/13/2020时遇到错误。下载后在ai平台上检查文件权限
相关文档:https://www.tensorflow.org/api_docs/python/tf/io/gfile/GFile(似乎可读属性已被删除...)
命令:
sh.gsutil('cp',GCS_PATH,raw_rating_path)
with tf.io.gfile.GFile(raw_rating_path) as f:
df = pd.read_csv(f)
已验证文件是本地文件,并具有以下权限:
-rw-rw-rw- 1 root root 32617551 Apr 1 20:24 /tmp/placeScores.csv
错误(从原始的AI平台日志中清除了一点:
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 676, in parser_f
return _read(filepath_or_buffer, kwds)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 448, in _read
parser = TextFileReader(fp_or_buf, **kwds)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 880, in __init__
self._make_engine(self.engine)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 1114, in _make_engine
self._engine = CParserWrapper(self.f, **self.options)
File "/root/.local/lib/python3.7/site-packages/pandas/io/parsers.py", line 1880, in __init__
src = TextIOWrapper(src, encoding=encoding, newline="")
AttributeError: 'GFile' object has no attribute 'readable'
阅读Tensor Flow文档,似乎您忘记了函数“ tf.io.gfile.GFile(raw_rating_path)”中的参数“ mode”,根据该文档,它应该是“ tf.io.gfile.GFile( raw_rating_path,mode ='r')“。
已删除tf.io.gfile.GFile线程锁定,并能够再次成功读取数据。不清楚ai平台上出了什么问题,因为它是使用tf.io.gfile.GFile在本地运行的。在ai平台tensorflow版本2.1上安装tf可能是一个问题
df = data_io.read_csv(raw_rating_path)
# with tf.io.gfile.GFile(raw_rating_path, 'r') as f:
# df = pd.read_csv(f)