我有一个
csv
文件,其中包含标题行和 100k 条目。
我在
python
IDE 中使用 pycharm
,并使用 conda
作为 python 解释器。 conda
供应 pymongo-3.4.0
作为 mongo-driver
。
我解析
csv
文件并将其另存为磁盘上的 json
n 文件,然后迭代 json
文件以将 json
对象插入到 mongo
数据库中。
JSON 看起来像这样:
{
a1 : {'name': 702104534, type='Single' }
a2 : {'name': 702104535, type='Single' }
a3 : {'name': 702104536, type='Married' }
}
Python代码:
import pymongo
import pickle
with open('my_json_file.json', 'rb') as in_file:
person_json = pickle.load(in_file)
conn = pymongo.MonogClient('localhost','27017')
db = conn['db']
coll = db['coll']
persons = person_json.keys()
for person in persons:
coll.insert_one(person_json[person])
出现以下错误:
Traceback (most recent call last):
File "C:/PyCharmWorkSpace/LCR/json2mongo.py", line 109, in <module>
data2mongo()
File "C:/PyCharmWorkSpace/LCR/json2mongo.py", line 89, in data2mongo
coll.insert_one(json_str)
File "C:\Anaconda3\lib\site-packages\pymongo\collection.py", line 657, in insert_one
bypass_doc_val=bypass_document_validation),
File "C:\Anaconda3\lib\site-packages\pymongo\collection.py", line 562, in _insert
check_keys, manipulate, write_concern, op_id, bypass_doc_val)
File "C:\Anaconda3\lib\site-packages\pymongo\collection.py", line 543, in _insert_one
check_keys=check_keys)
File "C:\Anaconda3\lib\site-packages\pymongo\pool.py", line 424, in command
self._raise_connection_failure(error)
File "C:\Anaconda3\lib\site-packages\pymongo\pool.py", line 552, in _raise_connection_failure
raise error
File "C:\Anaconda3\lib\site-packages\pymongo\pool.py", line 419, in command
collation=collation)
File "C:\Anaconda3\lib\site-packages\pymongo\network.py", line 94, in command
None, codec_options, check_keys)
bson.errors.InvalidDocument: Cannot encode object: 702104534
但是,如果 json 字符串是变量,则同样有效
Python代码:
import pymongo
conn = pymongo.MonogClient('localhost','27017')
db = conn['db']
coll = db['coll']
person = {'name': 702104534, 'type'='Single' }
coll.insert_one(person)
感谢您的帮助。
当
pymongo
动态生成或从基于磁盘的文件读取时,当使用任一插入方法(例如 json
或 json
或 )将 mongodb
字符串inserted
到
insert
时,
insert_one
似乎存在一些运行时类型转换兼容性问题insert_many
。
我能够通过关联标准 python 类型转换将
json
对象插入到 mongodb
。