pandas内存错误MemoryError如何解决,pandasmemoryerror, File "D:\W
pandas内存错误MemoryError如何解决,pandasmemoryerror, File "D:\W
File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 680, in runfile execfile(filename, namespace) File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\spyderlib\widgets\externalshell\sitecustomize.py", line 71, in execfile exec(compile(scripttext, filename, 'exec'), glob, loc) File "D:/pywork/Marking/DataProcessing.py", line 113, in <module> df = pd.DataFrame(data, columns=colNames) File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\pandas\core\frame.py", line 258, in __init__ dtype=dtype) File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\pandas\core\frame.py", line 4627, in _arrays_to_mgr return create_block_manager_from_arrays(arrays, arr_names, axes) File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\pandas\core\internals.py", line 3539, in create_block_manager_from_arrays blocks = form_blocks(arrays, names, axes) File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\pandas\core\internals.py", line 3614, in form_blocks int_blocks = _multi_blockify(int_items) File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\pandas\core\internals.py", line 3681, in _multi_blockify list(tup_block), dtype) File "D:\WinPython-32bit-2.7.9.3\python-2.7.9\lib\site-packages\pandas\core\internals.py", line 3725, in _stack_arrays stacked = np.empty(shape, dtype=dtype)MemoryError
使用pandas.DataFrame读175MB数据(111W行 X 38列),程序执行过程中报如上错误。
是读入错误还是计算中错误?
如果是后者,可以试试读入后 del 一些无用的 col,再计算
百万行我试过,但这么多列没试过
编橙之家文章,
相关内容
- Python爬虫返回unicode字符串如何得到汉字呢,pythonunico
- web开发和部署用pyenv还是virtualenv,pyenvvirtualenv,两种环境
- Python正则过滤特殊字符及乱码符怎么写,python特殊字符
- mac键盘上哪个键是python交互模式下快捷键C+underscore的
- python什么方法可以判断捉取的内容是否有更新,python
- Python TCPServer编程如何保存数据这块的问题,pythontcpse
- 哪里有《Python library reference》中文文档下载,,如题,找
- Python什么方法可以检测到上传的zip炸弹,并预防unzip引爆
- 需要可以暂停python命令运行的方法,暂停python命令运行
- Python tornado用户登录调用管理问题,pythontornado,用户登陆
评论关闭