pyspider MongoDB部署时遇到问题,该如何解决?

2026-04-02 01:331阅读0评论SEO教程
  • 内容介绍
  • 文章标签
  • 相关推荐

本文共计468个文字,预计阅读时间需要2分钟。

pyspider MongoDB部署时遇到问题,该如何解决?

在配置文件pyspider-cconfig.json后遇到错误,提示phantomjs未找到。以下是简化后的内容:

错误信息:phantomjs not found, continue running without it.时间:2015-12-25 17:29:08

如题pyspider-cconfig.json后报错:

如题 pyspider -c config.json 后报错:

pyspider MongoDB部署时遇到问题,该如何解决?

12345678910111213141516171819202122232425262728293031323334353637[W 151225 17:29:08 run:398] phantomjs not found, continue running without it.[I 151225 17:29:10 result_worker:49] result_worker starting...[I 151225 17:29:11 tornado_fetcher:429] fetcher starting...[I 151225 17:29:11 scheduler:453] loading projects[I 151225 17:29:11 processor:208] processor starting...Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'

   

本文共计468个文字,预计阅读时间需要2分钟。

pyspider MongoDB部署时遇到问题,该如何解决?

在配置文件pyspider-cconfig.json后遇到错误,提示phantomjs未找到。以下是简化后的内容:

错误信息:phantomjs not found, continue running without it.时间:2015-12-25 17:29:08

如题pyspider-cconfig.json后报错:

如题 pyspider -c config.json 后报错:

pyspider MongoDB部署时遇到问题,该如何解决?

12345678910111213141516171819202122232425262728293031323334353637[W 151225 17:29:08 run:398] phantomjs not found, continue running without it.[I 151225 17:29:10 result_worker:49] result_worker starting...[I 151225 17:29:11 tornado_fetcher:429] fetcher starting...[I 151225 17:29:11 scheduler:453] loading projects[I 151225 17:29:11 processor:208] processor starting...Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'Exception AttributeError: "'Cursor' object has no attribute '_Cursor__id'" in ignored[E 151225 17:29:11 scheduler:463] __init__() got an unexpected keyword argument 'fields'    Traceback (most recent call last):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 458, in run        self.run_once()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 442, in run_once        self._update_projects()      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/scheduler/scheduler.py", line 84, in _update_projects        for project in self.projectdb.check_update(self._last_update_project):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 61, in check_update        for project in self.get_all(fields=('updatetime', 'name')):      File "/root/miniconda2/lib/python2.7/site-packages/pyspider/database/mongodb/projectdb.py", line 49, in get_all        for each in self.collection.find({}, fields=fields):      File "/root/miniconda2/lib/python2.7/site-packages/pymongo/collection.py", line 1137, in find        return Cursor(self, *args, **kwargs)    TypeError: __init__() got an unexpected keyword argument 'fields'