Discussion:
how to fix it?
Megido _
2013-06-26 22:03:56 UTC
Permalink
ERROR: Error caught on signal handler: <bound method ?.item_scraped of
<scrapy.contrib.feedexport.FeedExporter object at 0x8a7cecc>>
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/twisted/internet/defer.py",
line 575, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "/usr/local/lib/python2.7/dist-packages/scrapy/core/scraper.py", line
213, in _itemproc_finished
item=output, response=response, spider=spider)
File "/usr/local/lib/python2.7/dist-packages/scrapy/signalmanager.py", line
23, in send_catch_log_deferred
return signal.send_catch_log_deferred(*a, **kw)
File "/usr/local/lib/python2.7/dist-packages/scrapy/utils/signal.py", line
53, in send_catch_log_deferred
*arguments, **named)
--- <exception caught here> ---
File "/usr/local/lib/python2.7/dist-packages/twisted/internet/defer.py",
line 137, in maybeDeferred
result = f(*args, **kw)
File
"/usr/local/lib/python2.7/dist-packages/scrapy/xlib/pydispatch/robustapply.py",
line 47, in robustApply
return receiver(*arguments, **named)
File "/usr/local/lib/python2.7/dist-packages/scrapy/contrib/feedexport.py",
line 191, in item_scraped
slot.exporter.export_item(item)
File
"/usr/local/lib/python2.7/dist-packages/scrapy/contrib/exporter/__init__.py",
line 86, in export_item
itemdict = dict(self._get_serialized_fields(item))
File
"/usr/local/lib/python2.7/dist-packages/scrapy/contrib/exporter/__init__.py",
line 60, in _get_serialized_fields
field_iter = item.iterkeys()
exceptions.AttributeError: 'NoneType' object has no attribute 'iterkeys'
--
You received this message because you are subscribed to the Google Groups "scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/***@public.gmane.org
To post to this group, send email to scrapy-users-/JYPxA39Uh5TLH3MbocFF+G/***@public.gmane.org
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/groups/opt_out.
Mingfeng Yang
2013-06-26 22:34:54 UTC
Permalink
Probably you yielded a 'None' (blank) as Item instance, and when
feedexporter tried to process it, it raised an exception.

IMHO, the right way to ask a question, you need to give more detailed
information, for example, snippet of your code, which page you tried to
scrape when this exception occured etc, instead of just the traceback of an
exception. With little information, people can give little help.

Ming-
Post by Megido _
ERROR: Error caught on signal handler: <bound method ?.item_scraped of
<scrapy.contrib.feedexport.FeedExporter object at 0x8a7cecc>>
File "/usr/local/lib/python2.7/dist-packages/twisted/internet/defer.py",
line 575, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "/usr/local/lib/python2.7/dist-packages/scrapy/core/scraper.py", line
213, in _itemproc_finished
item=output, response=response, spider=spider)
File "/usr/local/lib/python2.7/dist-packages/scrapy/signalmanager.py",
line 23, in send_catch_log_deferred
return signal.send_catch_log_deferred(*a, **kw)
File "/usr/local/lib/python2.7/dist-packages/scrapy/utils/signal.py", line
53, in send_catch_log_deferred
*arguments, **named)
--- <exception caught here> ---
File "/usr/local/lib/python2.7/dist-packages/twisted/internet/defer.py",
line 137, in maybeDeferred
result = f(*args, **kw)
File
"/usr/local/lib/python2.7/dist-packages/scrapy/xlib/pydispatch/robustapply.py",
line 47, in robustApply
return receiver(*arguments, **named)
File
"/usr/local/lib/python2.7/dist-packages/scrapy/contrib/feedexport.py", line
191, in item_scraped
slot.exporter.export_item(item)
File
"/usr/local/lib/python2.7/dist-packages/scrapy/contrib/exporter/__init__.py",
line 86, in export_item
itemdict = dict(self._get_serialized_fields(item))
File
"/usr/local/lib/python2.7/dist-packages/scrapy/contrib/exporter/__init__.py",
line 60, in _get_serialized_fields
field_iter = item.iterkeys()
exceptions.AttributeError: 'NoneType' object has no attribute 'iterkeys'
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/groups/opt_out.
--
You received this message because you are subscribed to the Google Groups "scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/***@public.gmane.org
To post to this group, send email to scrapy-users-/JYPxA39Uh5TLH3MbocFF+G/***@public.gmane.org
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/groups/opt_out.
Megido _
2013-06-27 01:55:15 UTC
Permalink
Megido _
2013-06-27 02:01:25 UTC
Permalink
and yes pipelines or other return None, this can look in log
Megido _
2013-06-27 02:20:55 UTC
Permalink
Megido _
2013-06-27 06:46:18 UTC
Permalink
I find funny error:

Loading...