Python scrapy run with Unhandled error in Deferred -


windows python version 2.7.10 scrapy version 1.0.1 when run scrapy fetch http://google.com:81 appear problem , don't konw how solve code: items.py:

from scrapy.item import item, field class stackitem(item):     title = field()    url = field()

stack_spider.py

from scrapy import spider scrapy.selector import selector   class stackspider(spider):    name = "stack"    allowed_domains = ["stackoverflow.com"]    start_urls = ["http://stackoverflow.com/questions?pagesize=50&sort=newest", ]     def parse(self, response): questions = selector(response).xpath('//div[@class="summary"]/h3')  question in questions:   item = stackitem()   item['title'] = question.xpath(       'a[@class="question-hyperlink"]/text()').extract()[0]   item['url'] = question.xpath(       'a[@class="question-hyperlink"]/@href').extract()[0]   yield item

the error detail:

$ scrapy crawl stack 2015-07-07 16:26:26 [scrapy] info: scrapy 1.0.1 started (bot: stack)  2015-07-07 16:26:26 [scrapy] info: optional features available: ssl, http11  2015-07-07 16:26:26 [scrapy] info: overridden settings: {'newspider_module': `'stack.spiders', 'spider_modules': ['stack.spiders'], 'bot_name': 'stack'}`  2015-07-07 16:26:27 [scrapy] info: enabled extensions: closespider, `telnetconsole, logstats, corestats, spiderstate`  unhandled error in deferred:  2015-07-07 16:26:28 [twisted] critical: unhandled error in deferred:  2015-07-07 16:26:28 [twisted] critical:

i think in stack_spider.py file missing line:

from stack.items import stackitem


Comments

Post a Comment

Popular posts from this blog

How to provide Authorization & Authentication using Asp.net, C#? -

Image
i have asp.net application in c#. i have provide page authorization specific user/usergroup. i have created 2 tables in database: 1) pagename 2)permissions[insert, update, view, delete] but i'm unable match tables , permissions assigning... can 1 please me, how created tables in database , how coding. please me. you can below explanation. configure access specific file , folder, set forms-based authentication. request page in application redirected logon.aspx automatically. in web.config file, type or paste following code. this code grants users access default1.aspx page , subdir1 folder . <configuration> <system.web> <authentication mode="forms" > <forms loginurl="login.aspx" name=".aspnetauth" protection="none" path="/" timeout="20" > </forms> </authentication> <!-- section denies access files in...
Read more

toolbar - How to add link to user registration inside toobar in admin joomla 3 custom component -

im trying write component admin side , need add user creation. dont want duplicate existing codes add link. know how add task not simple link toolbar. thx help. if wanting button opens new user screen can try in component: $bar = jtoolbar::getinstance('toolbar'); $bar->appendbutton('link', 'users', 'new user','index.php?option=com_users&task=user.add'); you need add view.html.php file wherever you're creating toolbar. is need?
Read more

How to use Authorization & Authentication in Asp.net, C#? -

i using roll management , trying give page , folder access according user or user group, using server created ad group user authentication. i have default1.aspx page default , subdir1 folder give different access separate user group i using below logic in web.config. <location path="subdir1"> <system.web> <authorization> <allow users ="?" /> </authorization> </system.web> </location> i facing problem provide same access 2 or more directory same user should have provide allow user code twice both folder? i can use logic repeating value folder want access providing in 1 logic. i have got answer configure folder/page access, have make different access shown below.. configure access specific file , folder, set forms-based authentication. request page in application redirected logon.aspx automatically. in web.config file, done following code. this code grants user...
Read more