Skip to content

Instantly share code, notes, and snippets.

View GloriaXie123's full-sized avatar
🏠
Working from home

GloriaXie GloriaXie123

🏠
Working from home
  • YumChina
View GitHub Profile
@GloriaXie123
GloriaXie123 / gist:f030929f846cc7b8fc7d5ad5a7ffa5b3
Created April 1, 2018 11:24 — forked from pawelmhm/gist:8917867
Scrapy spider crawling Stack Overflow
from scrapy.spider import Spider
from scrapy.contrib.spiders import CrawlSpider, Rule
from scrapy.contrib.linkextractors.sgml import SgmlLinkExtractor
from scrapy.selector import Selector
from scrapy.item import Item, Field
import urllib
class Question(Item):
tags = Field()
answers = Field()