Python Module Index

s
 
s
scrapy
    scrapy.contracts
    scrapy.contracts.default
    scrapy.contrib.closespider Close spider extension
    scrapy.contrib.corestats Core stats collection
    scrapy.contrib.debug Extensions for debugging Scrapy
    scrapy.contrib.downloadermiddleware
    scrapy.contrib.downloadermiddleware.ajaxcrawl
    scrapy.contrib.downloadermiddleware.chunked Chunked Transfer Middleware
    scrapy.contrib.downloadermiddleware.cookies Cookies Downloader Middleware
    scrapy.contrib.downloadermiddleware.defaultheaders Default Headers Downloader Middleware
    scrapy.contrib.downloadermiddleware.downloadtimeout Download timeout middleware
    scrapy.contrib.downloadermiddleware.httpauth HTTP Auth downloader middleware
    scrapy.contrib.downloadermiddleware.httpcache HTTP Cache downloader middleware
    scrapy.contrib.downloadermiddleware.httpcompression Http Compression Middleware
    scrapy.contrib.downloadermiddleware.httpproxy Http Proxy Middleware
    scrapy.contrib.downloadermiddleware.redirect Redirection Middleware
    scrapy.contrib.downloadermiddleware.retry Retry Middleware
    scrapy.contrib.downloadermiddleware.robotstxt robots.txt middleware
    scrapy.contrib.downloadermiddleware.stats Downloader Stats Middleware
    scrapy.contrib.downloadermiddleware.useragent User Agent Middleware
    scrapy.contrib.exporter Item Exporters
    scrapy.contrib.linkextractors Link extractors classes
    scrapy.contrib.linkextractors.sgml SGMLParser-based link extractors
    scrapy.contrib.loader Item Loader class
    scrapy.contrib.loader.processor A collection of processors to use with Item Loaders
    scrapy.contrib.logstats Basic stats logging
    scrapy.contrib.memdebug Memory debugger extension
    scrapy.contrib.memusage Memory usage extension
    scrapy.contrib.pipeline.images Images Pipeline
    scrapy.contrib.spidermiddleware
    scrapy.contrib.spidermiddleware.depth Depth Spider Middleware
    scrapy.contrib.spidermiddleware.httperror HTTP Error Spider Middleware
    scrapy.contrib.spidermiddleware.offsite Offsite Spider Middleware
    scrapy.contrib.spidermiddleware.referer Referer Spider Middleware
    scrapy.contrib.spidermiddleware.urllength URL Length Spider Middleware
    scrapy.contrib.spiders Collection of generic spiders
    scrapy.contrib.statsmailer StatsMailer extension
    scrapy.contrib.webservice Built-in web service resources
    scrapy.contrib.webservice.crawler Crawler JSON-RPC resource
    scrapy.contrib.webservice.enginestatus Engine Status JSON resource
    scrapy.contrib.webservice.stats Stats JSON-RPC resource
    scrapy.crawler The Scrapy crawler
    scrapy.exceptions Scrapy exceptions
    scrapy.http Request and Response classes
    scrapy.item Item and Field classes
    scrapy.log Logging facility
    scrapy.mail Email sending facility
    scrapy.selector Selector class
    scrapy.settings Settings manager
    scrapy.signalmanager The signal manager
    scrapy.signals Signals definitions
    scrapy.spider Spiders base class, spider manager and spider middleware
    scrapy.statscol Stats Collectors
    scrapy.telnet The Telnet Console
    scrapy.utils.trackref Track references of live objects
    scrapy.webservice Web service