Official website (https://scrapy.org/)
Scrapy
Sign in to saveScrapy ( ) is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company.
Key facts
- Software.name
- Scrapy
- Software.logo
- File:Scrapy logo.jpg
- Software.developer
- Zyte (formerly Scrapinghub)
- Software.programming language
- Python
- Software.operating system
- Windows, macOS, Linux
- Software.genre
- Web crawler
- Software.license
- BSD License
via Wikipedia infobox
Official website
Scrapy — open source web scraping framework for Python
Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.
scrapy.org →Link to the official site · 6,101 chars · not written by Vinony
Described at
TAPoR
tapor.ca →Scrapy is an open source programming library for web crawling and web page text extraction, written in Python. You can make calls to Scrapy code from within your own scripts and applications to automate the task of extracting data from websites. You would typically use Scrapy to automate the task of visiting one or more web pages, on a website to which you have access. You could alternately use it to invoke web-based Application Programming Interfaces (APIs).
Excerpt from a page describing this subject · 2,477 chars · not written by Vinony
Wikidata facts
- Official website
- scrapy.org
Show 5 more facts
- source code repository URL
- github.com/scrapy/scrapy
- issue tracker URL
- github.com/scrapy/scrapy/issues
- software version identifier
- 2.15.1
- described at URL
- marketplace.sshopencloud.eu/tool-or-service/UfX6Ad
- social media followers
- 5365
Sources (11)
via Wikidata · CC0
~1 min read
Article
2 sectionsContents
- History
- References
Scrapy ( ) is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company.
Scrapy project architecture is built around "spiders", which are self-contained crawlers that are given a set of instructions. Following the spirit of other don't repeat yourself frameworks, such as Django, it makes it easier to build and scale large crawling projects by allowing developers to reuse their code.