Understanding Web Scraping
1
Web Scraping 101
Art of Web Scraping
Twitter
LinkedIn
Introduction
Understanding Web Scraping
1
Web Scraping 101
2
Scraping Philosophy
3
Best Practices
4
Ethics & Legal Issues
Python Scraping Ecosystem
5
Making Requests
6
Parsing HTML
7
Other Libraries
Appendices
A
CSS & XPath Selectors
Table of contents
1.1
What is Web Scraping?
1.2
Scraping vs. Crawling
1.3
Parse Tree
1.4
The Scraping “Algorithm”
1.5
The Browser’s Role
1.6
Putting It All Together
Understanding Web Scraping
1
Web Scraping 101
1
Web Scraping 101
Tip
If you’re familiar with web scraping it may make sense to skip this chapter.
1.1
What is Web Scraping?
1.2
Scraping vs. Crawling
1.3
Parse Tree
1.4
The Scraping “Algorithm”
1.5
The Browser’s Role
1.6
Putting It All Together
Introduction
2
Scraping Philosophy