Understanding Web Scraping
4
Ethics & Legal Issues
Art of Web Scraping
Twitter
LinkedIn
Introduction
Understanding Web Scraping
1
Web Scraping 101
2
Scraping Philosophy
3
Best Practices
4
Ethics & Legal Issues
Python Scraping Ecosystem
5
Making Requests
6
Parsing HTML
7
Other Libraries
Appendices
A
CSS & XPath Selectors
Table of contents
4.1
Ethics
4.1.1
Why Ethics?
4.1.2
Can vs. Should
4.1.3
“It’s out there anyway”
4.2
Legal Issues
4.2.1
Intellectual Property
4.2.2
Privacy
4.2.3
Circumvention
4.2.4
The Future
Understanding Web Scraping
4
Ethics & Legal Issues
4
Ethics & Legal Issues
4.1
Ethics
4.1.1
Why Ethics?
4.1.2
Can vs. Should
4.1.3
“It’s out there anyway”
4.2
Legal Issues
4.2.1
Intellectual Property
4.2.2
Privacy
4.2.3
Circumvention
4.2.4
The Future
3
Best Practices
5
Making Requests