Web Scraping
Course Index
29 Lessons · 3 Sections
Master web scraping with Python — Requests, BeautifulSoup, Selenium, Playwright & Scrapy. Covers proxy rotation, anti-bot handling & Pandas data cleaning. Includes 5 production scrapers: price tracker, jobs, real estate pipeline & news aggregator.
29Lessons
3Sections
5Projects
FreeAccess
Section 1Web Scraping Fundamentals & BeautifulSoupLessons 1–10
Lesson 1
What is Web Scraping?
Lesson 2
Web Scraping Ethics & Legal Considerations
Lesson 3
How Websites Work: HTML & HTTP
Lesson 4
Browser DevTools for Scraping
Lesson 5
Python Requests: Fetching Pages
Lesson 6
BeautifulSoup: Parsing HTML
Lesson 7
CSS Selectors & XPath
Lesson 8
Scraping Tables & Pagination
Lesson 9
Saving Data: CSV, JSON & Databases
Lesson 10
Error Handling & Retries
Section 2Browser Automation, Scrapy & Anti-BotLessons 11–22
Lesson 11
Selenium: Browser Automation
Lesson 12
Playwright: Modern Browser Automation
Lesson 13
Scraping JavaScript-Rendered Pages
Lesson 14
Handling Login & Sessions
Lesson 15
Handling CAPTCHAs & Anti-Bot Measures
Lesson 16
Scrapy: Production Web Crawling
Lesson 17
Scrapy: Spiders, Items & Pipelines
Lesson 18
Scrapy-Playwright: Dynamic Sites
Lesson 19
Proxy Rotation & IP Management
Lesson 20
Rate Limiting & Respectful Scraping
Lesson 21
Scraping APIs vs HTML
Lesson 22
Scraping APIs: Postman & Network Tab
Section 3Data, Automation & ProjectsLessons 23–29