Web Scraping Tutorial with Scrapy and Python for Beginners

Assuming that you don’t know anything about web scraping, Scrapy, Python, web scraping, or even the meaning of web scraping—the author starts from the complete basics. A well-balanced course with theory and practical content followed by three projects at the end ensures you have the right skills to learn scraping.

99 on-demand videos & exercises

Level: Beginner

English

7hrs 36mins

Access on mobile, web and TV

Web scraping is the process of scraping websites and extracting desired data from them, and in this course, you will learn and master web scraping using Python and Scrapy with a step-by-step and in-depth guide.

The course starts with introducing you to the web scraping process (with infographics—no code); learn how to scrape data from websites and how to use Scrapy for this. After getting the basics clear, you will perform web scraping using Python and the Scrapy framework! After you have built an actual web scraper, you will get an idea of how web scraping works first-hand. You will then look at the essential concepts of web scraping and Scrapy. Learning how to scrape websites and the essentials already makes you a complete web scraper but you will take this even further and learn the advanced web scraping techniques to become an expert. Advanced topics such as crawling multiple pages and extracting data—pagination, scraping data using Regular Expressions (RegEx), scraping dynamic or JavaScript-rendered websites using Scrapy Playwright—will be thoroughly explained. Finally, you will perform three projects at the end—Champions League Table [ESPN], Product Tracker [Amazon], and Scraper Application [GUI].

By the end of this course, you will have learned how to do web scraping using Python and Scrapy. All the resource files are added to the GitHub repository at: https://github.com/PacktPublishing/Web-Scraping-Tutorial-with-Scrapy-and-Python-for-Beginners-

Course Curriculum

About the Author

Rahul Mula is a passionate developer with expertise in Python, Flutter, and web development. He was really intrigued the first time he learned about programming and realized what could be done with it. Rahul thrives on exploring diverse technologies and crafting innovative applications. He's the mastermind behind Keyviz, a remarkable open-source tool for real-time keystroke visualization.
Rahul's contributions extend to the realm of education, where he has authored books and crafted courses on Python programming, benefiting thousands of eager learners.