Scraping Dynamic Web Pages with Python and Selenium

Scraping Dynamic Web Pages with Python and Selenium

English | MP4 | AVC 1280×720 | AAC 44KHz 2ch | 1h 07m | 145 MB

In this course, you will go all the way from saying hello to Selenium to then combining it with Python and Beautiful Soup to learn all about extracting information from a dynamic webpage.

They say data is the new oil, and given what you can do with high quality data, you’d be hard-pressed to disagree. There are many ways to collect data, one of which is extracting the oodles of data swimming around in the form of websites. That is exactly what this course, Scraping Dynamic Web Pages with Python and Selenium, aims to teach. First, you are going to look at how to scrape data from dynamic websites. The main tool used is Selenium, and the course starts off by exploring that. Next, you will move onto the specifics of it, starting with opening a webpage using a web driver. Then you will learn to identify and locate dynamic elements in a webpage and handing the page source over to beautiful soup. Finally, to round off the course, you will explore the common challenges you will face and methods to increase scraping efficiency. When you are finished with this course, you will be able to combine Python, Selenium, and Beautiful Soup to extract data from any dynamic webpage.

Table of Contents

Course Overview
1 Course Overview

Exploring Selenium with Python
2 Module Introduction
3 Overview of Scraping Dynamic Webpages
4 What Is Selenium and Where Is It Used
5 Selenium WebDriver
6 Demo – Installing Libraries
7 Demo – Opening a Webpage with WebDriver
8 Summary

Locating Elements & Navigating Dynamic Web Pages
9 Module Introduction
10 Introduction to Elements
11 Methods to Locate Elements
12 Demo – Locating Elements in a Webpage – Part 1
13 Demo – Locating Elements in a Webpage – Part 2
14 Demo – Navigating a Webpage with Selenium
15 Summary

Loading Selenium Page Source into BeautifulSoup
16 Module Introduction
17 Introduction to Beautiful Soup
18 Transitioning from Selenium to Beautiful Soup
19 Demo – Combining Tools to Scrape a Dynamic Webpage – Introduction
20 Demo – Combining Tools to Scrape a Dynamic Webpage – Practical Implementation
21 Summary

Overcoming Challenges and Increasing Efficiency
22 Module Introduction
23 Challenges in Web Scraping
24 Tips to Increase Efficiency & Best Practices
25 Summary