Advertisement
Willcode4cash

Screenscraping using CFScrape and BeautifulSoup

Jul 26th, 2017
126
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Python 0.28 KB | None | 0 0
  1. import cfscrape
  2. from bs4 import BeautifulSoup
  3.  
  4. scraper = cfscrape.CloudflareScraper()
  5. html = scraper.get('http://www.CloudflareProtectedDomain.com').content
  6. parsed_html = BeautifulSoup(html, 'lxml')
  7. for link in parsed_html.select('div.className1 div.className2 a'):
  8.     link.get('href')
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement