Advertisement
Guest User

Untitled

a guest
Jun 16th, 2019
62
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.41 KB | None | 0 0
  1. import requests
  2. from bs4 import BeautifuSoup
  3. headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36'}
  4. res = requests.get(url, headers = headers)
  5. res.encoding = 'utf-8-sig'
  6. soup = BeautifulSoup(res.text, 'lxml')
  7.  
  8. from requests_html import HTMLSession
  9. session = HTMLSession()
  10. r = session.get(url)
  11. r.html.render()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement