Advertisement
Guest User

Untitled

a guest
Jan 28th, 2021
24
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 1.24 KB | None | 0 0
  1. def start_requests(self):
  2. url = 'https://b6e2v80xvh-3.algolianet.com/1/indexes/portfolio/query?x-algolia-agent=Algolia%20for%20JavaScript%20(4.0.2)%3B%20Browser%20(lite)&x-algolia-api-key=M2ZhYzZhMDcwN2QwMDlkMWFmNjdkMGM0YWE5MjYxNjlkZDRlYjFkZGY3YjQzNWJkZDgzZjgwZjRhMDBkYzY5MXJlc3RyaWN0SW5kaWNlcz0lNUIlMjJwb3J0Zm9saW8lMjIlMkMlMjJwb3J0Zm9saW9fam9icyUyMiU1RCZmaWx0ZXJzPXNob3dPbldlYnNpdGUlM0F0cnVl&x-algolia-application-id=B6E2V80XV'
  3. x = '{"query":"","hitsPerPage":15,"page":1,"facetFilters":[]}'
  4.  
  5. headers = {
  6. 'Connection': 'keep-alive',
  7. 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.104 Safari/537.36',
  8. 'content-type': 'application/x-www-form-urlencoded',
  9. 'Accept': '*/*',
  10. 'Origin': 'https://www.antler.co',
  11. 'Sec-Fetch-Site': 'cross-site',
  12. 'Sec-Fetch-Mode': 'cors',
  13. 'Sec-Fetch-Dest': 'empty',
  14. 'Referer': 'https://www.antler.co/',
  15. 'Accept-Language': 'en,en-US;q=0.9,ru-RU;q=0.8,ru;q=0.7'
  16. }
  17.  
  18. yield scrapy.Request(url, method='POST',
  19. body=x,
  20. headers=headers)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement