Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- next_page = response.xpath("//div//div[4]//ul[1]//li[10]//a[1]//@href").extract_first()
- if next_page is not None:
- yield scrapy.Request(url = response.urljoin(next_page), callback=self.parse)
Add Comment
Please, Sign In to add comment