Advertisement
Guest User

Untitled

a guest
Jan 24th, 2017
120
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Python 0.66 KB | None | 0 0
  1. # example
  2. # "http://<somelink>/clothing/men/sec/menCategory" == > "http://<somelink>/clothing/men/suit-separates/cat/cat1260002"
  3.  
  4.  
  5. start_urls = [
  6.         "http://<somelink>/",
  7.         "http://<somelink>/clothing/men/sec/menCategory",
  8.         "http://<somelink>/clothing/women/sec/womenCategory",
  9.         "http://<somelink>/clothing/women/petite-clothing/cat/cat3340001",
  10.         "http://<somelink>/clothing/women/express-one-eleven/cat/cat1820002",
  11.     ]
  12.     rules = [
  13.         Rule(LinkExtractor(
  14.             allow=('/clothing/[\w+]/[\w+]/cat/cat[0-9]',)),
  15.             callback='parse',),
  16.     ]
  17.  
  18.  
  19.     def parse(self, response):
  20.         print(response)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement