Guest User

Scraper for MAL genres in Posix Shell

a guest
Dec 28th, 2024
48
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Bash 0.50 KB | None | 0 0
  1. #/bin/sh
  2. GENRE_BASE_URL="https://myanimelist.net/anime/genre"
  3.  
  4. for i in {1..83}
  5. do
  6.     genre_url=$GENRE_BASE_URL/$i
  7.     genre_http_status=$(curl --silent --head --output /dev/null --write-out "%{http_code}" $genre_url)
  8.     if [ $genre_http_status -ne 200 ]
  9.     then
  10.         echo ${genre_url} does not exist
  11.         continue
  12.     fi
  13.     genre_name=$(
  14.         curl --silent $genre_url |
  15.         grep '<link rel="canonical"' |
  16.         sed 's@.*'$genre_url'/@@' |
  17.         sed 's/".*//' |
  18.         sed 's/_/ /g'
  19.     )  
  20.     echo ${genre_url} is ${genre_name}
  21. done
Advertisement
Add Comment
Please, Sign In to add comment