Advertisement
dholmer

BERT-stuff

Feb 20th, 2020
266
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 1.06 KB | None | 0 0
  1. Transformers:
  2. https://nlp.seas.harvard.edu/2018/04/03/attention.html
  3. https://arxiv.org/pdf/1706.03762.pdf
  4. https://jalammar.github.io/illustrated-transformer/
  5.  
  6. BERT:
  7. https://github.com/Jiakui/awesome-bert
  8. https://jalammar.github.io/a-visual-guide-to-using-bert-for-the-first-time/
  9.  
  10.  
  11.  
  12. Implementation:
  13. https://huggingface.co/transformers/examples.html#mm-imdb
  14. https://github.com/huggingface/transformers
  15. http://mccormickml.com/2019/07/22/BERT-fine-tuning/
  16. https://colab.research.google.com/drive/1Y4o3jh3ZH70tl6mCd76vz_IxX23biCPP
  17. https://github.com/google-research/bert/blob/master/predicting_movie_reviews_with_bert_on_tf_hub.ipynb
  18. svenska bert:
  19. https://colab.research.google.com/drive/1lfNb9AOvGkSipmAlN87VmTTWGSb5owWX
  20.  
  21. Bra youtubeklipp:
  22. Contextual word embeddings: https://www.youtube.com/watch?v=S-CspeZ8FHc
  23. Genomgång av attention is all you need: https://www.youtube.com/watch?v=iDulhoQ2pro
  24. Genomgång av BERT-pappret: https://www.youtube.com/watch?v=-9evrZnBorM
  25. Hela kanalen är guld: https://www.youtube.com/channel/UCoRX98PLOsaN8PtekB9kWrw
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement