Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Transformers:
- https://nlp.seas.harvard.edu/2018/04/03/attention.html
- https://arxiv.org/pdf/1706.03762.pdf
- https://jalammar.github.io/illustrated-transformer/
- BERT:
- https://github.com/Jiakui/awesome-bert
- https://jalammar.github.io/a-visual-guide-to-using-bert-for-the-first-time/
- Implementation:
- https://huggingface.co/transformers/examples.html#mm-imdb
- https://github.com/huggingface/transformers
- http://mccormickml.com/2019/07/22/BERT-fine-tuning/
- https://colab.research.google.com/drive/1Y4o3jh3ZH70tl6mCd76vz_IxX23biCPP
- https://github.com/google-research/bert/blob/master/predicting_movie_reviews_with_bert_on_tf_hub.ipynb
- svenska bert:
- https://colab.research.google.com/drive/1lfNb9AOvGkSipmAlN87VmTTWGSb5owWX
- Bra youtubeklipp:
- Contextual word embeddings: https://www.youtube.com/watch?v=S-CspeZ8FHc
- Genomgång av attention is all you need: https://www.youtube.com/watch?v=iDulhoQ2pro
- Genomgång av BERT-pappret: https://www.youtube.com/watch?v=-9evrZnBorM
- Hela kanalen är guld: https://www.youtube.com/channel/UCoRX98PLOsaN8PtekB9kWrw
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement