Advertisement
Guest User

Untitled

a guest
Oct 15th, 2019
98
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.43 KB | None | 0 0
  1. for epoch in range(1, 100):
  2. loss = 0.
  3. i = 0
  4. X,Y = generate_context_word_pairs(corpus=wids, window_size=window_size, vocab_size=vocab_size)
  5. for x, y in zip(X,Y):
  6. i += 1
  7. optimizer.zero_grad()
  8. log_probs = model(x[0])
  9. loss = loss_function(log_probs,torch.Tensor([y]).long())
  10. loss.backward()
  11. optimizer.step()
  12. loss += loss.data
  13. print('Epoch:', epoch, '\tLoss:', loss)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement