RNN for aspect-based

python train.py --batch-size 20 --rnn_type GRU --cuda --gpu 1 --lr 0.0001 --mdl RNN --clip_norm 1 --opt Adam --epochs 100
/scratch/sjn-p2/anaconda/anaconda2/lib/python2.7/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
Using TensorFlow backend.
There are 2 CUDA devices
Setting torch GPU to 1
Using device:1
Stored Environment:['term_len', 'word_index', 'glove', 'max_len', 'train', 'dev', 'test', 'index_word']
Loaded environment
Creating Model...
Setting Pretrained Embeddings
Initialized GRU model
Starting training
Namespace(aggregation='mean', attention_width=5, batch_size=20, clip_norm=1, cuda=True, dataset='Restaurants', dev=1, dropout_prob=0.5, embedding_size=300, epochs=100, eval=1, gpu=1, hidden_layer_size=300, l2_reg=0.0, learn_rate=0.0001, log=1, maxlen=0, mode='term', model_type='RNN', opt='Adam', pretrained=1, rnn_direction='uni', rnn_layers=1, rnn_size=300, rnn_type='GRU', seed=1111, term_model='mean', toy=False, trainable=1)
========================================================================
/scratch2/debate_tweets/sentiment/pytorch_sentiment_rnn/models/rnn.py:51: UserWarning: Implicit dimension choice for softmax has been deprecated. Change the call to include dim=X as an argument.
  decoded = self.softmax(decoded)
[Epoch 1] Train Loss=0.982651814901 T=0.48s
Test loss=0.901446342468
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 2] Train Loss=0.95118658648 T=0.56s
Test loss=0.901445686817
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 3] Train Loss=0.951176641066 T=0.71s
Test loss=0.901445448399
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 4] Train Loss=0.951173600242 T=0.71s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 5] Train Loss=0.951174995188 T=0.71s
Test loss=0.901445388794
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 6] Train Loss=0.948687356809 T=0.71s
Test loss=0.901445269585
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 7] Train Loss=0.951172740749 T=0.7s
Test loss=0.901445031166
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 8] Train Loss=0.953656671456 T=0.71s
Test loss=0.901444554329
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 9] Train Loss=0.951169224075 T=0.79s
Test loss=0.901444554329
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 10] Train Loss=0.951169604096 T=0.79s
Test loss=0.901444554329
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 11] Train Loss=0.951205837792 T=0.71s
Test loss=0.901444852352
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 12] Train Loss=0.95116915525 T=0.76s
Test loss=0.901445031166
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 13] Train Loss=0.951168282585 T=0.7s
Test loss=0.901444911957
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 14] Train Loss=0.951169023527 T=0.71s
Test loss=0.901444911957
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 15] Train Loss=0.948682827515 T=0.64s
Test loss=0.901444911957
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 16] Train Loss=0.948682683607 T=0.72s
Test loss=0.901445090771
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 17] Train Loss=0.951168916502 T=0.14s
Test loss=0.901445090771
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 18] Train Loss=0.951168957995 T=0.64s
Test loss=0.901445090771
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 19] Train Loss=0.948682609513 T=0.33s
Test loss=0.901445031166
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 20] Train Loss=0.951168829894 T=0.71s
Test loss=0.901444792747
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 21] Train Loss=0.951169036699 T=0.74s
Test loss=0.901444792747
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 22] Train Loss=0.953655012405 T=0.63s
Test loss=0.901444911957
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 23] Train Loss=0.948682806768 T=0.54s
Test loss=0.901445090771
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 24] Train Loss=0.948682539371 T=0.65s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 25] Train Loss=0.948682500513 T=0.19s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 26] Train Loss=0.951168660959 T=0.57s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 27] Train Loss=0.94868248767 T=0.74s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 28] Train Loss=0.94868251105 T=0.72s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 29] Train Loss=0.953654858289 T=0.65s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 30] Train Loss=0.95116866557 T=0.49s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 31] Train Loss=0.951168654703 T=0.6s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 32] Train Loss=0.951168655361 T=0.49s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 33] Train Loss=0.953654913612 T=0.57s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 34] Train Loss=0.951168639884 T=0.71s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 35] Train Loss=0.951168527261 T=0.73s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 36] Train Loss=0.951168565131 T=0.55s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 37] Train Loss=0.951168560191 T=0.46s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 38] Train Loss=0.951168566778 T=0.46s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 39] Train Loss=0.951168573693 T=0.47s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 40] Train Loss=0.948682485035 T=0.49s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 41] Train Loss=0.951168607612 T=0.6s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 42] Train Loss=0.948682409624 T=0.66s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 43] Train Loss=0.95365476246 T=0.73s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 44] Train Loss=0.951168561509 T=0.58s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 45] Train Loss=0.951168577645 T=0.62s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 46] Train Loss=0.948682382291 T=0.51s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 47] Train Loss=0.94868248273 T=0.72s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 48] Train Loss=0.948682389207 T=0.5s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 49] Train Loss=0.951168602672 T=0.72s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
[Epoch 50] Train Loss=0.953654762131 T=0.59s
Test loss=0.90144520998
Output Distribution={2: 1120}
Accuracy=0.65
========================================================================
^CTraceback (most recent call last):
  File "train.py", line 345, in <module>
    exp.train()
  File "train.py", line 328, in train
    loss = self.train_batch(i)
  File "train.py", line 308, in train_batch
    self.optimizer.step()
  File "/scratch/sjn-p2/anaconda/anaconda2/lib/python2.7/site-packages/torch/optim/adam.py", line 70, in step
    exp_avg_sq.mul_(beta2).addcmul_(1 - beta2, grad, grad)
KeyboardInterrupt