See `tf.nn.softmax_cross_entropy_with_logits_v2`.

WARNING:tensorflow:From /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:46: checkpoint_exists (from tensorflow.python.training.checkpoint_mana
gement) is deprecated and will be removed in a future version.
Instructions for updating:
Use standard file APIs to check for files with this prefix.
2019-02-11 14:11:31.7 WARNING in 'tensorflow'['deprecation'] at line 323: From /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:46: checkpoint_
exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version.
Instructions for updating:
Use standard file APIs to check for files with this prefix.
2019-02-11 14:11:31.7 INFO in 'deeppavlov.core.models.tf_model'['tf_model'] at line 47: [loading model from /root/TEMAPYTHON/save/seq2seq_model]
INFO:tensorflow:Restoring parameters from /root/TEMAPYTHON/save/seq2seq_model
2019-02-11 14:11:31.18 INFO in 'tensorflow'['saver'] at line 1270: Restoring parameters from /root/TEMAPYTHON/save/seq2seq_model
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1334, in _do_call
    return fn(*args)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Assign requires shapes of both tensors to match. lhs shape= [400] rhs shape= [500]
         [[{{node save/Assign_9}}]]
         [[{{node save/RestoreV2}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 1276, in restore
    {self.saver_def.filename_tensor_name: save_path})
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 929, in run
    run_metadata_ptr)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1152, in _run
    feed_dict_tensor, options, run_metadata)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1328, in _do_run
    run_metadata)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1348, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: Assign requires shapes of both tensors to match. lhs shape= [400] rhs shape= [500]
         [[node save/Assign_9 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]
         [[node save/RestoreV2 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]

Caused by op 'save/Assign_9', defined at:
  File "train.py", line 271, in <module>
    load_path='./save/seq2seq_model'
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 74, in __call__
    obj.__init__(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 27, in _wrapped
    return func(*args, **kwargs)
  File "train.py", line 200, in __init__
    self.load()

File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 27, in _wrapped
    return func(*args, **kwargs)
  File "train.py", line 200, in __init__
    self.load()
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 27, in _wrapped
    return func(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py", line 50, in load
    saver = tf.train.Saver(var_list)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 832, in __init__
    self.build()
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 844, in build
    self._build(self._filename, build_save=True, build_restore=True)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 881, in _build
    build_save=build_save, build_restore=build_restore)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 513, in _build_internal
    restore_sequentially, reshape)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 354, in _AddRestoreOps
    assign_ops.append(saveable.restore(saveable_tensors, shapes))
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saving/saveable_object_util.py", line 73, in restore
    self.op.get_shape().is_fully_defined())
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/ops/state_ops.py", line 223, in assign
    validate_shape=validate_shape)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/ops/gen_state_ops.py", line 64, in assign
    use_locking=use_locking, name=name)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/framework/op_def_library.py", line 788, in _apply_op_helper
    op_def=op_def)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 3300, in create_op
    op_def=op_def)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
    self._traceback = tf_stack.extract_stack()

InvalidArgumentError (see above for traceback): Assign requires shapes of both tensors to match. lhs shape= [400] rhs shape= [500]
         [[node save/Assign_9 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]
         [[node save/RestoreV2 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]


During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "train.py", line 271, in <module>
    load_path='./save/seq2seq_model'
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 74, in __call__
    obj.__init__(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 27, in _wrapped
    return func(*args, **kwargs)
  File "train.py", line 200, in __init__
    self.load()
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 27, in _wrapped
    return func(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py", line 51, in load
    saver.restore(self.sess, path)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 1312, in restore
    err, "a mismatch between the current graph and the graph")
File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py", line 51, in load
    saver.restore(self.sess, path)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 1312, in restore
    err, "a mismatch between the current graph and the graph")
tensorflow.python.framework.errors_impl.InvalidArgumentError: Restoring from checkpoint failed. This is most likely due to a mismatch between the current graph and the graph from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

Assign requires shapes of both tensors to match. lhs shape= [400] rhs shape= [500]
         [[node save/Assign_9 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]
         [[node save/RestoreV2 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]

Caused by op 'save/Assign_9', defined at:
  File "train.py", line 271, in <module>
    load_path='./save/seq2seq_model'
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 74, in __call__
    obj.__init__(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 27, in _wrapped
    return func(*args, **kwargs)
  File "train.py", line 200, in __init__
    self.load()
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_backend.py", line 27, in _wrapped
    return func(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py", line 50, in load
    saver = tf.train.Saver(var_list)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 832, in __init__
    self.build()
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 844, in build
    self._build(self._filename, build_save=True, build_restore=True)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 881, in _build
    build_save=build_save, build_restore=build_restore)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 513, in _build_internal
    restore_sequentially, reshape)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saver.py", line 354, in _AddRestoreOps
    assign_ops.append(saveable.restore(saveable_tensors, shapes))
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/training/saving/saveable_object_util.py", line 73, in restore
    self.op.get_shape().is_fully_defined())
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/ops/state_ops.py", line 223, in assign
    validate_shape=validate_shape)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/ops/gen_state_ops.py", line 64, in assign
    use_locking=use_locking, name=name)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/framework/op_def_library.py", line 788, in _apply_op_helper
    op_def=op_def)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 3300, in create_op
    op_def=op_def)
  File "/root/miniconda3/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
    self._traceback = tf_stack.extract_stack()

InvalidArgumentError (see above for traceback): Restoring from checkpoint failed. This is most likely due to a mismatch between the current graph and the graph from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

Assign requires shapes of both tensors to match. lhs shape= [400] rhs shape= [500]
         [[node save/Assign_9 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]
         [[node save/RestoreV2 (defined at /root/miniconda3/lib/python3.7/site-packages/deeppavlov/core/models/tf_model.py:50) ]]