(rlpyt) seita@tripel:~/rlpyt (master) $ python experiments/plot_rollout_classification.py --game beam_rider
Plotting results from classifying states as belonging to snapshots, from:
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200226/classifier-2020-02-26-09-53
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200226/classifier-2020-02-26-10-19
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200226/classifier-2020-02-26-10-44
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200226/classifier-2020-02-26-11-08
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200226/classifier-2020-02-26-12-56
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200226/classifier-2020-02-26-15-14
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200227/classifier-2020-02-27-09-29
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200227/classifier-2020-02-27-11-13
   /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200227/classifier-2020-02-27-13-21
ss idx: 10 (early)
ss idx: 20 (mid)
ss idx: 80 (late)
Just saved: /data/seita/rlpyt/data/local/classify_1/results_classify_states_beam_rider.png

Confusion matrix for:
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_00-20200216/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_01-20200220/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_02-20200220/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_03-20200221/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_04-20200221/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_05-20200221/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_06-20200221/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_07-20200222/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_08-20200222/snapshots/params_csteps_08099960_itr_00202499.tar
	/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_09-20200222/snapshots/params_csteps_08099960_itr_00202499.tar
Forming a confusion matrix. len(pred,true) = 499600,499600

Just a reminder, train args:
{'batch_size': 64, 'cuda_idx': 0, 'data': None, 'date': '2020-02-27-13-21', 'early_stop': 2, 'game': 'beam_rider', 'itrs_per_collection': 1250, 'l2reg': 5e-05, 'load_paths': ['/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_00-20200216', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_01-20200220', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_02-20200220', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_03-20200221', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_04-20200221', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_05-20200221', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_06-20200221', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_07-20200222', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_08-20200222', '/data/seita/rlpyt/data/local/teachers/ddqn_teacher_beam_rider_sticky/run_09-20200222'], 'log_interval_steps': 10000.0, 'lrate': 0.0001, 'multi_agent': True, 'multi_agent_num': 10, 'multi_agent_snap': 80, 'n_cycles': 20, 'n_cycles_min': 2, 'n_epochs_per_cycle': 4, 'n_parallel': 10, 'one_agent': False, 'one_agent_idx': 0, 'one_agent_int': 15, 'one_agent_max_cls': 5, 'remove_game_score': True, 'replay_size_per_agent': 50000.0, 'sampler': 'gpu', 'sticky_frames': True}

CM:
[[19328  4667  2307  2786  3836  1954  3924  2825  3314  5019]
 [ 4717 15619  3260  2608  4413  3271  4985  3783  4460  2844]
 [ 3157  2548 15687  4715  5056  3791  3398  3288  2688  5632]
 [ 4596  2859  4670 11507  5985  4246  4159  3278  4171  4489]
 [ 3820  2593  4002  4159 14048  6167  4117  3908  3975  3171]
 [ 2742  2745  3025  3665  7191 15437  4373  3568  4475  2739]
 [ 5380  4006  2816  3566  5040  3822 13653  3201  5365  3111]
 [ 4093  3449  3421  3202  5220  3531  4211 12557  5675  4601]
 [ 4655  3504  2982  3208  4589  3527  5654  5176 13241  3424]
 [ 4879  1836  4915  3021  3114  1118  2886  2216  1732 24243]]

normalized CM:
[[0.3869 0.0934 0.0462 0.0558 0.0768 0.0391 0.0785 0.0565 0.0663 0.1005]
 [0.0944 0.3126 0.0653 0.0522 0.0883 0.0655 0.0998 0.0757 0.0893 0.0569]
 [0.0632 0.051  0.314  0.0944 0.1012 0.0759 0.068  0.0658 0.0538 0.1127]
 [0.092  0.0572 0.0935 0.2303 0.1198 0.085  0.0832 0.0656 0.0835 0.0899]
 [0.0765 0.0519 0.0801 0.0832 0.2812 0.1234 0.0824 0.0782 0.0796 0.0635]
 [0.0549 0.0549 0.0605 0.0734 0.1439 0.309  0.0875 0.0714 0.0896 0.0548]
 [0.1077 0.0802 0.0564 0.0714 0.1009 0.0765 0.2733 0.0641 0.1074 0.0623]
 [0.0819 0.069  0.0685 0.0641 0.1045 0.0707 0.0843 0.2513 0.1136 0.0921]
 [0.0932 0.0701 0.0597 0.0642 0.0919 0.0706 0.1132 0.1036 0.265  0.0685]
 [0.0977 0.0367 0.0984 0.0605 0.0623 0.0224 0.0578 0.0444 0.0347 0.4852]]
tot_per_class: [49960, 49960, 49960, 49960, 49960, 49960, 49960, 49960, 49960, 49960]
Just saved confusion matrix of 10 classes: /data/seita/rlpyt/data/local/classify_1/dqn_roll_notrain_beam_rider_sticky-20200227/classifier-2020-02-27-13-21/confuse_mat_beam_rider_norm_True.png