Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- srun: job 7625090 queued and waiting for resources
- srun: job 7625090 has been allocated resources
- signal installed
- staged_cfr.py --resume --out /checkpoint/sgross/deepregret/flopNN_mpr1_train16000 --game flop --train-iters-per-step 8000 --strat-iters-per-step 32000 --lr-decay 0.1 --lr-decay-strat 0.1 --batch-size 20000 --train-iters-per-step 16000 --table-preflop 0 --model-per-round 1
- Namespace(batch_size=20000, bufsize=40000000, cardsum=0, cfr_iters_per_step=1600000, cfr_queue_ratio=3, cfr_threads=30000, chance_baseline=0, coalesce_buffers=0, compress=1, compress_preflop=1, dim=64, dump_interval=10, embed_card=False, embed_card_dim=None, ev_regret=0, exploitability_interval=10, exploitability_iters=500000000, fiber_threads=10, game='flop', gn=0, gpu=0, init=None, log=200, lr=0.001, lr_decay=0.1, lr_decay_strat=0.1, maxQ=0, max_action=0, max_action_delayed=0, max_grad_norm=1, max_round=-1, min_round=5, model='FastModel', model_per_round=1, nsteps=1000, opp_preflop_strat=None, opp_strat=None, optimizer='Adam', out='/checkpoint/sgross/deepregret/flopNN_mpr1_train16000', potsize_feat=0, regress_invalid_actions=0, resume=True, reweightW=1, shallow=False, strat_iters_per_step=32000, strat_linear=False, table_preflop=0, train_iters_per_step=16000, train_linear=False, use_conv=False, weight_decay=0.0, weight_potsize=1)
- ffffbbbbffbbbbbbbbbbbbbbbb
- 2018-12-13 12:52:46 Using model 'FastModel' with 98692 parameters
- 2018-12-13 12:52:46 Using model 'FastModel' with 98692 parameters
- 2018-12-13 12:52:46 Using model 'FastModel' with 98692 parameters
- 2018-12-13 12:52:46 Using model 'FastModel' with 98692 parameters
- 2018-12-13 12:52:46 Using model 'FastModel' with 98692 parameters
- 2018-12-13 12:52:46 Starting step 0
- Initializing Ranker5
- Initializing Ranker6
- Started 10 worker threads
- Iter count: 1629999 infoset count: 5978523
- 2018-12-13 12:53:13 Evaluated [111, 190, 205, 248] batches in queues
- 2018-12-13 12:53:13 Training regret model for player 0
- 2018-12-13 12:53:13 Setting num_threads = 8
- 2018-12-13 12:53:13 Setting num_threads = 8
- 2018-12-13 12:53:18 Using model 'FastModel' with 98692 parameters
- 2018-12-13 12:53:18 Using model 'FastModel' with 98692 parameters
- 2018-12-13 12:53:24 Round 1 Step 0 Iter 200 ; CFR 1495540 ; loss= 7.7461 ; RMSE= 1.7101 time/batch= 28.5 ms sampling= 4.1 ms
- 2018-12-13 12:53:24 Round 0 Step 0 Iter 200 ; CFR 815042 ; loss= 3.3291 ; RMSE= 1.3389 time/batch= 28.7 ms sampling= 4.1 ms
- 2018-12-13 12:53:29 Round 1 Step 0 Iter 400 ; CFR 1495540 ; loss= 7.2325 ; RMSE= 1.6591 time/batch= 25.6 ms sampling= 3.0 ms
- 2018-12-13 12:53:29 Round 0 Step 0 Iter 400 ; CFR 815042 ; loss= 3.2788 ; RMSE= 1.3253 time/batch= 25.6 ms sampling= 3.9 ms
- 2018-12-13 12:53:34 Round 1 Step 0 Iter 600 ; CFR 1495540 ; loss= 7.1546 ; RMSE= 1.6506 time/batch= 26.4 ms sampling= 3.7 ms
- 2018-12-13 12:53:35 Round 0 Step 0 Iter 600 ; CFR 815042 ; loss= 3.287 ; RMSE= 1.327 time/batch= 28.0 ms sampling= 4.5 ms
- 2018-12-13 12:53:40 Round 1 Step 0 Iter 800 ; CFR 1495540 ; loss= 7.1235 ; RMSE= 1.6482 time/batch= 27.1 ms sampling= 3.3 ms
- 2018-12-13 12:53:40 Round 0 Step 0 Iter 800 ; CFR 815042 ; loss= 3.2838 ; RMSE= 1.3263 time/batch= 26.1 ms sampling= 3.4 ms
- 2018-12-13 12:53:45 Round 1 Step 0 Iter 1000 ; CFR 1495540 ; loss= 7.0847 ; RMSE= 1.645 time/batch= 26.1 ms sampling= 3.1 ms
- 2018-12-13 12:53:45 Round 0 Step 0 Iter 1000 ; CFR 815042 ; loss= 3.2833 ; RMSE= 1.3262 time/batch= 26.6 ms sampling= 3.5 ms
- 2018-12-13 12:53:50 Round 1 Step 0 Iter 1200 ; CFR 1495540 ; loss= 7.0305 ; RMSE= 1.6398 time/batch= 26.6 ms sampling= 3.4 ms
- 2018-12-13 12:53:51 Round 0 Step 0 Iter 1200 ; CFR 815042 ; loss= 3.2855 ; RMSE= 1.3267 time/batch= 26.9 ms sampling= 3.5 ms
- 2018-12-13 12:53:56 Round 1 Step 0 Iter 1400 ; CFR 1495540 ; loss= 6.9862 ; RMSE= 1.6351 time/batch= 26.3 ms sampling= 2.8 ms
- 2018-12-13 12:53:56 Round 0 Step 0 Iter 1400 ; CFR 815042 ; loss= 3.2829 ; RMSE= 1.3261 time/batch= 26.7 ms sampling= 2.8 ms
- 2018-12-13 12:54:01 Round 1 Step 0 Iter 1600 ; CFR 1495540 ; loss= 6.9442 ; RMSE= 1.6313 time/batch= 26.5 ms sampling= 3.4 ms
- 2018-12-13 12:54:01 Round 0 Step 0 Iter 1600 ; CFR 815042 ; loss= 3.2832 ; RMSE= 1.3262 time/batch= 26.6 ms sampling= 3.2 ms
- 2018-12-13 12:54:06 Round 1 Step 0 Iter 1800 ; CFR 1495540 ; loss= 6.9076 ; RMSE= 1.628 time/batch= 26.0 ms sampling= 2.8 ms
- 2018-12-13 12:54:07 Round 0 Step 0 Iter 1800 ; CFR 815042 ; loss= 3.2834 ; RMSE= 1.3262 time/batch= 26.5 ms sampling= 3.9 ms
- 2018-12-13 12:54:11 Round 1 Step 0 Iter 2000 ; CFR 1495540 ; loss= 6.8715 ; RMSE= 1.6253 time/batch= 26.0 ms sampling= 2.5 ms
- 2018-12-13 12:54:12 Round 0 Step 0 Iter 2000 ; CFR 815042 ; loss= 3.2838 ; RMSE= 1.3263 time/batch= 26.8 ms sampling= 3.7 ms
- 2018-12-13 12:54:17 Round 1 Step 0 Iter 2200 ; CFR 1495540 ; loss= 6.8221 ; RMSE= 1.6203 time/batch= 26.3 ms sampling= 3.1 ms
- 2018-12-13 12:54:17 Round 0 Step 0 Iter 2200 ; CFR 815042 ; loss= 3.2818 ; RMSE= 1.3259 time/batch= 25.7 ms sampling= 3.1 ms
- 2018-12-13 12:54:22 Round 1 Step 0 Iter 2400 ; CFR 1495540 ; loss= 6.7788 ; RMSE= 1.6165 time/batch= 26.9 ms sampling= 2.9 ms
- 2018-12-13 12:54:23 Round 0 Step 0 Iter 2400 ; CFR 815042 ; loss= 3.2837 ; RMSE= 1.3263 time/batch= 27.4 ms sampling= 3.4 ms
- 2018-12-13 12:54:27 Round 1 Step 0 Iter 2600 ; CFR 1495540 ; loss= 6.7351 ; RMSE= 1.613 time/batch= 26.2 ms sampling= 3.0 ms
- 2018-12-13 12:54:28 Round 0 Step 0 Iter 2600 ; CFR 815042 ; loss= 3.2814 ; RMSE= 1.3258 time/batch= 26.0 ms sampling= 3.2 ms
- 2018-12-13 12:54:32 Round 1 Step 0 Iter 2800 ; CFR 1495540 ; loss= 6.6995 ; RMSE= 1.6098 time/batch= 26.2 ms sampling= 2.8 ms
- 2018-12-13 12:54:33 Round 0 Step 0 Iter 2800 ; CFR 815042 ; loss= 3.2833 ; RMSE= 1.3262 time/batch= 27.0 ms sampling= 3.1 ms
- 2018-12-13 12:54:38 Round 1 Step 0 Iter 3000 ; CFR 1495540 ; loss= 6.6655 ; RMSE= 1.6063 time/batch= 26.4 ms sampling= 2.8 ms
- 2018-12-13 12:54:39 Round 0 Step 0 Iter 3000 ; CFR 815042 ; loss= 3.2846 ; RMSE= 1.3265 time/batch= 27.0 ms sampling= 4.0 ms
- 2018-12-13 12:54:43 Round 1 Step 0 Iter 3200 ; CFR 1495540 ; loss= 6.6228 ; RMSE= 1.602 time/batch= 26.2 ms sampling= 3.6 ms
- 2018-12-13 12:54:44 Round 0 Step 0 Iter 3200 ; CFR 815042 ; loss= 3.2813 ; RMSE= 1.3258 time/batch= 26.2 ms sampling= 3.1 ms
- 2018-12-13 12:54:48 Round 1 Step 0 Iter 3400 ; CFR 1495540 ; loss= 6.5936 ; RMSE= 1.5996 time/batch= 25.8 ms sampling= 2.7 ms
- 2018-12-13 12:54:49 Round 0 Step 0 Iter 3400 ; CFR 815042 ; loss= 3.2847 ; RMSE= 1.3265 time/batch= 26.4 ms sampling= 3.1 ms
- 2018-12-13 12:54:53 Round 1 Step 0 Iter 3600 ; CFR 1495540 ; loss= 6.5614 ; RMSE= 1.5973 time/batch= 26.8 ms sampling= 2.9 ms
- 2018-12-13 12:54:54 Round 0 Step 0 Iter 3600 ; CFR 815042 ; loss= 3.2843 ; RMSE= 1.3264 time/batch= 26.0 ms sampling= 3.1 ms
- 2018-12-13 12:54:59 Round 1 Step 0 Iter 3800 ; CFR 1495540 ; loss= 6.5369 ; RMSE= 1.5947 time/batch= 26.2 ms sampling= 1.9 ms
- 2018-12-13 12:55:00 Round 0 Step 0 Iter 3800 ; CFR 815042 ; loss= 3.2841 ; RMSE= 1.3264 time/batch= 27.0 ms sampling= 3.9 ms
- 2018-12-13 12:55:04 Round 1 Step 0 Iter 4000 ; CFR 1495540 ; loss= 6.4995 ; RMSE= 1.591 time/batch= 26.5 ms sampling= 3.3 ms
- 2018-12-13 12:55:05 Round 0 Step 0 Iter 4000 ; CFR 815042 ; loss= 3.2837 ; RMSE= 1.3263 time/batch= 27.0 ms sampling= 3.4 ms
- 2018-12-13 12:55:09 Round 1 Step 0 Iter 4200 ; CFR 1495540 ; loss= 6.4651 ; RMSE= 1.5881 time/batch= 26.2 ms sampling= 3.0 ms
- 2018-12-13 12:55:11 Round 0 Step 0 Iter 4200 ; CFR 815042 ; loss= 3.2847 ; RMSE= 1.3265 time/batch= 27.1 ms sampling= 3.7 ms
- 2018-12-13 12:55:14 Round 1 Step 0 Iter 4400 ; CFR 1495540 ; loss= 6.4424 ; RMSE= 1.5866 time/batch= 26.1 ms sampling= 2.6 ms
- 2018-12-13 12:55:16 Round 0 Step 0 Iter 4400 ; CFR 815042 ; loss= 3.2828 ; RMSE= 1.3261 time/batch= 26.7 ms sampling= 3.3 ms
- 2018-12-13 12:55:20 Round 1 Step 0 Iter 4600 ; CFR 1495540 ; loss= 6.4184 ; RMSE= 1.5844 time/batch= 26.5 ms sampling= 3.0 ms
- 2018-12-13 12:55:21 Round 0 Step 0 Iter 4600 ; CFR 815042 ; loss= 3.2835 ; RMSE= 1.3263 time/batch= 26.3 ms sampling= 4.0 ms
- 2018-12-13 12:55:25 Round 1 Step 0 Iter 4800 ; CFR 1495540 ; loss= 6.3969 ; RMSE= 1.5824 time/batch= 26.1 ms sampling= 2.7 ms
- 2018-12-13 12:55:27 Round 0 Step 0 Iter 4800 ; CFR 815042 ; loss= 3.2816 ; RMSE= 1.3259 time/batch= 27.1 ms sampling= 3.7 ms
- 2018-12-13 12:55:30 Round 1 Step 0 Iter 5000 ; CFR 1495540 ; loss= 6.3678 ; RMSE= 1.5797 time/batch= 26.5 ms sampling= 3.3 ms
- 2018-12-13 12:55:32 Round 0 Step 0 Iter 5000 ; CFR 815042 ; loss= 3.2842 ; RMSE= 1.3264 time/batch= 26.5 ms sampling= 3.3 ms
- 2018-12-13 12:55:35 Round 1 Step 0 Iter 5200 ; CFR 1495540 ; loss= 6.3484 ; RMSE= 1.5774 time/batch= 25.5 ms sampling= 2.4 ms
- 2018-12-13 12:55:37 Round 0 Step 0 Iter 5200 ; CFR 815042 ; loss= 3.2847 ; RMSE= 1.3265 time/batch= 26.4 ms sampling= 4.0 ms
Add Comment
Please, Sign In to add comment