add documentation

(.venv) ➜  polaris git:(add_polaris_report_documentation) ✗ polaris fetch \
    --start_date 2020-01-21 \
    --end_date 2020-01-28 \
    --cache_dir /tmp/LightSail-2 \
    LightSail-2 \
    /tmp/LightSail2-normalized_frames.json
2021-08-18 15:53:41.688592: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2021-08-18 15:53:41.688653: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
2021-08-18 15:53:44,864 - polaris.fetch.data_fetch_decoder - INFO - Satellite: id=44420 name=LightSail-2 decoder=Lightsail2
2021-08-18 15:53:44,864 - polaris.fetch.data_fetch_decoder - INFO - selected decoder=Lightsail2
2021-08-18 15:53:44,864 - polaris.fetch.fetch_import_telemetry - INFO - Fetch period: 2020-01-21 00:00:00 to 2020-01-28 00:00:00
(FOR_EACH) Demoddata module(s) loading :
module : CSV loaded
(END) Demoddata module(s) loading :
No module list found
job 1 scanning page...1
job 1 scanning page...2
job 1 scanning page...3
job 1 scanning page...4
job 1 scanning page...5
job 1 scanning page...6
job 1 terminated

downloading started (Ctrl + C to stop)...       ~(  ^o^)~
no demoddata found for the observation 1593565 of 2020-01-27T10:09:56Z
no demoddata found for the observation 1593613 of 2020-01-27T09:34:41Z
no demoddata found for the observation 1593612 of 2020-01-27T07:49:17Z
no demoddata found for the observation 1593607 of 2020-01-27T06:51:45Z
no demoddata found for the observation 1593606 of 2020-01-27T05:06:22Z
no demoddata found for the observation 1593632 of 2020-01-27T03:21:14Z
downloading...data_1593623_2020-01-27T02-35-34
downloading...data_1593623_2020-01-27T02-35-26
downloading...data_1593623_2020-01-27T02-35-12
downloading...data_1593623_2020-01-27T02-35-05
downloading...data_1593623_2020-01-27T02-34-59
downloading...data_1593623_2020-01-27T02-34-52
downloading...data_1593623_2020-01-27T02-34-45
downloading...data_1593623_2020-01-27T02-34-38
downloading...data_1593623_2020-01-27T02-34-31
downloading...data_1593623_2020-01-27T02-34-23
downloading...data_1593623_2020-01-27T02-34-17
downloading...data_1593623_2020-01-27T02-34-10
downloading...data_1593623_2020-01-27T02-34-02
downloading...data_1593623_2020-01-27T02-35-48
downloading...data_1593623_2020-01-27T02-35-41
no demoddata found for the observation 1593619 of 2020-01-27T02:23:57Z
no demoddata found for the observation 1593631 of 2020-01-27T01:35:31Z
no demoddata found for the observation 1593587 of 2020-01-27T00:42:11Z
no demoddata found for the observation 1593574 of 2020-01-27T00:42:05Z
downloading...data_1593559_2020-01-27T00-41-14
downloading...data_1593559_2020-01-27T00-40-59
downloading...data_1593559_2020-01-27T00-40-31
downloading...data_1593559_2020-01-27T00-40-24
downloading...data_1593559_2020-01-27T00-42-17
downloading...data_1593600_2020-01-27T00-42-17
no demoddata found for the observation 1593591 of 2020-01-27T00:33:29Z
no demoddata found for the observation 1593586 of 2020-01-26T22:56:37Z
no demoddata found for the observation 1593573 of 2020-01-26T22:56:31Z
no demoddata found for the observation 1593627 of 2020-01-26T22:52:26Z
downloading...data_1593558_2020-01-26T22-51-54
downloading...data_1593558_2020-01-26T22-51-47
downloading...data_1593599_2020-01-26T22-52-09
downloading...data_1593599_2020-01-26T22-51-54
downloading...data_1593599_2020-01-26T22-52-01
downloading...data_1593599_2020-01-26T22-51-47
downloading...data_1593599_2020-01-26T22-52-23
downloading...data_1593599_2020-01-26T22-52-15
downloading...data_1593599_2020-01-26T22-56-14
downloading...data_1593599_2020-01-26T22-56-07
downloading...data_1593599_2020-01-26T22-56-27
downloading...data_1593599_2020-01-26T22-57-02
downloading...data_1593599_2020-01-26T22-56-41
downloading...data_1593599_2020-01-26T22-56-48
downloading...data_1593599_2020-01-26T22-56-35
downloading...data_1593599_2020-01-26T22-56-55
downloading...data_1593599_2020-01-26T22-58-26
no demoddata found for the observation 1593590 of 2020-01-26T22:48:13Z
no demoddata found for the observation 1593640 of 2020-01-26T22:10:45Z
no demoddata found for the observation 1593585 of 2020-01-26T21:10:54Z
no demoddata found for the observation 1593572 of 2020-01-26T21:10:48Z
no demoddata found for the observation 1593626 of 2020-01-26T21:07:11Z
downloading...data_1593598_2020-01-26T20-36-14
downloading...data_1593639_2020-01-26T20-32-01
downloading...data_1593639_2020-01-26T20-31-54
downloading...data_1593639_2020-01-26T20-31-47
downloading...data_1593639_2020-01-26T20-31-40
downloading...data_1593639_2020-01-26T20-34-01
downloading...data_1593639_2020-01-26T20-33-53
downloading...data_1593639_2020-01-26T20-33-47
downloading...data_1593639_2020-01-26T20-33-39
downloading...data_1593639_2020-01-26T20-33-32
downloading...data_1593639_2020-01-26T20-33-25
downloading...data_1593639_2020-01-26T20-33-18
downloading...data_1593639_2020-01-26T20-33-12
downloading...data_1593639_2020-01-26T20-32-57
downloading...data_1593639_2020-01-26T20-32-50
downloading...data_1593639_2020-01-26T20-32-43
downloading...data_1593639_2020-01-26T20-32-37
downloading...data_1593639_2020-01-26T20-32-29
downloading...data_1593639_2020-01-26T20-32-22
downloading...data_1593639_2020-01-26T20-32-16
downloading...data_1593639_2020-01-26T20-32-08
downloading...data_1593639_2020-01-26T20-34-28
downloading...data_1593639_2020-01-26T20-34-21
downloading...data_1593639_2020-01-26T20-34-14
downloading...data_1593639_2020-01-26T20-34-07
no demoddata found for the observation 1593584 of 2020-01-26T19:24:59Z
no demoddata found for the observation 1593571 of 2020-01-26T19:24:52Z
no demoddata found for the observation 1593618 of 2020-01-26T19:19:49Z
downloading...data_1593597_2020-01-26T18-51-15
downloading...data_1593597_2020-01-26T18-51-08
downloading...data_1593597_2020-01-26T18-50-54
downloading...data_1593597_2020-01-26T18-50-47
downloading...data_1593638_2020-01-26T18-43-26
downloading...data_1593583_2020-01-26T17-46-37
downloading...data_1593583_2020-01-26T17-45-41
downloading...data_1593583_2020-01-26T17-45-34
downloading...data_1593583_2020-01-26T17-45-27
no demoddata found for the observation 1593570 of 2020-01-26T17:39:21Z
downloading...data_1593622_2020-01-26T17-44-45
downloading...data_1593622_2020-01-26T17-44-10
no demoddata found for the observation 1593617 of 2020-01-26T17:33:59Z
no demoddata found for the observation 1593596 of 2020-01-26T16:57:05Z
downloading...data_1593637_2020-01-26T17-05-05
downloading...data_1593637_2020-01-26T17-04-58
no demoddata found for the observation 1593630 of 2020-01-26T16:44:37Z
no demoddata found for the observation 1593564 of 2020-01-26T16:24:26Z
no demoddata found for the observation 1599375 of 2020-01-26T15:59:40Z
downloading...data_1593621_2020-01-26T15-56-01
no demoddata found for the observation 1593605 of 2020-01-26T14:53:53Z
no demoddata found for the observation 1593578 of 2020-01-26T14:39:17Z
downloading...data_1593563_2020-01-26T14-46-15
downloading...data_1593563_2020-01-26T14-46-01
downloading...data_1593563_2020-01-26T14-47-04
downloading...data_1593563_2020-01-26T14-46-57
downloading...data_1593563_2020-01-26T14-46-50
downloading...data_1593563_2020-01-26T14-46-43
downloading...data_1593563_2020-01-26T14-46-36
downloading...data_1593604_2020-01-26T13-15-50
downloading...data_1593604_2020-01-26T13-15-43
no demoddata found for the observation 1593577 of 2020-01-26T12:54:02Z
downloading...data_1593562_2020-01-26T13-02-10
downloading...data_1593562_2020-01-26T13-02-04
downloading...data_1593562_2020-01-26T13-01-36
downloading...data_1593562_2020-01-26T13-01-28
downloading...data_1593562_2020-01-26T13-01-22
downloading...data_1593562_2020-01-26T13-01-15
downloading...data_1593562_2020-01-26T13-01-08
downloading...data_1593562_2020-01-26T13-01-00
downloading...data_1593562_2020-01-26T13-00-53
no demoddata found for the observation 1593561 of 2020-01-26T11:08:12Z
no demoddata found for the observation 1593611 of 2020-01-26T10:33:11Z
no demoddata found for the observation 1593610 of 2020-01-26T08:47:44Z
downloading...data_1593603_2020-01-26T07-58-01
downloading...data_1593603_2020-01-26T07-57-54
downloading...data_1593603_2020-01-26T07-57-48
downloading...data_1593603_2020-01-26T07-57-40
downloading...data_1593603_2020-01-26T07-57-33
downloading...data_1593603_2020-01-26T07-57-19
no demoddata found for the observation 1593609 of 2020-01-26T07:02:35Z
no demoddata found for the observation 1593602 of 2020-01-26T06:04:42Z
no demoddata found for the observation 1593616 of 2020-01-26T03:22:26Z
no demoddata found for the observation 1593582 of 2020-01-26T01:40:45Z
no demoddata found for the observation 1593615 of 2020-01-26T01:37:05Z
downloading...data_1593581_2020-01-26T00-00-59
no demoddata found for the observation 1593569 of 2020-01-25T23:55:00Z
no demoddata found for the observation 1593625 of 2020-01-25T23:50:53Z
no demoddata found for the observation 1593589 of 2020-01-25T23:46:36Z
no demoddata found for the observation 1593636 of 2020-01-25T23:09:27Z
no demoddata found for the observation 1593580 of 2020-01-25T22:09:28Z
no demoddata found for the observation 1593624 of 2020-01-25T22:05:34Z
no demoddata found for the observation 1593588 of 2020-01-25T22:01:34Z
no demoddata found for the observation 1593595 of 2020-01-25T21:26:42Z
no demoddata found for the observation 1593635 of 2020-01-25T21:23:38Z
no demoddata found for the observation 1593566 of 2020-01-25T21:17:33Z
no demoddata found for the observation 1593579 of 2020-01-25T20:23:34Z
no demoddata found for the observation 1593568 of 2020-01-25T20:23:27Z
downloading...data_1593594_2020-01-25T19-49-12
downloading...data_1593594_2020-01-25T19-49-05
downloading...data_1593594_2020-01-25T19-48-59
downloading...data_1593594_2020-01-25T19-49-40
downloading...data_1593594_2020-01-25T19-49-33
downloading...data_1593634_2020-01-25T19-43-50
downloading...data_1593634_2020-01-25T19-43-36
downloading...data_1593634_2020-01-25T19-43-22
downloading...data_1593634_2020-01-25T19-43-15
downloading...data_1593634_2020-01-25T19-42-54
downloading...data_1593634_2020-01-25T19-42-47
downloading...data_1593634_2020-01-25T19-46-03
downloading...data_1593634_2020-01-25T19-45-56
downloading...data_1593634_2020-01-25T19-45-49
downloading...data_1593634_2020-01-25T19-45-42
downloading...data_1593634_2020-01-25T19-45-35
downloading...data_1593634_2020-01-25T19-45-28
downloading...data_1593634_2020-01-25T19-45-22
downloading...data_1593634_2020-01-25T19-45-14
downloading...data_1593634_2020-01-25T19-45-08
downloading...data_1593634_2020-01-25T19-45-00
downloading...data_1593634_2020-01-25T19-44-54
downloading...data_1593634_2020-01-25T19-44-46
downloading...data_1593634_2020-01-25T19-44-32
downloading...data_1593634_2020-01-25T19-47-55
downloading...data_1593634_2020-01-25T19-47-48
downloading...data_1593634_2020-01-25T19-47-34
downloading...data_1593634_2020-01-25T19-47-21
downloading...data_1593634_2020-01-25T19-47-13
downloading...data_1593634_2020-01-25T19-47-06
downloading...data_1593634_2020-01-25T19-46-52
downloading...data_1593634_2020-01-25T19-46-45
downloading...data_1593634_2020-01-25T19-46-31
downloading...data_1593634_2020-01-25T19-46-24
downloading...data_1593634_2020-01-25T19-46-17
no demoddata found for the observation 1593567 of 2020-01-25T18:37:45Z
no demoddata found for the observation 1593614 of 2020-01-25T18:32:26Z
downloading...data_1593593_2020-01-25T18-02-34
downloading...data_1593593_2020-01-25T18-02-27
downloading...data_1593593_2020-01-25T18-02-06
downloading...data_1593633_2020-01-25T18-00-00
downloading...data_1593633_2020-01-25T17-59-53
downloading...data_1593633_2020-01-25T17-59-46
downloading...data_1593633_2020-01-25T17-59-32
downloading...data_1593633_2020-01-25T17-59-25
downloading...data_1593633_2020-01-25T17-58-50
downloading...data_1593633_2020-01-25T18-00-56
downloading...data_1593633_2020-01-25T18-00-49
downloading...data_1593633_2020-01-25T18-00-42
downloading...data_1593633_2020-01-25T18-00-35
downloading...data_1593633_2020-01-25T18-00-28
downloading...data_1593633_2020-01-25T18-00-21
downloading...data_1593633_2020-01-25T18-00-14
downloading...data_1593633_2020-01-25T18-00-07
no demoddata found for the observation 1593629 of 2020-01-25T17:43:12Z
downloading...data_1593620_2020-01-25T16-57-00
downloading...data_1593620_2020-01-25T16-56-53
downloading...data_1593620_2020-01-25T16-56-46
downloading...data_1593620_2020-01-25T16-56-32
downloading...data_1593620_2020-01-25T16-56-25
downloading...data_1593620_2020-01-25T16-56-18
downloading...data_1593620_2020-01-25T16-56-11
downloading...data_1593620_2020-01-25T16-56-04
downloading...data_1593620_2020-01-25T16-55-57
downloading...data_1593620_2020-01-25T16-55-51
no demoddata found for the observation 1593592 of 2020-01-25T16:10:21Z
no demoddata found for the observation 1593628 of 2020-01-25T15:57:48Z
no demoddata found for the observation 1593576 of 2020-01-25T15:37:44Z
downloading...data_1593560_2020-01-25T15-45-36
downloading...data_1593601_2020-01-25T14-13-40
downloading...data_1593601_2020-01-25T14-14-58
downloading...data_1593601_2020-01-25T14-14-50
downloading...data_1593601_2020-01-25T14-14-43
downloading...data_1593601_2020-01-25T14-14-36
downloading...data_1593601_2020-01-25T14-14-29
downloading...data_1593601_2020-01-25T14-14-22
no demoddata found for the observation 1593575 of 2020-01-25T13:52:24Z
no demoddata found for the observation 1593608 of 2020-01-25T11:31:40Z
no demoddata found for the observation 1591070 of 2020-01-25T03:35:56Z
no demoddata found for the observation 1590904 of 2020-01-25T00:56:56Z
downloading...data_1586061_2020-01-24T17-04-22
no demoddata found for the observation 1586043 of 2020-01-24T04:34:39Z
no demoddata found for the observation 1585513 of 2020-01-24T01:55:27Z
no demoddata found for the observation 1586015 of 2020-01-24T01:44:12Z
no demoddata found for the observation 1585509 of 2020-01-24T00:09:56Z
no demoddata found for the observation 1576361 of 2020-01-23T03:47:20Z
no demoddata found for the observation 1569729 of 2020-01-22T21:33:42Z
downloading...data_1569735_2020-01-22T20-58-50
downloading...data_1569735_2020-01-22T20-58-43
downloading...data_1569735_2020-01-22T20-58-36
no demoddata found for the observation 1569728 of 2020-01-22T19:48:05Z
no demoddata found for the observation 1569746 of 2020-01-22T19:44:50Z
downloading...data_1569734_2020-01-22T19-13-22
downloading...data_1569734_2020-01-22T19-13-15
downloading...data_1569734_2020-01-22T19-13-01
downloading...data_1569734_2020-01-22T19-12-54
downloading...data_1569734_2020-01-22T19-12-40
downloading...data_1569734_2020-01-22T19-12-33
downloading...data_1569734_2020-01-22T19-12-26
downloading...data_1569734_2020-01-22T19-12-19
downloading...data_1569734_2020-01-22T19-12-12
downloading...data_1569734_2020-01-22T19-12-05
downloading...data_1569734_2020-01-22T19-11-58
downloading...data_1569734_2020-01-22T19-14-11
no demoddata found for the observation 1569755 of 2020-01-22T18:55:39Z
downloading...data_1569750_2020-01-22T18-05-28
downloading...data_1569750_2020-01-22T18-07-13
downloading...data_1569750_2020-01-22T18-06-59
downloading...data_1569750_2020-01-22T18-06-52
downloading...data_1569750_2020-01-22T18-06-45
downloading...data_1569750_2020-01-22T18-06-38
downloading...data_1569750_2020-01-22T18-06-31
downloading...data_1569750_2020-01-22T18-06-17
downloading...data_1569750_2020-01-22T18-06-10
downloading...data_1569750_2020-01-22T18-06-03
downloading...data_1569750_2020-01-22T18-05-56
downloading...data_1569750_2020-01-22T18-05-49
downloading...data_1569750_2020-01-22T18-05-42
downloading...data_1569750_2020-01-22T18-05-35
no demoddata found for the observation 1569721 of 2020-01-22T17:59:37Z
no demoddata found for the observation 1569711 of 2020-01-22T16:49:47Z
downloading...data_1569738_2020-01-22T15-23-53
downloading...data_1569738_2020-01-22T15-24-14
no demoddata found for the observation 1569723 of 2020-01-22T15:04:56Z
no demoddata found for the observation 1569710 of 2020-01-22T15:04:16Z
no demoddata found for the observation 1569709 of 2020-01-22T13:19:02Z
no demoddata found for the observation 1569742 of 2020-01-22T12:44:10Z
no demoddata found for the observation 1569741 of 2020-01-22T10:58:41Z
downloading...data_1569737_2020-01-22T08-19-34
downloading...data_1569737_2020-01-22T08-19-13
downloading...data_1569737_2020-01-22T08-20-30
downloading...data_1569749_2020-01-22T05-41-29
downloading...data_1569749_2020-01-22T05-41-22
downloading...data_1569749_2020-01-22T05-41-15
downloading...data_1569749_2020-01-22T05-41-08
downloading...data_1569749_2020-01-22T05-41-01
downloading...data_1569749_2020-01-22T05-40-47
downloading...data_1569749_2020-01-22T05-42-32
downloading...data_1569749_2020-01-22T05-42-25
downloading...data_1569749_2020-01-22T05-42-18
downloading...data_1569749_2020-01-22T05-42-11
downloading...data_1569749_2020-01-22T05-42-04
downloading...data_1569749_2020-01-22T05-41-57
downloading...data_1569749_2020-01-22T05-41-50
downloading...data_1569749_2020-01-22T05-41-43
no demoddata found for the observation 1569720 of 2020-01-22T05:36:13Z
no demoddata found for the observation 1569745 of 2020-01-22T05:33:25Z
downloading...data_1569754_2020-01-22T04-50-30
downloading...data_1569754_2020-01-22T04-50-09
downloading...data_1569754_2020-01-22T04-50-02
downloading...data_1569754_2020-01-22T04-49-55
no demoddata found for the observation 1569727 of 2020-01-22T02:03:46Z
no demoddata found for the observation 1575841 of 2020-01-22T02:02:29Z
no demoddata found for the observation 1569726 of 2020-01-22T00:18:09Z
no demoddata found for the observation 1569752 of 2020-01-22T00:16:26Z
no demoddata found for the observation 1569733 of 2020-01-21T23:35:03Z
no demoddata found for the observation 1569725 of 2020-01-21T22:32:15Z
no demoddata found for the observation 1569732 of 2020-01-21T21:49:28Z
no demoddata found for the observation 1569724 of 2020-01-21T20:46:28Z
no demoddata found for the observation 1569744 of 2020-01-21T20:43:18Z
downloading...data_1569731_2020-01-21T20-11-20
downloading...data_1569731_2020-01-21T20-11-13
downloading...data_1569731_2020-01-21T20-11-06
downloading...data_1569731_2020-01-21T20-11-34
downloading...data_1569731_2020-01-21T20-11-27
downloading...data_1569748_2020-01-21T19-05-32
downloading...data_1569748_2020-01-21T19-05-25
downloading...data_1569748_2020-01-21T19-05-18
downloading...data_1569748_2020-01-21T19-05-11
downloading...data_1569748_2020-01-21T19-05-04
downloading...data_1569748_2020-01-21T19-04-57
downloading...data_1569748_2020-01-21T19-04-50
downloading...data_1569748_2020-01-21T19-04-43
downloading...data_1569748_2020-01-21T19-04-36
downloading...data_1569748_2020-01-21T19-04-29
downloading...data_1569748_2020-01-21T19-04-22
downloading...data_1569748_2020-01-21T19-04-15
downloading...data_1569748_2020-01-21T19-04-01
downloading...data_1569748_2020-01-21T19-03-54
downloading...data_1569748_2020-01-21T19-05-53
downloading...data_1569748_2020-01-21T19-05-46
no demoddata found for the observation 1569719 of 2020-01-21T18:58:08Z
downloading...data_1569730_2020-01-21T18-26-27
no demoddata found for the observation 1569753 of 2020-01-21T18:08:43Z
downloading...data_1569736_2020-01-21T16-23-29
downloading...data_1569736_2020-01-21T16-23-22
downloading...data_1569736_2020-01-21T16-23-15
downloading...data_1569736_2020-01-21T16-23-08
downloading...data_1569736_2020-01-21T16-22-40
downloading...data_1569736_2020-01-21T16-22-33
downloading...data_1569736_2020-01-21T16-22-26
downloading...data_1569736_2020-01-21T16-22-19
downloading...data_1569736_2020-01-21T16-22-12
no demoddata found for the observation 1569722 of 2020-01-21T16:03:17Z
downloading...data_1569708_2020-01-21T16-08-40
no demoddata found for the observation 1569707 of 2020-01-21T14:17:19Z
no demoddata found for the observation 1569740 of 2020-01-21T11:57:06Z
no demoddata found for the observation 1569739 of 2020-01-21T10:11:49Z
no demoddata found for the observation 1569718 of 2020-01-21T06:34:33Z
downloading...data_1569747_2020-01-21T04-56-19
downloading...data_1569747_2020-01-21T04-56-12
downloading...data_1569747_2020-01-21T04-56-05
downloading...data_1569747_2020-01-21T04-55-58
downloading...data_1569747_2020-01-21T04-55-44
no demoddata found for the observation 1569743 of 2020-01-21T04:46:24Z
no demoddata found for the observation 1561204 of 2020-01-21T01:19:45Z
no demoddata found for the observation 1569751 of 2020-01-21T01:14:49Z
2021-08-18 15:55:15,827 - polaris.fetch.fetch_import_telemetry - INFO - Saving the dataframes in directory: /tmp/LightSail-2
2021-08-18 15:55:15,827 - polaris.fetch.fetch_import_telemetry - INFO - Merging all the csv files into one CSV file.
2021-08-18 15:55:15,867 - polaris.fetch.fetch_import_telemetry - INFO - Merge Completed
2021-08-18 15:55:15,868 - polaris.fetch.fetch_import_telemetry - INFO - Starting decoding and merging of the new frames
2021-08-18 15:55:15,868 - polaris.fetch.fetch_import_telemetry - DEBUG - Decode command: decode_multiple --filename /tmp/LightSail-2/merged_frames.csv --format csv Lightsail2 > /tmp/LightSail-2/decoded_frames.json
2021-08-18 15:55:16,513 - polaris.fetch.fetch_import_telemetry - INFO - Decoding of data finished.
2021-08-18 15:55:16,513 - polaris.fetch.fetch_import_telemetry - INFO - Decoded data stored at /tmp/LightSail-2/decoded_frames.json
2021-08-18 15:55:16,534 - polaris.fetch.fetch_import_telemetry - DEBUG - Normalizer chosen: Lightsail2
2021-08-18 15:55:16,543 - polaris.fetch.fetch_import_telemetry - INFO - Loaded normalizer=Lightsail2
2021-08-18 15:55:16,583 - polaris.fetch.fetch_import_sw - INFO - Fetching space weather data from vinvelivaanilai
2021-08-18 15:55:16,583 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - Attempt number: 1 to fetch index DGD
2021-08-18 15:55:16,583 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - Getting files list
2021-08-18 15:55:16,583 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - List of files ['/tmp/LightSail-2/2020Q1_DGD.txt']
2021-08-18 15:55:16,583 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - /tmp/LightSail-2/2020Q1_DGD.txt does not exist
2021-08-18 15:55:19,277 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - 230 Anonymous access granted, restrictions apply
2021-08-18 15:55:19,561 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - Fetching file at /tmp/LightSail-2/2020Q1_DGD.txt
2021-08-18 15:55:26,809 - vinvelivaanilai.space_weather.sw_extractor - INFO - Extracting data from /tmp/LightSail-2/2020Q1_DGD.txt
2021-08-18 15:55:26,848 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - Attempt number: 1 to fetch index DPD
2021-08-18 15:55:26,848 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - Getting files list
2021-08-18 15:55:26,848 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - List of files ['/tmp/LightSail-2/2020Q1_DPD.txt']
2021-08-18 15:55:26,848 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - /tmp/LightSail-2/2020Q1_DPD.txt does not exist
2021-08-18 15:55:28,321 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - 230 Anonymous access granted, restrictions apply
2021-08-18 15:55:28,601 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - Fetching file at /tmp/LightSail-2/2020Q1_DPD.txt
2021-08-18 15:55:30,301 - vinvelivaanilai.space_weather.sw_extractor - INFO - Extracting data from /tmp/LightSail-2/2020Q1_DPD.txt
2021-08-18 15:55:30,337 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - Attempt number: 1 to fetch index DSD
2021-08-18 15:55:30,337 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - Getting files list
2021-08-18 15:55:30,337 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - List of files ['/tmp/LightSail-2/2020Q1_DSD.txt']
2021-08-18 15:55:30,337 - vinvelivaanilai.space_weather.sw_file_fetch - DEBUG - /tmp/LightSail-2/2020Q1_DSD.txt does not exist
2021-08-18 15:55:31,487 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - 230 Anonymous access granted, restrictions apply
2021-08-18 15:55:31,771 - vinvelivaanilai.space_weather.sw_file_fetch - INFO - Fetching file at /tmp/LightSail-2/2020Q1_DSD.txt
2021-08-18 15:55:33,469 - vinvelivaanilai.space_weather.sw_extractor - INFO - Extracting data from /tmp/LightSail-2/2020Q1_DSD.txt
2021-08-18 15:55:33,495 - polaris.fetch.fetch_import_sw - INFO - Finding the nearest space weather data
2021-08-18 15:55:33,521 - polaris.fetch.fetch_import_sw - INFO - Converting space weather data to the normalized frames format
2021-08-18 15:55:33,547 - polaris.fetch.fetch_import_sw - INFO - Loading normalizer for index: DGD
2021-08-18 15:55:33,573 - polaris.fetch.fetch_import_sw - INFO - Loading normalizer for index: DPD
2021-08-18 15:55:33,595 - polaris.fetch.fetch_import_sw - INFO - Loading normalizer for index: DSD
2021-08-18 15:55:33,598 - polaris.fetch.data_fetch_decoder - INFO - Combining space weather and telemetry frames
2021-08-18 15:55:33,606 - polaris.fetch.data_fetch_decoder - INFO - Tagging columns
2021-08-18 15:55:33,699 - polaris.fetch.data_fetch_decoder - INFO - Tagging Completed
2021-08-18 15:55:34,012 - polaris.fetch.data_fetch_decoder - INFO - Output file /tmp/LightSail2-normalized_frames.json
(.venv) ➜  polaris git:(add_polaris_report_documentation) ✗ polaris behave /tmp/LightSail2-normalized_frames.json \
    --output_file /tmp/LightSail2-anomaly_analysis.json
2021-08-18 15:57:07.477552: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2021-08-18 15:57:07.477586: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
INFO: 'LightSail-2' does not exist. Creating a new experiment
2021-08-18 15:57:09,344 - polaris.feature.cleaner_configurator - INFO - Default thresholds used for dataset na values (col:30% row:60%)!
2021/08/18 15:57:09 WARNING mlflow.utils.autologging_utils: You are using an unsupported version of tensorflow. If you encounter errors during autologging, try upgrading / downgrading tensorflow to a supported version, or try upgrading MLflow.
2021-08-18 15:57:09,533 - polaris.feature.cleaner - INFO - Dropping constant column(s) : dest_callsign,src_callsign,src_ssid,dest_ssid,ctl,pid,src_ip_addr,dst_ip_addr,src_port,dst_port,type,threev_pwrbusv,daughter_apwrcurr,daughter_bpwrcurr,daughter_bpwrbusv,buffers,adcs_mode,cam0_status,cam1_pics_remaining,motor_pwrbusv,pic_panel_flags,motor_cnt,motor_limit,College K 0-3,Neutron,X-Ray M,X-Ray X,Optical 2,Optical 3,Solar Mean Field,X-Ray C,Optical 1
2021-08-18 15:57:09,545 - polaris.feature.cleaner - DEBUG - Initial Shape: (262, 179), Final Shape: (262, 179)
2021-08-18 15:57:09.617146: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory
2021-08-18 15:57:09.617188: W tensorflow/stream_executor/cuda/cuda_driver.cc:269] failed call to cuInit: UNKNOWN ERROR (303)
2021-08-18 15:57:09.617228: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (fedora): /proc/driver/nvidia/version does not exist
2021-08-18 15:57:09.617561: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2021-08-18 15:57:09,701 - polaris.anomaly.anomaly_detector - INFO - Training on 208 rows of data, with batch size 128 and 20 epochs
2021-08-18 15:57:09.706748: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.
2021-08-18 15:57:09.706781: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.
2021-08-18 15:57:09.706847: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.
2021-08-18 15:57:10.098731: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:185] None of the MLIR Optimization Passes are enabled (registered 2)
Epoch 1/20
1/2 [==============>...............] - ETA: 0s - loss: 1.0238 - MSE: 1.01902021-08-18 15:57:10.737115: I tensorflow/core/profiler/lib/profiler_session.cc:131] Profiler session initializing.
2021-08-18 15:57:10.737157: I tensorflow/core/profiler/lib/profiler_session.cc:146] Profiler session started.
2021-08-18 15:57:10.740591: I tensorflow/core/profiler/lib/profiler_session.cc:66] Profiler session collecting data.
2021-08-18 15:57:10.741609: I tensorflow/core/profiler/lib/profiler_session.cc:164] Profiler session tear down.
2021-08-18 15:57:10.743228: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10

2021-08-18 15:57:10.744315: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for trace.json.gz to /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10/fedora.trace.json.gz
2021-08-18 15:57:10.748139: I tensorflow/core/profiler/rpc/client/save_profile.cc:136] Creating directory: /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10

2021-08-18 15:57:10.748329: I tensorflow/core/profiler/rpc/client/save_profile.cc:142] Dumped gzipped tool data for memory_profile.json.gz to /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10/fedora.memory_profile.json.gz
2021-08-18 15:57:10.748680: I tensorflow/core/profiler/rpc/client/capture_profile.cc:251] Creating directory: /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10
Dumped tool data for xplane.pb to /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10/fedora.xplane.pb
Dumped tool data for overview_page.pb to /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10/fedora.overview_page.pb
Dumped tool data for input_pipeline.pb to /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10/fedora.input_pipeline.pb
Dumped tool data for tensorflow_stats.pb to /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10/fedora.tensorflow_stats.pb
Dumped tool data for kernel_stats.pb to /tmp/tmp79s72n_b/train/plugins/profile/2021_08_18_15_57_10/fedora.kernel_stats.pb

2/2 [==============================] - 1s 26ms/step - loss: 1.0163 - MSE: 1.0115
Epoch 2/20
2/2 [==============================] - 0s 3ms/step - loss: 0.9895 - MSE: 0.9849
Epoch 3/20
2/2 [==============================] - 0s 3ms/step - loss: 0.9707 - MSE: 0.9661
Epoch 4/20
2/2 [==============================] - 0s 4ms/step - loss: 0.9539 - MSE: 0.9492
Epoch 5/20
2/2 [==============================] - 0s 6ms/step - loss: 0.9368 - MSE: 0.9319
Epoch 6/20
2/2 [==============================] - 0s 3ms/step - loss: 0.9199 - MSE: 0.9147
Epoch 7/20
2/2 [==============================] - 0s 4ms/step - loss: 0.9031 - MSE: 0.8976
Epoch 8/20
2/2 [==============================] - 0s 3ms/step - loss: 0.8865 - MSE: 0.8807
Epoch 9/20
2/2 [==============================] - 0s 4ms/step - loss: 0.8704 - MSE: 0.8644
Epoch 10/20
2/2 [==============================] - 0s 6ms/step - loss: 0.8555 - MSE: 0.8493
Epoch 11/20
2/2 [==============================] - 0s 5ms/step - loss: 0.8410 - MSE: 0.8346
Epoch 12/20
2/2 [==============================] - 0s 3ms/step - loss: 0.8275 - MSE: 0.8210
Epoch 13/20
2/2 [==============================] - 0s 3ms/step - loss: 0.8149 - MSE: 0.8082
Epoch 14/20
2/2 [==============================] - 0s 3ms/step - loss: 0.8029 - MSE: 0.7961
Epoch 15/20
2/2 [==============================] - 0s 2ms/step - loss: 0.7919 - MSE: 0.7849
Epoch 16/20
2/2 [==============================] - 0s 3ms/step - loss: 0.7820 - MSE: 0.7748
Epoch 17/20
2/2 [==============================] - 0s 4ms/step - loss: 0.7725 - MSE: 0.7652
Epoch 18/20
2/2 [==============================] - 0s 3ms/step - loss: 0.7641 - MSE: 0.7566
Epoch 19/20
2/2 [==============================] - 0s 3ms/step - loss: 0.7560 - MSE: 0.7485
Epoch 20/20
2/2 [==============================] - 0s 3ms/step - loss: 0.7488 - MSE: 0.7412
2021-08-18 15:57:11.351781: W tensorflow/python/util/util.cc:348] Sets are not currently considered sequences, but this may change in the future, so consider avoiding using them.
INFO:tensorflow:Assets written to: /tmp/tmpttuqbq1b/model/data/model/assets
1/1 [==============================] - 0s 122ms/step - loss: 1.0077 - MSE: 1.0021
2021-08-18 15:57:12,715 - polaris.anomaly.anomaly_detector - INFO - Test loss: 1.0077096223831177, Test MSE: 1.0021281242370605
INFO:tensorflow:Assets written to: /tmp/autoencoder_model.tf_model/assets
INFO:tensorflow:Assets written to: /tmp/encoder_model.tf_model/assets
INFO:tensorflow:Assets written to: /tmp/decoder_model.tf_model/assets
(.venv) ➜  polaris git:(add_polaris_report_documentation) ✗ polaris report /tmp/LightSail2-anomaly_analysis.json

2021-08-18 15:57:21.688607: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2021-08-18 15:57:21.688674: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
2021-08-18 15:57:23,342 - polaris.reports.server - INFO - Serving ready: http://localhost:8080
127.0.0.1 - - [18/Aug/2021 15:57:25] "GET /favicon.ico HTTP/1.1" 404 -
127.0.0.1 - - [18/Aug/2021 16:03:24] "GET / HTTP/1.1" 200 -
127.0.0.1 - - [18/Aug/2021 16:03:24] "GET /static/css/main.69ea37ba.chunk.css HTTP/1.1" 200 -
127.0.0.1 - - [18/Aug/2021 16:03:24] "GET /static/js/2.acd93575.chunk.js HTTP/1.1" 200 -
127.0.0.1 - - [18/Aug/2021 16:03:24] "GET /static/js/main.7b47d336.chunk.js HTTP/1.1" 200 -
127.0.0.1 - - [18/Aug/2021 16:03:25] "GET /static/media/polaris_logo.7c972b21.png HTTP/1.1" 200 -
127.0.0.1 - - [18/Aug/2021 16:03:25] "GET /analysis.json HTTP/1.1" 200 -
127.0.0.1 - - [18/Aug/2021 16:03:26] "GET /manifest.json HTTP/1.1" 200 -
127.0.0.1 - - [18/Aug/2021 16:03:26] "GET /logo192.png HTTP/1.1" 200 -