PS C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private> python launcher.py properties_DDR.json
2022-10-01 19:49:36,830 INFO root: Submission status None
2022-10-01 19:49:36,832 INFO root: Need submission. Let's run the pipeline
2022-10-01 19:49:36,855 INFO root: *** DOWNLOADING PHASE...
2022-10-01 19:49:36,855 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-01 19:49:37,263 INFO root: Number of eligible tickers: 5111
2022-10-01 19:49:37,281 INFO root: Downloading data for 5111 tickers
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-01 19:49:37,286 INFO root: Downloading 750
100%|█████████████████████████████████████████████████████████████████████████| 750/750 [2:04:54<00:00,  9.99s/tickers]
2022-10-01 21:54:35,859 INFO root: Number of tickers to remove due bad data 8
2022-10-01 21:54:47,756 INFO root: Downloading 750
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 750/750 [1:08:24<00:00,  5.47s/tickers]
2022-10-01 23:03:16,258 INFO root: Number of tickers to remove due bad data 29
2022-10-01 23:03:28,887 INFO root: Downloading 750
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 750/750 [1:16:42<00:00,  6.14s/tickers]
2022-10-02 00:20:15,160 INFO root: Number of tickers to remove due bad data 17
2022-10-02 00:20:27,245 INFO root: Downloading 750
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 750/750 [1:08:04<00:00,  5.45s/tickers]
2022-10-02 01:28:35,734 INFO root: Number of tickers to remove due bad data 16
2022-10-02 01:28:47,976 INFO root: Downloading 750
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 750/750 [1:07:11<00:00,  5.38s/tickers]
2022-10-02 02:36:03,878 INFO root: Number of tickers to remove due bad data 11
2022-10-02 02:36:15,954 INFO root: Downloading 750
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 750/750 [1:06:29<00:00,  5.32s/tickers]
2022-10-02 03:42:49,492 INFO root: Number of tickers to remove due bad data 17
2022-10-02 03:43:01,301 INFO root: Downloading 611
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 611/611 [56:54<00:00,  5.59s/tickers]
2022-10-02 04:39:58,646 INFO root: Number of tickers to remove due bad data 16
2022-10-02 04:40:08,157 INFO root: *** CREATING CUSTOM TARGET... [currently not used]
2022-10-02 04:42:19,027 INFO root: *** CREATING INDICATORS...
2022-10-02 04:42:29,392 INFO root: Found 8 cpus
  0%|                                                                                                                                                                                                              | 0/4785 [00:00<?, ?it/s]2022-10-02 04:42:40,112 INFO root: Submission status None
2022-10-02 04:42:40,113 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,118 INFO root: Submission status None
2022-10-02 04:42:40,120 INFO root: Submission status None
2022-10-02 04:42:40,125 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,126 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,127 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,127 INFO root: Submission status None
2022-10-02 04:42:40,131 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,133 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,137 INFO root: Submission status None
2022-10-02 04:42:40,138 INFO root: Submission status None
2022-10-02 04:42:40,139 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,140 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,140 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,141 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,142 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,144 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,151 INFO root: Submission status None
2022-10-02 04:42:40,151 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,154 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,154 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,154 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,154 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,155 INFO root: Submission status None
2022-10-02 04:42:40,155 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,155 INFO root: Submission status None
2022-10-02 04:42:40,156 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,157 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,157 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,159 INFO root: Submission status None
2022-10-02 04:42:40,157 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,159 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,159 INFO root: Submission status None
2022-10-02 04:42:40,159 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,167 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,168 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,168 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,169 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,169 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,170 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,170 INFO root: Submission status None
2022-10-02 04:42:40,171 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,171 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,172 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,172 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,174 INFO root: Submission status None
2022-10-02 04:42:40,174 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,174 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,174 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,174 INFO root: Submission status None
2022-10-02 04:42:40,175 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,177 INFO root: Submission status None
2022-10-02 04:42:40,178 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,180 INFO root: Submission status None
2022-10-02 04:42:40,184 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,184 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,185 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:40,186 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,186 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,187 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,187 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:40,187 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:40,187 INFO root:  Recreated folder data\db_raw_downloaded from scratch
Traceback (most recent call last):
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "<string>", line 1, in <module>
  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 116, in spawn_main
  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 125, in _main
    exitcode = _main(fd, parent_sentinel)
  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 125, in _main
    prepare(preparation_data)
    prepare(preparation_data)
  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 236, in prepare
  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 236, in prepare
        _fixup_main_from_path(data['init_main_from_path'])_fixup_main_from_path(data['init_main_from_path'])

  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 287, in _fixup_main_from_path
  File "C:\Program Files\Python310\lib\multiprocessing\spawn.py", line 287, in _fixup_main_from_path
        main_content = runpy.run_path(main_path,main_content = runpy.run_path(main_path,

  File "C:\Program Files\Python310\lib\runpy.py", line 289, in run_path
  File "C:\Program Files\Python310\lib\runpy.py", line 289, in run_path
    return _run_module_code(code, init_globals, run_name,
return _run_module_code(code, init_globals, run_name,  File "C:\Program Files\Python310\lib\runpy.py", line 96, in _run_module_code

      File "C:\Program Files\Python310\lib\runpy.py", line 96, in _run_module_code
_run_code(code, mod_globals, init_globals,
      File "C:\Program Files\Python310\lib\runpy.py", line 86, in _run_code
_run_code(code, mod_globals, init_globals,
exec(code, run_globals)  File "C:\Program Files\Python310\lib\runpy.py", line 86, in _run_code

      File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\launcher.py", line 93, in <module>
exec(code, run_globals)
  File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\launcher.py", line 93, in <module>
        run_full_pipline(data_config, submission_config)run_full_pipline(data_config, submission_config)

  File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\launcher.py", line 54, in run_full_pipline
  File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\launcher.py", line 54, in run_full_pipline
        yahoo_data.download_data(paths.db_raw, data_config)yahoo_data.download_data(paths.db_raw, data_config)

  File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py", line 98, in download_data
  File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py", line 98, in download_data
        ticker_data = get_ticker_data(db_dir) #from my folderticker_data = get_ticker_data(db_dir) #from my folder

  File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\utils\utils.py", line 27, in get_ticker_data
  File "C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\utils\utils.py", line 27, in get_ticker_data
    if len(list(db_dir.rglob('*.parquet'))) > 0:
      File "C:\Program Files\Python310\lib\pathlib.py", line 1047, in rglob
if len(list(db_dir.rglob('*.parquet'))) > 0:
  File "C:\Program Files\Python310\lib\pathlib.py", line 1047, in rglob
    for p in selector.select_from(self):
for p in selector.select_from(self):  File "C:\Program Files\Python310\lib\pathlib.py", line 492, in _select_from

      File "C:\Program Files\Python310\lib\pathlib.py", line 492, in _select_from
for starting_point in self._iterate_directories(parent_path, is_dir, scandir):    for starting_point in self._iterate_directories(parent_path, is_dir, scandir):

  File "C:\Program Files\Python310\lib\pathlib.py", line 471, in _iterate_directories
  File "C:\Program Files\Python310\lib\pathlib.py", line 471, in _iterate_directories
        with scandir(parent_path) as scandir_it:with scandir(parent_path) as scandir_it:
FileNotFoundError
FileNotFoundError: : [WinError 3] The system cannot find the path specified: 'data\\db_raw_downloaded'[WinError 3] The system cannot find the path specified: 'data\\db_raw_downloaded'

2022-10-02 04:42:40,473 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,488 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,489 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,491 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,491 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,507 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,508 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,515 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,517 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,522 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,529 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,534 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,540 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,541 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,545 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:40,578 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,561 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,566 INFO root: Downloading data for 5111 tickers
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,620 INFO root: Downloading 750
2022-10-02 04:42:40,590 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,594 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,599 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,548 INFO root: Downloading data for 5111 tickers
  0%|                                                                                                                                                                                                          | 0/750 [00:00<?, ?tickers/s]2022-10-02 04:42:40,605 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,639 INFO root: Downloading data for 5111 tickers
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,619 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:40,585 INFO root: Downloading data for 5111 tickers
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,604 INFO root: Downloading data for 5111 tickers
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,613 INFO root: Downloading data for 5111 tickers
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,647 INFO root: Downloading 750
2022-10-02 04:42:40,649 INFO root: Downloading 750
2022-10-02 04:42:40,650 INFO root: Downloading 750
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,658 INFO root: Downloading 750
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,664 INFO root: Downloading 750
2022-10-02 04:42:40,665 INFO root: Downloading 750
2022-10-02 04:42:40,667 INFO root: Downloading 750
2022-10-02 04:42:40,667 INFO root: Downloading 750
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:40,685 INFO root: Downloading 750
2022-10-02 04:42:40,691 INFO root: Downloading 750
  0%|                                                                                                                                                                                                          | 0/750 [00:00<?, ?tickers/s]2022-10-02 04:42:40,697 INFO root: Downloading 750
2022-10-02 04:42:40,698 INFO root: Downloading 750
  0%|                                                                                                                                                                                                          | 0/750 [00:00<?, ?tickers/s]2022-10-02 04:42:40,701 INFO root: Downloading 750
  0%|▌                                                                                                                                                                                                 | 2/750 [00:08<46:45,  3.75s/tickers]2022-10-02 04:42:50,063 INFO root: Submission status None
2022-10-02 04:42:50,064 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:50,066 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:50,072 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:50,080 INFO root: Submission status None
2022-10-02 04:42:50,081 INFO root: Need submission. Let's run the pipeline
2022-10-02 04:42:50,082 INFO root: *** DOWNLOADING PHASE...
2022-10-02 04:42:50,082 INFO root:  Recreated folder data\db_raw_downloaded from scratch
2022-10-02 04:42:50,303 INFO root: Number of eligible tickers: 5111
2022-10-02 04:42:50,322 INFO root: Downloading data for 5111 tickers
2022-10-02 04:42:50,324 INFO root: Number of eligible tickers: 5111
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:50,327 INFO root: Downloading 750
  0%|                                                                                                                                                                                                          | 0/750 [00:00<?, ?tickers/s]2022-10-02 04:42:50,337 INFO root: Downloading data for 5111 tickers
C:\Users\liz\iCloudDrive\code\numerai_signals_pipeline_private\app\providers\downloader_yahoo.py:114: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.
  for start_date, tickers_str in ticker_missing_grouped.iteritems():
2022-10-02 04:42:50,341 INFO root: Downloading 750
 39%|███████████████████████████████████████████████████████████████████████████▎                                                                                                                    | 294/750 [50:19<27:37,  3.64s/tickers]