/Users/mosherecanati/dev/local_star_coder/venv/lib/python3.9/site-packages/transformers/generation/utils.py:1369: UserWarning: Using `max_length`'s default (20) to control the generation length. This behaviour is deprecated and will be removed from the config in v5 of Transformers -- we recommend using `max_new_tokens` to control the maximum length of the generation.
  warnings.warn(
/Users/mosherecanati/dev/local_star_coder/venv/lib/python3.9/site-packages/transformers/generation/utils.py:1468: UserWarning: You are calling .generate() with the `input_ids` being on a device type different than your model's device. `input_ids` is on mps, whereas the model is on cpu. You may experience unexpected behaviors or slower generation. Please make sure that you have put `input_ids` to the correct device by calling for example input_ids = input_ids.to('cpu') before running `.generate()`.
  warnings.warn(
Traceback (most recent call last):
  File "/Users/mosherecanati/dev/local_star_coder/main.py", line 62, in <module>
    connect_to_star_coder()
  File "/Users/mosherecanati/dev/local_star_coder/main.py", line 56, in connect_to_star_coder
    outputs = model.generate(inputs)
  File "/Users/mosherecanati/dev/local_star_coder/venv/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/Users/mosherecanati/dev/local_star_coder/venv/lib/python3.9/site-packages/transformers/generation/utils.py", line 1538, in generate
    return self.greedy_search(
  File "/Users/mosherecanati/dev/local_star_coder/venv/lib/python3.9/site-packages/transformers/generation/utils.py", line 2359, in greedy_search
    model_inputs = self.prepare_inputs_for_generation(input_ids, **model_kwargs)
  File "/Users/mosherecanati/dev/local_star_coder/venv/lib/python3.9/site-packages/transformers/models/gpt_bigcode/modeling_gpt_bigcode.py", line 752, in prepare_inputs_for_generation
    position_ids = attention_mask.long().cumsum(-1) - 1
RuntimeError: MPS does not support cumsum op with int64 input