ibm-granite/granite-3.2-2b-instruct
#2
by
tomasmcm
- opened
Can you convert the new version of this model (ibm-granite/granite-3.2-2b-instruct) to ONNX?
I tried using https://huggingface.co/spaces/onnx-community/convert-to-onnx but I got this error:
Conversion failed:
Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards: 50%|█████ | 1/2 [00:07<00:07, 7.45s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00, 3.25s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00, 3.88s/it]
/usr/local/lib/python3.10/site-packages/transformers/models/granite/modeling_granite.py:745:
TracerWarning: Converting a tensor to a Python boolean might cause the trace to be incorrect.
We can't record the data flow of Python values, so this value will be treated as a constant in the future.
This means that the trace might not generalize to other inputs! if sequence_length != 1: