OPEA
/

Meta-Llama-3.1-405B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Meta-Llama-3.1-405B-Instruct-int4-sym-inc

2 contributors

History: 3 commits

wenhuach's picture

change to fp16

417447c 3 months ago