Pre-quantized Weights for Mistral-7B-Instruct
This hosts the files from https://catalog.ngc.nvidia.com/orgs/nvidia/models/mistral-7b-int4-chat/files?version=1.1 for easy programmatic access.
This hosts the files from https://catalog.ngc.nvidia.com/orgs/nvidia/models/mistral-7b-int4-chat/files?version=1.1 for easy programmatic access.