mergekit-community
/

LLaMa-3.1-13B

Text Generation

text-generation-inference

Model card Files Files and versions Community

LLaMa-3.1-13B / mergekit_config.yml

chargoddard's picture

Upload folder using huggingface_hub

b8b6777 verified 5 months ago

history blame contribute delete

345 Bytes

	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 24]
	model: unsloth/Meta-Llama-3.1-8B
	- sources:
	- layer_range: [12, 24]
	model: unsloth/Meta-Llama-3.1-8B
	- sources:
	- layer_range: [13, 24]
	model: unsloth/Meta-Llama-3.1-8B
	- sources:
	- layer_range: [24, 32]
	model: unsloth/Meta-Llama-3.1-8B