Upload folder using huggingface_hub (#1)

- da4f3c0863366284cc38726b4262b0edb105ad55f65006cf3bd3979b2a6b8aec (5966940352f10053e1f5c3aa4dc57af637396d50)
- a5a387d6d48bd9f4e1fa4ef922dfced62c38f837e5762fae5a7ec208ff1593b8 (69389d772c37c04b5557f5ee8d152b1173f22cd5)
- 04ac17cdc15b864439d32f55bdf3d79ba4391460149afae0d31e55a76ae13460 (443b707c8c077d85edb7869996bf9c442ceeb3da)
- 1c799622d9a32ffb9ed3b9598f4419fe3d68dfdea91f4e3237e961e24d0a3902 (50bcc518f8e0cabeae14bae10fbd5c66823dbd53)
- 75524dda1d12dd279f0a14a0c4a37c9277e307a9798400022e290987b64153a5 (324abf6f08d7aeed824f296620c07191326e7095)
- 62a3716f865ab77102060e1aaeaa68e5564e7a5486a9b92b380ebfcb8896cfe5 (c4675d053894119ab128da4cac080bb8d58ab454)

.gitattributes

@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Peach-2.0-9B-8k-Roleplay.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Peach-2.0-9B-8k-Roleplay.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Peach-2.0-9B-8k-Roleplay.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Peach-2.0-9B-8k-Roleplay.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+Peach-2.0-9B-8k-Roleplay.fp16.gguf filter=lfs diff=lfs merge=lfs -text

Peach-2.0-9B-8k-Roleplay.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:257b833650d3237e6d586673f8a6c0eecd80a40397e234b26a0f9f3478c6d8e8
+size 6258258624

Peach-2.0-9B-8k-Roleplay.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d88890b2cbc56a0f567f92a008182e8af0e8975111fa749cd52f41c32ba65a1c
+size 6107853504

Peach-2.0-9B-8k-Roleplay.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:50e6907991d750b3eaf3dcea1fe24215f1608fea0d2a23a890d5063e7f62ee8b
+size 7245640384

Peach-2.0-9B-8k-Roleplay.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32437ba0f13acb52b7e281a6df1fef6a4ec9e730c40b10437400cf9ced0da657
+size 9383916224

Peach-2.0-9B-8k-Roleplay.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b67ab3093a4c4924e3f34a18e6bf50e21611b234e84bafbb2cda1408c7cec0ac
+size 17661112960

README.md

@@ -0,0 +1,46 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+- text-generation
+model_name: Peach-2.0-9B-8k-Roleplay-GGUF
+base_model: ClosedCharacter/Peach-2.0-9B-8k-Roleplay
+inference: false
+model_creator: ClosedCharacter
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF](https://huggingface.co/MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF)
+- Model creator: [ClosedCharacter](https://huggingface.co/ClosedCharacter)
+- Original model: [ClosedCharacter/Peach-2.0-9B-8k-Roleplay](https://huggingface.co/ClosedCharacter/Peach-2.0-9B-8k-Roleplay)
+
+## Description
+[MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF](https://huggingface.co/MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF) contains GGUF format model files for [ClosedCharacter/Peach-2.0-9B-8k-Roleplay](https://huggingface.co/ClosedCharacter/Peach-2.0-9B-8k-Roleplay).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.