adeelahmad commited on
Commit
ec0416e
·
verified ·
1 Parent(s): f83cd16

Add files using upload-large-folder tool

Browse files
README.md CHANGED
@@ -1,19 +1,4 @@
1
  ---
2
- tags:
3
- - facebook
4
- - meta
5
- - pytorch
6
- - llama
7
- - llama-3
8
- - mlx
9
- - mlx
10
- - reasoning
11
- - llama
12
- - deepseek
13
- - ollama
14
- - chain-of-thoughts
15
- - small-llm
16
- - edge
17
  base_model: mlx-community/Llama-3.2-3B-Instruct
18
  language:
19
  - en
@@ -27,6 +12,14 @@ language:
27
  library_name: transformers
28
  license: llama3.2
29
  pipeline_tag: text-generation
 
 
 
 
 
 
 
 
30
  extra_gated_prompt: "### LLAMA 3.2 COMMUNITY LICENSE AGREEMENT\n\nLlama 3.2 Version\
31
  \ Release Date: September 25, 2024\n\n“Agreement” means the terms and conditions\
32
  \ for use, reproduction, distribution and modification of the Llama Materials set\
@@ -153,7 +146,7 @@ extra_gated_prompt: "### LLAMA 3.2 COMMUNITY LICENSE AGREEMENT\n\nLlama 3.2 Vers
153
  \ overburden, interfere with or impair the proper working, integrity, operation\
154
  \ or appearance of a website or computer system\n 7. Engage in any action, or\
155
  \ facilitate any action, to intentionally circumvent or remove usage restrictions\
156
- \ or other safety measures, or to enable functionality disabled by Meta \n2. Engage\
157
  \ in, promote, incite, facilitate, or assist in the planning or development of activities\
158
  \ that present a risk of death or bodily harm to individuals, including use of Llama\
159
  \ 3.2 related to the following:\n 8. Military, warfare, nuclear industries or\
@@ -174,7 +167,7 @@ extra_gated_prompt: "### LLAMA 3.2 COMMUNITY LICENSE AGREEMENT\n\nLlama 3.2 Vers
174
  \ without consent, authorization, or legal right\n 18. Representing that the\
175
  \ use of Llama 3.2 or outputs are human-generated\n 19. Generating or facilitating\
176
  \ false online engagement, including fake reviews and other means of fake online\
177
- \ engagement \n4. Fail to appropriately disclose to end users any known dangers\
178
  \ of your AI system 5. Interact with third party tools, models, or software designed\
179
  \ to generate unlawful content or engage in unlawful or harmful conduct and/or represent\
180
  \ that the outputs of such tools, models, or software are associated with Meta or\
@@ -214,46 +207,31 @@ extra_gated_description: The information you provide will be collected, stored,
214
  and shared in accordance with the [Meta Privacy Policy](https://www.facebook.com/privacy/policy/).
215
  extra_gated_button_content: Submit
216
  ---
217
- # ReasonableLlama-3B: A Fine-Tuned Reasoning Model
218
-
219
- HF: https://huggingface.co/adeelahmad/ReasonableLlama3-3B-Jr
220
- Ollama: https://ollama.com/adeelahmad/ReasonableLLAMA-Jr-3b
221
-
222
 
223
- Welcome to **ReasonableLlama-3B**, a cutting-edge reasoning model built on the foundation of LLaMA-3B. This model has been carefully fine-tuned to enhance its capabilities in logical
224
- thinking, problem-solving, and creative analysis.
225
 
226
- ## Overview
227
- - **Model Name**: ReasonableLlama-3B
228
- - **Base Architecture**: LLaMA-3B (Large Language Model with 3B parameters)
229
- - **Purpose**: Designed for tasks requiring advanced reasoning, problem-solving, and creative thinking
230
 
231
- ## Features
232
- - **Advanced Reasoning**: Excels in logical analysis, problem-solving, and decision-making.
233
- - **Creative Thinking**: Generates innovative solutions and ideas.
234
- - **Curriculum-Based Fine-Tuning**: Trained on high-quality datasets to enhance reasoning abilities.
235
 
236
- ## Technical Details
237
- - **Parameter Count**: 3B parameters
238
- - **Training Process**: Fine-tuned using state-of-the-art techniques for reasoning tasks
239
- - **Specialization**: Optimized for specific reasoning workflows and scenarios
240
 
241
- ## Use Cases
242
- - **Research**: Facilitates complex problem-solving and theoretical analysis.
243
- - **Education**: Assists in creating educational examples and problem sets.
244
- - **Problem Solving**: Helps generate innovative solutions across various domains.
245
 
246
- ## Installation and Usage
247
- - **Integration**: Can be integrated into existing systems via APIs or local setup.
248
- - **Inputs**: Supports text and images, leveraging Ollama's versatile capabilities.
249
 
250
- ## Limitations
251
- - **Scope**: Limited to single-step reasoning; multi-hop reasoning is a current focus area.
252
- - **Data Bias**: Caution with dataset provenance as it may reflect historical biases.
253
 
254
- ## Contributing
255
- Contributions welcome! Fork the project, submit issues, and pull requests on GitHub. Your insights can help shape future improvements.
 
 
 
256
 
257
- ## Citations
258
- - Special thanks to LLaMA's developers for providing a strong foundation.
259
- - Acknowledgments to the community contributing to open-source AI advancements.
 
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  base_model: mlx-community/Llama-3.2-3B-Instruct
3
  language:
4
  - en
 
12
  library_name: transformers
13
  license: llama3.2
14
  pipeline_tag: text-generation
15
+ tags:
16
+ - facebook
17
+ - meta
18
+ - pytorch
19
+ - llama
20
+ - llama-3
21
+ - mlx
22
+ - mlx
23
  extra_gated_prompt: "### LLAMA 3.2 COMMUNITY LICENSE AGREEMENT\n\nLlama 3.2 Version\
24
  \ Release Date: September 25, 2024\n\n“Agreement” means the terms and conditions\
25
  \ for use, reproduction, distribution and modification of the Llama Materials set\
 
146
  \ overburden, interfere with or impair the proper working, integrity, operation\
147
  \ or appearance of a website or computer system\n 7. Engage in any action, or\
148
  \ facilitate any action, to intentionally circumvent or remove usage restrictions\
149
+ \ or other safety measures, or to enable functionality disabled by Meta \n2. Engage\
150
  \ in, promote, incite, facilitate, or assist in the planning or development of activities\
151
  \ that present a risk of death or bodily harm to individuals, including use of Llama\
152
  \ 3.2 related to the following:\n 8. Military, warfare, nuclear industries or\
 
167
  \ without consent, authorization, or legal right\n 18. Representing that the\
168
  \ use of Llama 3.2 or outputs are human-generated\n 19. Generating or facilitating\
169
  \ false online engagement, including fake reviews and other means of fake online\
170
+ \ engagement \n4. Fail to appropriately disclose to end users any known dangers\
171
  \ of your AI system 5. Interact with third party tools, models, or software designed\
172
  \ to generate unlawful content or engage in unlawful or harmful conduct and/or represent\
173
  \ that the outputs of such tools, models, or software are associated with Meta or\
 
207
  and shared in accordance with the [Meta Privacy Policy](https://www.facebook.com/privacy/policy/).
208
  extra_gated_button_content: Submit
209
  ---
 
 
 
 
 
210
 
211
+ # adeelahmad/ReasonableLlama3-3B-Jr
 
212
 
213
+ The Model [adeelahmad/ReasonableLlama3-3B-Jr](https://huggingface.co/adeelahmad/ReasonableLlama3-3B-Jr) was
214
+ converted to MLX format from [mlx-community/Llama-3.2-3B-Instruct](https://huggingface.co/mlx-community/Llama-3.2-3B-Instruct)
215
+ using mlx-lm version **0.21.4**.
 
216
 
217
+ ## Use with mlx
 
 
 
218
 
219
+ ```bash
220
+ pip install mlx-lm
221
+ ```
 
222
 
223
+ ```python
224
+ from mlx_lm import load, generate
 
 
225
 
226
+ model, tokenizer = load("adeelahmad/ReasonableLlama3-3B-Jr")
 
 
227
 
228
+ prompt = "hello"
 
 
229
 
230
+ if tokenizer.chat_template is not None:
231
+ messages = [{"role": "user", "content": prompt}]
232
+ prompt = tokenizer.apply_chat_template(
233
+ messages, add_generation_prompt=True
234
+ )
235
 
236
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
237
+ ```
 
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5917c365205f5ba3eef61aeafe7b8e74cdb58b92d9a6c76cc6232cf75db7c396
3
  size 5368424925
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bbdd2a6974d2df44cd93567dbde3e72deed6651b49394bbd2535675002485a1
3
  size 5368424925
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6745b30770b1d8be47bdfcc3d168d22a2fac4ed19d0fdc3427b2a33dc3539c5c
3
  size 2466389976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea7d43db459f43a7c7b6bf291ca5b41dd1dc61abdf922053cac06e759689f088
3
  size 2466389976