Edd's picture

Edd

Erland

·

AI & ML interests

None yet

Recent Activity

authored a paper about 23 hours ago

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

updated a model 1 day ago

Erland/gemma_without_embedding

published a model 1 day ago

Erland/gemma_without_embedding

View all activity

Organizations

Erland's activity

upvoted a paper 2 days ago

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

Paper • 2504.20966 • Published 3 days ago • 17

upvoted a paper 4 days ago

The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs

Paper • 2504.17768 • Published 8 days ago • 12

upvoted 2 collections 3 months ago

Mistral Small 3 (All Versions)

A collection of Mistral's new Small 3.1 and 3 models including GGUF, 4-bit and more! • 14 items • Updated 2 days ago • 8

DeepSeek R1 (All Versions)

DeepSeek R1 - the most powerful reasoning open-source model - available in GGUF, original & 4-bit formats. Includes Llama & Qwen distilled models. • 30 items • Updated 2 days ago • 220

upvoted 2 papers 4 months ago

rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking

Paper • 2501.04519 • Published Jan 8 • 276

Towards System 2 Reasoning in LLMs: Learning How to Think With Meta Chain-of-Though

Paper • 2501.04682 • Published Jan 8 • 97

upvoted a collection 4 months ago

Phi-4 (All Versions)

Microsoft's Phi-4 models including Reasoning + Reasoning Plus & mini. Includes Dynamic 2.0 GGUF, 4-bit & 16-bit versions. Includes Unsloth's bug fixes • 20 items • Updated 1 day ago • 67

upvoted a paper 4 months ago

LLaVA-Mini: Efficient Image and Video Large Multimodal Models with One Vision Token

Paper • 2501.03895 • Published Jan 7 • 53

upvoted 8 collections 5 months ago

4bit Instruct Models

18 items • Updated 2 days ago • 29

Qwen 2.5

32 items • Updated 2 days ago • 13

Load 4bit models 4x faster

Native bitsandbytes 4bit pre quantized models • 25 items • Updated 2 days ago • 57

Qwen 2.5 Coder

Complete collection of Code-specific model series for Qwen2.5 in bnb 4bit, 16bit and GGUF formats. • 35 items • Updated 2 days ago • 28

Llama 3.2 Vision

Meta's Llama 3.2 vision models 11B and 90B. Include 4-bit bnb and original versions. • 8 items • Updated 2 days ago • 7

Llama 3.2

Meta's new Llama 3.2 vision and text models including 1B, 3B, 11B and 90B. Includes GGUF, 4-bit bnb and original versions. • 27 items • Updated 2 days ago • 63

Vision/multimodal Models

Collection of the most popular vision models including Llama 3.2, LlaVa, Qwen2 VL, Pixtral, PaliGemma and more! • 25 items • Updated 2 days ago • 10

Unsloth 4-bit Dynamic Quants

Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit • 28 items • Updated 2 days ago • 79

upvoted a collection 7 months ago

LLM Reasoning Papers

Papers to improve reasoning capabilities of LLMs • 20 items • Updated Jan 15 • 122

upvoted 2 papers 8 months ago

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11, 2024 • 21

Attention Heads of Large Language Models: A Survey

Paper • 2409.03752 • Published Sep 5, 2024 • 90

upvoted an article 9 months ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14, 2024

• 62