Tagged "gguf-quantization"
- Show HN: GGUFun, Play Snake and a Simple Maze on Ollama Using Hand Crafted GGUFs
- Unsloth Completes Comprehensive MiniMax M2.7 GGUF Quantization Suite
- Quantization Strategy Comparison: Balancing Quality and Speed on Consumer Laptops
- Google Gemma 4 Released with GGUF Quantizations
- Coding Implementation to Run Qwen3.5 Reasoning Models Distilled With Claude-Style Thinking Using GGUF and 4-Bit Quantization
- Qwen3.5-35B Unsloth Dynamic GGUFs Achieve SOTA Across Nearly All Quantisation Levels
- MiniMax-M2.5 230B MoE Model Released with GGUF Support for Local Deployment