Skip to content

gguf-quantization

from Orchestra-Research/AI-research-SKILLs

GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU re

v1.0.0MIT
428
Lines
1,351
Words
20
Code Blocks

Languages

bashpython
10-optimization/gguf/SKILL.md