huggingface-local-models
Picks models to run locally with llama.cpp and GGUF on CPU, Metal, CUDA or ROCm: finding GGUFs, quantization, local servers and conversion.
- Kind
- Skill
- Works with
- Claude Code
- Languages
- C / C++
- Source
- Hugging Face Skills @ 25910b3d0ba3
- Path
- skills/huggingface-local-models/SKILL.md
- Jobs
- Implementation
- Topics
- Machine learning
Credit
- Made by
- huggingface
- Original
- github.com/huggingface/skills/blob/25910b3d0ba31a2ba102f901cd…
- License
- Apache-2.0
Listed by Skill Manifest; not made by us.
InstallInstall it by hand, following the source.
hf skills add huggingface-local-models
Install factsScanned 2 Nov 2026
- Adds
- .claude/skills/huggingface-local-models/ (the skill folder)
- 3 file(s) the skill refers to
- Runs scripts
- Yes
- convert_hf_to_gguf.py
- shell block in the text
- Uses the network
- Yes
- installs system packages
- git clone / pull / push
- curl / wget
- Needs secrets
- None found
- Source revision
- 25910b3d0ba3
- Licence
- Apache-2.0
- Last activity
- 30 Oct 2026
- Review
- Reviewed
Found by a static scan of the stored text; nothing is run. “None found” is not a guarantee, so read what you install before you run it.
- Only the main file is read; other files in the folder are not scanned
# Hugging Face Local Models Search the Hugging Face Hub for llama.cpp-compatible GGUF repos, choose the right quant, and launch the model with `llama-cli` or `llama-server`. ## Default Workflow 1. Search the Hub with `apps=llama.cpp`. 2. Open `https://huggingface.co/<repo>?local-app=llama.cpp`. 3. Prefer the exact HF local-app snippet and quant recommendation when it is visible. 4. Confirm exact `.gguf` filenames with `https://huggingface.co/api/models/<repo>/tree/main?recursive=true`. 5. Launch with `llama-cli -hf <repo>:<QUANT>` or `llama-server -hf <repo>:<QUANT>`. 6. Fall back to `--hf-repo` plus `--hf-file` when the repo uses custom file naming. 7. Convert from Transformers weights only if the repo does not already expose GGUF files. ## Quick Start ### Install llama.cpp ```bash brew install llama.cpp winget install llama.cpp ``` ```bash git clone https://github.com/ggml-org/llama.cpp cd llama.cpp make ``` ### Authenticate for gated repos ```bash hf auth login ``` ### Search the Hub ```text https://huggingface.co/models?apps=llama.cpp&sort=trending https://huggingface.co/models?search=Qwen3.6&apps=llama.cpp&sort=trending …