AUTOMATION
Finetune Needle on Custom Tool Sets
Adapt Needle's 26M model to your specific tools and use cases
Updated: 5/13/2026
Difficulty
medium
Time
2-4 hours
Use Case
Customize Needle for domain-specific tool calling (smart home, messaging, navigation, etc.) on consumer devices
Popularity
0 views
About this automation
Use Needle's playground and finetuning pipeline to adapt the 26M parameter model to your custom tool categories. Needle was trained on 15 tool categories (timers, messaging, navigation, smart home) via Gemini synthesis, and the architecture supports easy finetuning on Mac/PC.
How to implement
1
Clone Needle repository from GitHub (cactus-compute/needle)
2
Define your custom tool schemas in JSON format
3
Synthesize or prepare function-calling training data (2B tokens of examples recommended)
4
Run finetuning on consumer hardware (Mac/PC) using provided scripts
5
Test on Needle playground with your tools
6
Deploy to target device (phone, watch, glasses) via Cactus inference engine