Show HN: Kiln – AI Boilerplate with Evals, Fine-Tuning, Synthetic Data, and Git
Show HN (score: 5)Description
Kiln is a free, open tool that gives you everything most AI projects need in one integrated package:
- Eval system: including LLM-as-judge evals, eval data generation, human baselines
- Fine-tuning: proxy to many fine-tuning providers like Fireworks/Together/OpenAI/Unsloth
- Synthetic data generation: deeply integrated into evals and fine-tuning
- Model routing: 12 providers including Ollama, OpenRouter, and more
- Git-based collaboration: projects are designed to be synced through your own git server
The key insight is that these tools work much better when they're integrated. For example, the synthetic data generator knows whether you're creating data for evals vs. fine-tuning (which have very different data needs), and evals can automatically test different prompt/model/fine-tune combinations.
It runs entirely locally - your project data stays in local files, and you control your own git repos. No external services required (though it integrates with them if you want).
Main project GitHub: https://github.com/Kiln-AI/Kiln
Demo GitHub where I use it to build a 'natural language to ffmpeg command' demo with evals, fine-tunes, and synthetic data (including demo video): https://github.com/Kiln-AI/demos/blob/main/end_to_end_projec...
More from Show
Show HN: SmokeVPN – All-in-One WireGuard VPN Hub – Switch Exits in Realtime
Show HN: SmokeVPN – All-in-One WireGuard VPN Hub – Switch Exits in Realtime I have started developing a prototype of a WireGuard VPN hub, where I could set a custom exit to a specific device, for example, my TV box would use a VPN in Germany, while my desktop a VPN is Serbia and I could switch the exit in realtime without having to stop the VPN connections and consequently no disconnections (ssh, etc).<p>The project grew, and I ended up adding SOCKS5 and HTTP proxy, Tor exits, exit pools, random exits, timed exits, and exits/routes based on domains or IP addresses. I also added an in-house DNS with several default block lists (malware, gambling, social media, etc.)<p>I found this project to have potential and decided to commercialize it, Smoke VPN was born.<p>The logs live entirely on the RAM, and I plan to open-source the full stack as soon as I get feedback from real users, people like you...<p>Can you please try the project for free for 7 days or 50 GB (whichever comes first)?<p>You don't need an account, email or password and you can add up to 10 devices.<p>Real feedback is truly welcome!
No other tools from this source yet.