Description
More from Hacker
Show HN: WebGPU enables local LLM in the browser – demo site with AI chat
Show HN: WebGPU enables local LLM in the browser – demo site with AI chat Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android.<p>Demo, similar to ChatGPT <a href="https://andreinwald.github.io/browser-llm/" rel="nofollow">https://andreinwald.github.io/browser-llm/</a><p>Code <a href="https://github.com/andreinwald/browser-llm">https://github.com/andreinwald/browser-llm</a><p>- No need to use your OPENAI_API_KEY - its local model that runs on your device<p>- No network requests to any API<p>- No need to install any program<p>- No need to download files on your device (model is cached in browser)<p>- Site will ask before downloading large files (llm model) to browser cache<p>- Hosted on Github Pages from this repo - secure, because you see what you are running
No other tools from this source yet.