❗️ Look for the red arrow

It’s pointing to <LocalChat /> — a little experiment I’ve been working on. It’s a React component you can drop into your own app. When loaded, it runs a small language model in your browser, using 🤗 Transformers.js and ONNX Runtime Web. It also loads the content of this website, so you can ask it questions about what you see.

You can try different small models, all running client-side with zero server costs.

Credits:

• Transformers.js-examples for the groundwork
• The chat-shadcn component for the UI
• Niantic’s Small Agents video for the inspiration