All writing

Posts tagged #llm

3 posts

  • Coming soon to Google Play

    BabbleScribe: Private Voice Typing for Android

    I talk faster than I type, and I did not want every sentence going to someone else's server. So I built BabbleScribe: private voice typing for Android that runs on your phone, on your own server, or on a cloud key you bring, with your history encrypted on the device. It is heading to Google Play.

    7 min read 0 0
  • AI Agents & SQL

    Teaching My Chat App to Query Databases — A Dual-Model Text-to-SQL Agent

    How I built a local text-to-SQL agent using two specialized models — Gemma3 for conversation and Qwen3 for tool calling — replacing the tedious SSH-psql-query workflow with natural language questions. Everything runs locally, nothing leaves my server.

    9 min read 0 0
  • LLM Systems

    Building an AI Chat System with Practical Memory, Search, and Multimodal Intelligence

    A behind-the-scenes engineering deep dive into building a production AI chat system. Memory management, context compression, web search integration, and the infrastructure decisions that make it work.

    8 min read 0 0