Skip to content
View alexe-ev's full-sized avatar
πŸš€
Building AI tools for product teams
πŸš€
Building AI tools for product teams

Block or report alexe-ev

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
alexe-ev/README.md

Hey, I'm Evgeny πŸ‘‹

Every AI product has two lives. The first is the demo: a hand-picked request, a strong model, an impressed room, and nobody asking what it cost. The second starts when real traffic arrives, and it runs on different fuel: cost per request, quality nobody is watching anymore, latency at the 99th percentile, a bill that grows faster than usage. Most teams prepare carefully for the first life and improvise the second.

I'm a product manager who builds the layer underneath AI products: the economics, evals, and decision infrastructure that decide whether they survive production. The full argument: After the Demo.

whisperly.io Β· LinkedIn Β· AI Economics series

In production

Whisperly is a paid macOS dictation app I build and run solo: it turns messy speech into clean, ready-to-send text. It is also where this layer gets tested on real users. The eval harness gates every release, and unit economics is a product constraint, so every model swap is a margin decision. Its open-source predecessor is Murmur.

The system

Every repo here started as a decision I needed a number for. Six stages, one direction:

The layer underneath AI products: economics β†’ evals β†’ routing β†’ impact β†’ skills β†’ production

ai-economics β†’ ai-ab-testing-tool β†’ multi-model-router β†’ ml-impact-calculator β†’ product-plugins β†’ whisperly.io

Text version
economics        β†’ evals         β†’ routing      β†’ impact           β†’ skills           β†’ production
what it costs    β†’ is it better  β†’ which model  β†’ quality to money β†’ repeatable work  β†’ where it survives

The research

AI Economics: 26 posts written March to May 2026, from token pricing through model selection and agent cost patterns to unit economics. The interactive calculator implements the math. Read the series or open the calculator.

Now

Shipping Whisperly for macOS, prototyping its iOS app, writing build-in-public essays on LinkedIn. Updated August 2026.

Contact

πŸ’¬ Telegram Β· πŸ’Ό LinkedIn

Pinned Loading

  1. multi-model-router multi-model-router Public

    Routes each prompt to the cheapest model that can handle it. Up to 80% lower LLM spend vs a single premium model. OpenAI-compatible API, three classifier strategies, YAML config.

    Python

  2. ai-economics ai-economics Public

    Interactive calculator for modeling AI feature costs: token pricing, optimization stacks, cascade routing, agent economics, and unit economics. Plus the AI Economics research series (26 posts).

    TypeScript

  3. ai-ab-testing-tool ai-ab-testing-tool Public

    A/B test LLM prompts and models with statistical evidence. Web UI + CLI.

    Python 1

  4. ml-impact-calculator ml-impact-calculator Public

    A PM's tool for ML threshold decisions β€” converts model metrics into daily error costs, support load, and churn impact.

    TypeScript

  5. product-plugins product-plugins Public

    Skill library for AI agents β€” 15 product domains, 121 skills. Tells the agent what to ask, how to reason, and what to output.