jasonyao.dev

AI Engineer · Toronto, Canada

Hi, I'm Jason.
I ship code that
teams run in prod.

I build agentic systems end to end — and land merged PRs in the open-source infra that thousands of teams depend on.

My background spans machine learning and backend systems engineering — Python, Java/Spring Boot, TypeScript. Since 2023, I've focused on AI engineering: multi-agent orchestration, agentic workflows, and the plumbing that keeps them reliable. I also ship consumer apps solo, idea to store.

Experience
7 years·software, ML & AI
Merged into
Apache Dubbo·Nacos·Spring AI
Based in Toronto
Work-authorized·no sponsorship
What I do

I treat AI engineering as a systems problem, not a prompt problem.

The interesting work is making LLMs reliable: orchestrating multiple agents, designing the control loops and state around them, and building the infrastructure so the whole thing holds up under real load. I run a heavily customized multi-session agent workflow over a FastAPI/SQLite control dashboard — the kind of tooling that turns a clever demo into something you can actually depend on.

That instinct isn't incidental — it's a master's in systems design with an AI focus, plus seven years shipping production software: machine learning, backend engineering (TypeScript/NestJs, Java/Spring Boot), and now production LLM systems. The same instinct shows up in open source, where I contribute fixes to the infrastructure other people build on.

Live demos
Experience

From ML to systems, and back to AI.

Seven years, with AI at both ends. I started as a machine-learning engineer, went deep on backend systems, then came back to AI — building with LLMs in production back in 2024, before "agent" was a job title.

Full-Stack AI Engineer Production AI
2025 — Present
Donkey Tech · Remote

Brought real-time voice AI to a live-streaming platform — integrating an LLM with text-to-speech and speech-to-text, live in production.

Full-Stack AI Engineer Production AI
2024 — 2025
Jade Tour · Toronto

Built the core ticketing engine, and integrated LLM function calling + RAG into the product — production AI on a live revenue system, not a demo.

Software Engineer
2020 — 2023
Sino Soft · Beijing, China

Backend & full-stack engineering — Java/Spring Boot, JavaScript. Built large-scale systems for major banks and insurers — high-traffic, high-stakes, reliability-first.p>

Machine Learning Engineer ML
2019 — 2020
Digital Processing Lab · DeKalb, USA

Where it started — a year building machine-learning models and pipelines. One line on what you trained or shipped.

Open source

Merged, not "side projects."

Real code, reviewed and merged into projects teams run in production — from Apache infrastructure to the LLM tooling the AI ecosystem builds on. Every card links to the PR; all public and verifiable.

AI agent tooling & Production infrastructure

Plus a few more merged across these repos.

Things I build

Shipped solo — idea to store.

A spread of consumer apps, on-device CV/ML experiments, and dev tooling. I design, build, and ship them myself, often coordinating parallel agent workflows to move faster.

Merchant Bookkeeping进销存 · small-merchant POS

Building

Offline-first bookkeeping for small merchants. Thumb-zone POS layout, triple-coded status indicators, dual local/cloud sync.

Flutter · Supabase · Riverpod

AR Filterreal-time face AR

R&D

Real-time augmented-reality camera filters — live face tracking with overlays and effects, running on-device.

MediaPipe · OpenCV · on-device

AI Keyboard恋爱键盘 · Chinese IME

R&D

AI-assisted Chinese input method exploring an on-device / server LLM split, built on RIME/Trime architecture.

RIME · Trime · on-device LLM

Posture Detection体态检测 · pose estimation

R&D

Real-time body-posture analysis from a live camera feed — pose estimation that detects and flags posture on the fly.

MediaPipe Pose · OpenCV

Multi-Agent Orchestratoragentic dev tooling

Tooling

A multi-session agent workflow with a FastAPI/SQLite control dashboard for managing parallel coding sessions — the backbone behind how I build everything above.

Python · FastAPI · SQLite · agent orchestration
Stack
AI Engineering
Multi-agent orchestration Agentic workflows LangChain LangGraph RAG
Backend
TypeScript Java Spring Boot Python FastAPI
Frontend / Mobile
TypeScript Vue React Flutter
Practice
Open-source contribution System design Solo product shipping
Contact
Open to AI Engineer roles

Let's build something reliable.

I'm looking for AI Engineer roles in Canada — work-authorized, no sponsorship needed. Also open to collaborating on agentic tooling or consumer apps.