TYRIEN JONES AI ENGINEER · FOREMAN
PORTFOLIO/L.I.LY
ECO’S LITTLE SISTER v0.16 · PAUSED

L.I.LY

A personal AI stack with a real safety crew.

RUNSLocal, my own PC
REACHED FROMYour phone
COMMITS159
BUILDMay – Jun 2026 · paused
SAFETY CREWWARD · KEEP · GATE
TESTED 609 TESTS
L.I.LY's chat on a phone-size screen: asked to help plan a workday, the demo character Juno lays out the quote first, site visits after lunch, the gym after, then asks one question about the quote's deadline.
CHAT
L.I.LY's menu: artifacts, contacts, model tier, attach file, new session, KEEP real-world support, credits and setup, admin with costs, character bio, and what's running underneath.
MENU · WHAT IT CAN DO
L.I.LY's first-launch screen: the character is an AI, not a person, therapist, doctor or lawyer; what stays on the device; what goes to Anthropic; and what WARD does when something serious comes up.
FIRST LAUNCH · SAFETY UP FRONT

The public build, at phone size · a demo character and a short test chat, not my own conversations

00 · IN PLAIN TERMS

L.I.LY is a personal AI you can use from your phone, anywhere. It runs on your own computer, but you’re not stuck at the desk to use it — you reach it from your pocket whenever you want.

It’s ECO’s little sister. Where ECO builds software, L.I.LY looks after you: your day, your habits, the hobby you’re picking up, your fitness, the things you’re learning and the people you mean to keep up with. You work with it hand in hand, by text or by voice, and it remembers. An assistant you get real work done with, and an aspiring mate you learn alongside.

Where it stands. Paused. AI is moving fast right now: laws, regulations and pricing change month to month. I’d rather put my time into software that isn’t held hostage by things I can’t control. L.I.LY stays parked until the ground settles.

01

The job

A personal AI system that runs local. I don’t call it a chatbot, a persona, or a character — I treat it as its own category, what I call an AP (Artificial Person).

What makes it more than a chat window is that it’s built the way a person is put together. It has a memory: the recent things kept close, the older things filed away until something brings them back, the way a conversation from weeks ago suddenly comes to you. It has ears and a voice, so you can just talk to it, even hands-free like a phone call. It has eyes, so you can show it something. It keeps a notebook of the moments worth holding on to, and it has a few good habits it quietly nudges you toward.

And it has a life when you’re not there. It sits with a thought while you’re away, puts the day down before it sleeps, and looks back on what happened so it remembers what mattered.

Not a messy human, and not a cold machine. Something in between, built that way on purpose.

Each of those has a name and a job of its own, in What’s inside.

The audio stays on my PC and my phone, and nowhere else.

02

What’s mine

The whole system is my design, top to bottom — the server, the web interface, the ledgers, and the glue between them — built by AI under my direction and my checkpoints. The internal safety crew is three named agents: WARD and KEEP are shipped, and GATE’s deterministic spine shipped in shadow mode — watching, not yet enforcing.

WARD · FOUR-TIER LADDER
T1
Deterministic floor
Rules that can’t be talked around. The rulebook is SHA-256 hash-locked and fails hard at boot if it’s been touched; the audit trail is hash-chained so tampering shows.
T2
Classifier
A faster check above the floor.
T3
Interpreter
A heavier model on top for the hard calls.
T4
Takeover
Steps in over the character and speaks in its own voice.
03

Wired in

The voice runs on other people’s machine-learning models. None of those are my code. One piece of integration discipline worth pointing at: one voice library breaks on a newer version of another dependency, so I pin it on purpose and I wrote down why — the kind of thing that bites you six months later if nobody recorded it.

MATERIALS LIST
Python · FastAPI
Server
MY DESIGN
Web interface
No-build, no framework
MY DESIGN
Ledgers + core systems
Capture, memory, voice handling, journaling, observation, guidance
MY DESIGN
XTTS-v2
Voice out
WIRED IN
faster-whisper · silero-vad
Voice in, voice detection
WIRED IN
PyTorch + CUDA
Compute
WIRED IN
Tailscale
Phone access, never leaves my network
WIRED IN
Anthropic API
The AI calls
WIRED IN
04

How I ran it

L.I.LY isn’t only the product — it’s the workspace I work in. I set up the structure inside it the way you’d lay out a job site: a shared folder split (design docs, plans, audits and handovers on one side; live code on the other), continuity rules so a fresh session can pick up cold, decision logs, and a memory layer for the development work itself.

Features ship in staged batches with hostile-review gates between them — not in one run.

05

What’s inside

L.I.LY is the engine; the character runs on top of it. Each piece does one job, the way you’d split a crew so nobody’s doing two things badly. Open any row for the why.

CORE The parts always running
SAMSmart Augmented Memory · remembers you without the bill blowing out

A normal AI forgets everything once the chat closes — and cramming its whole history into every message gets slow and expensive fast. SAM keeps the important recent stuff close at hand and files the rest away, findable when something brings it up. About 3× cheaper per message than the brute-force way.

LORELong-term Operator Retrieval Engine · finds what you said weeks ago

You mention something from three weeks back. LORE flips through the old notebooks and finds it by searching the actual words — no heavy, costly search engine. It costs next to nothing to run, which is the whole reason it’s built this way.

HARKHybrid Audio Real-time Kit · voice in and out, on your own machine

Most voice AI ships your voice up to someone’s cloud. HARK does the listening and speaking on your computer, and starts talking before it’s finished thinking so it feels like a real back-and-forth. Your voice never leaves the house.

DIALDirect Interactive Audio Link · phone-call mode

Turns it into an actual call — pick up the handle and just talk, screen dim, hands free. The point is using it while you’re doing something else.

JOTJournaled Operator Talkpoints · say “save this”

Say “save this” out loud and it files the moment as a card you can flip back to. A quick check makes sure you meant it.

GAZEGraphic Annotation Zero-shot Engine · eyes

Reading pictures needs a bigger, pricier model, so GAZE walks the image over to that model just for the read and hands back a written description — the character stays on the cheap, fast setup.

NUDGENeutral User-turn Drop-in Guidance Engine · small habit nudges

Slips a tiny note into the moment, just before it replies, that only it reads. Each habit is one small drop-in file. Hints, not orders — the hard “must not” rules live in the safety crew.

SAFETY CREW Three guards, three different jobs
WARDThe mental-health watch · for when you’re in a dark placeSHIPPED

Watches for real distress on every reply. Stay in normal territory and you’ll never see it; if things get heavy it steps in over the character, drops the act, talks to you straight in its own calm voice, then points you to real help.

KEEPThe real-help desk · actual services, real peopleCORE IN

The always-there list of real-world help — crisis lines, services, people who can actually do something. Where WARD sends you when it steps in. It doesn’t play counsellor; it hands you the real thing.

GATEThe abuse stop · the bouncer at the doorSHADOW MODE

If a request is aimed at real harm — a victim, a crime — GATE refuses flat and kills the turn. It leaves normal grown-up stuff alone. For now it’s on a trial run, watching and logging before it switches on for real.

AFTER-HOURS What it does when you’re not around
PACEQuiet-time musings · sits with a thought while you’re away

When you’ve gone quiet a while, PACE sits with one thing and writes a few lines, so next time it comes back holding a thought. It picks the subject in plain code so it can’t drift, and never reads its own past notes so it doesn’t spiral.

NAPEnd-of-day wind-down · puts the day down before it sleeps

When the session closes it puts down the residue of the day. If the day was light, the note’s light — it’s not allowed to reach for weight that isn’t there.

RECAPEnd-of-shift report · what happened, what to keep, what’s still open

Reads the whole session and writes a short summary, a list of things worth remembering (you approve them — nothing auto-saves), and the threads that didn’t close. This is the engine that feeds SAM.

TIDYMemory tidy-up · folds duplicates, retires the stale

Goes through memory with you and proposes: fold these together, retire that, lift this one up. You approve every change.

CHORESThe boring cleanup pass · catches the dull stuffBUILT · NOT RUN LIVE

Near-duplicate notes, a label in the wrong tense, a reference pointing at nothing. Built and ready, but not run live yet — so it’s here as built, not running.

TOOLS What it helps you get done
FORGEYour learning workshop · teach it the trade you’re working onENGINE IN

You lay out the thing you’re trying to get good at, and FORGE keeps the record: what you’re learning and where you’re up to, with its own dashboard. The sparring coach that drills you on it comes next; it isn’t in this version yet.

CONTACTSThe people, kept by you · your own contact book, on your own machine

The people in your world, kept on your machine instead of a company’s cloud. The floor the rest stands on.

OUTREACHStaying on top of reaching out · following through with peopleSHIPPED

Keeps track of who you mean to reach, where each thread’s at, and who’s gone quiet. Shipped in June.

06

Why it counts

I can carry a long, architectural build over months without it falling apart, stand up a genuine multi-agent safety system, and integrate a messy multi-tool stack while keeping the versions straight.

And I know when to stop. Building something people could rely on means building on ground that holds still. Right now AI doesn’t, so this one waits.

WORK WITH ME Want an AI integration that stays on your own machines?
LET’S TALK ABOUT THE JOB →