nazmi.tech · AI consulting & applied research · Finland · 2026-08-04
Draft for review
Help the agent know what is important, what is not —
and prevent it from making silent decisions.
A conversation with Isaac Kargar — Nazmi
Interview by Nicolas Dolenc · 2026-08-04
Isaac Kargar has spent a decade building AI systems that have to survive contact with a customer — and the last year building the thing that watches what those systems decide when nobody is looking. He has a name for the failure mode that worries him, and it isn't a wrong number.
TL;DR
- Isaac Kargar runs Nazmi, a senior AI consulting and implementation practice: agentic systems and automation, plus custom training of open models.
- His open-source project Lerim is a context compiler — it filters agent traces down to the decisions, constraints and corrections worth reusing.
- He built the fully autonomous version, then a self-pruning harness, then threw both away for a simple decomposed workflow: predictable, cheaper, small enough to train himself.
- The failure mode he guards against is the silent decision — an unverified intermediate choice nobody asked for and nobody saw.
Isaac Kargar is a morning person, which is a small fact that turns out to explain a lot. He does the hard thinking early, when there is enough of him left to check the work. By evening, he says plainly, there is no energy for it.
He runs Nazmi, an AI consulting and implementation practice built on an unusual promise for the category: work with the person who builds it. No account layer, no slideware — the site's own headline is “Shipped, not slideware.” The work splits into two fields. Agentic systems and automation, where the pitch is to take judgment-heavy work a team currently does by hand and hand it to agents they can actually trust. And custom model training, where open models — Llama, Mistral, Qwen — are fine-tuned, distilled and aligned until they know a specific domain properly. In practice a client engagement can run anywhere across MLOps, model training, model deployment, agentic systems, RAG, knowledge graphs and memory systems, depending on what the customer actually needs. He describes it, without decoration, as consulting.
The credentials behind that are the kind that take a while to accumulate. Ten-plus years shipping production AI and ML. A PhD at Aalto in multi-agent reinforcement learning and decision-making — a field that has aged extremely well, given that the techniques for making several agents cooperate and choose are now being retrofitted into large language models by everyone at once. Principal AI Scientist at In Parallel. Co-founder and Chief AI Officer at Resoniks, where the product listened to machines for the sound of something going wrong, and where he co-founded a €2.65M seed round. Before that, Silo AI, on autonomous driving simulation. More than a hundred technical articles along the way.
Ask him why this, out of everything a person could do with a life, and the answer is disarmingly small. It satisfies two appetites at once — the need to build something, and the need to keep learning. That is the whole motivation. Everything else is downstream of it.
The learning appetite has been industrialised. Kargar runs a personal Telegram channel with around four hundred subscribers, fed by an agent he wrote that pulls in links from Twitter, YouTube, LinkedIn — papers, blog posts, any URL really — summarises each one into text and a short audio clip, and files everything in a local SQL database. He reads the summaries daily, picks the one or two that matter, and passes those on. He is deliberate about the sources: company accounts over personalities, Prime Intellect for reinforcement learning, and a stated resistance to whatever technique the timeline has decided to be excited about this month. It is a filtering machine, built by someone whose professional life is filtering machines, pointed at his own attention.
Which is the same problem he has been working on at a much larger scale.
“There are a lot of data — chat traces, agent traces — you want a context layer on top of this to filter and extract the decisions made, the different signals, from those traces. This can be applied to data as well — you have Slack, Teams, etc. — you want to extract a signal and then use it.”
That project is Lerim, open-sourced under the Apache licence and described in one line as a compiler that turns AI agent traces into reusable context. Not a transcript archive — a filter. When an agent finishes a job it leaves behind an enormous, mostly worthless record of everything it thought. Buried in there is the part with value: the decisions taken, the constraints discovered, the corrections a human had to make, the facts established. Lerim extracts those and keeps each one linked back to the session it came from, so the next agent starts with cited context instead of rediscovering the same things from scratch.
Building it taught him that the hard part is not the part everyone assumes.
“The hardest part, especially for memory, was finding the balance — not memorizing too many details, but also not failing to memorize what matters.”
Remembering is easy. Forgetting well is the engineering problem. What he landed on is a hierarchy that behaves uncomfortably like a mind: recent context held close and available, mid-term facts periodically merged with their near-duplicates, rarely-used items allowed to decay, and the long tail parked in a database that gets read only when something actually needs it. Some labs call the consolidation pass dreaming. The comparison holds better than it has any right to.
And then the finding that a certain kind of engineer will recognise immediately, because it is the opposite of what the field rewards you for announcing. He built the fully agentic version first. Then a smarter harness, one clever enough to prune its own context window. Then he threw both away.
“In the end I came to the conclusion that a simple workflow can be enough — several components, LLM calls, do this, then do this — much more predictable, easier to build, and you can use smaller models.”
Cheaper, steadier, and — the part that matters for what he does next — small enough to fit a model he can train himself. Because once a workflow is decomposed into defined steps, each step is narrow enough to distil: record what an expensive frontier model decides at that step, then fine-tune a small model to reproduce the behaviour for a fraction of the cost.
He has been publishing the receipts for that, step by step, in a series on the Nazmi blog. It starts unglamorously — a 0.8-billion-parameter model taught to operate inside a SQL tool-use loop, improving from one solved task out of 220 to forty-something. It learned the protocol; it was not yet competitive. Six parts later, a 9B open model has been post-trained from 78 solved tasks to 115 out of 220 — level with GPT-5.5 medium on the same benchmark, for roughly fifty euros of training. That is the argument he makes to clients about model size, made in public, with numbers attached.
It is also the argument he applies to himself. In another post, he handed Lerim's own memory-extraction pipeline to Claude Code and let it run twenty-four experiments across two rounds to optimise it. Quality went up 41%. Nearly half of that came from a single schema-level change — swapping one call type for another, one line of code — rather than from any of the prompt engineering. An agent optimising an agent, with the result written down either way.
But none of this is the thing he actually guards against. Underneath all of it sits one discipline, and it is not about models at all.
“One of the things I try to do is help the agent know what is important, what is not — to try to prevent it from making silent decisions.”
A silent decision is a choice nobody asked for and nobody saw. Tell an agent to go and train a model on a dataset and it will do exactly that. Somewhere in the middle it will make a hundred small determinations — what counts as valid, what gets dropped, what to do with the rows that look wrong — and none of them will be announced, because from the agent's point of view they weren't decisions. They were just the work. His example is specific and unromantic: he checked a dataset one morning and found roughly a thousand data points missing information the agent needed, which is why the training was quietly failing.
His fix is slower and less impressive than the demo: the agent does the step, but I verify the result before continuing. Break the job into pieces, look at what came back, then release the next piece. It costs him time. It also means the failure surfaces on the morning it happens rather than three stages downstream, wearing a plausible face.
He is honest about why this keeps needing to be re-established. Trust in a model drifts upward on its own — you use it, it works, you check less — and performance appears to drop precisely because you stopped looking. Media enthusiasm accelerates the drift. So he periodically resets his own expectations, deliberately, as maintenance.
The lesson generalises past agents, and he knows it.
“In a startup you often have to do the hard work yourself first, which isn't scalable — you convert it into systematized steps, and only then can an AI agent maybe do a better job.”
There is no shortcut in which you skip the unscalable version. You do it by hand, badly, until you understand it well enough to name the steps. The naming is what makes delegation safe. Everything before that is hoping.
The same instinct governs when he builds at all. Research background, research reflex: look at what already exists before writing anything.
“Because of my research background, I spend some time reviewing what others have done... if nothing is solving my issue, I try to build it myself.”
Sometimes what comes back is a startup idea he plays with and abandons. Sometimes it is a genuinely unfilled gap and a small open-source tool exists a week later, like the browser extension that reads text aloud, written because he was, in his own words, lazy to read all the text an agent handed him. He is unembarrassed about the motive. Most useful tools are built by someone avoiding a chore.
Given the last word, he spent it on the thing he says he has no answer for: the layoffs, and the developers watching this technology arrive and wondering what is left for them. He does not offer reassurance. He thinks companies will be smaller, and says so. But he is precise about what does not compress.
“Many people can run [an agent] and tell it to do even the most difficult things... but those expertise details — how to collect the data, clean the data, how to train, what is the role of this component, how to make it better — maybe AI gets there, but I don't know we can do much more [without it].”
Anyone can issue the instruction. The judgment about whether the thing that came back is any good — that is the part still doing the work. Which is, in the end, the same claim as the silent decisions: the value isn't in producing the output. It is in being the one who checks.
Work with the person who builds it.
Key takeaways
- 01
A trace is not data until something filters it.
The reusable signal — decisions, constraints, corrections — has to be extracted and kept linked to its source. The filter is the product.
- 02
Memory systems fail on forgetting, not storing.
Balance beats capacity: hold recent context close, merge the middle, let the unused decay.
- 03
The simple decomposed workflow beat the autonomous agent.
A chain of small predictable calls proved more reliable than a clever harness — and small enough to run on models you can train yourself.
- 04
Watch for silent decisions.
An agent's unannounced intermediate choices are where work fails quietly. Verify each step before releasing the next one.
- 05
You have to do the unscalable version first.
Systematising work by hand is what makes handing it to an agent safe. There is no way to skip that stage.
Questions
What is Nazmi?
An AI consulting and implementation practice founded by Isaac Kargar, built around senior delivery you can put in front of a client. Two fields: agentic systems and automation, and custom model training on open models. Engagements span MLOps, model training and deployment, agentic systems, RAG, knowledge graphs and memory systems, shaped to the client's use case.
Who is Isaac Kargar?
A senior AI research engineer with ten-plus years building production AI and ML systems, and PhD research at Aalto in multi-agent reinforcement learning and decision-making. Previously Principal AI Scientist at In Parallel, co-founder and Chief AI Officer at Resoniks, and an AI engineer at Silo AI. He has written more than a hundred technical articles.
What is Lerim?
His open-source project: a context compiler that turns completed AI agent traces into reusable, cited context. Rather than replaying raw transcripts, it extracts the decisions, constraints, facts, preferences and corrections worth keeping, and links each back to the session it came from, so the next agent starts with evidence instead of guesswork.
What's a “silent decision”?
An unverified intermediate choice an agent makes on the way to a result — about data, scope or method — that nobody asked for and nobody saw. His central discipline is preventing them: break the work into steps, verify each result, and only then release the next step.
Why train small models instead of using a frontier model?
Because for a narrow task you often don't need general capability. Once a workflow is decomposed into defined steps, each step can be distilled: record what a powerful model decides, then fine-tune a small model to reproduce it. He publishes the results — including a 9B open model post-trained to match GPT-5.5 medium on a 220-task benchmark for roughly fifty euros of training.
Does he build or buy?
Research first. He reviews what already exists, and builds only when nothing solves the problem — sometimes producing a small open-source tool, sometimes a startup idea he later abandons.
How does he keep up with a field moving this fast?
A Telegram channel of about four hundred subscribers, fed by an agent that pulls links from across the web, summarises each into text and a short audio clip, and stores everything in a local SQL database. He reads the summaries daily and shares the best one or two. Sources are chosen deliberately — company accounts over personalities, and a stated resistance to hype cycles.
Where do humans still matter?
In the expertise around the model, not the instruction to it. Anyone can tell an agent to do something difficult; knowing how to collect and clean the data, how to train, what each component is for and how to make it better is what separates a working system from a plausible-looking one.