Last updated: June 2026 · The Knoxfield Group
I was listening to Andrej Karpathy speak recently, and he shared a line that stopped me in my tracks. He said it is a tweet he keeps thinking about: "You can outsource your thinking, but you can't outsource your understanding." If you want to watch the whole thing, here is the talk: Andrej Karpathy: From Vibe Coding to Agentic Engineering. He was talking about AI, about how people get into trouble when they let a machine do their thinking and then mistake its fluent output for their own understanding. But it really got me thinking, because it is the single best description I have heard of a problem I watch business owners wrestle with constantly, and it has nothing to do with AI.
I am writing this because that one sentence has been rattling around in my head for days. It answers a question almost every owner I talk to eventually asks, usually late at night with the books open: can I finally hand this off, or will I lose my grip on my own business if I do? I think the honest answer is more useful, and more freeing, than what most owners get told.
So here is where I land, up front, and then I will show my work. The fear of losing touch with your own numbers is real, and the data backs it up. But the failure is not outsourcing. The failure is outsourcing into a black box and keeping none of the understanding for yourself. This is a piece about how to hand off the work without handing off the understanding, what the numbers actually say about why that matters, and the four things you should never let anyone take off your desk no matter who runs your back office.
Here is how that conversation usually goes, close to word for word. An owner tells me they are underwater. The books are behind, payroll eats their Sunday nights, and they honestly cannot remember the last time they looked at a real number. So I ask the obvious question: why not hand it off? And they go quiet for a second, and then they say some version of, "Because if I let go of it, I'll lose touch with my own business." That, right there, is the real reason most owners keep grinding on work they are bad at and hate doing. Not the price. The fear that handing off the work means handing off the understanding too.
I want to take that fear seriously, because it deserves to be taken seriously. And then I want to show you why it points to exactly the opposite conclusion from the one most owners draw.
The night the books vanished
You do not have to imagine the worst version of this. It already happened to a lot of people, and recently.
Two days after Christmas in 2024, Bench, a venture-backed bookkeeping company that had raised more than one hundred million dollars and kept the books for tens of thousands of small businesses, abruptly shut down and took its platform offline overnight (TechCrunch). Owners who had handed Bench their financial records woke up to a login screen that no longer worked. No books. No reports. No history. And the timing could not have been crueler, because it landed at the start of tax season, the one stretch of the year when you cannot function without your numbers.
A different company stepped in within days and access was eventually restored for a window, so this is not a story about a permanent loss. It is a story about a feeling. Thousands of owners spent that week discovering, all at once, that the most important records in their business lived entirely inside someone else's system, and that they had no real understanding of what was in them or how to reconstruct them. They had outsourced the work. They had also, without meaning to, outsourced the understanding and the access and the control. When the box disappeared, so did everything they thought they had.
Now, the easy lesson is "be careful who you outsource to." That is true, but it is shallow. The deeper lesson is the one that runs through this whole piece. The problem was never that those owners outsourced their bookkeeping. Plenty of excellent, well-run businesses outsource their entire back office on purpose, and they are better for it. The problem was that they outsourced into a black box and kept none of the understanding for themselves.
Why the fear is rational (the part the data confirms)
I am not going to pretend this is only a feelings problem, because the numbers are not on the side of "do not worry about it." Three of them are worth sitting with.
You are closer to the edge than you think. The JPMorgan Chase Institute studied the bank flows of nearly six hundred thousand small businesses and found that the median small business holds just twenty-seven days of cash buffer, meaning twenty-seven days of typical outflows in the bank if the money coming in suddenly stopped (JPMorgan Chase Institute). For a restaurant or a retail shop the median is closer to nineteen days. For professional and higher-wage services it is around thirty-one. Either way, the typical small business is roughly one bad month from a genuine cash crisis. When your margin for error is that thin, not understanding your own cash position is not a luxury problem you will get to eventually. It is the thing most likely to take you out.
When you stop looking, problems hide for about a year. The Association of Certified Fraud Examiners runs the largest ongoing study of occupational fraud in the world. In its 2024 report, the typical fraud scheme ran about twelve months before anyone caught it, and more than half of all cases traced back to either a lack of internal controls or someone overriding the controls that existed (ACFE 2024 Report to the Nations). Smaller organizations are especially exposed, because they tend to run on trust and thin oversight. I am not telling you this to make you paranoid about your bookkeeper. I am telling you because it is the cleanest proof of Karpathy's point that I know. When the owner stops understanding the numbers, the average problem gets a full year to grow before a single person notices. Understanding is not a nice-to-have. It is the smoke detector.
Running out of cash is the symptom, not the disease. CB Insights has spent years cataloging why companies fail, and running out of money sits at or near the top of every version of the list. But the researchers are refreshingly blunt about it: running out of cash is almost always the final cause of death, not the root one (CB Insights). Underneath it sit the real problems, the ones an owner did not see in time. That distinction matters enormously here, because it is the whole argument in one line. Handing your bookkeeping to someone else moves the data entry off your desk. It does nothing, by itself, to cure the underlying problem of not understanding your business. If anything, a black box makes the disease easier to ignore right up until the symptom kills you.
Put those three together and the owner's fear looks less like anxiety and more like good instincts. Losing touch with your numbers really is dangerous. The mistake is concluding that the safest move is to keep doing the work yourself at eleven at night.
The real problem is not outsourcing. It is the black box.
Here is the unpopular thing I will say out loud, because someone should. The owner doing it all alone at eleven at night does not understand their numbers either. They are just tired. Closing the laptop with the books "done" is not the same as knowing where the business stands. Busy is not informed. A shoebox you personally stuffed is still a shoebox.
So the real question is not "do I keep control by doing this myself?" You are not in control right now. You are behind, you are exhausted, and on the questions that actually matter, you are guessing. The real question is which kind of help hands you understanding instead of quietly taking it away.
This is exactly where Karpathy's line earns its keep. The thinking-work can be handed off. The categorizing, the reconciling, the chasing down receipts, the filing, the running of payroll, all of the mechanical labor that eats your nights, none of that has to be yours. What cannot be handed off, what you must keep, is the understanding: knowing what the numbers mean and what to do about them. A good partner is one that takes the first thing entirely and protects the second thing fiercely. A black box takes both, and you do not notice the second one is gone until you need it.
The Four Anchors: what you keep no matter who runs your back office
If you only remember one thing from this piece, make it this. There are four things you should keep your hands on no matter who does the work. Hold these four, and you can outsource everything else with a clear conscience. Lose them, and it does not matter how cheap or convenient the service is, you are in a black box. I call them the Four Anchors.
Anchor 1: Your data stays yours. Your books, your records, and your history should live somewhere you can reach on your own, today, without asking permission. This is the Bench lesson in one sentence. If the only copy of your financial life is inside a vendor's platform and you have no independent access, you do not own your numbers, you are renting them, and the lease can end on December 27th. Ask any provider, plainly, "if we parted ways tomorrow, what exactly do I walk away with, and how fast?" If the answer is vague, that is your answer.
Anchor 2: One number you actually watch. You do not need to become a financial analyst. You need one number, checked on a real rhythm, that tells you whether the floor is solid. For most owners that number is cash position and runway: how much is in the bank and how many weeks it covers. Given that the median small business is twenty-seven days from trouble, this is not optional. The work of producing that number can absolutely be someone else's job. The habit of looking at it has to be yours.
Anchor 3: A human who translates, not just produces. A report you cannot read is not understanding, it is paperwork. The difference between a handled back office and a black box is whether a person will sit across from you and say, in plain English, "here is what happened this month, here is what it means, and here is the one thing I would do about it." Producing the statement is the thinking-work. Translating it is the part that keeps your understanding alive. If nobody is doing the translating, the understanding is not being handed to you, it is being lost.
Anchor 4: A clean exit. You should be able to leave, at any time, and take everything with you in a usable form, without a fight. This sounds like a legal detail and it is partly that, but mostly it is a tell. A partner who is comfortable making it easy for you to leave is a partner who is not holding your understanding hostage as a retention strategy. The ones who make leaving painful are telling you something about how they see the relationship.
None of these four require you to do the work. That is the entire point. You can hand off every hour of labor and still keep all four anchors. When you do, outsourcing stops being a risk and becomes the smartest move you can make, because now you have the time back and the understanding too.
Handled versus black box, side by side
| Black-box back office | A back office that's handled | |
|---|---|---|
| The work | Off your desk | Off your desk |
| What you get back | A report you don't really read | Owner-ready numbers in plain language |
| Your understanding | Fades over time | Gets sharper |
| Your records | Locked inside someone else's system | Always yours, always accessible |
| If you leave | A scramble, or a fight | Everything comes with you, cleanly |
| Who's in control | Unclear | You, with better information |
The difference is not whether the work leaves your plate. In both columns it does. The difference is whether the understanding, the access, and the control come back to you.
How to tell the difference before you hire
You can usually spot a black box in the first conversation, if you ask the right questions and listen for the squirm. Five I would ask anyone before handing them my back office:
- Will I get reporting in plain language, or just a file I have to interpret myself?
- Can I get a current, trustworthy answer on cash and margins on any given day, not just at tax time?
- If we ever parted ways, are my books and records mine to take, today, with no scramble?
- When something looks off, will a real person explain what it means and what they would do, or will I get silence until I chase them?
- A year from now, will I understand my business better, or worse?
If the honest answers point toward a black box, keep looking. The right partner leaves you feeling more informed every month, not less, and your records stay in your hands the entire time.
The AI wrinkle, because this is about to matter more
It is worth remembering the context Karpathy was using that line in. He was not talking about bookkeeping. He was talking about agentic AI, and the temptation to let the machine do your thinking and then mistake its fluent output for your own understanding.
That is about to become very relevant to back offices, because a great deal of the mechanical work, the categorizing, the matching, the data entry, is being automated right now, and it should be. This is good news. The thinking-work is exactly the kind of labor that machines and supervised operators can take off your plate. But the rule holds even harder than before. If you let an automated back office run in the dark, with no human translating and no owner watching the one number that matters, you have not bought understanding. You have bought a faster, cheaper black box, which is arguably worse, because it is more convincing.
The version that works is the one that mirrors Karpathy's advice on purpose: let technology and people do the thinking-work, keep a human accountable for anything that matters, and keep the owner, above all, understanding what is going on. The machine does the labor. The person keeps the meaning. You stay the one who decides.
Where Knoxfield fits
This is the whole reason The Knoxfield Group exists, and it is how we are built, on purpose. We run the back office, the bookkeeping, the invoicing, the payroll, the compliance, and we layer CFO-grade clarity on top, so the work leaves your desk and the understanding stays with you. Your data stays yours. There is one number we make sure you always know. A real person translates the month into plain language. And if you ever want to leave, you take everything with you. The Four Anchors are not a marketing line for us, they are the operating model. We even practice what Karpathy preached on the technology side: we use real tools and supervised operators to do the heavy lifting, with a human signing off on anything irreversible, so the machine does the thinking-work and a person keeps the understanding.
You hand off the work. You always know where you stand.
If you are not sure which side of the line your current setup falls on, that is worth twenty minutes. We will give you an honest read on what is worth handing off first and what you should never let go of, whether or not we end up working together.
Common questions
Does outsourcing my bookkeeping mean I'll lose touch with my finances? It can, and that fear is reasonable, but it is a choice of partner, not a law of nature. A black box takes the work and hands you a report you cannot read. Done right, it is the opposite: good owner-ready reporting and a person who explains it give you a clearer view of your numbers than you ever had doing it yourself late at night.
What is the difference between a "handled" back office and a "black box"? A black box takes the work off your desk but leaves you in the dark, often with your records locked inside its own system. A handled back office takes the work and gives you back four things: clean books, plain-language reporting, full access to your own data, and a clean exit. That is the Four Anchors test.
How do I stay in control if someone else runs my books? Control comes from understanding, not from doing the data entry yourself. Keep the Four Anchors. Make sure your data is always yours, watch one number on a real rhythm, insist on a human who translates, and confirm you can leave with everything at any time. Hold those, and you can outsource the labor without losing the control.
Isn't doing it myself the safest option? Usually not. The owner doing the books alone at eleven at night is tired, behind, and still guessing on the decisions that matter. Doing the work is not the same as understanding the numbers. The safest option is keeping the understanding while letting someone capable carry the work.
What should I hand off first? Start with the recurring, mechanical work that eats the most time and creates the most risk when it slips: bookkeeping and the monthly close, payroll, and bill pay. Keep, from day one, a clear read on cash. If you want a specific order for your business, that is exactly what a Back-Office Review is for.
