"Governance" tends to summon images of a compliance department nobody wants to talk to. Done right, for a team without one, it's the opposite: a small, fast group that makes it easier to ship AI, because everyone already knows what "approved" looks like before they ask.
This playbook is scoped to what we've stood up for clients who have no existing AI governance function — often just a CTO, a couple of engineering leads, and a mandate to move fast without a surprise on the front page. It borrows its structure from the NIST AI Risk Management Framework, which organizes the work into four functions: Govern, Map, Measure, and Manage. You don't need the full framework on day one — you need the Govern function, done well, in a month.
Week 1 — Name the roles, before the policy
A policy nobody owns doesn't get followed. Before writing anything down, assign three things:
- An AI governance lead — usually an engineering or product leader, not a full-time hire at this size.
- A small, cross-functional review committee — engineering, legal or compliance if you have it, and one person who represents the customer or end user.
- A single intake channel — one place, not three, where a new AI use case gets registered.
The committee doesn't need to be more than three or four people. Its authority matters more than its size: it needs to be able to actually delay a launch, or nobody will take its review seriously.
Week 2 — Build the system inventory
You can't govern what you can't see. Most mid-size orgs are surprised by how many AI features already exist once someone actually goes looking — a support macro here, a summarization endpoint there, none of it centrally tracked.
- List every AI system in production, pilot, or active development.
- For each one: what data it touches, what decision or action it can take, and whether a human reviews its output before it has consequences.
- Flag anything that makes a decision with real consequences for a person — credit, employment, health, or safety — for a higher bar of review.
Week 3 — Write the two documents that actually get used
Skip the 40-page policy binder. Two short documents cover almost everything a fast-moving team needs:
- An acceptable use policy — in plain language, what AI is and isn't allowed to do here, and what needs review versus what doesn't.
- An intake and review checklist — the specific questions the committee asks of every new use case: what data does it use, what's the failure mode, who's accountable if it's wrong, and how will we know if it's wrong.
The test for whether a policy is too long
If an engineer can't recall its substance after reading it once, it's too long to actually shape behavior. Keep both documents to a page or two.
Week 4 — Run the review committee live, on real work
Don't launch the board with a tabletop exercise — launch it against whatever AI feature is closest to shipping. Running the committee on real, time-pressured work in week four does two things a hypothetical review never can: it proves the process doesn't just slow everything down, and it surfaces the gaps in your checklist while they're still cheap to fix.
- Time-box the review — a target of under a week from submission to decision keeps the committee credible.
- Document the decision and the reasoning, even for approvals — the record is what makes the next review faster.
- Revisit the checklist after the first two or three reviews. It will be wrong in places; that's expected.
The goal isn't a governance function that can say no. It's one that can say yes quickly, with a paper trail, because the hard questions were already answered.
What comes after 30 days
Once the board is running, the natural next steps are the NIST framework's remaining functions — Map (categorizing risk by use case), Measure (metrics and testing for those risks), and Manage (ongoing monitoring and response). Most teams don't need all of that on day one. They need a board that exists, meets, and is trusted — the rest can be built as the AI footprint grows.
Setting up governance alongside your first agentic system, not after it? That's the easiest time to do it. Talk to us about building both at once.