AI knowledge management for mid-sized companies: AI only finds what's in the system.
AI knowledge management only works with knowledge that lives in the system; even the best AI can't find what sits in one person's head or a private spreadsheet.
The usual move is to put software with a chat window on top of the existing file shares. Then the mess gets searched faster, and the most important workflows are still missing because nobody ever wrote them down. At SUMAX we now run on a system of our own, and the AI tools build on the same foundation of users and permissions.
Process knowledge belongs in one place instead of in individual heads and scattered spreadsheets. The system takes over the grunt work, so the people who know the workflow can focus on the work they enjoy.
Knowledge in one head only shows up when that head is missing.
TakeawayTreat knowledge that only one person holds as an operational risk, and tell the team from day one what the system is for.
Experience builds up over years of daily work and isn't written in any process description. Day to day, nobody notices it. You notice it when a case sits untouched during vacation cover because only one person knows how it runs, or when new hires keep asking the same colleagues. A sick day comes with no handover, and at succession everything that was never written down retires along with the person. Employees quickly hear this kind of project as a plan to make them replaceable. It's the opposite. Whoever is the only one who knows a workflow answers the same questions every week and has a hard time taking a vacation. Once the knowledge is in the system, it takes over that repetitive work, and the person's experience counts where judgment is needed.
An AI across five file shares finds five versions.
TakeawayBring the knowledge for one workflow into one place and clear out duplicate versions before any AI gets access to it.
The usual shortcut is an AI search across everything that already exists: drives, folders, the wiki, inboxes and old systems. It works, technically. With RAG, the answer draws on passages a search has found first, usually through embeddings in a vector database, which also catches matches phrased in different words. Ask about a return and you also get the document on customer complaints. But if two versions of the same instruction sit in two places, the answer can come from the wrong one, and whatever was never written down is simply missing. That's why at SUMAX we moved away from the old CRM and the Excel sheets to a system of our own. Only once knowledge sits in one place can a stand-in, a new hire and AI work with it.
Only once knowledge sits in one place can a stand-in, a new hire and AI work with it.
Process knowledge becomes a tool once it's bundled.
TakeawayStart with one recurring workflow whose knowledge is scattered today, and only expand once it holds up in daily work.
One example from summer 2026. For one client we have recurring localization and review work. We moved it into a module of its own, with a clear goal: all the process knowledge should sit in one place instead of in individual heads and scattered spreadsheets. The module builds on the foundation all our tools share, meaning users, permissions and access. And like all our tools, it was built with the people who use it. For us, the foundation for everyone comes first, then a tool for one specific task, then bundled tools like our client archives. A knowledge management system for the whole company in one go has no place in that order. It grows one workflow at a time.
The AI sees only what the person asking may see.
TakeawayConnect a document only once it's settled who may see it, and have the AI work with exactly those permissions.
A knowledge system also pools confidential material, such as client contracts or HR records. An AI search without permissions turns that into a shortcut for everyone. OWASP lists this risk separately in its Top 10 for applications built on language models and recommends access controls that reach all the way into the vector database. That's why at SUMAX users, permissions and access keys came first for everyone, with security from the start, so not everyone can get at everything. Tools for single tasks only came after that. For a knowledge search, this means every answer is built only from documents the person asking could open themselves. Which personal data may go in at all is a question for AI governance.
Outdated knowledge does more damage than missing knowledge.
TakeawayGive every entry a valid-from date and budget upkeep as working time for the team that owns the workflow.
If an answer is missing, people ask. If an outdated answer comes with a source, people believe it. A language model can't tell on its own whether an instruction is from yesterday or from years ago. So every entry needs a valid-from date, and upkeep needs time in the working day of the team that knows the workflow. In line with that, the ISO 30401 standard treats knowledge management as a management system that gets reviewed and improved continuously. For personal data, Article 5 of the GDPR already requires it to be accurate and, where necessary, kept up to date. Prompts are process knowledge too and belong in the same place, with versions and test examples. The source in the answer makes checking fast. An answer only gets passed on after that check.
The knowledge inventory fits on one page.
TakeawayFill in the list for one department and start with the workflow that hits the most of the three questions.
You start with a list of the most important workflows in one department. Each workflow gets four entries: who can fully explain it today, where it lives (a head, a spreadsheet, an old system or a folder), when someone last reviewed it, and roughly what it costs per year, as an order of magnitude. Then I ask three questions about each workflow. Does the knowledge depend on a single person? Has nobody reviewed it in years? Is it part of one of the most expensive workflows? Where two or three apply, that's where the work starts. That one workflow moves into one place, gets permissions and a valid-from date, and the person who knows it checks the AI's first answers. Then comes the next workflow on the list.
From practice.
- The AI transformation at SUMAXFoundation, permissions and one layer of our own for every AI call: how the transformation at SUMAX is built.
- AI prompts as part of the documentationPrompts hold business rules, which makes them process knowledge. Goal, versions with reasons and test examples belong in one place.
- AI infrastructure: a pile of tools is not a systemUsers, permissions and access for everyone first, then tools. A layer of your own keeps the model swappable.
Frequently asked questions
What is AI knowledge management?
AI knowledge management connects a company's collected knowledge to a language model that answers questions asked in plain words and cites the source. The foundation is still documents, process descriptions and data in one place, with permissions and a valid-from date. What was never written down, the AI won't find either.
How is AI knowledge management different from a wiki?
A wiki stores knowledge, and you find it through keywords and structure. AI knowledge management uses the same content but understands questions in plain words and pulls the relevant passages into one answer with a source. Upkeep is the same work either way. An outdated wiki with AI on top is an outdated wiki that answers convincingly.
How does RAG work in knowledge management?
With retrieval-augmented generation, or RAG, a system first searches your own documents for relevant passages and hands them to the language model as context. Researchers led by Patrick Lewis described the method in 2020. That way the answer can name the passage it relies on. Whether the passage supports the statement only shows when a person checks it.
How do you get experience out of people's heads and into the system?
Best during regular work, while the person runs the workflow, rather than in a big documentation project. They explain what they do and why, an AI takes notes and structures them, and the person checks the result. The machine does the note-taking and structuring, and the call on right and wrong stays with the person who knows the workflow.
Can an AI search leak confidential documents?
Yes, if permissions don't reach into the search. Then an answer can contain content from documents the person asking isn't allowed to open. That's why users, permissions and access come first and documents second. The AI works with the permissions of the person asking.
Should you buy AI knowledge management or build it?
Bought software is up and running fast, but the vendor decides which model runs and how you're billed. Building got much cheaper with AI, running it is still work. At SUMAX we replaced several bought tools with our own, and a layer of our own lets us switch models at any time. Preparing and maintaining the knowledge comes with both options, and no software takes that off your hands.