Over the past year, a real Canadian private AI ecosystem has taken shape. That’s a good thing. It means organizations worried about data residency, Law 25, or sending client files into someone else’s model finally have options beyond “just use ChatGPT and hope for the best.”
But “private RAG” has become a loose enough label that it’s worth breaking down what it actually means, because the providers filling that space aren’t solving the same problem. Broadly, they fall into three categories.
1. Text-document RAG platforms
Most of the Canadian RAG providers you’ll find are built around a familiar shape: connect your PDFs, manuals, and internal wikis, and let employees ask questions against them. This is genuinely useful, and for a lot of organizations it’s exactly the right scope. The limitation is in the name: it’s text-document RAG. If your institutional knowledge lives in training videos, recorded safety briefings, or audio walkthroughs from a retiring technician, that content sits outside the system entirely, or gets routed through a separate third-party transcription API, which quietly reopens the privacy question you were trying to close.
2. Sovereign cloud platforms
A second category solves a different problem: keeping data inside Canadian data centres. This matters, and it’s a legitimate compliance win for a lot of use cases. But hosting in a Canadian region isn’t the same as architectural isolation. Data residency tells you where the servers sit. It doesn’t necessarily tell you whether your queries are running on shared infrastructure alongside other tenants, or whether the guarantee is a contractual promise rather than a technical one. Worth asking directly: is this data sovereignty, or data residency? They sound similar and they are not.
3. Knowledge graph and customer-facing platforms
A third group is built for a different job altogether: customer service automation, brand-safe responses, public-facing chat. These systems are optimized for consistency and factual guardrails at the front door of a business, not for internal compliance or document discovery. Comparing them to internal knowledge tools is a bit like comparing a customer support line to an internal filing cabinet. Both are useful. They’re not substitutes.
Where Discreetly AI fits
We built Discreetly AI for a narrower problem than “AI for everything”: regulated Canadian organizations, mainly manufacturing, legal, healthcare, and financial services, that need internal knowledge search without any of it leaving their environment.
A few things that set our approach apart from what’s above:
- Audio and video are first-class citizens, not an afterthought. Training videos, recorded procedures, and safety briefings get transcribed locally using faster-whisper and indexed alongside your documents. No external transcription service touches the audio.
- Architectural isolation, not policy isolation. Every client gets a dedicated database, a dedicated vector index, and dedicated inference. Not a shared multi-tenant backend with access controls layered on top.
- The Law 25 question, answered directly. If personal information can’t leave Quebec without a privacy impact assessment, the honest answer for most cloud AI tools is that they trigger one. Ours doesn’t, because nothing leaves the client’s environment in the first place.
- Flat monthly pricing. No per-token billing that scales unpredictably with how much your team actually uses the system.
This isn’t the right fit for every situation. If you need a public-facing customer service bot, or a knowledge graph for brand consistency at scale, the second and third categories above are probably the better starting point. What we’re built for is the organization that has real institutional knowledge, some of it written and some of it spoken, and can’t afford for any of it to touch a third-party model API.
The question worth asking any vendor
Whichever provider you’re evaluating, worth asking plainly: where does my data actually go, who else’s infrastructure does it touch, and is that a technical guarantee or a policy one? The answers separate the categories above faster than any feature comparison chart.
Curious where your own setup actually lands on this?
Discreetly AI is a private, on-premises document intelligence platform built for Canadian businesses in regulated industries. No data leaves your infrastructure.
Get in touch