AI vendor evaluation goes wrong when it focuses on feature checklists and ignores the structural factors that bite later. Here’s what actually matters in 2026. (dgm implements osFoundry as an independent partner — and we’ll score it honestly below.)
Evaluate structure, not just features
Features converge fast; the things that bite later are structural:
| Criterion | What to check |
|---|---|
| Lock-in | Can you switch models/providers, or are you trapped? |
| Data residency | UK/EU options? Self-hosting? |
| UK compliance | Does it support UK GDPR, your sector rules? |
| Pricing model | Per-seat (scales painfully) vs usage |
| Support | Quality and responsiveness |
| Exit | Can you keep your data, config and work? |
The biggest risk: lock-in
A vendor that ties you to its own models, pricing and roadmap makes switching costly and limits flexibility as AI evolves. Favour multi-model, bring-your-own-key platforms — ideally source-available — so you keep optionality. (See how to avoid vendor lock-in.)
Data due diligence
Ask:
- Where is data stored? (UK/EU residency, self-hosting?)
- Is my data used to train the vendor’s models?
- How are transfers handled under UK GDPR? (See data residency.)
- Security — encryption, audit logs, access controls?
For sensitive or regulated data, self-hosting or an EU region is often the safest answer.
Watch the pricing model
Per-seat fees scale painfully as your team grows; usage pricing (pay for what you use) is often more predictable and fairer for collaborative work. Model your likely usage and headcount growth before committing, and watch for hidden costs.
Scoring osFoundry honestly
Since dgm implements it, here’s osFoundry against these criteria (per its own published claims):
- Lock-in: low — multi-model, bring-your-own-key, source-available.
- Pricing: usage-priced, no per-seat fees.
- Data residency: US/EU/JP regions and self-hosting in your own cloud — but no dedicated UK region (use EU or self-host; we’d rather say so).
- Compliance: audit logging, data control and human-oversight support.
- Exit: source-available, so you keep your work.
And about us: dgm has integrated zero companies so far — we tell you rather than fabricate a track record.
Where dgm fits
dgm helps you run this evaluation — on osFoundry or any vendor — and implements the choice. To evaluate a shortlist against these criteria, book a consultation with dgm. General information to help you choose well.