Architecture & Security
When Should Your AI Product Use MCP?
When does MCP simplify an AI product's integrations? Compare shared tool access with direct APIs, including security, ownership, and a practical pilot.
By The Fractional Stack7 min read
A healthcare organization is building two AI assistants. One helps people find approved services; another helps staff answer questions about the same service directory. Should the team put Model Context Protocol (MCP) between those assistants and the directory, or connect each assistant to the existing API?
There is no universal answer. MCP may make a shared capability easier to expose to several AI applications. It also gives the team another interface to secure and maintain. The decision turns on reuse, the capabilities each application needs, and who will operate the integration after launch.
MCP standardizes the connection. It does not make the data accurate, the permissions correct, or the integration owned.
What MCP changes
MCP is an open protocol that lets an AI application connect to a server offering tools, information, or reusable prompts. The application can discover what the server offers and call a tool through a common interface. An MCP server can sit in front of an existing service or API; adopting it does not require replacing the underlying system. The official architecture overview explains the host, client, and server roles.
That common interface is the potential benefit. If several AI applications need the same business capability, a team may be able to define and maintain it once in an MCP server, then make it available to supported applications. Each connection still needs testing, appropriate authentication, and configuration. Changes to the underlying API still need to be handled somewhere.
MCP also does not decide how much freedom an AI assistant gets. A developer can call an MCP tool as part of a fixed sequence, or let an assistant choose among approved tools while handling an open-ended request. An assistant can likewise choose among tools backed by direct APIs. The protocol and the degree of AI autonomy are separate design choices.
A healthcare example: one capability, several assistants
Consider a hypothetical healthcare organization with a maintained directory of services, locations, eligibility criteria, and partner information. A public care-navigation assistant uses approved portions of that directory to help visitors find relevant services. An internal staff assistant uses it to answer operational questions and may see additional information its users are authorized to access. Neither use case needs patient records for these directory lookups.
Both need a reliable way to look up the directory. An MCP server with a small set of read-only tools could expose those lookups to both assistants. That starts to become attractive if the assistants run in different products, their hosts support the required MCP features, and more approved use cases are likely to reuse the same lookups.
The server would still enforce the caller's permissions. A public assistant should receive only approved public information; connecting it to the same server as a staff assistant must not give it staff access. The team would also need to decide how updates to directory data are validated, how failures are surfaced, and who maintains the server.
Now consider a nightly job that imports partner updates, checks required fields, flags conflicts, and publishes approved directory changes. Its steps are known in advance. Ordinary code calling the source API is a sensible starting point. Adding MCP to that job would need a specific benefit, such as reuse by other supported clients. The presence of an AI assistant elsewhere in the organization does not make every integration an MCP use case.
When a direct integration is enough
For one AI feature calling a small number of stable endpoints, a direct API integration may be quicker to build and easier to trace. It can expose precisely the operations that feature needs. A shared application service can also provide reuse without adopting MCP if all the consumers are under your control.
| Option | When it fits | What your team takes on |
|---|---|---|
| Direct API integration | One feature calling a few stable endpoints, with no other consumer in view | Tool definitions, permissions, and error handling inside a single application |
| Shared internal service | Several consumers you control need the same capability | A service contract, versioning, and coordination across internal teams |
| MCP server | Multiple compatible hosts need the same capability, and discovery or a standard interface solves a real problem | Everything above, plus server deployment, host compatibility, scope design, and support |
This remains true even when an assistant has some discretion. If the assistant needs two narrowly defined lookups that your application already exposes, you can provide those as tightly scoped tools backed by direct API calls. MCP becomes more compelling when multiple compatible hosts need access to the same capabilities.
There is no useful rule such as “adopt MCP after three integrations.” Count the connections you would otherwise maintain, but also account for the work of deploying an MCP server, supporting each host, setting permissions, handling errors, and keeping the interface current. The right crossover point depends on your systems and team. This is the same comparison discipline that belongs in any AI build-versus-buy evaluation.
Security depends on the whole design
Connecting an AI assistant to operational systems introduces risks regardless of the integration protocol. A malicious instruction in retrieved content could influence an assistant to request an inappropriate action. Excessive permissions increase the consequences of a mistake. MCP also brings server trust and authorization decisions that deserve explicit review. The MCP security guidance covers risks specific to MCP implementations, including overly broad scopes and proxy authorization mistakes.
For the healthcare example, start by defining exactly which data each assistant may retrieve. Enforce those rules in the server or underlying system based on authenticated identity; do not rely on a prompt telling the model what it is allowed to see. A read-only first release is a sensible choice for these lookup tasks, though MCP itself is not limited to read-only work.
If an assistant might later change an appointment or send a referral, treat that as a separate product and risk decision. Define who may initiate the action, what must be verified, when a human must approve it, and how the outcome is reconciled. Those controls are needed whether the action travels through MCP or a direct API, and they are part of what a production AI workflow requires beyond the model call.
Make activity traceable without indiscriminately storing sensitive content. Record the authenticated actor or application, tool invoked, outcome, time, and correlation ID. Capture arguments or results only when needed, with appropriate redaction, access controls, and retention. Logging full requests and responses by default can turn an audit trail into a second store of sensitive information.
If an assistant already has tool access in production, an Application Security Assessment can review how its permissions, prompts, and logging are implemented in code.
Who owns the extra layer?
A useful MCP server is a production interface. Someone must maintain it when the directory's schema changes, investigate failed calls, manage permissions, and test changes against the assistants that use it. If a vendor provides the server, establish who supports it, what capabilities it exposes, and how you will respond when it changes. If you build it yourself, assign an owner and include that work in the cost comparison.
Compatibility needs a practical check, too. A host's support for MCP does not guarantee that it handles your required authentication flow, tool behavior, approvals, or errors the way you expect. And a large catalog of tools can burden an assistant's context and tool selection; the MCP maintainers' roadmap calls out this scaling problem. Expose only the capabilities each use case needs and measure the actual impact rather than assuming either approach is faster or cheaper.
A decision you can test
Before making MCP the default for an AI product, answer four questions:
- Who will reuse the capability? Name the specific AI applications and check that their hosts can connect under your required security model.
- What should each one be allowed to do? Define the data and actions by user, application, and environment. Keep higher-risk operations out of the first release unless they are necessary.
- What does the shared interface save? Compare the connections and changes you would maintain with MCP against a direct integration or shared application service.
- Who will run it? Assign ownership for access, monitoring, incidents, version changes, and support.
For the healthcare organization, I would set acceptance criteria before piloting a few read-only directory lookups in one assistant, then test the same capability in a second supported host. Use representative tasks and check answer quality, permission boundaries, failure handling, latency, and effort to change the integration. Compare that experience with the direct API path. If the second use case gets a meaningful benefit without disproportionate operating work, the team has evidence to expand. If it does not, the API remains a sound choice.
Direct APIs remain useful for targeted features and fixed workflows, and a product can use both. If you are weighing the options, a fractional CTO can help define the acceptance criteria, run a bounded comparison, and recommend an architecture your team can support.
Related work
Tags
- AI Products
- Architecture
- Security
- Technology Strategy
Continue reading
How a Fractional CTO Evaluates AI Build-vs-Buy Decisions
Should you buy an AI product or build a custom solution? Evaluate workflow fit, quality, total cost, and ownership before committing to either path.
Read insight