Service · App development

Building an IBM Watson app.

A custom app built on the IBM Watson and watsonx platform, for enterprises with an existing IBM stack: banks, insurers, healthcare and government organisations that want to deploy AI without losing control over data and compliance. We build on watsonx.ai, watsonx.data, watsonx.governance, Watson Assistant, Discovery, NLU and Speech-to-Text where that fits, and we are honest when another route is the better one. This is not a vendor pitch: Watson is one option alongside Anthropic, OpenAI, Mistral or a local model.

watsonx.aiwatsonx.governanceWatson AssistantAI Act & GDPREU residency

When IBM Watson is the right choice, and when it is not.

IBM Watson has quietly reinvented itself in recent years. The original Watson from the Jeopardy era has largely been wound down, and what remains under the Watson banner is a collection of enterprise AI building blocks that work exceptionally well for a particular type of organisation: those whose existing systems run on IBM (Db2, MQ, mainframe COBOL, z/OS, Power Systems, Db2 Warehouse), where a purchasing relationship with IBM is a given, and where audit, governance and data residency matter more than the very latest benchmark score.

The new centre of gravity is called watsonx and consists of three related products: watsonx.ai (foundation models and custom model deployment), watsonx.data (an open lakehouse built on Iceberg and Presto) and watsonx.governance (model oversight and AI Act documentation). Alongside these, the older but still widely used components, Watson Assistant, Watson Discovery, Watson NLU and Watson Speech-to-Text, run in the same IBM Cloud environment. We build custom apps that call these components from our own front end and our own domain logic. Our broader approach to this kind of work is set out on the AI development page, with the more general LLM layer covered on custom LLM integrations.

What sets us apart is that we are vendor-independent. We are not an IBM partner with a quota, and we have no commercial incentive to choose Watson when another route fits better. For a retail start-up with a fresh cloud budget and no IBM history, watsonx is rarely the right choice; for a Dutch bank with a mainframe in Diemen, it often is. We can talk through how that trade-off applies to your situation in a vendor advice session before we discuss building anything.

Three typical forms.

Watson projects we encounter in practice tend to fall into three patterns. Which pattern fits you depends on where the value lies: conversational interfaces for customers or employees, document AI and search over your own corpus, or a deeper custom app in which watsonx.ai forms the brain for your own domain.

Conversational · Watson Assistant · customer contact

Customer support and employee assistant

An app or chat layer that handles customer or internal staff questions based on a controlled corpus. We use Watson Assistant for dialogue management where it fits, or build a custom orchestrator on watsonx.ai with your own prompts, retrieval and guardrails, depending on how much control you want over the conversation. For banks and insurers this often includes a handover mechanism to human agents and logging suitable for compliance investigations. We connect to an existing contact centre (Genesys, NICE, Avaya), CRM (Salesforce, Dynamics, Siebel) or telephony stack.

Watson Assistantwatsonx.aiRAG on your own corpusAudit logging
Document AI · Discovery · NLU

Document AI and enterprise search

An app that reads, classifies, summarises and makes searchable large streams of documents: contracts, policies, case files, regulations, knowledge bases, process documentation. Watson Discovery serves as the retrieval layer on top of your own corpus, while watsonx.ai generates the answers, summaries or structure. For regulated industries, you can keep the corpus within IBM Cloud Frankfurt, with granular access rules per role or document type. We then build integrations with existing document management systems (FileNet, OpenText, SharePoint, NetDocuments) and mainframe sources.

Watson DiscoveryWatson NLURAGFileNet · OpenText
Custom app · watsonx.ai · domain-specific

Custom AI app on watsonx

A bespoke app with its own domain, its own workflow and watsonx as the engine, for example a fraud investigation tool for an insurer, an underwriting assistant for a bank, or a triage app for a hospital. We build the front end as a native or web app, handle integration with the mainframe and data warehouse, and deploy watsonx.ai for reasoning. watsonx.governance keeps track of what the model does and how that relates to the EU AI Act. Our broader approach to this kind of work is set out in enterprise AI implementation.

watsonx.ai foundation modelswatsonx.governanceDB2 · MQ · mainframeOn-prem option

What you get at the end.

A production-ready custom app that draws on the Watson and watsonx building blocks where it makes sense, runs in your IBM Cloud environment or on-prem watsonx installation, and fits your existing architecture. No lock-in to us as an agency: you own the code, prompts, models and infrastructure definitions.

  • Native or cross-platform appA mobile app (iOS, Android, Flutter, React Native) or web app, built on the Watson and watsonx layer, with a UI that suits your brand and the work the end user does.
  • Custom orchestrator on top of watsonx.aiA custom prompt, retrieval and guardrail layer around watsonx.ai or Watson Assistant: no hard-coded vendor dialogues, but manageable flows you can adjust yourself.
  • RAG pipeline on your own corpusDocument ingestion, embedding and retrieval, via Watson Discovery, watsonx.data or an open-source vector store, so that answers are grounded in your own knowledge rather than generic web data.
  • Integrations with your IBM and non-IBM stackConnections to DB2, IBM MQ, z/OS, Power Systems, mainframe COBOL, FileNet and OpenText, and to non-IBM systems (Salesforce, Dynamics, SAP, ServiceNow) where needed. A Watson app rarely lives on its own.
  • EU data residency and hybrid deployment optionsIBM Cloud Frankfurt for most clients, or watsonx on Cloud Pak for Data on-prem or on a private cloud where requirements are stricter, for example in government or at banks with strict IT policies.
  • watsonx.governance integrationModel oversight, model version management and logging in a way that suits the EU AI Act requirements. No separate governance spreadsheet sits alongside the app; it is integrated into the production pipeline.
  • Evaluation and regression suiteA set of tests built on realistic examples from your domain, which we run against the model every release. A Watson app that quietly deteriorates on edge cases after an update should not go unnoticed.
  • Compliance evidence: DPIA, AI Act, NIS2, DORAThe documentation and logging you need for the Data Protection Officer, for compliance, audit and DNB processes: not a loose PDF at the end, but part of the architecture.
  • Fully transferable codebaseThe source code, infrastructure-as-code (Terraform or OpenShift manifests), prompts and evaluation set are yours. If you later want to continue with another agency or take it in-house, you can do so without us withholding any components.
  • Maintenance contract (optional)Monitoring, model evaluation, security patches and further development, only if you prefer to entrust these to us. Many clients commission only the build from us and manage the app internally afterwards.

Who we build Watson apps for.

Eight patterns we keep seeing in our conversations about IBM Watson and watsonx. If you recognise your organisation or use case in one of them, we are happy to talk further, and we will also be honest when another platform or a hybrid approach fits better than pure Watson.

Banks

Underwriting and KYC support

An app that helps the bank employee with credit underwriting, KYC investigation or fraud analysis, using watsonx.ai as the reasoning layer and existing core banking data from DB2 and the mainframe as the raw material. For clients under DNB and AFM supervision, audit logging and explainability weigh heavily; watsonx.governance helps build these requirements in.

Insurers

Claims triage and policy AI

An app that classifies incoming claims, detects fraud indicators, explains policy terms and proposes settlement for standard cases, while the human claims handler stays in control. Often with Watson Discovery over the policy archive and watsonx.ai for the reasoning, connected to Guidewire or a bespoke core insurance system.

Healthcare

Clinical decision support and triage

Apps that turn clinical data into decision support for doctors or triage staff, for example pre-consultation review for outpatient referrals or administrative assistance with discharge documentation. For healthcare, NEN 7510 applies from day one. We deliver suitable integrations with HiX, Epic, ChipSoft and CGM, and keep audio and patient data within the EU.

Government

Case-file AI for implementing organisations

Implementing organisations (tax authority, employee insurance agency, social security services, municipalities, ministries, regulators) handling large case files and dense regulation want to use AI without giving up control over data and explainability. Watson on IBM Cloud Frankfurt or on-premises Cloud Pak then fits within your existing procurement, security and architecture frameworks.

Logistics

Supply chain assistant on a SAP/IBM stack

Logistics companies with a hybrid SAP/IBM architecture (DB2, MQ, mainframe batch, alongside SAP S/4HANA) are a typical profile where Watson fits well, not because it is fashionable, but because the data already lives there and the IT organisation can work with it. We build apps for procurement, planning or inventory AI that run on this type of stack.

Energy & utilities

Field service app and asset AI

Energy and network companies that want to build predictive maintenance, asset AI or field service apps on an existing IBM Maximo and DB2 environment. Watson Speech to Text for hands-free reporting in the field, and watsonx.ai for the reasoning around faults or asset condition. Often in line with NIS2 requirements, which are tightening for the energy and water sectors.

Regulators & compliance

Regulatory AI for inspection and audit

Supervisors and internal compliance teams working under dense regulation (Wwft, MiFID II, DORA, NIS2, AI Act) who need to find passages, precedents and risk signals. Watson Discovery on top of a proprietary corpus, watsonx.ai for summarisation and explanation, and watsonx.governance for traceability.

Existing IBM customers

First AI step within an existing IBM relationship

Organisations with a large IBM installed base (DB2 Warehouse, Db2 on z, Cognos, OpenPages) that want to take a first serious AI step without bringing in a second cloud platform. For these clients, Watson is often the practical choice; we help with the first application, the evaluation, and the decision on whether a second platform should be introduced later.

Unpacking the Watson and watsonx platform.

A brief orientation on each building block, as we work through them in a first session. Not everything on this list belongs in your application — we decide together which components add value.

Foundation models · self-hosted model deployment

watsonx.ai

The reasoning layer: a set of foundation models (IBM Granite, Llama, Mixtral and other open-source families) that you can use via a hosted API in IBM Cloud Frankfurt, or run yourself in a Cloud Pak in your own data centre. For clients where audio or source data must never leave the premises, the on-premises route is decisive.

Lakehouse · Iceberg · Presto

watsonx.data

An open lakehouse architecture built on Apache Iceberg and Presto, with a choice of query engine and connectivity to existing warehouses. For clients whose data is spread across Db2, Cloud Object Storage and existing analytics environments, this provides a unified layer for the AI application to rest on — without first migrating everything.

Model oversight · AI Act documentation

watsonx.governance

Model registration, monitoring for bias and drift, and the documentation you need for an AI Act classification as high-risk. For banks and healthcare providers that must account to DNB, DORA or NEN 7510, this is the building block that makes the difference between "we are doing something with AI" and "we can demonstrate what we are doing".

Conversational · dialogue management

Watson Assistant

The older but still widely used conversational platform, with visual dialogue management, intents and entities. It works well for high-volume customer contact where you want tight control over flows — for example, a claims bot at an insurer. For open-domain conversations, we more often opt for a custom orchestrator on watsonx.ai.

Enterprise search · document AI

Watson Discovery

The search and document AI layer: ingestion of PDFs, Word files, HTML and mainframe files, with semantic retrieval and entity extraction. It works well as the retriever beneath a watsonx.ai application for RAG, and it has connectors that can work with existing document stores.

NLU · classification · sentiment

Watson NLU & Speech-to-Text

Two older but still useful building blocks: NLU for categorisation, sentiment and entity extraction on text, and Speech-to-Text for transcription within IBM Cloud. For specific speech recognition questions, we also consider other engines. See the page building a speech recognition app for the broader trade-offs.

Not yet sure about a large project?

Test your idea first: a working prototype in 1 day

With OneDayBuild, we turn your idea into something tangible in one day for €1,150, so you can see whether further development is worth the investment. Decide to go ahead with the full build? Then we credit the full cost.

Explore OneDayBuild →

How a Watson project runs.

1

Introduction & vendor assessment

A conversation in which we understand the organisation, the existing IBM relationship and the use case. We are explicit about this: not every AI application needs a Watson layer, and not every IBM client needs to put everything on Watson. Sometimes a focused advisory session is sufficient — see our page on digital consulting for the broader advisory route. If Watson is the right choice, we record why; if it isn't, we say so too. A vendor assessment belongs before the first sprint, not after it.

2

Architecture & data residency

We map out your existing IBM stack (DB2, MQ, mainframe COBOL, FileNet, Db2 Warehouse) and agree together where the AI workload should run: IBM Cloud Frankfurt for most clients, or watsonx on Cloud Pak for Data on-premises or in a private cloud for clients with stricter requirements, such as healthcare, defence, government and some banks. We record data residency, retention, sub-processors and encryption strategy in a single architecture document, which your security architect and the Data Protection Officer can review.

3

Compliance classification: GDPR, NIS2, DORA, AI Act

For banks, insurers, healthcare providers and government bodies, a Watson app is inherently a compliance question. We carry out the AI Act classification (minimal risk, limited transparency or high risk), a first-pass DPIA and, for financial clients, the translation into DORA and NIS2 requirements. For healthcare clients, the architecture aligns with NEN 7510, as described on our page about NEN 7510-compliant software. watsonx.governance handles much of the logging requirements automatically, provided it is built into the design from the start.

4

Build in sprints with an evaluation set

A working build on a staging environment every sprint, with a growing evaluation set containing examples from your domain. Each time we swap the model, adjust the prompt or add a new RAG source, we run the evaluation set and see straight away whether quality improves or worsens for each cohort. For app development, we use the usual tooling: Flutter, React Native or native iOS/Android for the front end, FastAPI or Spring for the back end, connected to watsonx endpoints and an IBM Cloud account.

5

Rollout, governance handover & management

A phased rollout through a pilot group, with training for end users and a handover document for the model owner within your organisation. We link watsonx.governance dashboards to the right role, often a compliance officer or risk manager, so that oversight after go-live does not become administrative leftovers. You can have management handled by us as an agency or by your internal team. We value a clean handover and no artificial dependencies.

Compliance is not an afterthought.

For organisations choosing Watson, compliance is almost always one of the reasons. We handle the legal, security and governance layer from the first sprint, not as a closing paperwork exercise, and not as an external consultancy stream running alongside the build.

AI Act & watsonx.governance

For high-risk applications, the AI Act requires documentation, monitoring, transparency and human oversight. watsonx.governance is designed for this: model registration, evaluations, drift detection and risk classification sit in a single toolchain. We build that toolchain into the app, not alongside it.

GDPR & DPIA

For every use case involving personal data, such as customer contact, employee data, case files or claims, we carry out a first-pass DPIA and arrange data processing agreements with IBM and any sub-processors. Audio and sensitive text remain within the EU, and we show exactly which processors see what.

NIS2 & DORA for the financial sector

Banks, insurers, critical infrastructure and large service providers fall under DORA and NIS2. We align the Watson architecture, supplier management and incident response with those frameworks, so the app is not called back by risk and compliance teams at a later stage. Concretely: contractual requirements for IBM as a third party, an exit strategy, and operational resilience testing.

EU residency: IBM Cloud Frankfurt

By default, we choose IBM Cloud Frankfurt for data residency within the EU. For clients with stricter requirements, such as some banks, healthcare providers and government bodies, we run watsonx on Cloud Pak for Data on-premises or on a dedicated private cloud. We explicitly document which route has been chosen and why.

NEN 7510 for healthcare providers

For healthcare clients, we adapt the Watson architecture to the institution's NEN 7510 controls: access management, logging, encryption and supplier management. We align with the existing ISMS and with the working practices of the medical ethics committee (FG) and the information security function.

Audit trail & human oversight

Every interaction with the Watson or watsonx system leaves a traceable record: which model, which prompt, which retrievals, which output and which human check. For high-risk applications, we build explicit "human-in-the-loop" steps in before the output goes live.

FD
Fabian van Dijk Business Developer · Appfront · fabian.vandijk@appfront.nl

Frequently asked questions.

What clients typically want to know before we start a Watson or watsonx project.

Are you an IBM partner?
No. We build apps on the Watson and watsonx platform because it is the right choice for a specific type of client, but we are not an IBM partner with a quota. That is a deliberate choice: we want to be able to advise independently of any vendor. For clients with an existing IBM relationship, this is actually an advantage. We look at what works within your architecture and compliance context, not at what brings a vendor target closer. See also our page on vendor choice in AI projects.
When do you choose watsonx, and when Anthropic, OpenAI or Mistral?
In broad terms: watsonx comes out ahead when your existing IBM stack runs deep, when EU data residency and explainability matter more than the very latest benchmark, and when a strong compliance framework (the AI Act, DORA, NEN 7510) calls for a central governance platform. Anthropic, OpenAI or Mistral often wins when the organisation is cloud-native, has no IBM legacy, or when a specific model capability is decisive. In practice we often use a hybrid approach: watsonx for the regulated layer and another model for parts of the pipeline where it fits better. We set out our reasoning in more detail on custom LLM integrations.
Can we run watsonx on-premises?
Yes. watsonx is available in IBM Cloud (we usually use Frankfurt for EU data residency) and as part of Cloud Pak for Data, which runs on-premises or in a private cloud, for example on OpenShift in your own data centre. For clients whose data must never leave the organisation, such as defence, some healthcare providers and some public bodies, the on-premises route is decisive. We advise on the right route for each project and take the wider data architecture into account.
How do you handle the AI Act?
For every Watson app, we carry out an AI Act classification upfront: low risk (general text, search or summarisation applications), limited transparency obligation (chat with customers) or high risk (medical decision support, credit assessment, HR selection, legal decision support, biometrics). For high-risk applications, we arrange the mandatory documentation, data quality requirements, monitoring and the human oversight mechanism. watsonx.governance is the practical engine here: it takes over much of the logging and version administration, provided we configure it properly during the build.
How do you handle DORA and NIS2 for financial clients?
DORA applies to banks, insurers and large financial service providers; NIS2 also affects a wider range of critical infrastructure players. We translate these frameworks concretely into the Watson architecture: contractual requirements for IBM as a third party, operational resilience testing, classification of the Watson environment as a critical ICT service, and alignment with the third-party register that DORA requires.
Can you integrate with our mainframe, DB2 and MQ?
Yes. For clients with a DB2 or mainframe layer, we work with IBM MQ as the messaging bus, using DB2 connectors or a data warehouse layer in watsonx.data. For COBOL or CICS work, we use integration services and API fronting. We don't touch the mainframe unnecessarily, but we make sure the Watson app communicates reliably with your existing systems.
Do you also work with Cloud Pak for Data?
Yes. Cloud Pak for Data is the broader on-premises or multi-cloud package that watsonx sits within. For clients with OpenShift in-house, this is often the natural landing point. We then run watsonx.ai, watsonx.data and watsonx.governance within your existing platform, deployed on OpenShift via GitOps. For clients just starting out, we more often begin on IBM Cloud Frankfurt and migrate later if scale demands it.
What if we already have a Watson Assistant implementation that isn't working well?
We hear this regularly: a Watson Assistant implementation that started off well but has become rigid or poorly maintained over time. We carry out a short review: how does it perform against an evaluation set, and is a refactor within Watson Assistant sensible, or is moving to a custom orchestrator on watsonx.ai the better route? We often refactor towards a hybrid setup with more LLM and fewer rigid intents.
Who owns the code, models and prompts?
You do. We hand over the full source code, the infrastructure-as-code (Terraform, Helm charts, OpenShift manifests), the prompts, the RAG configurations and the evaluation set. The watsonx resources run in your IBM Cloud account or on your Cloud Pak installation. A later handover to another agency or an in-house team is a clean transfer.
What determines the scope of such a project?
The biggest scope drivers are the complexity of the domain, the choice between IBM Cloud hosting and an on-premises Cloud Pak, the number of source systems to connect, and the compliance burden. An AI Act high-risk application requires considerably more documentation and logging than a low-risk search app. We work in sprints with clear sprint goals, so you can steer scope sprint by sprint. An initial conversation quickly gives a realistic picture of the scope.

Talk to us about your Watson app.

A no-obligation half-hour introductory call. Tell us who will use the app, in which architecture and with which compliance context. We'll think along, give direction, and be honest about when watsonx is the right choice and when another platform or a hybrid approach fits better. Sometimes a short advisory phase is the right first step before we talk about building. You can also email directly at fabian.vandijk@appfront.nl.

Edit content