Have a question?
Message sent Close

AI Governance in Financial Crime Compliance: Model Risk, Explainability and Automated Alerting

Home Knowledge Hub AI Governance in Financial Crime Compliance
Practitioner Guide

AI Governance in Financial Crime Compliance: Model Risk, Explainability and Automated Alerting

Most AI governance material is written for organisations in general. Financial crime compliance is a specific case: the systems are already deployed, the supervisory expectations predate the AI regulations, and the consequences of an unexplainable decision are legal rather than reputational. This guide sets out what AI oversight actually means inside an AML function.

Short answer (read this first)

  • AML systems are largely governed by model risk rules, not AI-specific ones. Supervisory expectations for model development, validation and governance came first and still apply
  • Most AML systems are not classified as high-risk under the EU AI Act’s Annex III list — but that is not the same as being out of scope
  • Explainability is a legal requirement in this domain, because an alert decision has to be defensible to a supervisor and, in some cases, to a court
  • The Wolfsberg Group has published five principles for using AI and machine learning in financial crime compliance, and these are the practical industry benchmark
  • Human decision-making stays in the loop. AI supports the suspicious activity determination; it does not make it

Where AI already sits in the AML stack

AI and machine learning are not a future consideration for financial crime functions. They are already embedded across the control environment:

Control Typical AI application Primary governance concern
Transaction monitoring Anomaly detection, alert scoring, threshold tuning, alert suppression Model risk, false negatives, threshold justification
Sanctions screening Fuzzy name matching, score-based hit prioritisation Explainability of a match or dismissal, tuning evidence
PEP and adverse media Entity resolution, relevance classification, article scoring Source reliability, bias, false attribution
Customer risk rating Dynamic risk scoring across attributes and behaviour Fairness, proxy discrimination, contestability
CDD and onboarding Document verification, biometric matching, data extraction Accuracy across demographics, vendor dependency
Investigation Case summarisation, narrative drafting, network analysis Hallucination, evidence integrity, reviewer over-reliance

Model risk came first

Financial crime functions have been governed on this question for over a decade. Supervisory model risk management guidance — most influentially the US interagency guidance on model risk management — established a structure that maps almost directly onto what AI governance frameworks now ask for:

  • Development and implementation — documented design, data quality, testing before deployment
  • Validation — independent challenge by people who did not build the model
  • Governance — ownership, policy, inventory, board-level reporting

The practical consequence for an AML function is that AI governance is not a new discipline bolted on. It is an extension of a model risk framework that should already exist, applied to systems that are harder to validate because their behaviour is learned rather than specified.

The gap that catches firms out. Rules-based monitoring can be validated by inspection — you can read the rule. A learned model cannot. Validation shifts from checking logic to testing behaviour: benchmarking against known outcomes, above-the-line and below-the-line testing, and monitoring for drift after deployment. Firms that carry their old validation approach into a machine learning system usually find the gap during an examination rather than before one.

The Wolfsberg principles

The Wolfsberg Group — an association of global banks whose guidance, while not regulation, is widely treated as a benchmark — published Principles for Using Artificial Intelligence and Machine Learning in Financial Crime Compliance. The Group supports the use of AI and machine learning to detect, investigate and manage financial crime risk, provided data ethics principles inform that use to ensure fair, effective and explainable outcomes.

Five elements sit at the centre of the Principles: legitimate purpose, proportionate use, design and technical expertise, accountability and oversight, and openness and transparency. Translated into practice, they ask a compliance function to be able to answer:

  • Why this technology is being used for this control, and what problem it solves
  • Whether the data used is proportionate to that purpose, including protected attributes
  • Who understands the model well enough to challenge it
  • Who owns the outcome when it goes wrong
  • What regulators, risk executives and affected customers are told about its use

One point in the Principles is frequently misread. They call for assessing the margin of error in an AI or ML solution — not for eliminating it. No industry standard exists for comparing human error rates against model error rates, and it is unreasonable to expect a zero error rate. The obligation is to define, document and monitor error, and to manage it as you would manage human error, with risk-appropriate indicators.

Explainability is not optional here

In most domains, explainability is a governance preference. In financial crime compliance it is operationally load-bearing, because every material decision has to be defensible after the fact:

To a supervisor

An examiner reviewing an alert that was closed will ask why. “The model scored it low” is not an answer. The firm needs to show what drove the score and why the threshold was set where it was.

To a customer

Screening decisions lead to account restrictions and exits. Where a customer contests a decision or a regulator asks about de-risking, the firm must be able to explain the basis without relying on the model as an authority.

In an enforcement context

Where a firm is examined over missed activity, the question is whether the control was reasonably designed. An unexplainable system is difficult to defend as reasonably designed, regardless of aggregate performance.

To the person doing the work

An analyst who cannot see why an alert fired cannot exercise judgement about it. Opaque scoring produces reviewer over-reliance, where the human in the loop confirms the model rather than challenging it.

Human in the loop, meaningfully. Mature implementations keep the suspicious activity determination with a person: the model surfaces and prioritises, the analyst decides, and the decision to report to a financial intelligence unit remains human. That structure only works if the analyst is given enough of the model’s reasoning to disagree with it.

Where AML systems sit under the EU AI Act

This is the question most often answered badly, in both directions.

Transaction monitoring and sanctions screening systems are generally not captured by the Act’s Annex III high-risk list, which covers areas such as creditworthiness assessment and risk pricing in life and health insurance. The Act’s recitals also indicate that AI systems used to detect fraud in financial services should not be treated as high-risk on that basis.

That conclusion is frequently over-extended into “the AI Act does not apply to us.” It does not follow, for several reasons:

  • Classification is by use case, not by department. A customer risk rating model that feeds credit or product decisions may be captured even if the monitoring engine beside it is not
  • AI literacy obligations apply broadly to providers and deployers of AI systems, regardless of risk tier — which creates a staff competence requirement in functions using these tools
  • General-purpose AI obligations attach to the models underneath, including where a firm builds investigation tooling on a foundation model
  • Sectoral supervision continues regardless. A financial regulator’s expectations about model governance do not soften because a system falls outside Annex III
  • Other jurisdictions classify differently. A group operating across the EU, UK, US and GCC cannot apply one classification globally

The practical position

Determining that an AML system is not high-risk under the EU AI Act is a governance finding that should be documented, dated and revisited — not an exemption to be assumed. The analysis itself is evidence of oversight; the absence of one is evidence of its lack.

Auditability of automated alerting

Where AI is used in monitoring, the audit trail has to answer more than “what happened.” A defensible record covers:

  • Model version in force at the time of the decision, and when it last changed
  • Inputs the model saw, including data that was missing or stale
  • Score and rationale — the factors that drove the outcome, at a level an analyst can read
  • Threshold configuration and the evidence base for it, including tuning history
  • Suppression logic — what was not alerted, and on what basis, which is the hardest part to reconstruct after the fact
  • Human action — who reviewed it, what they concluded, and whether they overrode the model
  • Override rates over time, because a falling override rate can indicate reviewer over-reliance rather than improving accuracy

Suppression deserves particular attention. A system that closes low-scoring alerts without human review is making a materiality judgement, and that judgement needs the same documentation, validation and monitoring as one that generates an alert. Firms usually instrument what the model flagged far better than what it silently dismissed.

Building the oversight function

Inventory first

List every AI or ML component in the financial crime stack, including vendor features enabled by default and anything staff have adopted informally. Firms consistently find more than they expected, particularly in investigation tooling.

Own each one

Every model needs a named owner accountable for its performance, and independent validation by someone who did not build it. Where a vendor supplies the model, the firm still owns the outcome.

Test what you cannot read

Above-the-line and below-the-line testing, benchmarking against known typologies, and periodic re-validation after retraining. Drift monitoring matters more than initial accuracy.

Train the reviewers

Analysts need enough understanding of the model to challenge it, and enough authority to do so. A human in the loop who cannot meaningfully disagree is documentation, not a control.

Read next:

Why financial crime teams are well placed for this work

AML and KYC professionals often assume AI governance belongs to technology or legal. In practice, the discipline it most resembles is theirs. A financial crime function already maintains an inventory of controls, classifies risk, documents rationale, tests thresholds, handles escalation and defends decisions to a supervisor. That is the shape of AI governance, applied to a different subject.

What has to be added is specific rather than vast: how models fail, what validation looks like when logic cannot be read, and how the AI regulations interact with obligations the function already carries. For a compliance professional, that is a matter of months rather than years — and it makes the function considerably harder to replace.

AI oversight, taught for compliance professionals

The Certified AI Governance & Security Analyst (CAIGSA) covers AI governance and AI security together — the EU AI Act, NIST AI RMF and ISO/IEC 42001, AI risk assessment, adversarial threats and human oversight controls — with a dedicated section on AI governance in financial crime compliance, covering model risk in transaction monitoring, explainability in sanctions and PEP screening, and the auditability of automated alerting.

No prerequisites, USD 199, no annual maintenance fee. Assessed by examination, independently accredited and blockchain-verified through ONRIGA.

ACBM issues the CAIGSA credential referenced in this article.

Sources:

  • Wolfsberg Group — Principles for Using Artificial Intelligence and Machine Learning in Financial Crime Compliance
  • Wolfsberg Group — Statement on Effective Monitoring for Suspicious Activity
  • FATF — reporting on opportunities and challenges of new technologies for AML/CFT
  • US interagency supervisory guidance on model risk management
  • Regulation (EU) 2024/1689 — the EU Artificial Intelligence Act, including Annex III and associated recitals
  • NIST AI Risk Management Framework

This article is general guidance and does not constitute legal or regulatory advice. Classification under the EU AI Act and applicable supervisory expectations depend on the specific system, use case and jurisdiction, and should be assessed with qualified advice.

Select your currency