← All discussions

R
Other Discussion

FCA AI Live Testing Snags Bank Approvals

Ramandeep Reddy · 20 Oct 2026

Compliance sign-off in July 2026 has exposed a nasty gap at our bank: product teams want several third-party AI pilots live by September, but model vendors won't provide training-data lineage, bias-test results or evidence that outputs meet our Consumer Duty obligations. The FCA's AI Live Testing programme is pushing us to explain these controls, yet risk won't approve customer use and we've already promised the board a September launch. Would you allow sandbox-only pilots, delay deployment, or accept compensating controls, and what evidence would you require before a model can affect customers?
👍 487 💬 4

4 replies

D

Daniela Graham · 20 Oct 2026

We hit that roadblock just before summer. What got us moving was a simple data contract with the vendor and feeding their model outputs into our own monitoring tool, the open source fairness library from Google, which let us run a controlled live cohort while the full evidence package was still being assembled.

Chloe Fox · 20 Oct 2026

I couldn't get the vendor to run a quick bias audit using the open‑source Aequitas library and give us the summary PDF, but they said their model is proprietary and wouldn’t let us attach any external code, so we got nothing useful.

Adrian Moore · 20 Oct 2026

Honestly, the board will pull the plug if we go live without solid evidence, so we should hit pause.
K

Kennedy Brooks · 20 Oct 2026

Look, the hidden trap here is that getting a model approved under AI Live Testing won't protect us if the regulator later demands proof of explainable decision making that our current vendors simply haven’t built into their pipelines. Without explicit evidence, every customer who flags a mismatch could become a liability that triggers a Conduct Commission probe before the September rollout even hits the floor. We might need to tie launch gates to a vendor commitment to produce a formal lineage report within weeks, otherwise I’d rather delay the pilot than risk a brand crisis downstream.

Log in or create a free account to join the conversation.