Back to all lessons
Awareness Lessons
3 days ago

Third-Party AI Provider Breach Exposes Notion Customer Chat Transcripts

Written by AI from the linked story. Not reviewed by an editor. How this works

Notion's exposure of AI chat transcripts stemmed not from a flaw in its own systems, but from a breach at Fireworks AI, a third-party provider powering the Notion AI 'Insights' feature. This is a classic supply chain security failure: Notion's customers trusted Notion, but their data was at risk through a vendor Notion trusted. The incident highlights that sensitive customer data — including potentially credentials pasted into AI chats — can be exposed even when your own infrastructure is secure. Organizations must treat third-party data processors as an extension of their own attack surface and apply commensurate due diligence and contractual controls.

Tactical Insight

Immediate actions

  • Notify all affected customers promptly and advise them to rotate any credentials or sensitive information shared via AI chat features.
  • Audit which third-party vendors currently store or process customer data and assess the scope of data exposed by each.

Long-term improvements

  • Establish a formal third-party risk management program requiring vendors to meet defined security standards before handling customer data.
  • Minimize data shared with AI sub-processors by applying data minimization principles — avoid storing full chat transcripts unless operationally essential.
  • Include mandatory breach notification SLAs and security assessment rights in all vendor contracts.

Detection measures

  • Implement continuous monitoring of third-party vendor security posture using supply chain risk intelligence tools.
  • Require vendors to provide timely, structured incident reports so downstream notifications to customers can be issued without delay.

Back this up with a control

All controls and vendors

Training helps people spot this. These controls make the attack fail even on the day someone does not.