Direct answer
Track every incident under one identifier. First verify the signal, then determine the incident type, severity and affected scope. Contain the harm, preserve evidence and give required notifications. After correcting the root cause, retest the system under the same conditions. An incident cannot be closed merely because 'we made a change'. Closure requires evidence that affected surfaces were corrected, no new error was introduced and recurrence controls work.
In plain language
Imagine a water leak in a building. Wiping the floor does not close the incident. You shut the valve, find every affected room, repair the pipe, check the electricity and walls, and then verify that the same place no longer leaks.
Why this matters
One inaccurate output may have propagated to other languages, caches, datasets, customer decisions or external platforms. Correcting only the visible example does not stop new incidents from the same root cause.
Do not confuse
- An error is a departure from expected behaviour; not every error is a security incident.
- A security incident affects or threatens confidentiality, integrity or availability.
- A privacy or personal-data breach may require its own legal and operational assessment.
- A representation incident materially presents an entity inaccurately, incompletely, out of date or without evidence.
- A near miss is a hazardous condition detected before harm; a known limitation is a system boundary recorded in advance.
What should you do?
- Open the signal under one incident identifier and record first-seen time, source, system, version and reporter.
- Determine type, severity, affected people and surfaces without hiding uncertainty.
- Contain harm through shutdown, quarantine, access removal or a safe alternative where necessary.
- Preserve event records, prompts, outputs, data, models, tools, versions and decision evidence.
- Notify affected people, customers, providers or competent authorities in time where applicable.
- Correct the root cause and address derived records, caches, vector stores and downstream surfaces.
- Retest with the same method, test regression, convert the lesson into a control and close with reasons.
How do you audit it?
- Does the incident have one identifier, an owner and a complete timeline?
- Were type, severity and impact scope determined from evidence?
- Did containment reduce harm while limiting unnecessary loss of service?
- Was evidence preserved in a form suitable for incident review?
- Were the notification decision, recipients, timing and reasons recorded?
- Was the root cause distinguished from the visible symptom?
- Was the incident closed without evidence of correction, live retest, regression and recurrence prevention?
Limit
Not every wrong AI answer is a cybersecurity incident, personal-data breach or serious incident requiring notification under law. Classification, recipient and deadline require specialist assessment based on effect, system role, contract, sector and applicable law.
Remember in one sentence
An incident closes not when the symptom disappears, but when the cause is corrected and the outcome verified.
Sources for this record
- S35W3C, *PROV-O: The PROV Ontology*Standard
- S36W3C, *Trace Context*Standard
- S37OpenTelemetry, *General Trace Semantic Conventions*Standard and project documentation
- S38NIST AI 600-1, *Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile*Voluntary standards-oriented institutional guidance
- S41NCSC and partner agencies, *Guidelines for Secure AI System Development*Official multi-agency security guidance
- S42NIST SP 800-61 Rev. 3, *Incident Response Recommendations and Considerations for Cybersecurity Risk Management*Voluntary standards-oriented institutional guidance
- S44NIST, *AI Risk Management Framework Playbook* and AI RMF CoreVoluntary implementation guidance

