Skip to content
OpenAdvisories

Weakness (CWE)

CWE-1426: Improper Validation of Generative AI Output

Base Incomplete Mapping discouraged

The product invokes a generative AI/ML
component whose behaviors and outputs cannot be directly
controlled, but the product does not validate or
insufficiently validates the outputs to ensure that they
align with the intended security, content, or privacy
policy.

How to prevent it (4 mitigations)

  1. Architecture and Design

    Since the output from a generative AI component (such as an LLM) cannot be trusted, ensure that it operates in an untrusted or non-privileged space.

  2. Operation

    Use "semantic comparators," which are mechanisms that
    provide semantic comparison to identify objects that might appear
    different but are semantically similar.

  3. Operation

    Use components that operate
    externally to the system to monitor the output and
    act as a moderator. These components are called
    different terms, such as supervisors or
    guardrails.

  4. Build and Compilation

    During model training, use an appropriate variety of good
    and bad examples to guide preferred outputs.

Source: MITRE CWE-1426

All Critical High Medium Low Exploited only Public exploit

1 result · Clear filters · Feed

  • Medium 5.0
    CVE-2025-62453

    GitHub Copilot and Visual Studio Code Security Feature Bypass Vulnerability

    Improper validation of generative ai output in GitHub Copilot and Visual Studio Code allows an authorized attacker to bypass a security feature locally.

    Microsoft Visual Studio Code