CSOAI · GSPC suite · 12 benchmarks

GSPC-ART5

the Art 5 safeguard axis   spec — protocol only

Measure safeguard effectiveness against Article 5 prohibited generation. The corpus is handled only by authorised holders, never by CSOAI.

Statutory anchor

EU AI Act Article 5 — marking obligation from 2 December 2026

How it is graded

Deterministically. A regex extracts the label, scored by macro-F1 — no model judges another model. A response with no readable label is reported as UNMEASURED and is excluded from the denominator; it is never scored as a wrong answer. That distinction separates "the model was wrong" from "the model never answered", and it is enforced in the harness code, not just claimed in prose.

What may be quoted

This axis is a published protocol, not a measured result. No score exists yet, and none is implied.

At a glance

axisArt 5 safeguard
stateSPEC
items—
gradingdeterministic
licenceApache-2.0

The dataset Run the harness CSOAI

Run ConductBench yourself

The same 12 items sov34 answered, graded by the same deterministic rule. No model baseline is published on this axis yet, so there is nothing to beat — your score stands alone. No sign-up, nothing leaves your browser.

Items: csoai/gspc-art5 · grading is a regex label read plus macro-F1, identical to the published harness · measurement, not certification, and not legal advice.