Synthetic Face
Social-Media Benchmark
Does your detector still catch an AI-generated face after it has been through a social feed, compressed, resized, and re-encoded, rather than arriving as a clean studio render?

Clean-render accuracy is not field accuracy.
Detectors that score well on clean synthetic faces often degrade sharply once an image has been through a platform's upload and re-encode pipeline. This benchmark isolates that gap.
Every item is labeled on a two-part axis, so performance can be read per cell rather than as a single average.
Twelve cells, read as a grid.
Skin tone uses a 6-band ordinal scale reconciled against Individual Typology Angle, so cells stay comparable across items. Swatches are indicative of the band, not a measured value.
Each condition emulates a platform pipeline.
Applied identically to reals and fakes. Facebook, Instagram, TikTok, and X pipelines plus a compression, blur, noise, and resize sweep.
How the corpus is built and labeled.
Every item names its attack with a TTP tag.
A pass or fail count does not tell you what to fix. Each item carries a Tactic, Technique, and Procedure tag: the tactic is synthetic impersonation, the technique is identity-conditioned synthesis, and the procedure is the specific generator. Group misses by any of the three to target a fix.
What it is for, and what it is not.
- Detector evaluation and robustness testing
- Locating where a detector breaks, by cell and by condition
- Training and fine-tuning as the corpus grows
- One synthesis family (SDXL + InstantID); more generators on the roadmap
- Frontal face crops; not a census of the attack surface
- Demographic labels are perceptual consensus review, not biometric ground truth
Synthetic faces, one per cell.
Query the corpus the way you would query a database.
Every dimension is a filter. Compose them, read a live .total, then pull only what you need.
GET /v1/items ?benchmark=synthetic-face-v1 &kind=fake &skin_tone=intermediate &gender=female &condition=clean
Pull it and score your detector.
Access is via the Margen platform. Generate an API key, then follow the API docs to pull the catalog and measure per cell and per condition.







