Reject a Terminology Standard Define-XML Does Not Name

Review ask

As a clinical trial statistician or programmer, answer two short questions in Your review: the task and the inputs. Agreeing with both approves this benchmark; disagreeing with either needs a comment. Propose a fix with the Edit button on any source file, or add it to your comments.

We suggest spending no more than 5 minutes on a review. The other tabs beside Your review are background for assessment, not under review.

Summary

EditUnder reviewWhat this benchmark means

README.md

Public entries: Python and R. Passing coverage requires an installed inventory.

Goal: carry the collected sex (SEX) for each subject, coded with the study's controlled terminology for sex.

Input: collected demographics with the study and subject identifiers and the recorded sex code.

Variables:

SEX would be the subject's recorded sex, one of the codes the terminology lists: F, M or U.

Note: the sex terminology names the published standard it is drawn from. That name, CDISC CT, is not one of the standard names Define-XML publishes, so the study's terminology is rejected as soon as it is read, before any record is read and before any submission document is generated.

How to fix

Name the published terminology as Define-XML spells it: CDISC controlled terminology is CDISC/NCI.

codelists:
  - standard:
      name: CDISC/NCI
      publishing_set: SDTM
      version: '2023-12-15'

A list the sponsor defines, rather than draws from published terminology, belongs in a codelist source that names no standard.

Expected failure

Editthe run is rejected; no artifact is accepted

expected/error.yaml

phase: validation
condition: value_not_permitted
rule: SCHEMA-12

expected/error.yaml

phase: validation
condition: value_not_permitted
spec_paths:
  - codelists[0].standard.name
rule: SCHEMA-12
context:
  value: CDISC CT
  permitted:
    - ADaMIG
    - ADaMIG-MD
    - BIMO
    - CDISC/NCI
    - SDTMIG
    - SDTMIG-AP
    - SDTMIG-MD
    - SENDIG
    - SENDIG-AR
    - SENDIG-DART
    - SENDIG-GENETOX

YAML specification

1 spec file

spec.yaml

Edit32 lines

1yamaa: "1.0"2type: spec3model: SDTM4domain: DM5keys: [STUDYID, USUBJID]6input:7  DM_RAW: input/dm_raw.csv89output:10  path: dm.csv11  columns: [STUDYID, USUBJID, SEX]1213columns:14  - name: STUDYID15    type: str16    label: Study Identifier17    derivation: DM_RAW.STUDYID1819  - name: USUBJID20    type: str21    label: Unique Subject Identifier22    derivation: DM_RAW.USUBJID2324  - name: SEX25    type: str26    label: Sex27    derivation: DM_RAW.SEX28    submission:29      codelist: SEX30      origins:31        - type: Collected32          source: Investigator

Inputs

Under review1 source file

input/dm_raw.csv

Edit2 rows

input/dm_raw.csv
STUDYID	USUBJID	SEX
YAMAA-01		F
YAMAA-01		M

Unexpected Output

Under reviewNo artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Human review and assessment

Variable Name	Variable Label	Type	Controlled Terms or Format	Origin	Conversion Definition	Variable Type	Variable Order
STUDYID	Study Identifier	Char		Collected	Copy value from DM_RAW.STUDYID.	SDTM	1
USUBJID	Unique Subject Identifier	Char		Collected	Copy value from DM_RAW.USUBJID.	SDTM	2
SEX	Sex	Char	Sex	Collected	Copy value from DM_RAW.SEX.	SDTM	3

Codelist ID	Name	Value	Decode	Codelist NCI alias	Value NCI alias	Extensible
SEX	Sex	F	Female	C66731	C16576	No
SEX	Sex	M	Male	C66731	C20197	No
SEX	Sex	U	Unknown	C66731	C17998	No

Version	Date	Author	Description
1.7	2026-10-20	yamaa docs build	Read a specification in the 1.0 surface as its 0.5 counterpart; state that missing values stay missing where a mapping declares no missing handler, and leave out a declared missing answer that restates a handler's default
1.6	2026-10-17	yamaa docs build	Describe collected date parts written as ISO 8601 date text and times of day counted in seconds since midnight
1.5	2026-10-17	yamaa docs build	Name collected precision in words instead of letter codes; state imputation fallbacks, minimum source precision, bounds ignored outside the collected period, and invalid text with no handler as an error; describe date and datetime shifts, imputation flag codes, and partial text giving no date part
1.4	2026-10-15	yamaa docs build	State datetime precision codes through the hour and minute, and complete only the time parts a collected datetime lacks
1.3	2026-09-29	yamaa docs build	Show study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.2	2026-09-29	yamaa docs build	Classify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.1	2026-09-29	yamaa docs build	Resolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0		yamaa docs build	Initial generation from spec.yaml

How to fix

input/dm_raw.csv

Your review

Mapping spec