Reject Trivial Filter

Review ask

As a clinical trial statistician or programmer, answer two short questions in Your review: the task and the inputs. Agreeing with both approves this benchmark; disagreeing with either needs a comment. Propose a fix with the Edit button on any source file, or add it to your comments.

We suggest spending no more than 5 minutes on a review. The other tabs beside Your review are background for assessment, not under review.

Summary

EditUnder reviewWhat this benchmark means

README.md

Public entries: Python and R. Passing coverage requires an installed inventory.

Goal: carry the planned arm (ARM) and the actual arm (ACTARM) for each subject.

Input: EDC output in long form, one row per collected item.

Variables:

ARM would be the planned arm as collected; Unassigned when none was collected.
ACTARM would be the actual arm, a copy of the planned arm, but the copy also states which collected rows to choose among. The planned arm is one value by then rather than a set of rows, so the run is rejected before any data is read and no artifact is accepted.

How to fix

Decide whether the actual arm repeats a value the record already carries or reads the collected rows itself. Repeating the planned arm names it and nothing else:

- name: ACTARM
  type: str
  label: Description of Actual Arm
  derivation: ARM

When the actual arm is collected in its own right, read the rows that hold it, exactly as the planned arm does:

- name: ACTARM
  type: str
  label: Description of Actual Arm
  derivation:
    first_available:
      sources:
        - filter: ODM.ItemOID = 'IT.DM.ACTARM'
          variable: ODM.Value
      missing: Unassigned

Expected failure

Editthe run is rejected; no artifact is accepted

expected/error.yaml

phase: validation
condition: prohibited_construct
rule: LOOKUP-8

expected/error.yaml

phase: validation
condition: prohibited_construct
spec_paths:
  - columns.ACTARM.derivation.source.filter
rule: LOOKUP-8
context:
  identifier: ARM

YAML specification

1 spec file

spec.yaml

Edit48 lines

1yamaa: "1.0"2type: spec3model: SDTM4domain: DM5keys: [STUDYID, USUBJID]67input:8  ODM: input/odm.csv910output:11  path: dm.csv12  columns: [DOMAIN, STUDYID, USUBJID, ARM, ACTARM]1314columns:15  - name: DOMAIN16    type: str17    label: Domain Abbreviation18    derivation: "'DM'"1920  - name: STUDYID21    type: str22    label: Study Identifier23    derivation: ODM.StudyOID2425  - name: USUBJID26    type: str27    label: Unique Subject Identifier28    derivation: ODM.SubjectKey2930  - name: ARM31    type: str32    label: Description of Planned Arm33    derivation:34      first_available:35        sources:36          - filter: ODM.ItemOID = 'IT.DM.ARM'37            variable: ODM.Value38        missing: Unassigned3940  # ARM is an output column holding one value per subject, so the filter41  # has no records to choose among.42  - name: ACTARM43    type: str44    label: Description of Actual Arm45    derivation:46      source:47        filter: ODM.ItemOID = 'IT.DM.ARM'48        variable: ARM

Inputs

Under review1 source file

input/odm.csv

Edit4 rows

input/odm.csv
StudyOID	MetaDataVersionOID	SubjectKey	StudyEventOID	StudyEventRepeatKey	ItemGroupOID	ItemGroupRepeatKey	ItemOID	Value
STUDY01	MDV.1	001	SCREENING	1	IG.DM	1	IT.DM.SEX	Male
STUDY01	MDV.1	001	SCREENING	1	IG.DM	1	IT.DM.AGE	34
STUDY01	MDV.1	002	SCREENING	1	IG.DM	1	IT.DM.SEX	Female
STUDY01	MDV.1	002	SCREENING	1	IG.DM	1	IT.DM.AGE	28

Unexpected Output

Under reviewNo artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Human review and assessment

Variable Name	Variable Label	Type	Origin	Conversion Definition	Variable Type	Variable Order
DOMAIN	Domain Abbreviation	Char	Assigned	Set constant value "DM".	SDTM	1
STUDYID	Study Identifier	Char	Collected	Copy value from ODM.StudyOID.	SDTM	2
USUBJID	Unique Subject Identifier	Char	Collected	Copy value from ODM.SubjectKey.	SDTM	3
ARM	Description of Planned Arm	Char	Derived	First non-missing of ODM.Value where ODM.ItemOID = 'IT.DM.ARM'; all missing → "Unassigned".	SDTM	4
ACTARM	Description of Actual Arm	Char	Derived	Copy value from ARM where ODM.ItemOID = 'IT.DM.ARM'.	SDTM	5

Version	Date	Author	Description
1.7	2026-10-20	yamaa docs build	Read a specification in the 1.0 surface as its 0.5 counterpart; state that missing values stay missing where a mapping declares no missing handler, and leave out a declared missing answer that restates a handler's default
1.6	2026-10-17	yamaa docs build	Describe collected date parts written as ISO 8601 date text and times of day counted in seconds since midnight
1.5	2026-10-17	yamaa docs build	Name collected precision in words instead of letter codes; state imputation fallbacks, minimum source precision, bounds ignored outside the collected period, and invalid text with no handler as an error; describe date and datetime shifts, imputation flag codes, and partial text giving no date part
1.4	2026-10-15	yamaa docs build	State datetime precision codes through the hour and minute, and complete only the time parts a collected datetime lacks
1.3	2026-09-29	yamaa docs build	Show study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.2	2026-09-29	yamaa docs build	Classify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.1	2026-09-29	yamaa docs build	Resolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0		yamaa docs build	Initial generation from spec.yaml

How to fix

input/odm.csv

Your review

Mapping spec