Review ask

As a clinical trial statistician or programmer, challenge anything in this benchmark: describe a problem in Comments, or propose a fix with the Edit button on any source file.

  1. Task: Is this a specification error a study team could realistically make, and should the build stop on it rather than continue?
  2. Inputs: Do they trigger the failure for the reason the summary gives?
  3. Expected failure: Is this the right error, raised at the right point, and would it tell the programmer what to fix?

The other tabs beside Comments are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Goal: record AGE for every subject from the collected demographics, requiring a value for each subject.

Input: collected demographics carrying age (AGE).

Variables:

  • AGE would be the subject's age, copied from the collected records.

Note: a subject with no recorded age leaves it missing, so the check on the completed dataset fails and no artifact is accepted.

How to fix

Decide whether the study can proceed without the value, then either correct the data or loosen the rule. When the age exists on the case report form, correct it at the governed source and rerun. When absence is genuinely possible, drop the not_missing check and let that subject's age stay missing:

- name: AGE
  type: int
  label: Age
  derivation: DM.AGE

Do not fill the gap with a placeholder age, which reports a value nobody recorded.

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
verification
condition
not_missing_failed
requirement
REQ-0375
expected/error.yaml
phase: verification
condition: not_missing_failed
spec_paths:
  - columns.AGE.verifications[0].not_missing
requirement: REQ-0375
context:
  column: AGE
  failure_count: 1
  keys:
    - STUDYID: PILOT7
      USUBJID: P7-812

Inputs

Under review
1 source file

input/dm.csv

Edit
2 rows
input/dm.csv
STUDYIDUSUBJIDAGE
PILOT754
PILOT7—

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Comments and assessment materials

Comments

Signed in with GitHub; saved in repository Discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADSLSTUDYIDStudy IdentifiercharacterCopy value from DM.STUDYID.Predecessor
ADSLUSUBJIDUnique Subject IdentifiercharacterCopy value from DM.USUBJID.Predecessor
ADSLAGEAgenumericCopy value from DM.AGE.Predecessor
VersionDateAuthorDescriptionReviewerSign-off
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml