Review ask

As a clinical trial statistician or programmer, challenge anything in this benchmark: describe a problem in Comments, or propose a fix with the Edit button on any source file.

  1. Task: Is this a specification error a study team could realistically make, and should the build stop on it rather than continue?
  2. Inputs: Do they trigger the failure for the reason the summary gives?
  3. Expected failure: Is this the right error, raised at the right point, and would it tell the programmer what to fix?

The other tabs beside Comments are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Goal: build one record per subject and treatment carrying DOSECUM, the total dose administered across the matching exposure records.

Input: a subject-treatment inventory carrying EXTRT, plus component exposure records carrying EXTRT, EXSEQ, and EXDOSE, where the dose is declared numeric.

Variables:

  • DOSECUM would be the total of EXDOSE across the matching exposure records for the same subject and treatment, and missing when no matching record carries a dose.

A stored dose that is not a plain number, such as 200 mg with its unit attached, is rejected while the exposure records are read, so no artifact is accepted.

How to fix

Normalize the source into separate value and unit fields before declaring the dose numeric. For this record, the corrected input should carry EXDOSE as 200 and EXDOSU as mg; then the existing declaration is valid:

EX:
  path: input/ex.csv
  types:
    EXDOSE: float

If the composite text must remain unchanged, ingest it as text, preserve it for traceability, and derive a validated numeric dose before attempting the aggregate. A numeric type declaration must not strip the unit implicitly.

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
ingest
condition
field_parse_failed
requirement
REQ-0536
expected/error.yaml
phase: ingest
condition: field_parse_failed
spec_paths:
  - input.EX.types.EXDOSE
requirement: REQ-0536
context:
  dataset: EX
  field: EXDOSE
  type: float
  value: "200 mg"

Inputs

Under review
2 source files

input/ex.csv

Edit
5 rows
input/ex.csv
STUDYIDUSUBJIDEXTRTEXSEQEXDOSE
YAMAA-01Carboplatin1100
YAMAA-01Carboplatin2200 mg
YAMAA-01Carboplatin3—
YAMAA-01Paclitaxel1150
YAMAA-01Paclitaxel2175

input/subject_treatment.csv

Edit
3 rows
input/subject_treatment.csv
STUDYIDUSUBJIDEXTRT
YAMAA-01Carboplatin
YAMAA-01Paclitaxel
YAMAA-01Cisplatin

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Comments and assessment materials

Comments

Signed in with GitHub; saved in repository Discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADEXSTUDYIDStudy IdentifiercharacterCopy value from TRT.STUDYID.Predecessor
ADEXUSUBJIDUnique Subject IdentifiercharacterCopy value from TRT.USUBJID.Predecessor
ADEXEXTRTName of TreatmentcharacterCopy value from TRT.EXTRT.Predecessor
ADEXDOSECUMCumulative DosenumericAggregate SUM(EX.EXDOSE).Derived
VersionDateAuthorDescriptionReviewerSign-off
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml