Review ask

As a clinical trial statistician or programmer, challenge anything in this benchmark: describe a problem in Comments, or propose a fix with the Edit button on any source file.

  1. Task: Is this a specification error a study team could realistically make, and should the build stop on it rather than continue?
  2. Inputs: Do they trigger the failure for the reason the summary gives?
  3. Expected failure: Is this the right error, raised at the right point, and would it tell the programmer what to fix?

The other tabs beside Comments are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Goal: carry the treatment a subject received and the dose they received of it onto TRT01A and TRT01DOSE.

Input: demographics records for each subject, with exposure records carrying treatment (EXTRT), dose (EXDOSE), sequence number (EXSEQ), and start date (EXSTDTC).

Variables:

  • TRT01A would contain the treatment from the subject's chosen exposure record.
  • TRT01DOSE would contain the dose from that same record.

Note: the pair must come from one administration, but nothing says which one, so a subject matching more than one exposure record has no single answer, and the run is rejected with no artifact accepted.

How to fix

State the full order and which end of that order to keep. To choose the earliest administration, read the sequence as an integer so ties on the date are broken numerically:

input:
  EX: {path: input/ex.csv, types: {EXSEQ: int}}

intermediates:
  - id: DOSING
    dataset: EX
    order_by: [EX.EXSTDTC, EX.EXSEQ]
    keep: first

Both TRT01A and TRT01DOSE then come from that same chosen record.

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
join
condition
multiple_matches
requirement
REQ-0127
expected/error.yaml
phase: join
condition: multiple_matches
spec_paths:
  - intermediates[0]
requirement: REQ-0127
context:
  intermediate: DOSING
  dataset: EX
  key:
    - STUDYID
    - USUBJID
  intermediate_key:
    STUDYID: PILOT7
    USUBJID: P7-321
  match_count: 2
  keys:
    - STUDYID: PILOT7
      USUBJID: P7-321

Inputs

Under review
2 source files

input/dm.csv

Edit
1 row
input/dm.csv
STUDYIDUSUBJID
PILOT7

input/ex.csv

Edit
2 rows
input/ex.csv
STUDYIDUSUBJIDEXSEQEXTRTEXDOSEEXSTDTC
PILOT71Carboplatin3002023-03-01
PILOT72Pemetrexed5002023-03-22

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Comments and assessment materials

Comments

Signed in with GitHub; saved in repository Discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADSLSTUDYIDStudy IdentifiercharacterCopy value from DM.STUDYID.Predecessor
ADSLUSUBJIDUnique Subject IdentifiercharacterCopy value from DM.USUBJID.Predecessor
ADSLTRT01AActual Treatment for Period 01characterTake EXTRT from the EX record matching on the shared output keys, and a row with no match is an error.Derived
ADSLTRT01DOSEActual Dose for Period 01numericTake EXDOSE from the EX record matching on the shared output keys, and a row with no match is an error.Derived
VersionDateAuthorDescriptionReviewerSign-off
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml