Review ask

As a clinical trial statistician or programmer, answer two short questions in Your review: the task and the inputs. Agreeing with both approves this benchmark; disagreeing with either needs a comment. Propose a fix with the Edit button on any source file, or add it to your comments.

We suggest spending no more than 5 minutes on a review. The other tabs beside Your review are background for assessment, not under review.

Summary

Lifecycle: draftEditUnder review
What this benchmark means
README.md

Public entries: Python and R. Passing coverage requires an installed inventory.

Goal: derive each subject's end-of-study date (EOSDT) from the subject's disposition record, reporting a subject with several records instead of stopping the run.

Input: demographics records with disposition records carrying the disposition category, decoded term, and start date.

Variables:

  • EOSDT would be the start date of the subject's end-of-study disposition record, and blank when the subject has none.

Note: a subject with several disposition records was to be reported, yet nothing says which of them gives the end-of-study date. Such a subject would have no single date to read, so the specification is rejected before any record is read and no artifact is accepted.

How to fix

Decide which record gives a repeated subject its date, such as the latest event, and declare that choice beside the warning:

intermediates:
  - id: DS_EOS
    dataset: DS
    key: [STUDYID, USUBJID]
    filter: "DS.DSCAT = 'DISPOSITION EVENT'"
    order_by: [DS.DSSTDTC]
    keep: last
    verifications:
      - unique: {columns: [STUDYID, USUBJID], severity: warning}

When every subject must have exactly one such record, keep the check at its default severity instead, so a repeated subject stops the run:

    verifications:
      - unique: [STUDYID, USUBJID]

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
validation
condition
value_not_permitted
rule
LOOKUP-17
expected/error.yaml
phase: validation
condition: value_not_permitted
spec_paths:
  - intermediates.DS_EOS.verifications[0].unique.severity
rule: LOOKUP-17
context:
  intermediate: DS_EOS
  value: warning
  permitted: [error]

Inputs

Under review
2 source files

input/dm.csv

Edit
2 rows
input/dm.csv
STUDYIDUSUBJID
YAMAA-01
YAMAA-01

input/ds.csv

Edit
3 rows
input/ds.csv
STUDYIDUSUBJIDDSCATDSDECODDSSTDTC
YAMAA-01DISPOSITION EVENTCOMPLETED2024-01-10
YAMAA-01DISPOSITION EVENTWITHDRAWAL BY SUBJECT2024-01-15
YAMAA-01DISPOSITION EVENTCOMPLETED2024-02-11

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Human review and assessment

Your review

2 questions and your comments · View benchmark discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADSLSTUDYIDStudy IdentifiercharacterCopy value from DM.STUDYID.Predecessor
ADSLUSUBJIDUnique Subject IdentifiercharacterCopy value from DM.USUBJID.Predecessor
ADSLEOSDTEnd of Study DatecharacterTake DSSTDTC from the DS record matching on STUDYID and USUBJID, where DS.DSCAT = 'DISPOSITION EVENT', and no match yields blank.Derived
VersionDateAuthorDescriptionReviewerSign-off
1.72026-10-20yamaa docs buildRead a specification in the 1.0 surface as its 0.5 counterpart; state that missing values stay missing where a mapping declares no missing handler, and leave out a declared missing answer that restates a handler's default
1.62026-10-17yamaa docs buildDescribe collected date parts written as ISO 8601 date text and times of day counted in seconds since midnight
1.52026-10-17yamaa docs buildName collected precision in words instead of letter codes; state imputation fallbacks, minimum source precision, bounds ignored outside the collected period, and invalid text with no handler as an error; describe date and datetime shifts, imputation flag codes, and partial text giving no date part
1.42026-10-15yamaa docs buildState datetime precision codes through the hour and minute, and complete only the time parts a collected datetime lacks
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml