Review ask

As a clinical trial statistician or programmer, answer two short questions in Your review: the task and the inputs. Agreeing with both approves this benchmark; disagreeing with either needs a comment. Propose a fix with the Edit button on any source file, or add it to your comments.

We suggest spending no more than 5 minutes on a review. The other tabs beside Your review are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Public entries: Python and R. Passing coverage requires an installed inventory.

Goal: attach the reference upper limit (LBSTNRHI) to each collected result by test and sex.

Input: collected results carrying test code (LBTESTCD) and sex (SEX), plus a reference table carrying an upper limit (NRHI) per test code and sex.

Variables:

  • LBSTNRHI would be the upper limit read from the reference table matched on test code and sex. Every result is required to find its reference entry, so a result whose test code and sex have none rejects the run with no artifact accepted.

How to fix

Add the governed AST/M range to the reference table when one exists. If an absent range is intentionally represented by a missing value, drop require_match: true:

intermediates:
  - id: REFRANGE
    dataset: LBRANGE
    key: [LBTESTCD, SEX]

The lookup then returns a missing value for every column read through it when a complete key has no match, and the run counts each such answer under absent. Declaring absent beside require_match: true is refused as a contradiction.

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
join
condition
unmatched_key
rule
LOOKUP-24
expected/error.yaml
phase: join
condition: unmatched_key
spec_paths:
  - intermediates.REFRANGE
rule: LOOKUP-24
context:
  intermediate: REFRANGE
  dataset: LBRANGE
  key: [LBTESTCD, SEX]
  intermediate_key:
    LBTESTCD: AST
    SEX: M
  keys:
    - STUDYID: PILOT7
      USUBJID: P7-542
      LBSEQ: 1

Inputs

Under review
2 source files

input/lb_raw.csv

Edit
2 rows
input/lb_raw.csv
STUDYIDUSUBJIDLBSEQLBTESTCDSEX
PILOT71ALTF
PILOT71ASTM

input/lbrange.csv

Edit
3 rows
input/lbrange.csv
LBTESTCDSEXNRHI
ALTF33
ALTM41
ASTF32

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Human review and assessment

Your review

2 questions and your comments · View benchmark discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Variable NameVariable LabelTypeLengthControlled Terms or FormatOriginCoreConversion DefinitionVariable TypeVariable OrderComments for Define
STUDYIDStudy IdentifierCharCollectedCopy value from LB_RAW.STUDYID.SDTM1
USUBJIDUnique Subject IdentifierCharCollectedCopy value from LB_RAW.USUBJID.SDTM2
LBSEQSequence NumberNumCollectedCopy value from LB_RAW.LBSEQ.SDTM3
LBTESTCDLab Test or Examination Short NameCharCollectedCopy value from LB_RAW.LBTESTCD.SDTM4
SEXSexCharCollectedCopy value from LB_RAW.SEX.SDTM5
LBSTNRHIReference Range Upper Limit-Std UnitsNumDerivedTake NRHI from the LBRANGE record matching on LBTESTCD and SEX, and a row with no match is an error.SDTM6
VersionDateAuthorDescriptionReviewerSign-off
1.72026-10-20yamaa docs buildRead a specification in the 1.0 surface as its 0.5 counterpart; state that missing values stay missing where a mapping declares no missing handler, and leave out a declared missing answer that restates a handler's default
1.62026-10-17yamaa docs buildDescribe collected date parts written as ISO 8601 date text and times of day counted in seconds since midnight
1.52026-10-17yamaa docs buildName collected precision in words instead of letter codes; state imputation fallbacks, minimum source precision, bounds ignored outside the collected period, and invalid text with no handler as an error; describe date and datetime shifts, imputation flag codes, and partial text giving no date part
1.42026-10-15yamaa docs buildState datetime precision codes through the hour and minute, and complete only the time parts a collected datetime lacks
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml