Review ask

As a clinical trial statistician or programmer, answer two short questions in Your review: the task and the inputs. Agreeing with both approves this benchmark; disagreeing with either needs a comment. Propose a fix with the Edit button on any source file, or add it to your comments.

We suggest spending no more than 5 minutes on a review. The other tabs beside Your review are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Public entries: Python and R. Passing coverage requires an installed inventory.

Goal: translate the collected overall response into its analysis category (AVALC).

Input: response records carrying the collected overall response (OVRLRESP).

Variables:

  • AVALC would contain the analysis category matching the collected overall response: CR means COMPLETE RESPONSE, PR means PARTIAL RESPONSE, SD means STABLE DISEASE, and PD means PROGRESSIVE DISEASE. Every response must be present and listed; the collected value NE is not, so the run is rejected with no artifact accepted.

How to fix

If NE is a valid collected response, add its governed analysis meaning to the dictionary:

mapping:
  source: RS.OVRLRESP
  dict:
    CR: COMPLETE RESPONSE
    PR: PARTIAL RESPONSE
    SD: STABLE DISEASE
    PD: PROGRESSIVE DISEASE
    NE: NOT EVALUABLE

If an unknown response should instead produce a missing result, state that missing-value answer explicitly with unmapped: null. Prefer completing the dictionary when the value is valid.

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
mapping
condition
unmapped_value
rule
COLUMN-10
expected/error.yaml
phase: mapping
condition: unmapped_value
spec_paths:
  - columns.AVALC.derivation.mapping
rule: COLUMN-10
context:
  source: RS.OVRLRESP
  value: NE
  keys:
    - STUDYID: PILOT7
      USUBJID: P7-702
      RSSEQ: 1

Inputs

Under review
1 source file

input/rs.csv

Edit
1 row
input/rs.csv
STUDYIDUSUBJIDRSSEQOVRLRESP
PILOT71NE

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Human review and assessment

Your review

2 questions and your comments · View benchmark discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADRSSTUDYIDStudy IdentifiercharacterCopy value from RS.STUDYID.Predecessor
ADRSUSUBJIDUnique Subject IdentifiercharacterCopy value from RS.USUBJID.Predecessor
ADRSRSSEQSequence NumbernumericCopy value from RS.RSSEQ.Predecessor
ADRSAVALCAnalysis Value (C)characterRecode RS.OVRLRESP: "CR" → "COMPLETE RESPONSE", "PR" → "PARTIAL RESPONSE", "SD" → "STABLE DISEASE", "PD" → "PROGRESSIVE DISEASE"; missing values stay missing; unlisted values are errors.Derived
VersionDateAuthorDescriptionReviewerSign-off
1.72026-10-20yamaa docs buildRead a specification in the 1.0 surface as its 0.5 counterpart; state that missing values stay missing where a mapping declares no missing handler, and leave out a declared missing answer that restates a handler's default
1.62026-10-17yamaa docs buildDescribe collected date parts written as ISO 8601 date text and times of day counted in seconds since midnight
1.52026-10-17yamaa docs buildName collected precision in words instead of letter codes; state imputation fallbacks, minimum source precision, bounds ignored outside the collected period, and invalid text with no handler as an error; describe date and datetime shifts, imputation flag codes, and partial text giving no date part
1.42026-10-15yamaa docs buildState datetime precision codes through the hour and minute, and complete only the time parts a collected datetime lacks
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml