Review ask

As a clinical trial statistician or programmer, challenge anything in this benchmark: describe a problem in Comments, or propose a fix with the Edit button on any source file.

  1. Task: Is this a specification error a study team could realistically make, and should the build stop on it rather than continue?
  2. Inputs: Do they trigger the failure for the reason the summary gives?
  3. Expected failure: Is this the right error, raised at the right point, and would it tell the programmer what to fix?

The other tabs beside Comments are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Goal: translate the collected overall response into its analysis category (AVALC).

Input: response records carrying the collected overall response (OVRLRESP).

Variables:

  • AVALC would contain the analysis category matching the collected overall response: CR means COMPLETE RESPONSE, PR means PARTIAL RESPONSE, SD means STABLE DISEASE, and PD means PROGRESSIVE DISEASE. Every response must be present and listed; the collected value NE is not, so the run is rejected with no artifact accepted.

How to fix

If NE is a valid collected response, add its governed analysis meaning to the dictionary:

mapping:
  source: RS.OVRLRESP
  dict:
    CR: COMPLETE RESPONSE
    PR: PARTIAL RESPONSE
    SD: STABLE DISEASE
    PD: PROGRESSIVE DISEASE
    NE: NOT EVALUABLE

If an unknown response should instead produce a missing result, state that missing-value answer explicitly with unmapped: null. Prefer completing the dictionary when the value is valid.

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
mapping
condition
unmapped_value
requirement
REQ-0334
expected/error.yaml
phase: mapping
condition: unmapped_value
spec_paths:
  - columns.AVALC.derivation.mapping
requirement: REQ-0334
context:
  source: RS.OVRLRESP
  value: NE
  keys:
    - STUDYID: PILOT7
      USUBJID: P7-702
      RSSEQ: 1

Inputs

Under review
1 source file

input/rs.csv

Edit
1 row
input/rs.csv
STUDYIDUSUBJIDRSSEQOVRLRESP
PILOT71NE

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Comments and assessment materials

Comments

Signed in with GitHub; saved in repository Discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADRSSTUDYIDStudy IdentifiercharacterCopy value from RS.STUDYID.Predecessor
ADRSUSUBJIDUnique Subject IdentifiercharacterCopy value from RS.USUBJID.Predecessor
ADRSRSSEQSequence NumbernumericCopy value from RS.RSSEQ.Predecessor
ADRSAVALCAnalysis Value (C)characterRecode RS.OVRLRESP: "CR" → "COMPLETE RESPONSE", "PR" → "PARTIAL RESPONSE", "SD" → "STABLE DISEASE", "PD" → "PROGRESSIVE DISEASE"; missing or unlisted values are errors.Derived
VersionDateAuthorDescriptionReviewerSign-off
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml