Review ask

As a clinical trial statistician or programmer, challenge anything in this benchmark: describe a problem in Comments, or propose a fix with the Edit button on any source file.

  1. Task: Is this a specification error a study team could realistically make, and should the build stop on it rather than continue?
  2. Inputs: Do they trigger the failure for the reason the summary gives?
  3. Expected failure: Is this the right error, raised at the right point, and would it tell the programmer what to fix?

The other tabs beside Comments are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Goal: carry the source identifier through as ID and return the project routine's result as RESULT.

Input: a source file with ID and VALUE, where VALUE holds the numeric value passed to the routine.

Variables:

  • ID is the source identifier, carried through unchanged.
  • RESULT would be the numeric result of passing the source VALUE to the project_value routine.

Note: the call omits the numeric input required by the routine. The run is rejected before any project code or data is read, and no artifact is accepted.

How to fix

Supply the required argument declared by the environment:

function:
  name: project_value
  args: {x: SOURCE.VALUE}

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
validation
condition
invalid_function_argument
requirement
REQ-0700
expected/error.yaml
phase: validation
condition: invalid_function_argument
spec_paths:
  - columns.RESULT.derivation.function.args
requirement: REQ-0700
context:
  function: project_value
  argument: x
  cause: missing_required_argument

Inputs

Under review
1 source file

input/source.csv

Edit
1 row
input/source.csv
IDVALUE
011.5

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Comments and assessment materials

Comments

Signed in with GitHub; saved in repository Discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Variable NameVariable LabelTypeLengthControlled Terms or FormatOriginCoreConversion DefinitionVariable TypeVariable OrderComments for Define
IDIdentifierCharCollectedCopy value from SOURCE.ID.SDTM1
RESULTProject Function ResultNumDerivedCall project function project_value.SDTM2
VersionDateAuthorDescriptionReviewerSign-off
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml