Review ask

As a clinical trial statistician or programmer, challenge anything in this benchmark: describe a problem in Comments, or propose a fix with the Edit button on any source file.

  1. Task: Is this a specification error a study team could realistically make, and should the build stop on it rather than continue?
  2. Inputs: Do they trigger the failure for the reason the summary gives?
  3. Expected failure: Is this the right error, raised at the right point, and would it tell the programmer what to fix?

The other tabs beside Comments are background for assessment, not under review.

Summary

Lifecycle: reviewedEditUnder review
What this benchmark means
README.md

Goal: compute CELLTOT, the whole number of cells in the sample, as CELLCNT * VOLUML for each subject.

Input: laboratory records carrying the collected cell concentration (CELLCNT) and the sample volume (VOLUML) for four subjects: an ordinary count and volume, a product exactly at the largest whole number the result can hold (9,223,372,036,854,775,807), a missing concentration, and a product past that largest whole number.

Variables:

  • CELLTOT would contain the whole number of cells, CELLCNT multiplied by VOLUML, and missing when either is missing. A product beyond the largest whole number the result can hold stops the run, and no artifact is accepted.

How to fix

Verify the transcription and correct CELLCNT in the source before running the calculation. If the verified count genuinely cannot fit in a signed 64-bit integer, the specification cannot represent it exactly as int; change the measurement unit or representation upstream rather than allowing the multiplication to wrap or converting the count to an approximate value.

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
derivation
condition
integer_overflow
requirement
REQ-0434
expected/error.yaml
phase: derivation
condition: integer_overflow
spec_paths:
  - columns.CELLTOT.derivation.compute
requirement: REQ-0434
context:
  expr: "CELLCNT * VOLUML"
  keys:
    - STUDYID: YAMAA-01
      USUBJID: YAMAA-01-102

Inputs

Under review
1 source file

input/lb.csv

Edit
4 rows
input/lb.csv
STUDYIDUSUBJIDCELLCNTVOLUML
YAMAA-01500000020
YAMAA-0190071992547409931024
YAMAA-0192233720368547758071
YAMAA-01—10

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Comments and assessment materials

Comments

Signed in with GitHub; saved in repository Discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADLBSTUDYIDStudy IdentifiercharacterCopy value from LB.STUDYID.Predecessor
ADLBUSUBJIDUnique Subject IdentifiercharacterCopy value from LB.USUBJID.Predecessor
ADLBCELLTOTTotal Cell CountnumericCompute CELLCNT * VOLUML.Derived
VersionDateAuthorDescriptionReviewerSign-off
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml