Reject Device Calibrations Matched on a Number the Dataset Does Not Carry

Review ask

As a clinical trial statistician or programmer, answer two short questions in Your review: the task and the inputs. Agreeing with both approves this benchmark; disagreeing with either needs a comment. Propose a fix with the Edit button on any source file, or add it to your comments.

We suggest spending no more than 5 minutes on a review. The other tabs beside Your review are background for assessment, not under review.

Summary

EditUnder reviewWhat this benchmark means

README.md

Public entries: Python and R. Passing coverage requires an installed inventory.

Goal: count the calibrations (NCAL) of the device each blood pressure measurement (VSSTRESN) was taken with.

Input: collected measurements, each with the number of the device that took it, and a log of device calibrations by device number.

Variables:

NCAL would be the number of times the measurement's device was calibrated.

Note: the calibrations are matched on a value of the row being built. The device number is a field of the collected record that the dataset does not carry, so the run is rejected before any data is read; the field is never read in its place, and no artifact is accepted.

How to fix

Read the device number from the record each row is built from, naming the dataset:

aggregate:
  expr: "COUNT(CALIB.CALDT)"
  key: {DEVICEID: VS_RAW.DEVNUM}

Or bring the device number onto the row as a column and name the column.

Expected failure

Editthe run is rejected; no artifact is accepted

expected/error.yaml

phase: validation
condition: unknown_field
rule: LOOKUP-5

expected/error.yaml

phase: validation
condition: unknown_field
spec_paths:
  - columns.NCAL.derivation.aggregate.key.DEVICEID
rule: LOOKUP-5
context:
  identifier: DEVNUM

YAML specification

1 spec file

spec.yaml

Edit46 lines

1yamaa: "1.0"2type: spec3model: SDTM4domain: VS5keys: [STUDYID, USUBJID, VSSEQ]6input:7  VS_RAW: {path: input/vs_raw.csv, types: {VSSEQ: int, SYSBP: int}}8  CALIB: {path: input/calibrations.csv, types: {CALDT: date}}9base: VS_RAW1011output:12  path: vs.csv13  columns: [STUDYID, USUBJID, VSSEQ, VSSTRESN, NCAL]1415columns:16  - name: STUDYID17    type: str18    label: Study Identifier19    derivation: VS_RAW.STUDYID2021  - name: USUBJID22    type: str23    label: Unique Subject Identifier24    derivation: VS_RAW.USUBJID2526  - name: VSSEQ27    type: int28    label: Sequence Number29    derivation: VS_RAW.VSSEQ3031  - name: VSSTRESN32    type: int33    label: Numeric Result/Finding in Standard Units34    derivation: VS_RAW.SYSBP3536  # The number of calibrations of the device each measurement was taken37  # with. The device number is written bare, and a bare name is a column of38  # the dataset being built; the specification declares no DEVNUM column,39  # so it is rejected before any data is read.40  - name: NCAL41    type: int42    label: Number of Device Calibrations43    derivation:44      aggregate:45        expr: "COUNT(CALIB.CALDT)"46        key: {DEVICEID: DEVNUM}

Inputs

Under review2 source files

input/calibrations.csv

Edit3 rows

input/calibrations.csv
DEVICEID	CALDT
BP-01	2025-01-02
BP-01	2025-02-03
BP-02	2025-01-15

input/vs_raw.csv

Edit3 rows

input/vs_raw.csv
STUDYID	VSSEQ	DEVNUM	SYSBP
YAMAA-01	1	BP-01	121
YAMAA-01	2	BP-02	118
YAMAA-01	1	BP-01	134

Unexpected Output

Under reviewNo artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Human review and assessment

Variable Name	Variable Label	Type	Origin	Conversion Definition	Variable Type	Variable Order
STUDYID	Study Identifier	Char	Collected	Copy value from VS_RAW.STUDYID.	SDTM	1
USUBJID	Unique Subject Identifier	Char	Collected	Copy value from VS_RAW.USUBJID.	SDTM	2
VSSEQ	Sequence Number	Num	Collected	Copy value from VS_RAW.VSSEQ.	SDTM	3
VSSTRESN	Numeric Result/Finding in Standard Units	Num	Collected	Copy value from VS_RAW.SYSBP.	SDTM	4
NCAL	Number of Device Calibrations	Num	Derived	Aggregate COUNT(CALIB.CALDT) over records whose DEVICEID equals DEVNUM.	SDTM	5

Version	Date	Author	Description
1.7	2026-10-20	yamaa docs build	Read a specification in the 1.0 surface as its 0.5 counterpart; state that missing values stay missing where a mapping declares no missing handler, and leave out a declared missing answer that restates a handler's default
1.6	2026-10-17	yamaa docs build	Describe collected date parts written as ISO 8601 date text and times of day counted in seconds since midnight
1.5	2026-10-17	yamaa docs build	Name collected precision in words instead of letter codes; state imputation fallbacks, minimum source precision, bounds ignored outside the collected period, and invalid text with no handler as an error; describe date and datetime shifts, imputation flag codes, and partial text giving no date part
1.4	2026-10-15	yamaa docs build	State datetime precision codes through the hour and minute, and complete only the time parts a collected datetime lacks
1.3	2026-09-29	yamaa docs build	Show study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.2	2026-09-29	yamaa docs build	Classify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.1	2026-09-29	yamaa docs build	Resolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0		yamaa docs build	Initial generation from spec.yaml

How to fix

input/calibrations.csv

input/vs_raw.csv

Your review

Mapping spec