Review ask

As a clinical trial statistician or programmer, answer two short questions in Your review: the task and the inputs and outputs. Agreeing with both approves this benchmark; disagreeing with either needs a comment. Propose a fix with the Edit button on any source file, or add it to your comments.

We suggest spending no more than 5 minutes on a review. The other tabs beside Your review are background for assessment, not under review.

Summary

Lifecycle: draftEditUnder review
What this benchmark means
README.md

Public entries: Python and R. Passing coverage requires an installed inventory.

Goal: pin the text lookup contract: inline dictionaries, an external dictionary file, case-insensitive reads, and a regular-expression search with capture groups.

Input: DM carries one record per subject with coded sex, race, and treatment group values and a subject identifier that normally starts with a site prefix, such as UCSD-0123. The race dictionary is a YAML file beside the input.

Columns:

  • SEXC reads an inline dictionary with exact matching: M gives Male and F gives Female, while a code with no entry and a missing sex both give Unknown.
  • RACEC uses the same lookup contract with the dictionary loaded from the YAML file instead of written in the spec; a race with no entry or a missing race gives Unknown.
  • TRTGRPC reads case-insensitively: source and dictionary keys are folded to upper case before comparison, so lowercase and mixed-case treatment codes match their uppercase keys. A missing treatment group gives Unknown.
  • SITENUM matches each whole identifier against a regular expression (capital letters, a hyphen, digits) and keeps the second capture group, the digits after the prefix, as text, so leading zeros stay. An identifier of any other shape gives NONE, and a missing identifier gives MISSING.

Inputs

Under review
2 source files

input/dm.csv

Edit
4 rows
input/dm.csv
USUBJIDSEXRACETRTGRPSUBJID
MWHITEdrugUCSD-0123
FASIANDRUGUCSD-0456
UBLACK OR AFRICAN AMERICANPlacebobad-id
—WHITE——

input/race_dict.yaml

Edit
ASIAN: Asian
"BLACK OR AFRICAN AMERICAN": Black or African American
WHITE: White

Expected output

Under review
4 expected rows

expected/adsl.csv

Edit
4 rows
expected/adsl.csv
STUDYIDUSUBJIDSEXCRACECTRTGRPCSITENUM
YAMAA-01MaleWhiteDrug0123
YAMAA-01FemaleAsianDrug0456
YAMAA-01UnknownBlack or African AmericanPlaceboNONE
YAMAA-01UnknownWhiteUnknownMISSING
Shaded columns are derived— = missing value

Human review and assessment

Your review

2 questions and your comments · View benchmark discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADSLSTUDYIDStudy IdentifiercharacterSet constant value "YAMAA-01".Assigned
ADSLUSUBJIDUnique Subject IdentifiercharacterCopy value from DM.USUBJID.Predecessor
ADSLSEXCSex DecodedcharacterRecode DM.SEX: "M" → "Male", "F" → "Female"; missing or unlisted values → "Unknown".Derived
ADSLRACECRace DecodedcharacterRecode DM.RACE using the dictionary in input/race_dict.yaml; missing values → "Unknown"; unlisted values are errors.Derived
ADSLTRTGRPCPlanned Treatment DecodedcharacterRecode DM.TRTGRP: "DRUG" → "Drug", "PLACEBO" → "Placebo"; missing values → "Unknown"; unlisted values are errors; matching ignores letter case.Derived
ADSLSITENUMSite Number ExtractedcharacterExtract capture group 2 matching ^([A-Z]+)-(\d+)$ from DM.SUBJID; a missing source → "MISSING"; no match → "NONE".Derived
VersionDateAuthorDescriptionReviewerSign-off
1.72026-10-20yamaa docs buildRead a specification in the 1.0 surface as its 0.5 counterpart; state that missing values stay missing where a mapping declares no missing handler, and leave out a declared missing answer that restates a handler's default
1.62026-10-17yamaa docs buildDescribe collected date parts written as ISO 8601 date text and times of day counted in seconds since midnight
1.52026-10-17yamaa docs buildName collected precision in words instead of letter codes; state imputation fallbacks, minimum source precision, bounds ignored outside the collected period, and invalid text with no handler as an error; describe date and datetime shifts, imputation flag codes, and partial text giving no date part
1.42026-10-15yamaa docs buildState datetime precision codes through the hour and minute, and complete only the time parts a collected datetime lacks
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml

yamaa code

Public calls generated from benchmark.yaml; results must match the expected output

R

Edit
3 lines
library(yamaa)yamaa_spec("spec.yaml")$run()$output

Python

Edit
3 lines
import yamaayamaa.spec("spec.yaml").run().output