Review ask

As a clinical trial statistician or programmer, challenge anything in this benchmark: describe a problem in Comments, or propose a fix with the Edit button on any source file.

  1. Task: Is this a specification error a study team could realistically make, and should the build stop on it rather than continue?
  2. Inputs: Do they trigger the failure for the reason the summary gives?
  3. Expected failure: Is this the right error, raised at the right point, and would it tell the programmer what to fix?

The other tabs beside Comments are background for assessment, not under review.

Summary

Lifecycle: draftEditUnder review
What this benchmark means
README.md

Goal: flag adverse events whose term mentions dermatitis or erythema, writing the structured str_contains result straight into SKIN_FLAG.

Input: collected adverse events with one record for each event, carrying the event term.

Variables:

  • SKIN_FLAG would hold whether the event term contains DERMATITIS or ERYTHEMA, and UNKNOWN when the term is missing.

The structured form returns true or false, and no column type accepts a boolean: the first record's match yields true, which has no text form, so the run fails and no artifact is accepted. The missing value is accepted and stands in for a missing term, but a record that carries a term yields true or false whether or not it matches, so a run succeeds only when every term is missing.

How to fix

Map the boolean to flag values with the predicate-text form inside a case, which is the spelling that stores text:

- name: SKIN_FLAG
  type: str
  derivation:
    case:
      - when: "AE.AEDECOD IS NULL"
        then: {literal: UNKNOWN}
      - when: "str_contains(AE.AEDECOD, 'DERMATITIS|ERYTHEMA')"
        then: {literal: Y}
      - otherwise: {literal: N}

Expected failure

Edit
the run is rejected; no artifact is accepted
expected/error.yaml
phase
convert
condition
conversion_failed
requirement
REQ-0013
expected/error.yaml
phase: convert
condition: conversion_failed
spec_paths:
  - columns.SKIN_FLAG
requirement: REQ-0013
context:
  from: bool
  to: str
  value: true
  keys:
    - STUDYID: YAMAA-01
      USUBJID: YAMAA-01-001
      AESEQ: 1

Inputs

Under review
1 source file

input/ae.csv

Edit
3 rows
input/ae.csv
STUDYIDUSUBJIDAESEQAEDECOD
YAMAA-011APPLICATION SITE DERMATITIS
YAMAA-012HEADACHE
YAMAA-013—

Unexpected Output

Under review
No artifact is produced

No fixture files in this directory.

Shaded columns are derived— = missing value

Comments and assessment materials

Comments

Signed in with GitHub; saved in repository Discussions

Mapping spec

Generated from the benchmark YAML; do not edit by hand

Dataset NameVariable NameVariable LabelTypeCodelist/Controlled TermsCoreComputational MethodOrigin
ADAESTUDYIDStudy IdentifiercharacterCopy value from AE.STUDYID.Predecessor
ADAEUSUBJIDUnique Subject IdentifiercharacterCopy value from AE.USUBJID.Predecessor
ADAEAESEQSequence NumbernumericCopy value from AE.AESEQ.Predecessor
ADAESKIN_FLAGSkin Event FlagcharacterTrue when AE.AEDECOD matches DERMATITIS|ERYTHEMA anywhere, false when it does not; a missing source → "UNKNOWN".Derived
VersionDateAuthorDescriptionReviewerSign-off
1.32026-09-29yamaa docs buildShow study codelist names, external dictionaries, and ISO 8601 formats in variable rows; list the document's codelist values and metadata
1.22026-09-29yamaa docs buildClassify ADaM copies from a declared input as Predecessor and recodes as Derived, and SDTM recodes of locally derived columns as Derived
1.12026-09-29yamaa docs buildResolve lookups into the donor record they select, and give every derivation shape a plain-language rule instead of its raw YAML
1.0yamaa docs buildInitial generation from spec.yaml