Comment from Amirhossein Daneshpajouh

AnonymousSupportAcademic
Summary: Dr. Kay C. Wiese, representing Simon Fraser University's Computational Biology Lab, proposes four specific quantitative reporting elements to be added to the draft guidance. The author argues for more rigorous disclosure of off-target nomination completeness, structural-variant detection floors, sequencing-depth adequacy, and bioinformatics reproducibility to address current qualitative gaps in the draft.
This comment supersedes my earlier submission on this docket (comment tracking number mrl-e7yr-j4u0). It is identical in substance; only internal source-file names in the citations were replaced with descriptive names. Please treat this version as authoritative, and I have separately requested withdrawal of the earlier submission. Executive summary. This comment asks the Agency to require four additive, quantitative reporting elements layered onto the existing draft guidance, each anchored to a specific guidance section and each computable today on public data alone: 1. (Sections VI-VII, off-target nomination completeness.) A sponsor relying on an in silico off-target candidate list should disclose the completeness of that list against three explicit, computable channels - reference-only, patient short variants, and patient structural-variant junctions - rather than leaving the list's completeness unstated. 2. (Section VIII, chromosomal-integrity / loss-of-genome-integrity analysis.) A sponsor relying on a short-read structural-variant caller for large-indel or translocation detection should report a distribution-free, caller-specific certified miss-rate floor against an orthogonal high-fidelity (e.g., long-read) truth set, because short-read SV callers carry large, caller-specific blind spots that a "sensitive and quantitative" claim (guidance's own language) does not, by itself, rule out. 3. (Sections IV-VII, sequencing-depth / sample-size adequacy.) Any zero-observed-failure calibration or validation claim should distinguish an existence floor (the sample size at which a bound is merely defined) from the much larger certification floor (the sample size actually needed to certify the stated miss-rate), because the two are numerically far apart and are conflated in current practice. 4. (Submission of study reports, bioinformatics reproducibility.) Every certified or reported number should be traceable to a hash-bound, independently re-derivable artifact and pipeline, as a concrete operationalization of the guidance's reproducibility expectations. Two worked examples (an approved ex vivo product and an investigational in vivo product) show the off-target completeness gap is measurable today on public reference data, and that for at least one documented site the ancestry-conditional coverage gap spans two orders of magnitude (8.9% vs 0.029% carrier probability, AFR vs NFE, at a single created candidate). An independent public-data benchmark shows that a widely used short-read structural-variant caller, evaluated against a long-read gold-standard truth set, has a certified deletion miss-rate of at least 70.7% (one-sided 95% lower bound) on the benchmarked class - a concrete instance of the detection-floor gap that Section VIII's "sensitive and quantitative" language does not itself quantify. Full 23-page comment is attached as FDA_COMMENT_FINAL_CLEAN.pdf. Affiliation: Simon Fraser University's Computational Biology Lab, under the supervision of Dr. Kay C. Wiese. Conflict of interest: The author declares no competing interests.

View on Regulations.gov