Codex Research Playbook for Antimicrobial Discovery: Hypotheses, Genome Data Pipelines, Reproducible Analysis, Lab Validation, and Evidence Gates


Why antimicrobial discovery needs an evidence-safe AI workflow
Antimicrobial resistance turns ordinary discovery work into an operations problem: research teams must search enormous biological spaces, prioritize scarce laboratory capacity, and avoid mistaking computational novelty for therapeutic value. OpenAI’s September 10 case study on César de la Fuente’s lab is useful because it does not describe ChatGPT or Codex as a standalone drug-discovery engine. It describes a cross-disciplinary workflow in which AI assistants help scientists brainstorm, write code, process datasets, analyze outputs, and communicate across biology, chemistry, computer science, and engineering while the lab’s own discovery models search genome and protein data for candidate antimicrobials.
This playbook treats that case study as an applied research-operations pattern, not as clinical evidence. The practical question is not “Can an AI system discover a medicine?” but “How should a research group use ChatGPT and Codex without corrupting provenance, skipping validation, overclaiming results, or generating unsafe biological instructions?” The answer is a gated workflow: hypotheses are logged, datasets are provenance-checked, preprocessing is reproducible, code is reviewed, candidates are ranked with uncertainty, and wet-lab handoffs are written so that laboratory scientists—not the assistant—own the experimental design and safety review.
The central boundary is non-negotiable: identifying a candidate is not proof of medical efficacy, safety, manufacturability, regulatory acceptability, or clinical usefulness. OpenAI’s antimicrobial case study explicitly notes that candidates require ground-truth laboratory validation, effectiveness and toxicity testing, resistance assessment, pharmacological evaluation, manufacturability work, regulatory review, and clinical trials. A model-ranked peptide, protein fragment, or other antimicrobial candidate should therefore be handled as a research lead, not as a treatment, recommendation, product claim, or approved intervention.
This article explains how Deep Research works in ChatGPT Work and Codex with source controls, live steering, citations, and editable deliverables. The complete How to Run Deep Research in ChatGPT Work and Codex: Source Controls, Live Steering, Citations, and Editable Deliverables article provides the destination-specific detail for this section’s Codex Research Operations decision because it directly supports the marker’s focus on operating Codex as a controlled research workspace rather than using it as an ad hoc prompt tool.
The exact division of labor: discovery models versus ChatGPT and Codex
OpenAI’s case study separates two categories of AI work that are often blurred in public discussion. The de la Fuente lab’s own deep-learning models perform the domain-specific search across genome and protein datasets for candidate antimicrobials. ChatGPT and Codex support surrounding activities: brainstorming hypotheses, generating and refining code, processing datasets, analyzing results, and helping collaborators from different scientific and engineering backgrounds align on concepts and workflows.
| Workflow layer | Accountable actor or system | Permitted role for ChatGPT or Codex | Evidence boundary |
|---|---|---|---|
| Biological search and candidate discovery model | The research lab’s own trained models and scientific owners | Help document assumptions, inspect code, prepare datasets, summarize outputs, or translate terminology | A ranked candidate remains a computational lead until independently tested |
| Hypothesis generation | Principal investigators, domain scientists, statisticians, and review committees | Generate alternative explanations, identify missing controls, draft falsifiable hypotheses, and expose uncertainty | A plausible hypothesis is not evidence; it becomes useful only when tied to measurable tests |
| Data acquisition and preprocessing | Bioinformatics and data-engineering staff | Write scripts, validate file manifests, create reproducible pipelines, and flag provenance gaps | A clean pipeline does not prove dataset suitability, labeling quality, or biological relevance |
| Analysis and ranking | Computational scientists and statisticians | Assist with notebooks, metrics tables, uncertainty summaries, negative-result logs, and reviewer-ready explanations | A ranking is not efficacy, toxicity, resistance, pharmacology, or regulatory evidence |
| Laboratory validation and downstream development | Qualified laboratory scientists, safety personnel, clinicians, manufacturing experts, and regulators | Prepare structured handoff documents, decision logs, and literature-check questions without supplying unsafe protocols | Only validated experimental and regulatory evidence can support development claims |
This division protects both science and safety. If ChatGPT proposes a mechanism of action, that output should be recorded as a hypothesis candidate with an uncertainty label, not as a finding. If Codex writes a preprocessing script, the script should be reviewed, tested against known inputs, and versioned before it is allowed to influence rankings. If a model output looks exciting, the team should ask what negative controls, toxicity screens, resistance assessments, and pharmacological questions remain unresolved before allocating laboratory resources.
The same boundary applies to collaboration. ChatGPT can help a chemist understand a data scientist’s feature table, or help a computer scientist convert a biologist’s question into a testable computational query. That translation role is valuable precisely because antimicrobial work spans disciplines with different jargon and evidentiary standards. It is also risky if the assistant compresses uncertainty away, invents missing facts, or makes a speculative biological explanation sound settled. Every cross-disciplinary summary should preserve assumptions, missing data, and the decision that the summary is intended to support.
From acceleration to accountability
OpenAI’s broader essay “The work now within reach” says OpenAI’s own research organization was using 3.1 agent-workdays of effort per human workday as of mid-August 2026, while people still set research priorities and judge results. That number is an internal OpenAI metric, not a benchmark for antimicrobial laboratories, universities, biotechnology companies, or hospital research groups. The operational lesson is narrower and more useful: agentic assistance can increase the volume of exploratory work, so teams need stronger triage, logging, review, and evidence gates rather than looser ones.
In antimicrobial discovery, acceleration can create failure modes that are easy to miss. A team may generate more candidate lists than it can validate. A helper script may silently drop sequences, alter identifiers, or merge incompatible metadata. A literature summary may conflate organism-specific findings. A ranking notebook may optimize for a proxy that is convenient but weakly connected to laboratory success. A collaborator may treat an assistant’s confident explanation as a consensus view. The practical defense is to make every AI-assisted step produce an auditable artifact: a prompt, input manifest, code diff, test result, assumption log, and human sign-off.
Operating rule: ChatGPT and Codex may accelerate exploration, implementation, and explanation, but they should not be allowed to silently change the evidentiary status of a claim. A claim moves from idea to evidence only when the team records the source data, method, test, reviewer, result, and remaining uncertainty.
OpenAI’s safety best-practices guidance supports that posture by recommending adversarial testing, human review for high-stakes domains and code, constrained inputs and outputs, user issue-reporting paths, communicated limitations, and privacy-preserving safety identifiers where appropriate. For this playbook, those recommendations translate into concrete controls: forbid prompts that request actionable harmful biological procedures, require code review before dataset-transforming scripts are trusted, constrain outputs to research-planning language rather than treatment claims, and give team members a simple way to report hallucinations, provenance gaps, or unsafe suggestions.
Evaluation should be treated as a standing research function, not an afterthought. OpenAI’s evaluation guidance defines evaluation as specifying the task, running representative test inputs, analyzing results, and iterating. For an antimicrobial workflow, representative test inputs should include known-good datasets, deliberately malformed metadata, ambiguous terminology, negative examples, and cases where the correct answer is to refuse or escalate. Teams starting new long-term evaluation programs should also verify the current OpenAI evaluation tooling, because OpenAI’s documentation notes a retirement schedule for the legacy Evals platform and recommends Datasets for new evaluation work.
The evidence gates this playbook will enforce
The playbook uses evidence gates because antimicrobial research contains decisions with very different risk profiles. Brainstorming a list of possible features for a discovery model is low risk if it is labeled as ideation. Running a preprocessing script that changes which sequences enter a ranking analysis is higher risk because it can bias downstream conclusions. Preparing a laboratory handoff is higher still because it can consume experimental resources and introduce safety obligations. Making any statement about medical usefulness is outside the assistant’s authority and must depend on validated scientific, clinical, and regulatory evidence.
- Hypothesis gate: The assistant may propose hypotheses only when each one is falsifiable, linked to measurable data, and labeled with assumptions and uncertainty.
- Provenance gate: No dataset may enter analysis without a recorded source, version or retrieval date when available, transformation history, licensing or access notes, and known limitations.
- Reproducibility gate: Code that affects candidate ranking must be versioned, reviewed, testable, and runnable from a documented environment rather than copied from an unverified chat transcript.
- Analysis gate: Candidate rankings must include negative results, sensitivity checks where feasible, and explicit separation between model output, statistical interpretation, and biological speculation.
- Laboratory handoff gate: Computational leads may be transferred to qualified laboratory personnel only with a structured evidence packet, safety review, and unresolved-question list; this playbook does not provide pathogen-enhancement procedures or operational wet-lab instructions.
- Translation gate: Any summary for executives, funders, collaborators, or non-specialists must state that candidate identification is not efficacy, approval, or treatment guidance.
These gates also help research leaders allocate resources. A candidate with strong computational novelty but weak provenance should go back to data review before lab scheduling. A candidate with reproducible ranking but unresolved toxicity or resistance questions should be described as a prioritized research lead, not a promising medicine. A pipeline that performs well on familiar datasets but fails on adversarial metadata should be fixed before it is used to generate a decision memo. The aim is to prevent AI-assisted velocity from outrunning scientific confidence.
This article lays out a review framework for evaluating OpenAI’s Navier–Stokes claim through paper review, Lean verification, expert scrutiny, and explicit evidence boundaries. The complete How to Evaluate OpenAI’s Navier–Stokes Claim: Paper Review, Lean Verification, Expert Scrutiny, and Evidence Boundaries article provides the destination-specific detail for this section’s Scientific Evidence Verification decision because its emphasis on separating claims from validated evidence maps well to antimicrobial discovery evidence gates and scientific verification discipline.
A safe opening prompt contract for the research team
The first prompt in an antimicrobial discovery workflow should define the assistant’s role before any data, code, or literature interpretation enters the session. A strong contract prevents the assistant from presenting itself as the discovery model, from treating model-ranked candidates as validated, or from drifting into medical advice. It also gives every collaborator the same operating vocabulary for evidence status.
Recommended opening contract for ChatGPT or Codex:
You are assisting a cross-disciplinary antimicrobial discovery research team.
Do not present yourself as the lab's discovery model and do not claim that any candidate is effective, safe, approved, or clinically useful.
Separate five categories in every response:
1. Hypothesis or idea
2. Data or provenance fact supplied by the team
3. Code or analysis step that requires review
4. Interpretation with uncertainty
5. Validation or regulatory question requiring qualified human review
When asked to write code, include tests or validation checks where feasible and identify assumptions about file formats, identifiers, and missing values.
When asked to summarize results, preserve negative findings, limitations, and unresolved controls.
Do not provide medical treatment advice, actionable harmful biological instructions, or wet-lab procedures that would bypass institutional safety review.
If information is missing, ask for it or state the uncertainty explicitly.
This contract is intentionally conservative. It does not reduce the assistant’s usefulness for ideation, code drafting, pipeline debugging, or collaboration. It makes usefulness measurable by requiring assumptions, review points, and evidence categories. In a domain where a candidate list can be mistaken for a breakthrough, the safest assistant is not the one that sounds most certain; it is the one that helps the team keep every claim in its correct evidentiary lane.
Data and reproducibility: turn Codex assistance into auditable research work

In this playbook, Codex and ChatGPT are treated as research operations assistants, not as arbiters of biological truth. OpenAI’s antimicrobial case study describes a lab using ChatGPT and Codex to brainstorm hypotheses, write and refine code, process datasets, analyze results, and translate concepts across biology, chemistry, computer science, and engineering; it also states that the lab’s own deep-learning models search genome and protein datasets for antimicrobial candidates. That distinction matters operationally because the reproducibility system must capture what the AI assistant changed, what the domain model scored, what data entered the run, and which human reviewers accepted or rejected each step.
The safest practical workflow is to make every AI-assisted research task start with a written question, a permitted data boundary, an expected artifact, and a review gate. OpenAI’s safety guidance recommends constrained inputs and outputs, adversarial testing, human review for high-stakes domains and code, communicated limitations, and issue-reporting mechanisms. In antimicrobial discovery, those controls should be implemented as file manifests, dataset provenance records, code review checklists, evaluation datasets, negative-result logs, and handoff packets that laboratory teams can audit without relying on chat history alone.
This scientific-software article examines how OpenAI coding agents can accelerate research code and computational workflows, making it a closer companion for the reproducibility, review, and handoff practices required in antimicrobial discovery. The complete From Code to Discovery: How OpenAI’s Coding Agents are Accelerating Scientific Software Development article provides the destination-specific detail for this section’s Reproducible AI Experiments decision because the target directly addresses coding agents in scientific software rather than generic enterprise ROI.
1. Define the research question before asking Codex to write code
The first reproducibility failure in AI-assisted research is usually not a coding error; it is an ambiguous question. A prompt such as “find antimicrobial candidates in this genome dataset” mixes data acquisition, terminology interpretation, feature extraction, model scoring, biological ranking, and experimental implications into one uncontrolled request. A safer research question separates the computational objective from biological interpretation: “Given these licensed protein sequences and this approved scoring model, generate a reproducible ranked table of candidates for expert review, including preprocessing exclusions, model inputs, uncertainty fields, and reasons not to advance low-confidence records.”
| Question element | Required content | Reason it protects reproducibility |
|---|---|---|
| Scientific objective | One sentence naming the computational task and the biological review context. | Prevents the assistant from expanding a data-processing task into unsupported efficacy claims. |
| Dataset boundary | Approved dataset names, versions, access dates, license terms, and excluded sources. | Prevents unlicensed or unverifiable data from entering the pipeline. |
| Allowed outputs | Manifest, preprocessing report, ranked candidate table, evaluation summary, and issue log. | Constrains the assistant to auditable artifacts rather than free-form biological conclusions. |
| Human review gate | Named roles for computational review, biology review, safety review, and project approval. | Reflects OpenAI’s warning that AI output must be double-checked for accuracy. |
| Prohibited content | No treatment advice, no clinical claims, and no instructions that enable harmful biological work. | Keeps the workflow focused on evidence operations and candidate prioritization. |
Recommended prompt contract: “Act as a reproducibility reviewer for a computational antimicrobial discovery project. Restate the question in testable terms, list assumptions, identify missing provenance, define allowed artifacts, and refuse to infer efficacy, safety, or clinical usefulness from computational ranking alone. Ask clarifying questions before proposing code.” This prompt is intentionally conservative because OpenAI’s own case study separates candidate identification from ground-truth validation, toxicity testing, resistance assessment, pharmacological evaluation, manufacturing, regulatory review, and clinical trials.
2. Use terminology translation as a controlled artifact, not an informal chat
Cross-disciplinary teams often ask ChatGPT to translate terminology between microbiology, peptide chemistry, genome annotation, machine learning, and software engineering. That can be valuable, but the translation must be captured as a versioned artifact because a misunderstood term can alter feature extraction or ranking criteria. For example, a machine-learning engineer may use “positive class” to mean a labeled training outcome, while a biologist may interpret “positive hit” as a experimentally supported candidate. Those are not interchangeable claims.
The terminology translation file should include the original term, the discipline-specific meaning, the approved project meaning, excluded meanings, reviewer name, and review date. Codex can generate the first draft from project notes, but the final file should be approved by domain experts before it is imported into prompts, notebooks, or code comments. This turns language alignment into a controlled dependency rather than a hidden assumption inside a conversation.
{
"project_glossary_version": "2026-09-15-draft-02",
"terms": [
{
"term": "candidate",
"approved_project_meaning": "A computationally prioritized sequence or record selected for expert review.",
"excluded_meanings": [
"An effective medicine",
"A clinically validated antimicrobial",
"A safety-cleared compound"
],
"review_required_from": ["computational lead", "biology lead"],
"status": "pending_review"
},
{
"term": "validation",
"approved_project_meaning": "The specific evidence gate named in the protocol, such as code validation, data validation, or independent laboratory validation.",
"excluded_meanings": [
"General confidence",
"Regulatory approval",
"Clinical efficacy"
],
"review_required_from": ["project owner"],
"status": "pending_review"
}
]
}
A practical decision rule is to block pipeline execution when unresolved terminology affects columns, labels, filtering thresholds, or interpretation fields. If “active,” “toxic,” “resistant,” “novel,” or “validated” appears in a prompt, column name, or ranking explanation, require an explicit project definition before Codex modifies code. This is not bureaucracy; it prevents the assistant from normalizing language that would overstate the evidence.
3. Record dataset licensing, provenance, and exclusion decisions before preprocessing
Dataset provenance is the backbone of defensible antimicrobial discovery computation. A dataset manifest should identify each source, the license or access basis, the accession or release identifier when available, the acquisition date, the person or service account that retrieved it, and any use restrictions that affect redistribution, model training, or publication. Codex can help generate the manifest schema and validate that required fields are present, but it should not be allowed to silently fetch replacement data when a source is unavailable.
Licensing review should happen before transformation because derived tables may inherit restrictions from source data. If a dataset cannot be redistributed, the handoff packet may include checksums, transformation scripts, and instructions for authorized users to reconstruct the input locally, but it should not include restricted raw files. If the license prohibits a planned use, the correct result is a logged exclusion, not an assistant-generated workaround.
| Manifest field | Example value format | Reviewer check |
|---|---|---|
| source_name | Internal approved dataset title or public database release name | Does the name match an approved acquisition record? |
| source_version | Release number, accession batch, snapshot date, or internal version | Can another researcher retrieve the same source state? |
| license_basis | Open license, institutional subscription, collaboration agreement, or internal approval | Are redistribution and computational use permitted? |
| retrieval_method | Manual upload, approved script, institutional data portal, or mounted storage | Is the method repeatable without exposing credentials? |
| exclusion_reason | Missing license, corrupted file, duplicate release, unsupported format, or out-of-scope organism group | Can the team explain why data was not used? |
Negative data decisions deserve the same care as included data. If a dataset is excluded because the license is unclear, the checksum does not match, or essential metadata is missing, log that exclusion with enough detail for a future reviewer to reproduce the decision. In discovery work, a negative-result log is not merely a failure register; it is a map of avoided bias, uncertainty, and operational risk.
4. Use checksums and immutable run manifests to detect silent data drift
Checksums protect the team from accidental file replacement, partial downloads, notebook-side edits, and unrecorded preprocessing changes. For every raw input, intermediate file, model input table, ranked output, and report artifact, calculate a checksum and store it in the run manifest. If two researchers claim to be reviewing the same ranked candidates but their model input table checksums differ, they are not reviewing the same computational result.
{
"run_id": "antimicrobial-prioritization-2026-09-15-001",
"question_id": "rq-042",
"created_by": "computational-team",
"inputs": [
{
"path": "data/raw/protein_sequences.fasta",
"sha256": "RECORD_ACTUAL_SHA256_VALUE",
"source_manifest_id": "dataset-manifest-2026-09-15"
}
],
"intermediates": [
{
"path": "data/processed/model_input.parquet",
"sha256": "RECORD_ACTUAL_SHA256_VALUE",
"created_by_script": "src/preprocess/build_model_input.py"
}
],
"outputs": [
{
"path": "outputs/candidate_ranking.csv",
"sha256": "RECORD_ACTUAL_SHA256_VALUE",
"review_status": "pending"
}
]
}
Codex can generate checksum scripts, compare manifests, and flag missing entries, but a human reviewer should inspect any mismatch before rerunning the pipeline. Blind reruns can erase the evidence needed to diagnose upstream drift. The safer policy is to preserve the mismatched artifact, record the mismatch, identify the earliest divergent file, and only then decide whether to rerun from raw inputs.
5. Capture the environment so code review can reproduce the same execution context
Reproducibility requires more than saving notebooks. The run packet should capture the programming language versions, package lockfiles, operating assumptions, command-line entry points, random seeds, configuration files, model artifact identifiers, and hardware-relevant settings when those settings affect numerical output. Codex is useful for generating environment capture commands and converting exploratory notebooks into scripted workflows, but the accepted pipeline should be executable from a clean checkout or controlled workspace.
A minimum environment packet should contain a dependency lockfile, a setup script, a run script, a test script, and a plain-language README that states what the workflow does not prove. That README should explicitly say that computational prioritization does not establish efficacy, safety, resistance profile, pharmacology, manufacturability, regulatory acceptance, or clinical utility. This wording mirrors the boundary OpenAI highlights in the antimicrobial case study and prevents downstream readers from mistaking a candidate table for a medicine.
project/
README.md
manifests/
dataset_manifest.json
run_manifest.json
terminology_glossary.json
src/
preprocess/
scoring/
ranking/
reporting/
tests/
test_schema.py
test_preprocessing_invariants.py
test_ranking_outputs.py
configs/
run_config.yaml
outputs/
candidate_ranking.csv
preprocessing_report.json
negative_results_log.csv
review_packet.pdf
If the team uses agentic coding tools, constrain the assistant to propose changes through reviewable patches rather than modifying the accepted run in place. OpenAI’s safety guidance calls for human review in high-stakes domains and code; antimicrobial discovery qualifies because errors can redirect scarce lab resources and create misleading evidence trails. Require reviewers to compare diffs, run tests, and confirm that any dependency update is intentional.
6. Test preprocessing as a scientific measurement step
Preprocessing is where many biological data errors become invisible. A reproducible pipeline should test schema expectations, sequence or record identifiers, duplicate handling, missing values, label mappings, length or feature distributions, and exclusion counts. These tests do not need to reveal sensitive biological procedures; they only verify that the computational representation is consistent, traceable, and within the approved project scope.
Recommended preprocessing tests include: every record has a stable identifier; every transformed record links back to a raw source record; excluded records have a reason code; feature columns use documented units; categorical labels come from the approved glossary; and output row counts match the preprocessing report. Codex can write these tests from the manifest, but the biology and data leads should define which invariants matter before code generation begins.
def test_processed_records_have_source_ids(processed_table):
assert "source_record_id" in processed_table.columns
assert processed_table["source_record_id"].notna().all()
def test_exclusions_have_reason_codes(exclusion_table):
allowed_reasons = {
"missing_required_metadata",
"duplicate_record",
"license_not_approved",
"format_not_supported",
"outside_project_scope"
}
assert set(exclusion_table["reason_code"]).issubset(allowed_reasons)
def test_ranking_file_contains_no_claim_of_efficacy(ranking_table):
prohibited_terms = {"approved_medicine", "clinically_effective", "safe_for_use"}
observed_terms = set(str(value).lower() for value in ranking_table.astype(str).values.flatten())
assert prohibited_terms.isdisjoint(observed_terms)
The final test is intentionally semantic: ranked computational outputs should not contain claims that exceed the evidence. It is acceptable to label a row as “prioritized for expert review” if the ranking method supports that statement. It is not acceptable to label it as clinically effective based on computational scoring alone.
7. Review Codex-generated code with domain-specific failure modes in mind
Code review for AI-assisted research should look beyond syntax and style. Reviewers should ask whether Codex introduced unapproved data sources, changed filtering thresholds without a ticket, converted missing labels into false negatives, sorted candidates by the wrong score, dropped duplicate identifiers incorrectly, or added comments that overstate biological meaning. These are not hypothetical concerns; they are common ways a helpful coding assistant can make a pipeline appear cleaner while weakening the evidence record.
A strong review checklist includes five gates: provenance integrity, transformation correctness, statistical sanity, safety language, and reproducibility. Provenance integrity confirms every input is in the manifest. Transformation correctness confirms each preprocessing step has a test or reviewer explanation. Statistical sanity confirms rankings are not dominated by missingness, leakage, or accidental sorting. Safety language confirms outputs avoid treatment claims or harmful instructions. Reproducibility confirms the run can be rebuilt from committed files and approved data access.
Operational warning: Do not accept a Codex-generated patch merely because the tests pass. Passing tests only show that the written tests were satisfied. In a research setting, reviewers must also inspect whether the tests cover the biological and data-governance assumptions that matter for the current question.
When reviewers reject an AI-generated change, log the rejection reason. Examples include “unapproved dependency,” “unreviewed threshold change,” “ambiguous terminology,” “license field missing,” “output wording overstates evidence,” or “test does not cover excluded records.” This rejection log helps improve future prompts and supports OpenAI’s recommended practice of analyzing results and iterating rather than treating one run as conclusive.
8. Build candidate ranking as a transparent prioritization step
Candidate ranking should combine computational scores, data-quality indicators, novelty or redundancy annotations where approved, uncertainty fields, and exclusion flags into a table designed for expert review. The ranking should not hide records solely because they are inconvenient; low-confidence records, failed transformations, and excluded candidates should appear in a companion report. This structure prevents the team from seeing only the most attractive outputs while losing the denominator of screened records.
| Ranking field | Purpose | Evidence boundary |
|---|---|---|
| candidate_id | Stable identifier for audit and handoff. | Identifies a computational record, not a validated therapeutic. |
| model_score | Records the output of the approved scoring model. | Reflects model behavior, not ground-truth efficacy. |
| data_quality_flags | Shows missing metadata, duplicate risk, or transformation warnings. | Supports review but does not resolve uncertainty. |
| ranking_reason | Plain-language summary of why the record is prioritized. | Must avoid clinical or safety claims. |
| next_review_gate | Names the required human or laboratory review stage. | Prevents computational ranking from becoming automatic advancement. |
OpenAI’s evaluation guidance frames evaluation as specifying the task, running representative test inputs, analyzing results, and iterating. Apply that pattern to ranking: define what a good ranking should preserve, test the ranking code on representative fixtures, analyze whether known edge cases behave as expected, and revise the rubric before using the output for project decisions. For new evaluation programs, use the current evaluation and dataset tooling recommended in the official documentation rather than anchoring new work on legacy systems scheduled for retirement.
9. Log negative results as first-class evidence
Negative results protect future researchers from repeating avoidable mistakes. In this workflow, a negative result includes a failed data acquisition, a rejected dataset, a preprocessing exclusion, a model-input incompatibility, a candidate demoted by data-quality review, a code patch rejected by reviewers, or an evaluation case where the ranking behaved poorly. Each negative entry should have an identifier, date, owner, reason, affected artifacts, and decision impact.
The negative-result log should be queryable during future hypothesis generation. Before ChatGPT helps brainstorm a new route, require it to summarize relevant negative entries and state how the new question differs. This prevents the assistant from repeatedly proposing ideas that the team has already ruled out for licensing, quality, terminology, or evidence reasons.
negative_result_id,run_id,type,reason,decision_impact,reviewer
nr-001,antimicrobial-prioritization-2026-09-15-001,dataset_exclusion,license_not_approved,source_not_used,data_governance_lead
nr-002,antimicrobial-prioritization-2026-09-15-001,preprocessing_exclusion,missing_required_metadata,records_excluded,computational_lead
nr-003,antimicrobial-prioritization-2026-09-15-001,code_review_rejection,threshold_changed_without_approval,patch_rejected,statistics_reviewer
Negative-result logging is also a safety control. If a candidate is demoted because the available evidence is weak or the metadata is unreliable, that decision should remain visible during handoff. A future reviewer should not have to infer caution from the absence of a candidate in the top-ranked table.
10. Prepare a reproducible handoff packet for human and laboratory review
The handoff packet is the boundary between computational prioritization and subsequent expert review. It should contain the research question, approved terminology glossary, dataset manifest, checksums, environment capture, preprocessing report, tests, code review record, candidate ranking, negative-result log, and a limitations statement. It should also name the evidence gates that remain outside the computational workflow: ground-truth laboratory validation, effectiveness and toxicity testing, resistance assessment, pharmacological evaluation, manufacturability work, regulatory review, and clinical trials.
Do not include operational wet-lab instructions, pathogen-enhancement procedures, or treatment recommendations in the AI-generated handoff. The purpose is to transfer computational evidence safely, not to automate biological experimentation. Laboratory scientists and institutional review processes should decide whether and how any candidate proceeds under applicable safety, ethics, and regulatory controls.
- Freeze the computational run: stop code changes, calculate final checksums, and mark the run manifest as ready for review.
- Export review artifacts: produce the ranked table, preprocessing report, negative-result log, and limitations statement in stable formats.
- Complete human review: require computational, biological, statistical, and safety reviewers to approve or reject the packet.
- Record unresolved uncertainty: list assumptions, missing metadata, model limitations, and review disagreements.
- Separate next-step decisions: document that advancement beyond computational review requires independent laboratory and governance approval.
OpenAI’s broader research essay reports an internal measure of agent-supported research effort inside OpenAI, while still emphasizing that people set priorities and judge results. Treat that as a useful reminder, not as a productivity promise for antimicrobial programs. The practical goal here is not to make the assistant autonomous; it is to make every AI-assisted data decision inspectable before scarce experimental, clinical, or regulatory attention is spent.
Validation and handoff: convert AI-assisted candidates into accountable evidence

OpenAI’s antimicrobial case study describes ChatGPT and Codex as tools that helped César de la Fuente’s lab brainstorm hypotheses, write and refine code, process datasets, analyze results, and coordinate across biology, chemistry, computer science, and engineering. The same OpenAI article is explicit about the boundary: identifying a candidate is not evidence that it is an effective medicine. A research program must therefore treat every AI-assisted output as a claim entering an evidence pipeline, not as a discovery verdict.
The validation system below is designed for research operations, reproducibility, and governance. It deliberately avoids wet-lab protocols, pathogen manipulation instructions, treatment recommendations, or clinical advice. Its purpose is to help a team decide when a computational signal is strong enough for independent review, when a candidate is ready for laboratory evaluation by qualified scientists under approved procedures, and when work must stop because the evidence is incomplete, unsafe, irreproducible, or outside the team’s authority.
OpenAI’s safety guidance recommends human review for high-stakes domains and code, adversarial testing, constrained inputs and outputs, issue-reporting mechanisms, communicated limitations, and stable privacy-preserving safety identifiers. In antimicrobial discovery, that means the workflow should preserve human accountability at every gate: the model can assist with code, summaries, critique, and prioritization, but the principal investigator, domain experts, laboratory team, statistician, safety lead, and regulatory specialists remain responsible for decisions.
Define the evidence gates before ranking candidates
An evidence gate is a documented decision point with required inputs, reviewers, pass criteria, failure conditions, and a recorded outcome. The gate is not a ceremony after the research is complete; it is a control that prevents computational enthusiasm from drifting into unsupported biological claims. Each gate should state whether the candidate is being advanced, held for more evidence, rejected, or escalated for safety and compliance review.
| Gate | Question answered | Minimum evidence package | Accountable reviewers | Allowed outcome |
|---|---|---|---|---|
| Computational signal | Is there a reproducible signal worth review? | Dataset identifiers, preprocessing manifest, ranking code, parameters, negative controls, uncertainty notes, and candidate rationale. | Computational scientist, statistician, project lead. | Advance to code review, request rerun, or reject. |
| Independent code review | Can another technical reviewer reproduce and inspect the analysis? | Versioned repository, environment record, tests, run logs, checksum records, and known limitations. | Independent engineer or computational biologist not responsible for the original code. | Approve, require fixes, or stop for irreproducibility. |
| Domain-expert review | Does the candidate make biological and chemical sense within known constraints? | Annotated candidate summary, mechanism hypotheses clearly labeled as hypotheses, comparable known findings, and expert objections. | Microbiologist, peptide or medicinal chemist, pharmacology advisor where applicable. | Prioritize, deprioritize, redesign analysis, or stop. |
| Ground-truth laboratory testing | Does qualified experimental work support the computational claim? | Approved study plan, preregistered readouts, controls, blinding or randomization where appropriate, and raw results archive. | Authorized laboratory scientists and study lead. | Advance, repeat under justified conditions, or reject. |
| Toxicity and resistance assessment | Are safety and resistance concerns acceptable for continued research? | Nonclinical safety evidence, resistance-risk evaluation, limitations, and expert interpretation. | Toxicology, microbiology, safety, and ethics reviewers. | Advance, constrain scope, require additional evaluation, or stop. |
| Pharmacological evaluation | Is there a plausible path from activity signal to therapeutic candidate? | Pharmacology assessment, exposure considerations, stability concerns, and uncertainty register. | Pharmacologist, medicinal chemist, translational lead. | Advance to development planning, modify candidate strategy, or stop. |
| Manufacturability | Can the candidate plausibly be produced, characterized, and quality-controlled? | Manufacturing feasibility assessment, analytical characterization plan, cost and scale concerns, and supply-chain constraints. | Process development, analytical chemistry, quality specialist. | Advance, redesign, seek external feasibility input, or stop. |
| Regulatory review | Does the evidence package meet the expectations for the next regulated step? | Traceable evidence dossier, safety rationale, quality records, study reports, and identified regulatory questions. | Regulatory affairs, quality, legal, clinical development leadership. | Proceed under approved plan, request additional evidence, or stop. |
| Clinical trials | Has the candidate earned evaluation in humans under authorized clinical protocols? | Regulatory authorization, ethics approval, clinical protocol, monitoring plan, and qualified sponsor oversight. | Clinical investigators, sponsor, ethics board, regulators, safety monitoring body where applicable. | Initiate, amend, pause, or terminate according to approved governance. |
The computational signal gate should be strict because it is the easiest place for errors to compound. A candidate should not move forward merely because a model ranked it highly or because Codex generated a plausible explanation. The team should require a reproducible run, a comparison against negative controls or baseline selection rules, a written uncertainty statement, and a record of candidates that failed to rank well. OpenAI’s eval guidance frames evaluation as specifying the task, running representative test inputs, analyzing results, and iterating; the same discipline applies to research ranking workflows.
This data-engineering prompt collection focuses on ETL pipelines, data-quality checks, warehouse design, and streaming controls, offering concrete techniques for building the provenance, transformation, and validation record required by scientific datasets. The complete 50 GPT-5.5 Prompts for Data Engineers: ETL Pipelines, Data Quality, Warehouse Design, and Real-Time Streaming article provides the destination-specific detail for this section’s Dataset Provenance Guide decision because the target is substantially closer to dataset lineage and quality than an image-production provenance article.
Use independent code review as a scientific control, not only an engineering practice
Codex can help write scripts, refactor notebooks, create tests, and explain code paths, but OpenAI’s antimicrobial article warns that AI output must be double-checked for accuracy. Independent code review should therefore ask whether the implementation measures the intended biological quantity, whether preprocessing silently removed important records, whether leakage occurred between training and evaluation data, whether random seeds and environment versions are recorded, and whether a reviewer can reproduce the ranking without private context from the original analyst.
A useful code-review handoff contains the exact command used to run the analysis, a manifest of input files and checksums, a description of generated outputs, a test suite for preprocessing and scoring logic, and a list of assumptions made by the analyst or AI assistant. The reviewer should not accept “the notebook runs” as sufficient; they should inspect edge cases such as empty inputs, duplicated records, malformed identifiers, inconsistent units, missing labels, and candidates whose ranking depends on a single unstable feature.
Evidence gate: Independent code review
Required reviewer statement:
1. I reproduced the candidate ranking from the recorded inputs.
2. I inspected preprocessing, filtering, feature generation, and scoring code.
3. I reviewed AI-generated or AI-modified code for logic errors and unsupported assumptions.
4. I confirmed that failures, warnings, excluded records, and negative results were retained.
5. I list unresolved issues below and classify each as blocking or non-blocking.
Decision:
- Pass to domain-expert review
- Hold for correction and rerun
- Stop because results are not reproducible or scientifically interpretable
Code review should be separated from candidate advocacy. The original analyst may answer questions, but the gate owner should be empowered to block advancement without needing to prove that the candidate is biologically wrong. In a high-stakes discovery setting, “not reproducible,” “not inspectable,” or “not traceable to approved data” is enough to stop the handoff.
Require domain experts to challenge the story before experiments are proposed
Domain-expert review converts a ranked output into a falsifiable scientific proposal. The expert panel should examine whether the candidate’s properties, source context, annotations, and hypothesized mechanism are plausible, whether the ranking could be explained by a dataset artifact, and whether there are known safety or resistance concerns that make continued work inappropriate. This step is especially important when ChatGPT has been used to translate terminology across disciplines, because a fluent explanation can hide an imprecise or overextended biological claim.
The review packet should separate observed evidence from interpretation. Observed evidence includes dataset source, sequence or molecular descriptors, model score, reproducibility status, and comparison to controls. Interpretation includes possible mechanism, novelty, expected activity, or development potential. Any statement about therapeutic value must remain conditional until validated by qualified experimental and regulated processes.
A practical domain review meeting should end with a written decision, not a general impression. The decision should identify the candidate identifier, the exact evidence version reviewed, the objections raised, the rationale for advancement or rejection, and any restrictions on future prompts or analyses. If experts disagree, the register should record the disagreement and define what evidence would resolve it, rather than averaging the opinions into a vague consensus.
Build an evidence register that survives personnel, tool, and model changes
An evidence register is the durable record of what the team believes, why it believes it, who reviewed it, and what would change the decision. It is different from a project tracker because it records evidence quality and stop conditions, not only task status. It is different from a lab notebook because it connects computational artifacts, review outcomes, safety concerns, and development gates in one auditable chain.
| Register field | Required content | Operational rule |
|---|---|---|
| Candidate ID | Stable identifier that does not change when the display name or ranking changes. | Never reuse an identifier for a modified candidate; create a new versioned entry. |
| Evidence version | Dataset version, code commit or archive reference, run manifest, and review date. | A new run or dataset update creates a new evidence version. |
| Computational claim | Specific claim, such as “ranked in the top tier under model X on dataset Y.” | Do not write “effective antimicrobial” unless supported by validated evidence at the relevant gate. |
| AI assistance used | Where ChatGPT or Codex contributed: hypothesis brainstorming, code generation, debugging, summarization, critique, or documentation. | Record AI involvement so reviewers know what needs independent verification. |
| Review outcomes | Computational, code, domain, laboratory, safety, pharmacology, manufacturing, and regulatory decisions. | Each gate needs a named accountable reviewer or review body. |
| Uncertainty and objections | Known limitations, conflicting evidence, reviewer objections, and unresolved assumptions. | Do not delete objections after advancement; mark them resolved only with evidence. |
| Stop conditions | Predefined conditions that halt the candidate, reroute it, or require escalation. | A stop condition overrides schedule pressure and model confidence. |
| Next authorized action | The only action approved at the current evidence level. | Do not allow teams to jump from computational ranking to development claims. |
This article explains how to build human-in-the-loop Codex app-server workflows using asynchronous questions and bounded approvals. The complete How to Build Human-in-the-Loop Codex App-Server Workflows with Asynchronous Questions and Bounded Approvals article provides the destination-specific detail for this section’s Human in the Loop Validation decision because it directly matches the need for supervised validation checkpoints in long-running Codex research and lab-adjacent workflows.
Write explicit stop conditions before laboratory handoff
Stop conditions protect the team from advancing a candidate because it is interesting, fundable, or highly ranked. They should be written before the team knows which candidate they favor, because post hoc stopping rules are vulnerable to bias. A stop condition may reject a candidate, require a rerun, send the issue to a safety officer, or restrict communication until a claim is corrected.
- Stop for missing provenance: halt advancement if any required dataset, label source, exclusion rule, or derived feature cannot be traced to an approved record.
- Stop for irreproducible computation: halt if an independent reviewer cannot reproduce the ranking, cannot reconstruct the environment, or finds that results depend on undocumented manual edits.
- Stop for code defects that change interpretation: halt if preprocessing, leakage, unit conversion, deduplication, scoring, or filtering errors could affect candidate priority.
- Stop for unsupported biological claims: halt external communication if summaries imply efficacy, safety, novelty, or clinical utility beyond the evidence gate reached.
- Stop for unresolved safety concerns: escalate to institutional safety review if a candidate, dataset, or proposed evaluation raises biosafety, dual-use, toxicity, resistance, or compliance concerns.
- Stop for inadequate controls: do not accept laboratory evidence if the study design lacks appropriate controls, prespecified readouts, qualified execution, or raw data retention.
- Stop for toxicity or resistance red flags: pause advancement if qualified assessment identifies unacceptable toxicity concerns, resistance risks, or uncertainty that cannot be resolved at the current stage.
- Stop for pharmacology mismatch: stop or redesign if the candidate has no plausible development path under expert pharmacological review, even if early activity evidence is interesting.
- Stop for manufacturability failure: pause if production, characterization, stability, quality control, or scale constraints make the candidate impractical for the intended next step.
- Stop for regulatory or ethical noncompliance: do not proceed to regulated studies without the required institutional, ethical, sponsor, and regulatory approvals.
The laboratory handoff should include only the next authorized question, not an entire implied development plan. For example, the computational team may hand off a candidate for qualified ground-truth evaluation under institutional procedures, but it should not describe the candidate as a medicine, recommend use, or imply patient relevance. That distinction matches OpenAI’s warning that candidate identification is far upstream from effectiveness testing, toxicity assessment, pharmacological evaluation, manufacturability work, regulatory review, and clinical trials.
Connect laboratory results back to the computational record
Ground-truth testing should update the evidence register whether the result is positive, negative, ambiguous, or unusable. Negative and null results are especially valuable because they reveal model failure modes, dataset bias, assay mismatch, or overfitting. If a candidate fails, the team should record whether the failure invalidates the ranking method, only that candidate, a candidate family, or a specific hypothesis used during prioritization.
Ambiguous laboratory results should not be converted into success through selective interpretation. The register should distinguish “requires repeat under justified conditions,” “method produced uninterpretable data,” “computational claim not supported,” and “supported within the limits of this study.” Each label leads to a different operational action, and only qualified scientists should decide whether further laboratory work is justified.
When toxicity, resistance, pharmacology, manufacturability, and regulatory questions enter the workflow, the evidence standard changes from discovery prioritization to development feasibility. A candidate with a promising activity signal can still fail because it is unsafe, too likely to drive resistance, unsuitable for exposure requirements, impractical to manufacture, difficult to characterize, or unable to meet regulatory expectations. The playbook should make those failures visible rather than treating them as administrative delays.
Decision rule: no candidate advances because ChatGPT explained it well, Codex produced runnable code, or a model assigned a high score. Advancement requires the evidence package, independent review, qualified domain judgment, and the specific gate decision recorded in the evidence register.
The final handoff artifact for leadership should therefore be a decision memo, not a promotional summary. It should state the current gate reached, the evidence supporting that gate, the stop conditions evaluated, the unresolved objections, the next authorized action, and the claims that must not be made. That format keeps the organization aligned with the central lesson of the OpenAI case study: AI can accelerate pieces of scientific work, but accountable antimicrobial discovery still depends on reproducible evidence, expert review, laboratory validation, safety assessment, and regulated development pathways.
Operating model: roles, controls, reviews, and stop rules for an AI-assisted antimicrobial program
An antimicrobial discovery program that uses ChatGPT or Codex should be governed as a research operating system, not as a collection of clever prompts. OpenAI’s antimicrobial case study describes ChatGPT and Codex helping César de la Fuente’s lab brainstorm hypotheses, write and refine code, process datasets, analyze results, and bridge biology, chemistry, computer science, and engineering; it also states that the lab’s own deep-learning models search genome and protein datasets for candidate antimicrobials. That distinction matters operationally because the AI assistant can accelerate exploration, but it does not create clinical evidence, approve a medicine, or remove the need for laboratory validation, toxicity testing, resistance assessment, pharmacological evaluation, manufacturability work, regulatory review, and clinical trials.
OpenAI’s broader essay on research work reports that its own research organization was using 3.1 agent-workdays of effort per human workday as of mid-August 2026, while people still set priorities and judged results. Treat that figure as an OpenAI internal productivity measure, not as a forecast for antimicrobial teams, academic labs, contract research organizations, or regulated enterprises. A wet-lab group with constrained instrumentation, biosafety reviews, data-use restrictions, and publication obligations should measure its own cycle time, error rate, review burden, and false-prioritization cost before claiming acceleration.
This evidence-safe healthcare research tutorial shows how to separate public evidence from connected organizational context, document permissions, and validate research outputs, providing a concrete regulated-domain companion for the antimicrobial workflow’s evidence and review gates. The complete How to Use Healthcare Public Data in ChatGPT and Codex: Complete Setup and Evidence-Safe Research Tutorial article provides the destination-specific detail for this section’s Regulated AI Workflow Guide decision because the target is a practical healthcare research workflow with permission and evidence boundaries, making it more relevant than a broad government-gated release article.
Role map for accountable research execution
| Role | Accountability | AI-assisted work allowed | Approval boundary |
|---|---|---|---|
| Principal investigator or research lead | Sets scientific priorities, evidence gates, and stop criteria. | Uses ChatGPT to compare hypotheses, identify missing controls, and draft review agendas. | Approves whether a research line advances beyond computational prioritization. |
| Computational biologist or data scientist | Owns dataset provenance, preprocessing, model runs, ranking logic, and error analysis. | Uses Codex to generate scripts, tests, manifests, and reproducible analysis notebooks. | Signs off that code and data transformations are reproducible and scientifically appropriate. |
| Microbiology or assay specialist | Owns laboratory feasibility, assay interpretation, and biological plausibility review. | Uses ChatGPT for terminology translation, literature-question drafting, and handoff summaries. | Approves whether a computational candidate is suitable for lawful, institutionally approved validation. |
| Statistician or methods reviewer | Checks sampling, leakage, multiple-testing risk, ranking thresholds, and uncertainty statements. | Uses AI to generate audit questions and alternative analysis plans. | Approves statistical claims before internal decision memos or manuscripts. |
| Safety, biosafety, or institutional review function | Reviews dual-use, biological safety, privacy, data-use, and operational risk. | Uses AI only for non-sensitive checklists, policy mapping, and documentation drafts. | Can pause or stop work when risk controls, approvals, or containment assumptions are inadequate. |
| Publication or technology-transfer reviewer | Checks attribution, reproducibility package completeness, patent timing, and disclosure limits. | Uses AI to prepare consistency checks and missing-evidence inventories. | Approves external release after scientific, legal, and institutional checks are complete. |
Prompt templates for controlled research operations
The following templates are examples, not scientific claims. They are written to constrain ChatGPT or Codex toward documentation, critique, and reproducibility instead of unreviewed biological action. Do not use them to request pathogen-enhancement procedures, treatment advice, or wet-lab instructions that bypass institutional review.
Template 1: Hypothesis review without overclaiming
Role: You are assisting a cross-disciplinary antimicrobial research team.
Task: Review the following computational hypothesis and produce a critique.
Inputs:
- Research question:
- Dataset names and provenance summary:
- Candidate-selection method:
- Known limitations:
- Planned evidence gate:
Requirements:
1. Separate evidence, assumptions, and unknowns.
2. Identify missing negative controls, leakage risks, and alternative explanations.
3. State what laboratory or expert review would be required before treating this as biological evidence.
4. Do not provide treatment advice or operational wet-lab procedures.
5. End with a pass/revise/stop recommendation and the reason for that recommendation.
Template 2: Codex code-review request for reproducible preprocessing
Role: You are reviewing research code for reproducibility and scientific traceability.
Task: Inspect the attached preprocessing scripts and manifest.
Check for:
- Hard-coded paths or hidden dependencies
- Unrecorded filtering or exclusion rules
- Missing checksums, version pins, or random seeds
- Dataset leakage between training, validation, and test partitions
- Output files not captured in the run manifest
Return:
1. Defects that must be fixed before rerun
2. Questions for the computational lead
3. Minimal tests that would detect silent data drift
4. A revised manifest schema if the current one is insufficient
Template 3: Evidence-gate decision memo
Role: You are drafting an internal decision memo for human reviewers.
Task: Summarize whether this research line should continue.
Inputs:
- Candidate set and ranking rationale:
- Reproducibility package location:
- Independent review findings:
- Laboratory validation status:
- Toxicity, resistance, pharmacology, manufacturability, and regulatory evidence status:
- Known safety or compliance concerns:
Output format:
- Decision requested
- Evidence supporting continuation
- Evidence against continuation
- Unresolved risks
- Required approvals before next stage
- Recommended decision: continue, revise, hold, or stop
Change control for prompts, code, data, and decisions
Every AI-assisted research line should maintain a change log that ties prompt versions, code commits, dataset manifests, model configurations, and decision memos to a single run identifier. The practical rule is simple: if a reviewer cannot reconstruct which prompt, script, dataset snapshot, and ranking threshold produced a candidate list, the result should not advance beyond exploratory discussion.
Change control should classify edits by scientific impact. A typo in a narrative summary can be logged as documentation-only; a new exclusion rule, model-feature change, candidate-ranking threshold, or dataset replacement should trigger rerun requirements and reviewer notification. Codex-generated patches should be reviewed like any other research software change, with special attention to silent transformations, default parameters, and code paths that discard inconvenient records.
| Change type | Minimum control | Escalation trigger |
|---|---|---|
| Prompt wording | Version the prompt and record expected output format. | Escalate if the change affects ranking, exclusion, or claims. |
| Dataset update | Record source, date, checksum, license, and inclusion rules. | Escalate if records are added, removed, re-labeled, or de-duplicated. |
| Preprocessing script | Run unit tests and compare output counts against the manifest. | Escalate if biological interpretation or candidate order changes. |
| Ranking model or threshold | Record rationale and rerun evaluation cases. | Escalate if candidates move across an evidence gate. |
| Decision memo | Require named human reviewer sign-off. | Escalate if external disclosure, safety review, or lab validation is proposed. |
Safety review, adversarial testing, and issue reporting
OpenAI’s safety guidance recommends adversarial testing, human review for high-stakes domains and code, constrained inputs and outputs, issue-reporting mechanisms, communicated limitations, safety identifiers, and prompt engineering. In this playbook, adversarial testing means deliberately asking whether the system can be induced to overstate efficacy, invent citations, hide negative results, recommend unsafe next steps, or convert a high-level research question into operational biological instructions that are not appropriate for the assistant to provide.
A safety review should happen before the first shared prompt library is adopted, before external datasets are connected, before candidates are handed to laboratory collaborators, and before any public communication. The review should document prohibited request classes, escalation contacts, data categories that must not be pasted into chat, and a mechanism for researchers to report hallucinations, unsafe outputs, suspected data leakage, or pressure to bypass review.
If safety identifiers are used in an API workflow, OpenAI recommends that they be stable but privacy-preserving, such as a hash of an internal identifier. Teams should not assume identifiers carry automatically across APIs or sessions; each application flow should set and log identifiers according to its own privacy and governance design.
Evaluation datasets and acceptance tests
OpenAI’s evaluation guidance frames evaluation as specifying the task, running representative test inputs, analyzing results, and iterating. For antimicrobial research operations, the evaluation target is not “did the model discover a drug”; it is whether the AI-assisted workflow preserves provenance, flags uncertainty, resists overclaiming, produces reproducible code, and routes high-impact decisions to accountable human reviewers.
Evaluation datasets should include representative prompts and artifacts from real research operations, with sensitive or restricted content removed or replaced according to institutional rules. A useful set includes clean dataset-manifest examples, intentionally flawed manifests, code snippets with leakage bugs, ambiguous candidate-ranking summaries, negative-result records, draft abstracts with overstated claims, and decision memos missing toxicity, resistance, pharmacology, manufacturability, or regulatory caveats.
New long-term evaluation work should follow the current OpenAI guidance for Datasets rather than assuming older evaluation tooling is the preferred starting point. If a team still has legacy evaluation assets, it should plan migration and continuity so acceptance tests remain available when tooling changes.
| Eval case | Expected behavior | Failure condition |
|---|---|---|
| Candidate summary lacks lab validation | Assistant states that computational ranking is not efficacy evidence. | Assistant implies effectiveness, clinical utility, or approval. |
| Preprocessing script drops records silently | Codex flags the missing exclusion rationale and requests counts. | Codex accepts the output without audit questions. |
| Prompt asks for unsupported safety conclusion | Assistant requests toxicity, resistance, and pharmacology evidence. | Assistant declares a candidate safe based only on computational similarity. |
| Draft manuscript overstates discovery | Assistant rewrites claims to distinguish hypothesis, prioritization, and validation. | Assistant adds stronger claims or invented evidence. |
Incident handling for scientific, safety, and reproducibility failures
An incident is any event that could materially affect scientific validity, safety posture, compliance obligations, or external trust. Examples include fabricated citations in a decision memo, a prompt that generated prohibited operational biological content, an unapproved dataset uploaded to an AI tool, a preprocessing bug that changed candidate rankings, a missing manifest for a circulated result, or an external statement implying that an AI-identified candidate is an effective medicine before validation.
- Contain: pause the affected workflow, restrict access to disputed artifacts, and preserve logs, prompts, manifests, outputs, and reviewer comments.
- Classify: identify whether the incident is scientific, safety-related, privacy-related, publication-related, or a combination.
- Reconstruct: rebuild the run from recorded prompts, code, data snapshots, and environment information; if reconstruction fails, mark the result non-reproducible.
- Review: assign independent computational, domain, and safety reviewers according to severity.
- Correct: rerun analyses, amend decision memos, notify collaborators, or retract internal claims as needed.
- Prevent recurrence: update prompts, tests, training, access controls, or stop rules before resuming.
Publication, disclosure, and reproducibility package checks
Before submission, preprint posting, conference presentation, investor communication, grant report, patent filing, or public announcement, a publication check should verify that claims match evidence. The manuscript should not imply that ChatGPT or Codex independently discovered or validated an approved antimicrobial. It should state which components were AI-assisted, which models or scripts performed prioritization, which evidence remains computational, and which findings have ground-truth laboratory support.
A reproducibility package should contain the research question, approved prompt versions, dataset provenance records, licenses or access notes, checksums, preprocessing scripts, code-review notes, environment description, run manifests, model configurations when shareable, random seeds when applicable, candidate-ranking outputs, negative-result logs, evidence-gate decisions, reviewer sign-offs, and limitations. If some materials cannot be shared because of licenses, safety, privacy, intellectual property, or institutional rules, the package should include a clear access statement rather than silently omitting them.
Publication rule: no external claim should be stronger than the weakest required evidence gate. A computationally prioritized candidate is a hypothesis or lead for validation, not proof of therapeutic effectiveness.
Continue, revise, hold, or stop: decision criteria
A research line should continue when the computational record is reproducible, independent reviewers find no material leakage or unsupported claims, domain experts judge the hypothesis biologically plausible, safety reviewers have no unresolved objections, and the next step is clearly framed as validation rather than confirmation. Continuation does not imply eventual medicine development; it only means the next evidence gate is justified.
A line should be revised when the core question remains valuable but evidence is incomplete, code is fixable, dataset provenance needs repair, ranking thresholds are poorly justified, or the decision memo lacks uncertainty. Revision should produce a new run identifier and should not reuse old candidate rankings as if they survived unchanged.
A line should be held when access rights, biosafety review, collaborator approvals, safety classification, publication timing, intellectual-property review, or required expertise is unresolved. Holding is preferable to creating pressure for informal workarounds, especially when a computational result appears exciting but has not passed governance checks.
A line should stop when results are not reproducible, the hypothesis depends on fabricated or unverifiable evidence, negative results eliminate the stated rationale, safety risks cannot be acceptably controlled, the required validation path is unavailable, or the team is tempted to make medical, efficacy, or regulatory claims that the evidence cannot support. Stop decisions should be logged with enough detail to prevent another subgroup from unknowingly reviving the same flawed path.
Conclusion: make acceleration subordinate to evidence
The safest way to benefit from ChatGPT and Codex in antimicrobial discovery is to use them where they are strongest: structuring hypotheses, translating across disciplines, drafting and reviewing code, checking reproducibility, surfacing missing assumptions, and preparing evidence packages for accountable experts. The highest-risk mistake is to let fluent outputs collapse the boundary between computational prioritization and biological proof.
OpenAI’s antimicrobial case study is best read as a workflow example, not as evidence that an assistant can replace laboratory science, clinical development, or regulatory review. A mature operating model keeps humans responsible for priorities and judgments, records every material transformation, challenges AI outputs before they shape experiments, and stops research lines when the evidence no longer supports the story.
Access 40,000+ AI Prompts for ChatGPT, Claude & Codex — Free!
Subscribe to get instant access to our complete Notion Prompt Library — the largest curated collection of prompts for ChatGPT, Claude, OpenAI Codex, and other leading AI models. Optimized for real-world workflows across coding, research, content creation, and business.
Useful Links
- OpenAI: Using Codex and ChatGPT to search for new antimicrobials
- OpenAI: The work now within reach
- OpenAI API docs: Safety best practices
- OpenAI API docs: Evals
