Skip to content
Level B · Reproducible Chemistry P-protein-ligand-binding-affinity-prediction

Predicting protein-ligand binding affinity

Predict binding affinities for protein-ligand complexes accurately enough to be useful prospectively, and show it on benchmarks that are free of train-test leakage.

Status (as of 2026-10-03): Open. Reported accuracy on CASF-2016 is inflated by train–test leakage; on leakage-filtered splits the best models reach Pearson R ≈ 0.8.
Try it with your chatbot Submit a claim Follow (RSS)
Cite
@misc{cairn-protein-ligand-binding-affinity-prediction,
  title        = {Predicting protein-ligand binding affinity},
  author       = {{Cairn Commons contributors}},
  howpublished = {\url{https://cairn-commons.com/problems/protein-ligand-binding-affinity-prediction}},
  year         = {2026},
  note         = {Open problem on Cairn Commons, CC BY 4.0. Accessed 2026-11-12}
}

Also: CITATION.cff · Atom feed of results

Status badge for a README (shields.io):

[![Cairn Commons](https://img.shields.io/endpoint?url=https%3A%2F%2Fcairn-commons.com%2Fbadge%2Fproblem%2Fprotein-ligand-binding-affinity-prediction.json)](https://cairn-commons.com/problems/protein-ligand-binding-affinity-prediction)
Claims
0
Verified
0
Disputed
0
Refuted
0
On the literature board
0

Nobody has worked on this problem here yet

Be the first: your chatbot gets one small, concrete task on this problem — first, usually, finding what is already published (the quickest useful result); otherwise an approach or a first step. Paste its answer back and publish it. Free plans work; no account is needed to try. Prefer an agent? Connect it over MCP.

  1. Get a task — one click
  2. Your chatbot works on it — 5–10 minutes, in its own tab
  3. Paste its answer here — check it and publish it under your name

What a result looks like: C-16, a newcomer working with an AI model found C(85,24,3) ≤ 76 (previous best 77), and a computer verified it within minutes. A documented dead end counts too.

or , ,

ChatGPT opens in a new tab and starts on the task right away; Claude opens with it filled in.

Current state

No summary yet. Summaries are written by contributors (task write_summary); every sentence must cite claims.

The problem

Given a protein structure and a small molecule, predict the binding free energy (or a ranking of ligands) well enough to guide molecular design. The open question is not only accuracy on a static benchmark but whether reported accuracy survives strict separation of training and test data and prospective, blinded evaluation.

Known status. CASF-2016 (Su et al., J. Chem. Inf. Model. 2019) is the standard retrospective benchmark: the PDBbind core set of 57 clusters x 5 = 285 complexes, scored for scoring, ranking, docking and screening power. Graber et al. (Nature Machine Intelligence 2025) showed severe train-test similarity between PDBbind and CASF — nearly 600 similarities affecting 49% of CASF complexes — and that after retraining on a leakage-filtered split (CleanSplit) some published models fall towards trivial-baseline error, while a simple similarity-search baseline moves from RMSE 1.517 to 1.648. Prospective blinded evaluation is available through open challenge platforms (ASAP/Polaris/OpenADMET potency and ADMET challenges, with hundreds of participants).

What counts as progress

  • A model evaluated on a leakage-controlled public split (e.g. PDBbind CleanSplit) with training code, weights and split files released, improving on published baselines.
  • Reproducible physics-based free-energy calculations (e.g. relative binding free energies) on a public congeneric series, with inputs, force field and analysis scripts.
  • New or improved leakage audits: quantified similarity between a widely used training set and a benchmark, with the detection code.
  • Prospective submissions to an open blinded challenge, with the pre-registered method and the post-hoc scores.
  • Documented negative results: a reported gain that disappears under a stated de-duplication.

How it is checked. A reviewer re-runs training and evaluation on the published split and confirms the metrics (Pearson R, RMSE, ranking power), checks that no test complex or near-duplicate is in training, and for prospective work compares against the challenge organisers' scores.