loading page

Estimation of Model Accuracy in CASP15 Using the ModFOLDdock Server
  • +2
  • Liam McGuffin,
  • Nicholas S. Edmunds,
  • Shuaa M. A. Alharbi,
  • Ahmet G. Genc,
  • Recep Adiyaman
Liam McGuffin
University of Reading School of Biological Sciences

Corresponding Author:[email protected]

Author Profile
Nicholas S. Edmunds
University of Reading School of Biological Sciences
Author Profile
Shuaa M. A. Alharbi
University of Reading School of Biological Sciences
Author Profile
Ahmet G. Genc
University of Reading School of Biological Sciences
Author Profile
Recep Adiyaman
University of Reading School of Biological Sciences
Author Profile

Abstract

In CASP15 there was a greater emphasis on multimeric modelling than in previous experiments, with assembly structures nearly doubling in number (41 up from 22) since the previous round. CASP15 also included a new estimation of model accuracy (EMA) category in recognition of the importance of objective quality assessment for quaternary structure models. ModFOLDdock is a multimeric model quality assessment server developed by the McGuffin group at the University of Reading, which brings together a range of single-model, clustering and deep learning methods to form a consensus of approaches. For CASP15 three variants of ModFOLDdock were developed to optimise for the different facets of the quality estimation problem. The standard ModFOLDdock variant produced predicted scores optimised for positive linear correlations with the observed scores. The ModFOLDdockR variant produced predicted scores optimised for ranking, i.e., the top-ranked models have highest accuracy. In addition, the ModFOLDdockS variant used a quasi-single model approach to score each model on an individual basis. The scores from all three variants achieved strongly positive Pearson correlation coefficients with the CASP observed scores (oligo-lDDT) in excess of 0.70, which were maintained across both homomeric and heteromeric model populations. In addition, at least one of the ModFOLDdock variants was consistently ranked in the top two methods across all three EMA categories. Specifically, for overall global fold prediction accuracy, ModFOLDdock placed second and ModFOLDdockR placed third; for overall interface quality prediction accuracy ModFOLDdockR, ModFOLDdock and ModFOLDdockS were placed above all other predictor methods, and ModFOLDdockR and ModFOLDdockS were placed second and third respectively for individual residue confidence scores. The ModFOLDdock server is available at: [https://www.reading.ac.uk/bioinf/ModFOLDdock/](https://www.reading.ac.uk/bioinf/ModFOLDdock/). ModFOLDdock is also available as part of the MultiFOLD docker package: [https://hub.docker.com/r/mcguffin/multifold](https://hub.docker.com/r/mcguffin/multifold)
31 Mar 2023Submitted to PROTEINS: Structure, Function, and Bioinformatics
03 Apr 2023Review(s) Completed, Editorial Evaluation Pending
03 Apr 2023Submission Checks Completed
03 Apr 2023Assigned to Editor
11 Apr 2023Reviewer(s) Assigned
02 May 2023Editorial Decision: Revise Minor
15 May 20231st Revision Received
15 May 2023Review(s) Completed, Editorial Evaluation Pending
15 May 2023Submission Checks Completed
15 May 2023Assigned to Editor
18 May 2023Editorial Decision: Accept