<?xml version="1.0" encoding="UTF-8"?>
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:ali="http://www.niso.org/schemas/ali/1.0/" article-type="research-article" dtd-version="1.4" xml:lang="en">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">ticsys</journal-id>
      <journal-title-group>
        <journal-title>Transactions on Intelligent Computing Systems</journal-title>
        <abbrev-journal-title abbrev-type="publisher">Trans. Intell. Comput. Syst.</abbrev-journal-title>
      </journal-title-group>
      <issn publication-format="electronic">2784-0166</issn>
      <publisher>
        <publisher-name>Aurora Computing Society</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.58304/dsyrva74</article-id>
      <title-group>
        <article-title>DARUMA: a gateway to fast and easy prediction of intrinsically disordered regions: a supplementary report</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes">
          <name>
            <surname>Dąbrowski</surname>
            <given-names>Eszter</given-names>
          </name>
          <xref ref-type="aff" rid="aff1"/>
          <xref ref-type="corresp" rid="cor1"/>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Kapoor</surname>
            <given-names>Ravi</given-names>
          </name>
          <role vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Writing – original draft" vocab-term-identifier="https://credit.niso.org/contributor-roles/writing-original-draft/">Writing – original draft</role>
          <role vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Conceptualization" vocab-term-identifier="https://credit.niso.org/contributor-roles/conceptualization/">Conceptualization</role>
          <role vocab="credit" vocab-identifier="https://credit.niso.org/" vocab-term="Funding acquisition" vocab-term-identifier="https://credit.niso.org/contributor-roles/funding-acquisition/">Funding acquisition</role>
          <xref ref-type="aff" rid="aff2"/>
        </contrib>
        <aff id="aff1">Department of Computer Science, Savanna Institute of Public Health, Kenya</aff>
        <aff id="aff2">Department of Statistics, University of the Lowlands, Netherlands</aff>
      </contrib-group>
      <contrib-group>
        <contrib contrib-type="editor">
          <name>
            <surname>Angiulli</surname>
            <given-names>Giovanni</given-names>
          </name>
        </contrib>
      </contrib-group>
      <author-notes>
        <corresp id="cor1"><email>eszter.dabrowski227@savanna.example</email></corresp>
      </author-notes>
      <pub-date publication-format="electronic" date-type="pub" iso-8601-date="2023-03-11">
        <day>11</day>
        <month>03</month>
        <year>2023</year>
      </pub-date>
      <volume>1</volume>
      <issue>1</issue>
      <elocation-id>e6639</elocation-id>
      <pub-history>
        <event>
          <date date-type="received" iso-8601-date="2022-09-07">
            <day>07</day>
            <month>09</month>
            <year>2022</year>
          </date>
        </event>
        <event>
          <date date-type="accepted" iso-8601-date="2023-01-23">
            <day>23</day>
            <month>01</month>
            <year>2023</year>
          </date>
        </event>
      </pub-history>
      <permissions>
        <copyright-statement>© 2023 Aurora Computing Society</copyright-statement>
        <copyright-year>2023</copyright-year>
        <copyright-holder>Aurora Computing Society</copyright-holder>
        <ali:free_to_read/>
        <license>
          <ali:license_ref>https://creativecommons.org/licenses/by/4.0/</ali:license_ref>
        </license>
      </permissions>
      <abstract>
        <p>Intrinsically disordered proteins (IDPs) are proteins that contain intrinsically disordered regions (IDRs), which lack stable three-dimensional structures under physiological conditions. These regions are known to play crucial roles in many biological processes. While IDRs can be predicted from their amino acid sequences, and several accurate IDR prediction programs have been developed, such programs often require substantial computational resources, including long execution times, large databases for homology searches, and advanced computer architectures. Since DNA sequence data continues to grow rapidly, particularly at a genomic scale, there is an increasing need for fast and accurate IDR prediction programs that demand fewer computational resources.</p>
        <p>In this study, we developed DARUMA (Disorder order clAssifier by Rapid and User-friendly MAchine), an IDR prediction program designed for speed and ease of use. DARUMA uses a one-dimensional convolutional neural network (1D-CNN) that processes the physicochemical properties of amino acid residues instead of relying on sequence profiles. DARUMA employs a simple neural network that predicts IDRs using the output of 1D-CNN as input features. To ensure easy installation on users’ systems, DARUMA was written entirely in Python using standard and NumPy libraries.</p>
      </abstract>
      <kwd-group kwd-group-type="author">
        <kwd>Intrinsically disordered protein</kwd>
        <kwd>Intrinsically disordered region</kwd>
        <kwd>Machine learning</kwd>
        <kwd>Fast prediction</kwd>
        <kwd>Convolution neural network.</kwd>
      </kwd-group>
      <funding-group>
        <funding-statement>This work was supported by the Japan Society for the Promotion of Science (KAKENHI JP22H01234).</funding-statement>
      </funding-group>
    </article-meta>
  </front>
  <body><sec sec-type="intro"><title>Introduction</title><p>Intrinsically disordered proteins (IDPs) have attracted much attention in protein science over the past two decades (<xref rid="ref-46" ref-type="bibr">Uversky, 2002</xref>; <xref rid="ref-48" ref-type="bibr">Wright &amp; Dyson, 1999</xref>). IDPs are proteins that contain intrinsically disordered regions (IDRs), which do not adopt stable 3D structures under physiological conditions (<xref rid="ref-5" ref-type="bibr">Dunker et al., 2001</xref>). Despite lacking a stable structure, IDRs play key roles in essential biological processes, such as transcriptional regulation and signal transduction, challenging the traditional concept that proteins function solely by forming stable three-dimensional structures (<xref rid="ref-7" ref-type="bibr">Dyson &amp; Wright, 2005</xref>). Following the discovery of IDPs, one of the major breakthroughs in molecular biology has been the development of sequencing techniques (<xref rid="ref-43" ref-type="bibr">Shendure &amp; Ji, 2008</xref>). Advances in next-generation sequencing have led to an extraordinary surge in DNA sequence data. In 2002, GenBank housed approximately 17 million sequences in its main section and 170,000 sequences in the whole genome shotgun (WGS) section. In 2024, these numbers had grown to 250 million in GenBank and 3.4 billion in WGS (<xref rid="ref-37" ref-type="bibr">NCBI, 2025</xref>) (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.ncbi.nlm.nih.gov/genbank/statistics/">https://www.ncbi.nlm.nih.gov/genbank/statistics/</uri>). Since GenBank primarily stores sequence data for individual or small groups of genes, while the WGS section contains data from whole genome shotgun analyses, this trend indicates a shift from sequencing individual genes to genome wide sequencing. Reflecting the trend, UniProtKB provides 843,388 proteome datasets on March 8th, 2025 (<xref rid="ref-45" ref-type="bibr">UniProt, 2025</xref>) (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.uniprot.org/">https://www.uniprot.org/</uri>).</p><p>IDR prediction programs have played a crucial role in shaping our understanding of IDPs since the early stages of IDP research. In particular, proteome-scale predictions of IDRs have enabled comparisons of IDR ratios between model organisms and facilitated analyses of sub-cellular localizations, post-translational modifications, and protein-protein interactions in IDPs (<xref rid="ref-6" ref-type="bibr">Dunker et al., 2008</xref>; <xref rid="ref-10" ref-type="bibr">Fukuchi et al., 2011</xref>; <xref rid="ref-17" ref-type="bibr">Haynes et al., 2006</xref>; <xref rid="ref-22" ref-type="bibr">Iakoucheva et al., 2004</xref>; <xref rid="ref-32" ref-type="bibr">Minezaki et al., 2006</xref>; <xref rid="ref-40" ref-type="bibr">Patil &amp; Nakamura, 2006</xref>; <xref rid="ref-47" ref-type="bibr">Ward et al., 2004</xref>). Such research has suggested that eukaryotic genomes encode a substantial number of IDPs, with 30–40% of residues in eukaryotic proteomes found in IDRs. Additionally, IDPs are abundant in nuclear proteins and tend to serve as hub proteins with more interaction partners in protein-protein interaction networks. These insights have become widely accepted in IDP research, largely based on computational predictions of IDRs (<xref rid="ref-39" ref-type="bibr">Oldfield &amp; Dunker, 2014</xref>). As a result, experimental determination of IDRs is seldom conducted for annotation purposes, with IDR predictions typically being accepted as annotations. Given the rapid growth in proteome-scale sequence data and the advantages of large-scale IDR analysis, the demand for fast and accurate IDR prediction programs continues to rise.</p><p>Over the past two decades, numerous IDR predictors have been developed and evaluated in competitions such as CASP5 to CASP10 (<xref rid="ref-34" ref-type="bibr">Moult et al., 2014</xref>; <xref rid="ref-35" ref-type="bibr">Moult et al., 2003</xref>) and the Critical Assessment of protein Intrinsic Disorder prediction (CAID) (<xref rid="ref-3" ref-type="bibr">Conte et al., 2023</xref>; <xref rid="ref-38" ref-type="bibr">Necci et al., 2021</xref>). Typically, IDR prediction involves converting amino acid sequences into feature values, such as the physicochemical properties of amino acid residues, their secondary structure propensities, and/or sequence profiles (<xref rid="ref-18" ref-type="bibr">He et al., 2009</xref>; <xref rid="ref-30" ref-type="bibr">Meng, Uversky &amp; Kurgan, 2017</xref>). Although there are many disorder predictors, the CAID2 challenge found that the predictors using sequence profile have the advantage in the disorder prediction accuracy (<xref rid="ref-3" ref-type="bibr">Conte et al., 2023</xref>). Sequence profiles are created from multiple sequence alignments, which are generally generated by iterating homology searches against a reference database. Most profile driven IDR predictors rely on position-specific scoring matrices (PSSM), a type of sequence profile produced by PSI-BLAST (<xref rid="ref-1" ref-type="bibr">Altschul et al., 1997</xref>). While sequence profile-driven predictors generally achieve high accuracy, they come with significant computational costs due to resource-intensive process of generating sequence profiles. Homology search programs typically require a large sequence database as the search target and their iterative processes to identify remote homologs are time consuming (<xref rid="ref-1" ref-type="bibr">Altschul et al., 1997</xref>).</p><p>IDR prediction methods are roughly divided into three categories: machine learning methods, scoring function methods, and consensus methods. The accumulation of IDR annotations in IDP databases (<xref rid="ref-9" ref-type="bibr">Fukuchi et al., 2014</xref>; <xref rid="ref-16" ref-type="bibr">Hatos et al., 2020</xref>; <xref rid="ref-41" ref-type="bibr">Piovesan et al., 2018</xref>), along with advances in machine learning, has enabled the development of more powerful prediction models. Machine learning-based predictors typically provide highly accurate predictions but require high-spec hardware, including large amounts of random-access memory (RAM) and multiple graphics processing units (GPUs). Additionally, some machine learning-based predictors rely on extra libraries and packages, making their installations on local environments challenging. Given the rapid growth of sequence data, particularly proteome data, and the increasing demand for IDR annotations, a cost-effective, user-friendly program that maintains high accuracy is highly desirable.</p><p>In this study, we developed a fast, accurate, and user-friendly predictor called DARUMA (Disorder order clAssifier by Rapid and User-friendly MAchine). DARUMA uses a convolutional neural network (CNN) (<xref rid="ref-27" ref-type="bibr">Lecun et al., 1998</xref>) that processes the physicochemical properties of amino acid residues instead of relying on sequence profiles. Written entirely in Python using standard and NumPy libraries, DARUMA’s design ensures easy installation on users’ systems. Its streamlined specification allows for rapid predictions, making it especially suitable for large-scale analyses.</p></sec><sec sec-type="materials|methods"><title>Materials and Methods</title><sec><title>Feature value embedding</title><p>To represent the features of amino acid sequences, we used the AAindex database (<xref rid="ref-25" ref-type="bibr">Kawashima &amp; Kanehisa, 2000</xref>), which provides 20 numerical values for various physicochemical and biological properties of amino acids. The AAindex database is divided into three sections, AAindex1, AAindex2, and AAindex3 (<xref rid="ref-26" ref-type="bibr">Kawashima et al., 2008</xref>). We selected AAindex1, which contains 566 indexes for the physicochemical properties of each amino acid, including factors such as side chain size and hydrophobicity. We utilized 553 indexes as feature values, excluding all those with N/A values. The values were normalized to a scale from 0 to 1 across the 20 numerical properties. Consequently, each amino acid residue was represented by a 553-dimensional vector of physicochemical properties, and an amino acid sequence with L residues was embedded into an L × 553-dimensional vector.</p></sec><sec><title>Construction of training and validation datasets</title><p>To construct the training and validation datasets, we used two sources: the DM4229 dataset and the IDEAL database (<xref rid="ref-9" ref-type="bibr">Fukuchi et al., 2014</xref>) (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.ideal-db.org/">https://www.ideal-db.org/</uri>). DM4229, which was originally used to develop the SPINE D program (<xref rid="ref-49" ref-type="bibr">Zhang et al., 2012</xref>), provides IDR annotations for 4,229 proteins. IDEAL, an IDP database, offers IDR annotations for 981 proteins. To eliminate redundancy between DM4229 and IDEAL, we performed clustering using BLASTClust (<xref rid="ref-1" ref-type="bibr">Altschul et al., 1997</xref>) with a 25% identity threshold, resulting in 4,981 clusters containing a total of 5,210 proteins. We selected representative proteins from each cluster as follows: the longest protein from IDEAL if a cluster contained multiple IDEAL proteins, an IDEAL protein if the cluster had one IDEAL protein, and the longest protein if a cluster had no IDEAL protein. IDEAL proteins were prioritized over those from DM4229 because IDEAL is continuously updated (<xref rid="ref-23" ref-type="bibr">IDEAL, 2025</xref>) (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.ideal-db.org/history.html">https://www.ideal-db.org/history.html</uri>). The CAID project, which evaluates IDR prediction programs, provides datasets for performance assessment. Since we used the CAID dataset as evaluation dataset, we excluded proteins with 25% or greater similarity to any CAID proteins from the representative proteins. This resulted in a final set of 4,762 proteins. Of these, 4,286 proteins (3,731 from DM4229 and 555 from IDEAL; <xref rid="supp-4" ref-type="supplementary-material">Table S1</xref>) were assigned to the training dataset, and 476 proteins (414 from DM4229 and 62 from IDEAL; <xref rid="supp-4" ref-type="supplementary-material">Table S1</xref>) were used for the validation dataset. To further enhance generalization ability, we included another validation dataset, the SL dataset (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://mendel.bii.a-star.edu.sg/SEQUENCES/disorder/">https://mendel.bii.a-star.edu.sg/SEQUENCES/disorder/</uri>), provided by <xref rid="ref-44" ref-type="bibr">Sirota et al. (2010)</xref> as a benchmark set for IDR predictor. We removed redundant proteins with 25% sequence identity found in the other datasets from the SL dataset.</p></sec><sec><title>Construction of evaluation dataset</title><p>We used the dataset from the first round of CAID (CAID1) (<xref rid="ref-38" ref-type="bibr">Necci et al., 2021</xref>), DisProt646 and DisProt-PDB646 (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://codeocean.com/capsule/2223745/tree/v1">https://codeocean.com/capsule/2223745/tree/v1</uri>), for evaluation. While both DisProt646 and DisProt-PDB646 contains 646 proteins from the DisProt database (<xref rid="ref-16" ref-type="bibr">Hatos et al., 2020</xref>), they follow different policies for disorder annotation. In both datasets, a residue is labeled as positive if it has a disorder annotation in DisProt. However, DisProt646 labels a residue as negative if it lacks a disorder annotation in DisProt, whereas DisProt-PDB646 labels a residue as negative only if it lacks a disorder annotation in DisProt and is part of a PDB structure. Consequently, DisProt-PDB646 includes residues labeled as neither positive nor negative (undefined in <xref rid="supp-4" ref-type="supplementary-material">Table S1</xref>), whereas DisProt646 classifies all residues as either positive or negative. For performance evaluations using DisProt-PDB646, undefined residues were excluded. Additionally, we evaluated our method using the two datasets from the second round of CAID (CAID2) (<xref rid="ref-3" ref-type="bibr">Conte et al., 2023</xref>): disorder_nox and disorder_pdb (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://caid.idpcentral.org/challenge/results">https://caid.idpcentral.org/challenge/results</uri>). Redundant proteins shared with the training and validation datasets were removed from these evaluation sets. The disorder_pdb dataset follows the same labeling policies as DisProt-PDB646. In contrast, disorder_nox labels a residue as positive if it is identified as disordered by circular dichroism and registered in DisProt, with all other residues labeled as negative. The detailed statistics of these datasets are provided in <xref rid="supp-4" ref-type="supplementary-material">Table S1</xref>.</p></sec><sec><title>DARUMA architecture</title><p>DARUMA comprises two units: a feature extraction unit (FEU) and a prediction unit (PU) (<xref rid="fig-1" ref-type="fig">Fig. 1</xref>). The FEU employs a CNN featuring three 1D convolutional layers (<xref rid="ref-27" ref-type="bibr">Lecun et al., 1998</xref>). A query sequence is embedded into an L × 553 vector, which is then zero-padded with 72 residues on both terminals before inputting into the first 1D convolutional layer. The filter size and the number of filters for all 1D convolutional layers are set to 9 and 128, respectively. Each layer uses the rectified linear unit (ReLU) (<xref rid="ref-11" ref-type="bibr">Hahnloser et al., 2000</xref>; <xref rid="ref-36" ref-type="bibr">Nair &amp; Hinton, 2010</xref>) activation function. The vector size decreases by eight residues at each 1D convolutional layer since the padding layer is not utilized in the FEU. As a result, the output from the final 1D convolutional layer consists of feature values compressed into an (L + 120) × 128-dimensional shape, which are then processed by the PU after applying the sliding window technique. In this sliding window process, the window size and the sliding step size are set to 121 and 1, respectively. The PU utilizes a neural network (<xref rid="ref-29" ref-type="bibr">McCulloch &amp; Pitts, 1990</xref>; <xref rid="ref-42" ref-type="bibr">Rosenblatt, 1958</xref>) that includes an input layer with 121 × 128 nodes, two hidden layers each containing 128 nodes, and an output layer with 2 nodes. The ReLU activation function is applied to the hidden layers, while the output layer employs the Softmax activation function (<xref rid="ref-2" ref-type="bibr">Bridle, 1990</xref>). The output from the Softmax node is averaged over 17 residues centered around a residue of interest; if the average exceeds 0.5, that residue is classified as disordered. When the 17-window was not applicable at the terminal regions, values over all residues were averaged. Additionally, IDRs shorter than 10 residues are relabeled as structured, while structured regions shorter than 10 residues are reclassified as disordered.</p><fig position="float" id="fig-1" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/fig-1</object-id><label>Figure 1</label><caption><title>Structure of the DARUMA model.</title><p>L represents the length of the query sequence. The values in parentheses indicate the dimensions of each layer. The values added to L at the first dimension in parentheses are the size of the zero-padded region. The boxes, flanking the solid-lined box and surrounded by dashed lines, indicate the zero-padded region. The figures associated with size and depth denote the size and number of filters, respectively. The term node refers to the number of nodes that make up the affine layer.</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2035"/></fig></sec><sec><title>Optimization of DARUMA</title><p>We optimized all hyperparameters in DARUMA through a grid search, selecting those that demonstrated the highest average performance across the two validation datasets. Additionally, we optimized the size of the sliding window applied to the outputs of the Softmax node. A detailed description of the hyperparameter selection process is provided in the additional information.</p></sec><sec><title>Evaluation of DARUMA</title><p>We selected eight IDR predictors as reference programs: IUPred3-long, IUPred3-short (<xref rid="ref-8" ref-type="bibr">Erdos, Pajkos &amp; Dosztanyi, 2021</xref>), SETH (<xref rid="ref-24" ref-type="bibr">Ilzhofer, Heinzinger &amp; Rost, 2022</xref>), SPOT-Disorder-Single (<xref rid="ref-14" ref-type="bibr">Hanson, Paliwal &amp; Zhou, 2018</xref>), SPOT-Disorder (<xref rid="ref-15" ref-type="bibr">Hanson et al., 2017</xref>), SPOT-Disorder2 (<xref rid="ref-13" ref-type="bibr">Hanson et al., 2019</xref>), flDPnn (<xref rid="ref-21" ref-type="bibr">Hu et al., 2021</xref>), and rawMSA (<xref rid="ref-33" ref-type="bibr">Mirabello &amp; Wallner, 2019</xref>). IUPred3-long, IUPred3-short, SETH, and SPOT-Disorder-Single do not utilize sequence profiles, and we categorized them as profile-free predictors. In contrast, SPOT-Disorder, SPOT-Disorder2, and flDPnn use sequence profiles and are classified as profile-driven predictors. Since rawMSA uses homology searching, we categorize it as the profile-driven predictor, although it utilizes raw multiple sequence alignments without generating profiles. Among these, SETH, rawMSA, SPOT-Disorder-Single, SPOT-Disorder, SPOT-Disorder2, and flDPnn employ machine learning methods, with the first two utilizing CNN, the following three utilizing long short-term memory methods (<xref rid="ref-20" ref-type="bibr">Hochreiter &amp; Schmidhuber, 1997</xref>), and flDPnn employing a deep neural network (<xref rid="ref-19" ref-type="bibr">Hinton, Osindero &amp; Teh, 2006</xref>) consisting of two fully-connected layers, all as their main model architecture. IUPred3-long and -short use a statistical potential to describe intra-chain contacting residue pairs, resulting in shorter execution times compared to profile-driven predictors (<xref rid="ref-31" ref-type="bibr">Meszaros, Erdos &amp; Dosztanyi, 2018</xref>). To ensure fair comparisons of execution time, all predictors were run on a machine equipped with an Intel Xeon E5-2697 v4 processor at 2.30GHz and 128GB of RAM, without the use of a GPU. The execution time was normalized by sequence length as follows: total execution time across all proteins in a dataset was divided by the total number of residues and multiplied by 1,000.</p><p>To measure the performance of the predictors, we utilized the Matthews Correlation Coefficient (MCC) (<xref rid="ref-28" ref-type="bibr">Matthews, 1975</xref>), the area under the curve of receiver operating characteristics (AUCroc) (<xref rid="ref-12" ref-type="bibr">Hanley &amp; McNeil, 1982</xref>), sensitivity, and precision.</p><p>MCC, sensitivity, and precision are represented as follows:</p><p>
<disp-formula id="ueqn-221">
<alternatives><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2036"/><tex-math id="tex-ueqn-221">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{upgreek}
\usepackage{mathrsfs}
\setlength{\oddsidemargin}{-69pt}
\begin{document}
$MCC = \; \displaystyle{{TP \times TN - FP \times FN} \over {\sqrt {\left( {TP + FP} \right)\left( {TP + FN} \right)\left( {TN + FP} \right)\left( {TN + FN} \right)} }},$\end{document}</tex-math><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="mml-ueqn-221" display="block" overflow="scroll"><mml:mi>M</mml:mi><mml:mi>C</mml:mi><mml:mi>C</mml:mi><mml:mo>=</mml:mo><mml:mspace width="thickmathspace"/><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>×</mml:mo><mml:mi>T</mml:mi><mml:mi>N</mml:mi><mml:mo>−</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi><mml:mo>×</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:msqrt><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>N</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:mo>(</mml:mo><mml:mrow><mml:mi>T</mml:mi><mml:mi>N</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow><mml:mo>)</mml:mo></mml:mrow></mml:msqrt></mml:mrow></mml:mfrac></mml:mrow><mml:mo>,</mml:mo></mml:mstyle></mml:math></alternatives></disp-formula>
</p><p>
<disp-formula id="ueqn-222">
<alternatives><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2037"/><tex-math id="tex-ueqn-222">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{upgreek}
\usepackage{mathrsfs}
\setlength{\oddsidemargin}{-69pt}
\begin{document}
$Sensitivity = \displaystyle{{TP} \over {TP + FN}}, \, \rm and$\end{document}</tex-math><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="mml-ueqn-222" display="block" overflow="scroll"><mml:mi>S</mml:mi><mml:mi>e</mml:mi><mml:mi>n</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>t</mml:mi><mml:mi>i</mml:mi><mml:mi>v</mml:mi><mml:mi>i</mml:mi><mml:mi>t</mml:mi><mml:mi>y</mml:mi><mml:mo>=</mml:mo><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>N</mml:mi></mml:mrow></mml:mfrac></mml:mrow><mml:mo>,</mml:mo><mml:mspace width="thinmathspace"/><mml:mi mathvariant="normal">a</mml:mi><mml:mi mathvariant="normal">n</mml:mi><mml:mi mathvariant="normal">d</mml:mi></mml:mstyle></mml:math></alternatives></disp-formula>
</p><p><disp-formula id="ueqn-1">
<alternatives><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2038"/><tex-math id="tex-ueqn-1">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{upgreek}
\usepackage{mathrsfs}
\setlength{\oddsidemargin}{-69pt}
\begin{document}
$Precision = \; \displaystyle{{TP} \over {TP + FP}}$\end{document}</tex-math><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="mml-ueqn-1" display="block" overflow="scroll"><mml:mi>P</mml:mi><mml:mi>r</mml:mi><mml:mi>e</mml:mi><mml:mi>c</mml:mi><mml:mi>i</mml:mi><mml:mi>s</mml:mi><mml:mi>i</mml:mi><mml:mi>o</mml:mi><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mspace width="thickmathspace"/><mml:mstyle displaystyle="true" scriptlevel="0"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi></mml:mrow><mml:mrow><mml:mi>T</mml:mi><mml:mi>P</mml:mi><mml:mo>+</mml:mo><mml:mi>F</mml:mi><mml:mi>P</mml:mi></mml:mrow></mml:mfrac></mml:mrow></mml:mstyle></mml:math></alternatives></disp-formula>where TP, TN, FP, and FN represent true positives, true negatives, false positives, and false negatives, respectively. We utilized the default thresholds from the reference predictors to differentiate between positive and negative. Portions of this text were previously published as part of a preprint (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.researchsquare.com/article/rs-5414158/v1">https://www.researchsquare.com/article/rs-5414158/v1</uri>).</p></sec></sec><sec sec-type="results"><title>Results</title><p>We compared the performance of DARUMA with that of other predictors. <xref rid="table-1" ref-type="table">Table 1A</xref> presents the evaluation results using the CAID1 dataset, DisProt646, and DisProt-PDB646. Among the profile-free programs, DARUMA and SETH, which utilize CNN, achieved the highest performance in MCC, and DARUMA, SETH, and SPOT-Disorder-Single exhibited a comparable performance in AUCroc for the DisProt646 dataset. Overall, the profile-driven predictors achieved high performances, flDPnn especially showed notable performances in both MCC and AUCroc. A similar trend is observed for the DisProt-PDB646 dataset, where the profile-driven predictors also demonstrated good performance. DARUMA excelled among the profile-free predictors and outperformed flDPnn and rawMSA, which are the profile-driven predictors, in both MCC and AUCroc. Interestingly, although flDPnn achieved high performance in the DisProt646 results, it recorded the lowest accuracy. <xref rid="table-1" ref-type="table">Table 1B</xref> presents the evaluation on the CAID2 dataset. Consistent with the findings from DisProt646 and DisProt-PDB646, DARUMA performed well among the profile-free predictors, achieving the highest MCC for both datasets and the highest AUCroc for disorder_pdb. Overall, among all predictors, including the profile-driven ones, DARUMA ranked second in MCC for the disorder_nox dataset and the third in MCC and AUCroc for the disorder_pdb dataset, demonstrating comparable performance of the profile-driven predictors. Those results show that DARUMA exhibited consistent performances across all test datasets, indicating its robustness in IDR prediction.</p><table-wrap position="float" id="table-1" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/table-1</object-id><label>Table 1</label><caption><title>Performance metrics for of all predictors evaluated on the CAID1 and CAID2 datasets.</title></caption><alternatives><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2039"/><table frame="hsides" rules="groups" content-type="text"><colgroup span="1"><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/></colgroup><thead><tr><th colspan="6" rowspan="1">(A) Performance metrics on the CAID1 dataset</th></tr><tr><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1"/><th colspan="2" rowspan="1">DisProt646</th><th colspan="2" rowspan="1">DisProt-PDB646</th></tr><tr><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1">MCC</th><th rowspan="1" colspan="1">AUCroc</th><th rowspan="1" colspan="1">MCC</th><th rowspan="1" colspan="1">AUCroc</th></tr></thead><tbody><tr><td rowspan="5" colspan="1">Profile-Free</td><td rowspan="1" colspan="1">DARUMA</td><td align="char" char="." rowspan="1" colspan="1">0.315</td><td align="char" char="." rowspan="1" colspan="1">0.753</td><td align="char" char="." rowspan="1" colspan="1">0.678</td><td align="char" char="." rowspan="1" colspan="1">0.910</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder-Single</td><td align="char" char="." rowspan="1" colspan="1">0.278</td><td align="char" char="." rowspan="1" colspan="1">0.757</td><td align="char" char="." rowspan="1" colspan="1">0.614</td><td align="char" char="." rowspan="1" colspan="1">0.897</td></tr><tr><td rowspan="1" colspan="1">IUPred3-long</td><td align="char" char="." rowspan="1" colspan="1">0.286</td><td align="char" char="." rowspan="1" colspan="1">0.738</td><td align="char" char="." rowspan="1" colspan="1">0.591</td><td align="char" char="." rowspan="1" colspan="1">0.865</td></tr><tr><td rowspan="1" colspan="1">IUPred3-short</td><td align="char" char="." rowspan="1" colspan="1">0.278</td><td align="char" char="." rowspan="1" colspan="1">0.742</td><td align="char" char="." rowspan="1" colspan="1">0.562</td><td align="char" char="." rowspan="1" colspan="1">0.861</td></tr><tr><td rowspan="1" colspan="1">SETH</td><td align="char" char="." rowspan="1" colspan="1">0.329</td><td align="char" char="." rowspan="1" colspan="1">0.756</td><td align="char" char="." rowspan="1" colspan="1">0.689</td><td align="char" char="." rowspan="1" colspan="1">0.894</td></tr><tr><td rowspan="4" colspan="1">Profile-Driven</td><td rowspan="1" colspan="1">SPOT-Disorder</td><td align="char" char="." rowspan="1" colspan="1">0.309</td><td align="char" char="." rowspan="1" colspan="1">0.750</td><td align="char" char="." rowspan="1" colspan="1">0.698</td><td align="char" char="." rowspan="1" colspan="1">0.917</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder2</td><td align="char" char="." rowspan="1" colspan="1">0.332</td><td align="char" char="." rowspan="1" colspan="1">0.765</td><td align="char" char="." rowspan="1" colspan="1">0.711</td><td align="char" char="." rowspan="1" colspan="1">0.924</td></tr><tr><td rowspan="1" colspan="1">flDPnn</td><td align="char" char="." rowspan="1" colspan="1">0.361</td><td align="char" char="." rowspan="1" colspan="1">0.814</td><td align="char" char="." rowspan="1" colspan="1">0.534</td><td align="char" char="." rowspan="1" colspan="1">0.874</td></tr><tr><td rowspan="1" colspan="1">rawMSA</td><td align="char" char="." rowspan="1" colspan="1">0.327</td><td align="char" char="." rowspan="1" colspan="1">0.785</td><td align="char" char="." rowspan="1" colspan="1">0.639</td><td align="char" char="." rowspan="1" colspan="1">0.902</td></tr></tbody></table><table frame="hsides" rules="groups" content-type="text"><colgroup span="1"><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/></colgroup><thead><tr><th colspan="6" rowspan="1">(B) Performance metrics on the CAID2 dataset</th></tr><tr><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1"/><th colspan="2" rowspan="1">disorder_nox</th><th colspan="2" rowspan="1">disorder_pdb</th></tr><tr><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1">MCC</th><th rowspan="1" colspan="1">AUCroc</th><th rowspan="1" colspan="1">MCC</th><th rowspan="1" colspan="1">AUCroc</th></tr></thead><tbody><tr><td rowspan="5" colspan="1">Profile-Free</td><td rowspan="1" colspan="1">DARUMA</td><td rowspan="1" colspan="1">0.420</td><td rowspan="1" colspan="1">0.792</td><td rowspan="1" colspan="1">0.738</td><td rowspan="1" colspan="1">0.923</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder-Single</td><td rowspan="1" colspan="1">0.371</td><td rowspan="1" colspan="1">0.793</td><td rowspan="1" colspan="1">0.668</td><td rowspan="1" colspan="1">0.917</td></tr><tr><td rowspan="1" colspan="1">IUPred3-long</td><td rowspan="1" colspan="1">0.377</td><td rowspan="1" colspan="1">0.774</td><td rowspan="1" colspan="1">0.656</td><td rowspan="1" colspan="1">0.885</td></tr><tr><td rowspan="1" colspan="1">IUPred3-short</td><td rowspan="1" colspan="1">0.332</td><td rowspan="1" colspan="1">0.763</td><td rowspan="1" colspan="1">0.600</td><td rowspan="1" colspan="1">0.873</td></tr><tr><td rowspan="1" colspan="1">SETH</td><td rowspan="1" colspan="1">0.401</td><td rowspan="1" colspan="1">0.793</td><td rowspan="1" colspan="1">0.711</td><td rowspan="1" colspan="1">0.911</td></tr><tr><td rowspan="4" colspan="1">Profile-Driven</td><td rowspan="1" colspan="1">SPOT-Disorder</td><td rowspan="1" colspan="1">0.416</td><td rowspan="1" colspan="1">0.799</td><td rowspan="1" colspan="1">0.754</td><td rowspan="1" colspan="1">0.930</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder2</td><td rowspan="1" colspan="1">0.452</td><td rowspan="1" colspan="1">0.786</td><td rowspan="1" colspan="1">0.794</td><td rowspan="1" colspan="1">0.949</td></tr><tr><td rowspan="1" colspan="1">flDPnn</td><td rowspan="1" colspan="1">0.411</td><td rowspan="1" colspan="1">0.840</td><td rowspan="1" colspan="1">0.544</td><td rowspan="1" colspan="1">0.893</td></tr><tr><td rowspan="1" colspan="1">rawMSA</td><td rowspan="1" colspan="1">0.345</td><td rowspan="1" colspan="1">0.798</td><td rowspan="1" colspan="1">0.634</td><td rowspan="1" colspan="1">0.910</td></tr></tbody></table></alternatives></table-wrap><p>Next, we compared the execution times of the predictors on the CAID1 dataset. To determine the execution time for each predictor, we calculated the execution time per 1,000 residues across all proteins in the datasets. <xref rid="fig-2" ref-type="fig">Figure 2</xref> shows a scatterplot illustrating the relationship between execution time and MCC. In both datasets, DARUMA, IUPred3-long and -short emerged as the fastest predictors. Among these, DARUMA showed comparable performance to the profile-driven predictors in both datasets. Although SETH showed high performance along with DARUMA, it took 30.19 s, which was 33.5 times longer than DARUMA. Generally, profile-driven predictors yield good performance but require more time to execute (<xref rid="ref-3" ref-type="bibr">Conte et al., 2023</xref>). This trend is evident in <xref rid="fig-2" ref-type="fig">Fig. 2</xref>, particularly in the case of SPOT-Disorder2. flDPnn was the fastest among the profile-driven predictors, taking 47.13 s, which is about 52 times longer than DARUMA. Overall, DARUMA can deliver high-speed IDR predictions with accuracy comparable to that of the profile-driven predictors.</p><fig position="float" id="fig-2" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/fig-2</object-id><label>Figure 2</label><caption><title>MCC and execution time of each predictor on the two CAID1 datasets.</title><p>Execution time and MCC for each predictor are plotted on the horizontal and vertical axes. DisProt646 and DisProt-PDB646 are indicated as blue and orange, respectively. Filled and open circles indicate the profile-free predictors and profile-driven predictors, respectively. The names and execution times of the predictors are displayed alongside their corresponding markers. Please note that the horizontal axis is presented on a logarithm scale.</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2040"/></fig><p>DARUMA offers significant benefits to users, particularly for large-scale analyses. <xref rid="fig-3" ref-type="fig">Figure 3</xref> schematically illustrates the execution time distributions of IUPred3-long, IUPred3-short, and DARUMA. We utilized the DisProt646 dataset, which comprises 646 proteins, to calculate the execution time for each protein. The execution time are depicted in the boxplot. DARUMA(multi) represents the execution time distribution when a query is input in a multiple FASTA file containing a large number of amino acid sequences in FASTA format. When the number of sequences is N, DARUMA(single) presents the execution time distribution for a protein based on N independent executions of DARUMA. In these two processes, DARUMA(multi) performs the initialization process only once because the parallelization is not implemented even on DARUMA(multi), whereas DARUMA(single) executes the initiation N times. In the multiple FASTA query, the execution time per protein is 0.037 s, which is about 12.6 times faster than DARUMA(single) and 14.9 times faster than the two IUPred3 predictors. Additionally, the execution times of DARUMA(multi) and DARUMA(single) scaled linearly with sequence length, maintaining consistent differences across individual proteins (<xref rid="supp-2" ref-type="supplementary-material">Fig. S1</xref>). This indicates that the initialization time of the prediction model accounts for majority of DARUMA’s execution time. SETH can also accept a multiple FASTA file as an input; however, we could not include it in <xref rid="fig-3" ref-type="fig">Fig. 3</xref> because we could not calculate the execution time for each protein. DARUMA was 58.4 times faster than SETH in the total execution time for the DisProt646 dataset.</p><fig position="float" id="fig-3" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/fig-3</object-id><label>Figure 3</label><caption><title>Execution time of each predictor on the DisProt646 dataset.</title><p>The boxplot provides a schematic representation of the execution time distribution for proteins in the DisProt646 dataset. The green triangle and orange line indicates the average and median execution time, respectively. The box represents the quartile range, horizontal bar depicts the full range of the dataset, and circles denote outliers. DARUMA(single) and DARUMA(multi) represent the execution time for a single protein query and a query in the multi FASTA format.</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2041"/></fig><p>DARUMA is available through a web interface that supports two types of input: single sequence and multiple sequences (<xref rid="fig-4" ref-type="fig">Fig. 4A</xref>). For a single FASTA input, DARUMA presents the results with a graphic chart, displaying the disorder probability for each residue in a line graph, while highlighting the disordered regions in red on the query sequence (<xref rid="fig-4" ref-type="fig">Fig. 4B</xref>). In addition to the graphical outputs, users can download the results in text format by clicking the button in the upper right corner of <xref rid="fig-4" ref-type="fig">Fig. 4B</xref>. When sequences are input in the multi FASTA format, users receive an e-mail containing a URL that leads to a results list (<xref rid="fig-4" ref-type="fig">Fig. 4C</xref>). Additionally, DARUMA is provided as a Python pip package, within a Docker container, and through GitHub for easy installation in local environments. These services simplify the installation process, allowing DARUMA to run on both Python2 and Python3 with only the standard and NumPy libraries required. Installation packages can be found at <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://antepontem.org/daruma/download.html">https://antepontem.org/daruma/download.html</uri>.</p><fig position="float" id="fig-4" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/fig-4</object-id><label>Figure 4</label><caption><title>Web interface of DARUMA.</title><p>(A) The submission page of DARUMA. The dotted circle highlights the button for selecting either single FASTA or multiple FASTA formats. Users can enter a sequence or sequences in the box below, or they can upload a file. (B) An example of the DARUMA results. The blue line graph schematically displays the disordered probabilities along the query sequence, while the orange box indicates the disordered regions based on binary predictions. The button enclosed by the dotted circle allows users to download the results in text format. (C) The list of results submitted <italic toggle="yes">via</italic> a multi FASTA file. Users receive an e-mail containing the URL for this page. The blue letters are hyperlinks to the results formatted as shown in panel B. The button enclosed by the dotted circle enables users to download an archived file containing each result in text format.</p></caption><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2042"/></fig></sec><sec sec-type="discussion"><title>Discussion</title><p>DARUMA achieved a high MCC and area under the curve (AUC) (<xref rid="table-1" ref-type="table">Table 1</xref>) among the profile-free predictors due to its high sensitivity of 0.718 (<xref rid="table-2" ref-type="table">Table 2</xref>). Since the definitions of positive in DisProt646 and DisProt-PDB646 are the same, the sensitivity, true positives, and false negatives are identical between these two datasets. Generally, as the number of residues predicted as positive increases, the number of false positives (FPs) also rises, conversely, an increase in negative predictions typically leads to a higher count of false negatives (FNs). In fact, DARUMA had the second-highest number of true positives (TPs) and the third-highest number of false positives, while flDPnn, which recorded the highest MCC and AUCroc (0.361 and 0.814 in <xref rid="table-1" ref-type="table">Table 1A</xref>) in DisProt646, had the highest number of true negatives (TNs) and FNs. These results indicate that DARUMA tends to yield more positive predictions, whereas flDPnn generates more negative predictions. SPOT-Disorder and SPOT-Disorder2, which are the profile-driven predictors, and SETH, which is the profile-free predictors, display a similar trend to DARUMA. Considering the trade-off between the numbers of positive predictions and the risk of misclassifications, it is important for users to understand the characteristics of each predictor.</p><table-wrap position="float" id="table-2" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/table-2</object-id><label>Table 2</label><caption><title>Additional performance metrics for all predictors on the DisProt646 and DisProt-PDB646 datasets.</title></caption><alternatives><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2043"/><table frame="hsides" rules="groups" content-type="text"><colgroup span="1"><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/><col span="1"/></colgroup><thead><tr><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1"/><th rowspan="1" colspan="1">Sensitivity</th><th rowspan="1" colspan="1">Precision</th><th rowspan="1" colspan="1">TP</th><th rowspan="1" colspan="1">TN</th><th rowspan="1" colspan="1">FP</th><th rowspan="1" colspan="1">FN</th></tr></thead><tbody><tr><td colspan="8" rowspan="1">DisProt646</td></tr><tr><td rowspan="5" colspan="1">Profile-Free</td><td rowspan="1" colspan="1">DARUMA</td><td rowspan="1" colspan="1">0.718</td><td rowspan="1" colspan="1">0.313</td><td rowspan="1" colspan="1">39,182</td><td rowspan="1" colspan="1">196,163</td><td rowspan="1" colspan="1">85,828</td><td rowspan="1" colspan="1">15,422</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder-Single</td><td rowspan="1" colspan="1">0.556</td><td rowspan="1" colspan="1">0.329</td><td rowspan="1" colspan="1">30,384</td><td rowspan="1" colspan="1">220,025</td><td rowspan="1" colspan="1">61,966</td><td rowspan="1" colspan="1">24,220</td></tr><tr><td rowspan="1" colspan="1">IUPred3-long</td><td rowspan="1" colspan="1">0.638</td><td rowspan="1" colspan="1">0.312</td><td rowspan="1" colspan="1">34,829</td><td rowspan="1" colspan="1">205,135</td><td rowspan="1" colspan="1">76,856</td><td rowspan="1" colspan="1">19,775</td></tr><tr><td rowspan="1" colspan="1">IUPred3-short</td><td rowspan="1" colspan="1">0.557</td><td rowspan="1" colspan="1">0.329</td><td rowspan="1" colspan="1">30,415</td><td rowspan="1" colspan="1">219,870</td><td rowspan="1" colspan="1">62,121</td><td rowspan="1" colspan="1">24,189</td></tr><tr><td rowspan="1" colspan="1">SETH</td><td rowspan="1" colspan="1">0.770</td><td rowspan="1" colspan="1">0.310</td><td rowspan="1" colspan="1">42,041</td><td rowspan="1" colspan="1">188,399</td><td rowspan="1" colspan="1">93,592</td><td align="char" char="." rowspan="1" colspan="1">12,563</td></tr><tr><td rowspan="4" colspan="1">Profile-Driven</td><td rowspan="1" colspan="1">SPOT-Disorder</td><td rowspan="1" colspan="1">0.713</td><td rowspan="1" colspan="1">0.309</td><td rowspan="1" colspan="1">38,685</td><td rowspan="1" colspan="1">195,091</td><td rowspan="1" colspan="1">86,358</td><td align="char" char="." rowspan="1" colspan="1">15,608</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder2</td><td rowspan="1" colspan="1">0.742</td><td rowspan="1" colspan="1">0.331</td><td rowspan="1" colspan="1">36,651</td><td rowspan="1" colspan="1">161,985</td><td rowspan="1" colspan="1">73,967</td><td align="char" char="." rowspan="1" colspan="1">12,777</td></tr><tr><td rowspan="1" colspan="1">flDPnn</td><td rowspan="1" colspan="1">0.507</td><td rowspan="1" colspan="1">0.439</td><td rowspan="1" colspan="1">27,667</td><td rowspan="1" colspan="1">246,597</td><td rowspan="1" colspan="1">35,322</td><td align="char" char="." rowspan="1" colspan="1">26,893</td></tr><tr><td rowspan="1" colspan="1">rawMSA</td><td rowspan="1" colspan="1">0.660</td><td rowspan="1" colspan="1">0.340</td><td rowspan="1" colspan="1">36,034</td><td rowspan="1" colspan="1">211,959</td><td rowspan="1" colspan="1">70,032</td><td align="char" char="." rowspan="1" colspan="1">18,570</td></tr><tr><td colspan="8" rowspan="1">DisProt-PDB646</td></tr><tr><td rowspan="5" colspan="1">Profile-Free</td><td rowspan="1" colspan="1">DARUMA</td><td rowspan="1" colspan="1">0.718</td><td rowspan="1" colspan="1">0.826</td><td rowspan="1" colspan="1">39,182</td><td rowspan="1" colspan="1">114,203</td><td rowspan="1" colspan="1">8,263</td><td align="char" char="." rowspan="1" colspan="1">15,422</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder-Single</td><td rowspan="1" colspan="1">0.556</td><td rowspan="1" colspan="1">0.887</td><td rowspan="1" colspan="1">30,384</td><td rowspan="1" colspan="1">118,590</td><td rowspan="1" colspan="1">3,876</td><td align="char" char="." rowspan="1" colspan="1">24,220</td></tr><tr><td rowspan="1" colspan="1">IUPred3-long</td><td rowspan="1" colspan="1">0.638</td><td rowspan="1" colspan="1">0.778</td><td rowspan="1" colspan="1">34,829</td><td rowspan="1" colspan="1">112,504</td><td rowspan="1" colspan="1">9,962</td><td align="char" char="." rowspan="1" colspan="1">19,775</td></tr><tr><td rowspan="1" colspan="1">IUPred3-short</td><td rowspan="1" colspan="1">0.557</td><td rowspan="1" colspan="1">0.807</td><td rowspan="1" colspan="1">30,415</td><td rowspan="1" colspan="1">115,209</td><td rowspan="1" colspan="1">7,257</td><td align="char" char="." rowspan="1" colspan="1">24,189</td></tr><tr><td rowspan="1" colspan="1">SETH</td><td rowspan="1" colspan="1">0.770</td><td rowspan="1" colspan="1">0.797</td><td rowspan="1" colspan="1">42,041</td><td rowspan="1" colspan="1">111,771</td><td rowspan="1" colspan="1">10,695</td><td align="char" char="." rowspan="1" colspan="1">12,563</td></tr><tr><td rowspan="4" colspan="1">Profile-Driven</td><td rowspan="1" colspan="1">SPOT-Disorder</td><td rowspan="1" colspan="1">0.713</td><td rowspan="1" colspan="1">0.857</td><td rowspan="1" colspan="1">38,685</td><td rowspan="1" colspan="1">115,925</td><td rowspan="1" colspan="1">6,469</td><td align="char" char="." rowspan="1" colspan="1">15,608</td></tr><tr><td rowspan="1" colspan="1">SPOT-Disorder2</td><td rowspan="1" colspan="1">0.742</td><td rowspan="1" colspan="1">0.847</td><td rowspan="1" colspan="1">36,651</td><td rowspan="1" colspan="1">106,382</td><td rowspan="1" colspan="1">6,610</td><td align="char" char="." rowspan="1" colspan="1">12,777</td></tr><tr><td rowspan="1" colspan="1">flDPnn</td><td rowspan="1" colspan="1">0.507</td><td rowspan="1" colspan="1">0.814</td><td rowspan="1" colspan="1">27,667</td><td rowspan="1" colspan="1">116,078</td><td rowspan="1" colspan="1">6,316</td><td align="char" char="." rowspan="1" colspan="1">26,893</td></tr><tr><td rowspan="1" colspan="1">rawMSA</td><td rowspan="1" colspan="1">0.660</td><td rowspan="1" colspan="1">0.823</td><td rowspan="1" colspan="1">36,034</td><td rowspan="1" colspan="1">114,725</td><td rowspan="1" colspan="1">7,741</td><td align="char" char="." rowspan="1" colspan="1">18,570</td></tr></tbody></table></alternatives></table-wrap><p>In the evaluation using DisProt-PDB646, the accuracy of all predictors improved compared to their performance with DisProt646. In DisProt646, residues with disordered annotations are labeled as positive, while others are labeled as negative. In contrast, in DisProt-PDB646, only residues with ordered annotations are labeled negative, with the remainder categorized as undefined. Therefore, the negative residues in DisProt646 are divided into negative and undefined categories in DisProt-PDB646. Since annotations are based on experimental evidence, the undefined residues in DisProt-PDB646 are those lacking any experimental validation. In this context, DisProt-PDB646 serves as a conservative dataset by excluding uncertain negative labels. These undefined residues may contain cryptic IDRs, and the residues in these regions can exhibit IDR properties. When a predictor identifies these residues as positive due to such IDR characteristics, this leads to false positives when evaluated against the DisProt646 dataset. The CAID experiment demonstrated that this characteristic of the dataset was one of the reasons for the increased accuracy (<xref rid="ref-38" ref-type="bibr">Necci et al., 2021</xref>).</p><p>While DARUMA, SETH, and rawMSA adopt CNN architectures for their prediction models, the input feature values differ among them. DARUMA, SETH and rawMSA utilize the physicochemical properties of each amino acid, the embedding values generated by the protein language model ProtT5, and raw multiple sequence alignments. Despite these differences, the overall performances of these predictors were comparable (<xref rid="fig-2" ref-type="fig">Fig. 2</xref>).</p><p>Although we used eight predictors as reference predictors in the development of the DARUMA model, we compared the performance of DARUMA with 34 predictors available from CAID2 (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://caid.idpcentral.org/challenge/results">https://caid.idpcentral.org/challenge/results</uri>) (<xref rid="supp-6" ref-type="supplementary-material">Table S3</xref>). In order to ensure a fair comparison of execution time, we ran DARUMA on the Intel Xeon E5-2697 v4 processor at 2.30 GHz with RAM limited to 47 GB, which matches the RAM size used in the CAID2. Some profile-free predictors, such as SETH-0, metapredict, and DARUMA, show comparable performance, although the predictors demonstrating high performance were mostly profile-driven ones. DARUMA achieved high speed prediction than other two among these three. <xref rid="supp-3" ref-type="supplementary-material">Figure S2</xref> showed that DARUMA is a well-balanced IDR predictor in terms of both prediction accuracy and execution time.</p><p>We demonstrated in the results section that DARUMA can quickly process a file in the multi FASTA format. Fast predictions are particularly useful for large-scale analyses, which are often conducted on local computer environments. In such cases, execution time depends on the specifications of the running devices. <xref rid="table-3" ref-type="table">Table 3</xref> presents the execution time of four devices: the Intel Xeon E5-2697 v4 processor at 2.30 GHz with 128 GB of RAM (Xeon E5 128 G), the Intel Xeon Silver 4214R processor at 2.40 GHz with 92 GB of RAM (Xeon Silver 92 G), the Intel Core i3-2120 processor at 3.30 GHz with 4 GB of RAM (Core i3 4 G 2nd Gen), and the Intel(R) Xeon(R) Gold 5222 CPU @ 3.80GHz with GPU of RTX2080ti (Xeon Gold with GPU). Among these, the Xeon Silver 92 G is the device used for the web interface. The experiments were conducted using sequences from the human proteome, which includes 20,371 proteins (<xref rid="ref-45" ref-type="bibr">UniProt, 2025</xref>) (<uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.uniprot.org/">https://www.uniprot.org/</uri>). The execution times for processing the human proteome were 13.72, 27.25, 39.15 and 1.93 min on the Xeon E5 128 G, Xeon Silver 92 G, Core i3 4 G 2nd Gen, and Xeon Gold with GPU, respectively, resulting in per 1,000 residues execution times of 0.072, 0.14, 0.21 and, 0.010 s. Although the Xeon processors exhibited high performance in terms of speed, the Core i3 4 G 2nd Gen, a consumer-grade CPU released over a decade ago, demonstrated a practical execution time of less than an hour for the human proteome. The human proteome can be processed in less than 2 min by running DARUMA on a GPU. It shows that it is beneficial for large-scale analyses. These results indicate that DARUMA enables fast predictions on a wide range of processors, from consumer-grade to server-grade. Therefore, many users can run DARUMA in their respective environments.</p><table-wrap position="float" id="table-3" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/table-3</object-id><label>Table 3</label><caption><title>Comparison of execution times across various computing configurations.</title></caption><alternatives><graphic xmlns:xlink="http://www.w3.org/1999/xlink" position="float" orientation="portrait" xlink:href="/publication/155/files/2044"/><table frame="hsides" rules="groups" content-type="text"><colgroup span="1"><col span="1"/><col span="1"/><col span="1"/><col span="1"/></colgroup><thead><tr><th rowspan="1" colspan="1">Configuration</th><th rowspan="1" colspan="1">Predictor</th><th rowspan="1" colspan="1">Minutes</th><th rowspan="1" colspan="1">Seconds per 1,000 residues</th></tr></thead><tbody><tr><td rowspan="3" colspan="1">Xeon E5 128 G</td><td rowspan="1" colspan="1">IUPred3-long</td><td rowspan="1" colspan="1">182.01</td><td rowspan="1" colspan="1">0.96</td></tr><tr><td rowspan="1" colspan="1">IUPred3-short</td><td rowspan="1" colspan="1">180.13</td><td rowspan="1" colspan="1">0.95</td></tr><tr><td rowspan="1" colspan="1">DARUMA(multi)</td><td rowspan="1" colspan="1">13.72</td><td rowspan="1" colspan="1">0.072</td></tr><tr><td rowspan="1" colspan="1">Xeon Silver 92 G(on WEB)</td><td rowspan="1" colspan="1">DARUMA(multi)</td><td rowspan="1" colspan="1">27.25</td><td rowspan="1" colspan="1">0.14</td></tr><tr><td rowspan="1" colspan="1">Core i3 4 G 2nd Gen</td><td rowspan="1" colspan="1">DARUMA(multi)</td><td rowspan="1" colspan="1">39.15</td><td rowspan="1" colspan="1">0.21</td></tr><tr><td rowspan="1" colspan="1">Xeon Gold with GPU</td><td rowspan="1" colspan="1">DARUMA(multi)</td><td rowspan="1" colspan="1">1.93</td><td rowspan="1" colspan="1">0.010</td></tr></tbody></table></alternatives></table-wrap><p>Although we evaluated the performance of DARUMA with the programs locally installed in our environment, there are programs only available <italic toggle="yes">via</italic> the web interface. RIDAO (<xref rid="ref-4" ref-type="bibr">Dayhoff &amp; Uversky, 2022</xref>) is the website to provide results of six disorder predictors and the consensus score. We could refer the execution time in its article (<xref rid="ref-4" ref-type="bibr">Dayhoff &amp; Uversky, 2022</xref>), which can process about 420 million residues in 42 min due to multi-threaded execution. We calculated the execution time of DARUMA for the same dataset, resulting in an execution time of 77.5 min. Since DARUMA conducts its prediction on a single GPU (Xeon Gold with RTX2080ti GPU) environment at present, we conducted a performance test using multiple GPUs (Xeon Gold with two RTX2080ti GPUs) on the same dataset, and we found that the execution time was significantly reduced to 39.2 min. This result showed that the multiple thread version of DARUMA is expected to enhance its usability, and it will be available in the near future.</p></sec><sec sec-type="conclusions"><title>Conclusions</title><p>In this study, we developed DARUMA, a tool capable of delivering high-speed IDR predictions with accuracy comparable to that of state-of-the-art predictors. DARUMA is accessible <italic toggle="yes">via</italic> a web interface that accommodates both single protein queries and proteome-wide searches. Additionally, DARUMA is offered in several installation packages, enabling users to easily install the software in local environments. Users can benefit from high-speed predictions with DARUMA across a range of devices, from consumer-grade processors to sever-grade systems. DARUMA is accessible at <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://antepontem.org/daruma/">https://antepontem.org/daruma/</uri>.</p></sec><sec id="supplemental-information" sec-type="supplementary-material"><title>Supplemental Information</title><supplementary-material id="supp-1" position="float" content-type="local-data" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/supp-1</object-id><label>Supplemental Information 1</label><caption><title>Optimization of hyperparameters for DARUMA.</title></caption><media xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="peerj-cs-11-3343-s001.pdf" position="float" orientation="portrait"/></supplementary-material><supplementary-material id="supp-2" position="float" content-type="local-data" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/supp-2</object-id><label>Supplemental Information 2</label><caption><title>AUCroc and execution time of each predictor on the disorder_pdb datasets.</title><p>Execution time and AUCroc for each predictor are plotted on the horizontal and vertical axes. Filled and open circles indicate the Profile-free predictors and Profile-driven predictors, respectively. The Pred-IDR and DisoPred are plotted as a lattice of circles because the details of both predictors have not been published. A red triangle indicates DARUMA executed on the GPU. Please note that the horizontal axis is presented on a logarithm scale.</p></caption><media xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="peerj-cs-11-3343-s002.png" position="float" orientation="portrait"/></supplementary-material><supplementary-material id="supp-3" position="float" content-type="local-data" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/supp-3</object-id><label>Supplemental Information 3</label><caption><title>Comparison of execution time of sequence length.</title><p>The circles represent the execution times of proteins for DARUMA(multi) (red circles), DARUMA(single) (cyan circles), IUPred3-long (magenta circles), and IUPred3-short (yellow circles), respectively.</p></caption><media xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="peerj-cs-11-3343-s003.png" position="float" orientation="portrait"/></supplementary-material><supplementary-material id="supp-4" position="float" content-type="local-data" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/supp-4</object-id><label>Supplemental Information 4</label><caption><title>Dataset details.</title></caption><media xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="peerj-cs-11-3343-s004.docx" position="float" orientation="portrait"/></supplementary-material><supplementary-material id="supp-5" position="float" content-type="local-data" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/supp-5</object-id><label>Supplemental Information 5</label><caption><title>List of candidate hyperparameters for grid search.</title></caption><media xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="peerj-cs-11-3343-s005.docx" position="float" orientation="portrait"/></supplementary-material><supplementary-material id="supp-6" position="float" content-type="local-data" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/supp-6</object-id><label>Supplemental Information 6</label><caption><title>Two accuracy metrics and execution time for all predictors on disorder PDB.</title><p>The order of predictors follows based on AUCroc. The MCC and AUCroc for all predictors excluding DARUMA and DARUMA (GPU) were calculated based on the prediction results provided in https://caid.idpcentral.org/assets/sections/challenge/static/predictions/2/predictions.zip . The execution times for all predictors excluding DARUMA and DARUMA (GPU) were obtained from the results reported on https://caid.idpcentral.org/challenge/results . We executed DARUMA on the Intel Xeon E5-2697 with RAM limited to 47 GB to fairly compare the execution time. We run DARUMA(GPU) on the Intel(R) Xeon(R) Gold 5222 CPU @ 3.80GHz with GPU of RTX2080ti. The ’D’, ’F’, or ’-’ in the Profile column indicates the predictor group, Profile-driven, Profile-free, or not published, respectively.</p></caption><media xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="peerj-cs-11-3343-s006.docx" position="float" orientation="portrait"/></supplementary-material><supplementary-material id="supp-7" position="float" content-type="local-data" orientation="portrait"><object-id pub-id-type="doi">10.7717/peerj-cs.3343/supp-7</object-id><label>Supplemental Information 7</label><caption><title>Raw DM4229 dataset.</title></caption><media xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="peerj-cs-11-3343-s007.txt" position="float" orientation="portrait"/></supplementary-material></sec></body>
  <back><ack><p>The authors would like to thank Associate Professor Kenji Kawauchi for editing the English language of this manuscript.</p></ack><sec sec-type="additional-information"><title>Additional Information and Declarations</title><sec sec-type="COI-statement"><title>Competing Interests</title><p>The authors declare that they have no competing interests.</p></sec><sec sec-type="author-contributions"><title>Author Contributions</title><p><xref rid="author-1" ref-type="contrib">Itsuki Shimizu</xref> performed the experiments, analyzed the data, performed the computation work, prepared figures and/or tables, authored or reviewed drafts of the article, and approved the final draft.</p><p><xref rid="author-2" ref-type="contrib">Takuya Ida</xref> performed the computation work, prepared figures and/or tables, and approved the final draft.</p><p><xref rid="author-3" ref-type="contrib">Yuhei Ozawa</xref> performed the experiments, authored or reviewed drafts of the article, and approved the final draft.</p><p><xref rid="author-4" ref-type="contrib">Satoshi Fukuchi</xref> conceived and designed the experiments, prepared figures and/or tables, authored or reviewed drafts of the article, and approved the final draft.</p><p><xref rid="author-5" ref-type="contrib">Hiroto Anbo</xref> conceived and designed the experiments, performed the experiments, analyzed the data, prepared figures and/or tables, authored or reviewed drafts of the article, and approved the final draft.</p></sec><sec sec-type="data-availability"><title>Data Availability</title><p>The following information was supplied regarding data availability:</p><p>The data and code is available at GitHub and Zenodo:</p><p>- <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://github.com/antepontem/DARUMA-Additional-Data">https://github.com/antepontem/DARUMA-Additional-Data</uri>.</p><p>- shimizuitsuki0316, &amp; antepontem. (2025). antepontem/DARUMA-Additional-Data: DARUMA-Additional-Data (v1.1.0). Zenodo. <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://doi.org/10.5281/zenodo.16564099">https://doi.org/10.5281/zenodo.16564099</uri>.</p><p>The IDEAL dataset is available at: <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.ideal-db.org/current.html">https://www.ideal-db.org/current.html</uri>.</p><p>The SL dataset is available at Bioinformatics Institute A*STAR Singapore: <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://mendel.bii.a-star.edu.sg/SEQUENCES/disorder/">https://mendel.bii.a-star.edu.sg/SEQUENCES/disorder/</uri>.</p><p>The CAID1 dataset is available at CodeOcean: <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://codeocean.com/capsule/2223745/tree/v1">https://codeocean.com/capsule/2223745/tree/v1</uri>.</p><p>The CAID2 dataset and prediction results are available at: <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://caid.idpcentral.org/challenge/results">https://caid.idpcentral.org/challenge/results</uri>.</p><p>The RIDAO dataset is available at: <uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://ridao.app/publications">https://ridao.app/publications</uri>.</p><p>The data and code are available in the <xref rid="supplemental-information" ref-type="sec">Supplemental Files</xref>.</p></sec></sec><ref-list content-type="authoryear"><title>References</title><ref id="ref-1"><label>Altschul et al. (1997)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Altschul</surname><given-names>SF</given-names></name>
<name name-style="western"><surname>Madden</surname><given-names>TL</given-names></name>
<name name-style="western"><surname>Schaffer</surname><given-names>AA</given-names></name>
<name name-style="western"><surname>Zhang</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Zhang</surname><given-names>Z</given-names></name>
<name name-style="western"><surname>Miller</surname><given-names>W</given-names></name>
<name name-style="western"><surname>Lipman</surname><given-names>DJ</given-names></name>
</person-group><article-title>Gapped BLAST and PSI-BLAST: a new generation of protein database search programs</article-title><source>Nucleic Acids Research</source><year iso-8601-date="1997">1997</year><volume>25</volume><issue>17</issue><fpage>3389</fpage><lpage>3402</lpage><pub-id pub-id-type="doi">10.1093/nar/25.17.3389</pub-id><pub-id pub-id-type="pmid">9254694</pub-id><pub-id pub-id-type="pmcid">PMC146917</pub-id></element-citation></ref><ref id="ref-2"><label>Bridle (1990)</label><element-citation publication-type="confproc"><person-group person-group-type="author">
<name name-style="western"><surname>Bridle</surname><given-names>J</given-names></name>
</person-group><article-title>Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition</article-title><year iso-8601-date="1990">1990</year><conf-name>Proceedings of the Neurocomputing: Algorithms, Architectures and Applications</conf-name><fpage>227</fpage><lpage>236</lpage></element-citation></ref><ref id="ref-3"><label>Conte et al. (2023)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Conte</surname><given-names>AD</given-names></name>
<name name-style="western"><surname>Mehdiabadi</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Bouhraoua</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Miguel Monzon</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Tosatto</surname><given-names>SCE</given-names></name>
<name name-style="western"><surname>Piovesan</surname><given-names>D</given-names></name>
</person-group><article-title>Critical assessment of protein intrinsic disorder prediction (CAID)-results of round 2</article-title><source>Proteins</source><year iso-8601-date="2023">2023</year><volume>91</volume><issue>12</issue><fpage>1925</fpage><lpage>1934</lpage><pub-id pub-id-type="doi">10.1002/prot.26582</pub-id><pub-id pub-id-type="pmid">37621223</pub-id></element-citation></ref><ref id="ref-4"><label>Dayhoff &amp; Uversky (2022)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Dayhoff</surname><given-names>GW</given-names><suffix>2nd</suffix></name>
<name name-style="western"><surname>Uversky</surname><given-names>VN</given-names></name>
</person-group><article-title>Rapid prediction and analysis of protein intrinsic disorder</article-title><source>Protein Science</source><year iso-8601-date="2022">2022</year><volume>31</volume><issue>12</issue><elocation-id>e4496</elocation-id><pub-id pub-id-type="doi">10.1002/pro.4496</pub-id><pub-id pub-id-type="pmid">36334049</pub-id><pub-id pub-id-type="pmcid">PMC9679974</pub-id></element-citation></ref><ref id="ref-5"><label>Dunker et al. (2001)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Dunker</surname><given-names>AK</given-names></name>
<name name-style="western"><surname>Lawson</surname><given-names>JD</given-names></name>
<name name-style="western"><surname>Brown</surname><given-names>CJ</given-names></name>
<name name-style="western"><surname>Williams</surname><given-names>RM</given-names></name>
<name name-style="western"><surname>Romero</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Oh</surname><given-names>JS</given-names></name>
<name name-style="western"><surname>Oldfield</surname><given-names>CJ</given-names></name>
<name name-style="western"><surname>Campen</surname><given-names>AM</given-names></name>
<name name-style="western"><surname>Ratliff</surname><given-names>CM</given-names></name>
<name name-style="western"><surname>Hipps</surname><given-names>KW</given-names></name>
<name name-style="western"><surname>Ausio</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Nissen</surname><given-names>MS</given-names></name>
<name name-style="western"><surname>Reeves</surname><given-names>R</given-names></name>
<name name-style="western"><surname>Kang</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Kissinger</surname><given-names>CR</given-names></name>
<name name-style="western"><surname>Bailey</surname><given-names>RW</given-names></name>
<name name-style="western"><surname>Griswold</surname><given-names>MD</given-names></name>
<name name-style="western"><surname>Chiu</surname><given-names>W</given-names></name>
<name name-style="western"><surname>Garner</surname><given-names>EC</given-names></name>
<name name-style="western"><surname>Obradovic</surname><given-names>Z</given-names></name>
</person-group><article-title>Intrinsically disordered protein</article-title><source>Journal of Molecular Graphics and Modelling</source><year iso-8601-date="2001">2001</year><volume>19</volume><issue>1</issue><fpage>26</fpage><lpage>59</lpage><pub-id pub-id-type="doi">10.1016/s1093-3263(00)00138-8</pub-id><pub-id pub-id-type="pmid">11381529</pub-id></element-citation></ref><ref id="ref-6"><label>Dunker et al. (2008)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Dunker</surname><given-names>AK</given-names></name>
<name name-style="western"><surname>Silman</surname><given-names>I</given-names></name>
<name name-style="western"><surname>Uversky</surname><given-names>VN</given-names></name>
<name name-style="western"><surname>Sussman</surname><given-names>JL</given-names></name>
</person-group><article-title>Function and structure of inherently disordered proteins</article-title><source>Current Opinion in Structural Biology</source><year iso-8601-date="2008">2008</year><volume>18</volume><issue>6</issue><fpage>756</fpage><lpage>764</lpage><pub-id pub-id-type="doi">10.1016/j.sbi.2008.10.002</pub-id><pub-id pub-id-type="pmid">18952168</pub-id></element-citation></ref><ref id="ref-7"><label>Dyson &amp; Wright (2005)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Dyson</surname><given-names>HJ</given-names></name>
<name name-style="western"><surname>Wright</surname><given-names>PE</given-names></name>
</person-group><article-title>Intrinsically unstructured proteins and their functions</article-title><source>Nature Reviews: Molecular Cell Biology</source><year iso-8601-date="2005">2005</year><volume>6</volume><issue>3</issue><fpage>197</fpage><lpage>208</lpage><pub-id pub-id-type="doi">10.1038/nrm1589</pub-id><pub-id pub-id-type="pmid">15738986</pub-id></element-citation></ref><ref id="ref-8"><label>Erdos, Pajkos &amp; Dosztanyi (2021)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Erdos</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Pajkos</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Dosztanyi</surname><given-names>Z</given-names></name>
</person-group><article-title>IUPred3: prediction of protein disorder enhanced with unambiguous experimental annotation and visualization of evolutionary conservation</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2021">2021</year><volume>49</volume><issue>W1</issue><fpage>W297</fpage><lpage>W303</lpage><pub-id pub-id-type="doi">10.1093/nar/gkab408</pub-id><pub-id pub-id-type="pmid">34048569</pub-id><pub-id pub-id-type="pmcid">PMC8262696</pub-id></element-citation></ref><ref id="ref-9"><label>Fukuchi et al. (2014)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Fukuchi</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Amemiya</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Sakamoto</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Nobe</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Hosoda</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Kado</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Murakami</surname><given-names>SD</given-names></name>
<name name-style="western"><surname>Koike</surname><given-names>R</given-names></name>
<name name-style="western"><surname>Hiroaki</surname><given-names>H</given-names></name>
<name name-style="western"><surname>Ota</surname><given-names>M</given-names></name>
</person-group><article-title>IDEAL in 2014 illustrates interaction networks composed of intrinsically disordered proteins and their binding partners</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2014">2014</year><volume>42</volume><issue>D1</issue><fpage>D320</fpage><lpage>325</lpage><pub-id pub-id-type="doi">10.1093/nar/gkt1010</pub-id><pub-id pub-id-type="pmid">24178034</pub-id><pub-id pub-id-type="pmcid">PMC3965115</pub-id></element-citation></ref><ref id="ref-10"><label>Fukuchi et al. (2011)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Fukuchi</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Hosoda</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Homma</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Gojobori</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Nishikawa</surname><given-names>K</given-names></name>
</person-group><article-title>Binary classification of protein molecules into intrinsically disordered and ordered segments</article-title><source>BMC Structural Biology</source><year iso-8601-date="2011">2011</year><volume>11</volume><issue>1</issue><fpage>29</fpage><pub-id pub-id-type="doi">10.1186/1472-6807-11-29</pub-id><pub-id pub-id-type="pmid">21693062</pub-id><pub-id pub-id-type="pmcid">PMC3199747</pub-id></element-citation></ref><ref id="ref-11"><label>Hahnloser et al. (2000)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hahnloser</surname><given-names>RH</given-names></name>
<name name-style="western"><surname>Sarpeshkar</surname><given-names>R</given-names></name>
<name name-style="western"><surname>Mahowald</surname><given-names>MA</given-names></name>
<name name-style="western"><surname>Douglas</surname><given-names>RJ</given-names></name>
<name name-style="western"><surname>Seung</surname><given-names>HS</given-names></name>
</person-group><article-title>Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit</article-title><source>Nature</source><year iso-8601-date="2000">2000</year><volume>405</volume><issue>6789</issue><fpage>947</fpage><lpage>951</lpage><pub-id pub-id-type="doi">10.1038/35016072</pub-id><pub-id pub-id-type="pmid">10879535</pub-id></element-citation></ref><ref id="ref-12"><label>Hanley &amp; McNeil (1982)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hanley</surname><given-names>JA</given-names></name>
<name name-style="western"><surname>McNeil</surname><given-names>BJ</given-names></name>
</person-group><article-title>The meaning and use of the area under a receiver operating characteristic (ROC) curve</article-title><source>Radiology</source><year iso-8601-date="1982">1982</year><volume>143</volume><issue>1</issue><fpage>29</fpage><lpage>36</lpage><pub-id pub-id-type="doi">10.1148/radiology.143.1.7063747</pub-id><pub-id pub-id-type="pmid">7063747</pub-id></element-citation></ref><ref id="ref-13"><label>Hanson et al. (2019)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hanson</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Paliwal</surname><given-names>KK</given-names></name>
<name name-style="western"><surname>Litfin</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Zhou</surname><given-names>Y</given-names></name>
</person-group><article-title>SPOT-Disorder2: improved protein intrinsic disorder prediction by ensembled deep learning</article-title><source>Genomics Proteomics Bioinformatics</source><year iso-8601-date="2019">2019</year><volume>17</volume><issue>6</issue><fpage>645</fpage><lpage>656</lpage><pub-id pub-id-type="doi">10.1016/j.gpb.2019.01.004</pub-id><pub-id pub-id-type="pmid">32173600</pub-id><pub-id pub-id-type="pmcid">PMC7212484</pub-id></element-citation></ref><ref id="ref-14"><label>Hanson, Paliwal &amp; Zhou (2018)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hanson</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Paliwal</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Zhou</surname><given-names>Y</given-names></name>
</person-group><article-title>Accurate single-sequence prediction of protein intrinsic disorder by an ensemble of deep recurrent and convolutional architectures</article-title><source>Journal of Chemical Information and Modeling</source><year iso-8601-date="2018">2018</year><volume>58</volume><issue>11</issue><fpage>2369</fpage><lpage>2376</lpage><pub-id pub-id-type="doi">10.1021/acs.jcim.8b00636</pub-id><pub-id pub-id-type="pmid">30395465</pub-id></element-citation></ref><ref id="ref-15"><label>Hanson et al. (2017)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hanson</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Yang</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Paliwal</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Zhou</surname><given-names>Y</given-names></name>
</person-group><article-title>Improving protein disorder prediction by deep bidirectional long short-term memory recurrent neural networks</article-title><source>Bioinformatics</source><year iso-8601-date="2017">2017</year><volume>33</volume><issue>5</issue><fpage>685</fpage><lpage>692</lpage><pub-id pub-id-type="doi">10.1093/bioinformatics/btw678</pub-id><pub-id pub-id-type="pmid">28011771</pub-id></element-citation></ref><ref id="ref-16"><label>Hatos et al. (2020)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hatos</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Hajdu-Soltesz</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Monzon</surname><given-names>AM</given-names></name>
<name name-style="western"><surname>Palopoli</surname><given-names>N</given-names></name>
<name name-style="western"><surname>Alvarez</surname><given-names>L</given-names></name>
<name name-style="western"><surname>Aykac-Fas</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Bassot</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Benitez</surname><given-names>GI</given-names></name>
<name name-style="western"><surname>Bevilacqua</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Chasapi</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Chemes</surname><given-names>L</given-names></name>
<name name-style="western"><surname>Davey</surname><given-names>NE</given-names></name>
<name name-style="western"><surname>Davidovic</surname><given-names>R</given-names></name>
<name name-style="western"><surname>Dunker</surname><given-names>AK</given-names></name>
<name name-style="western"><surname>Elofsson</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Gobeill</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Foutel</surname><given-names>NSG</given-names></name>
<name name-style="western"><surname>Sudha</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Guharoy</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Horvath</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Iglesias</surname><given-names>V</given-names></name>
<name name-style="western"><surname>Kajava</surname><given-names>AV</given-names></name>
<name name-style="western"><surname>Kovacs</surname><given-names>OP</given-names></name>
<name name-style="western"><surname>Lamb</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Lambrughi</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Lazar</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Leclercq</surname><given-names>JY</given-names></name>
<name name-style="western"><surname>Leonardi</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Macedo-Ribeiro</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Macossay-Castillo</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Maiani</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Manso</surname><given-names>JA</given-names></name>
<name name-style="western"><surname>Marino-Buslje</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Martinez-Perez</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Meszaros</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Micetic</surname><given-names>I</given-names></name>
<name name-style="western"><surname>Minervini</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Murvai</surname><given-names>N</given-names></name>
<name name-style="western"><surname>Necci</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Ouzounis</surname><given-names>CA</given-names></name>
<name name-style="western"><surname>Pajkos</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Paladin</surname><given-names>L</given-names></name>
<name name-style="western"><surname>Pancsa</surname><given-names>R</given-names></name>
<name name-style="western"><surname>Papaleo</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Parisi</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Pasche</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Barbosa Pereira</surname><given-names>PJ</given-names></name>
<name name-style="western"><surname>Promponas</surname><given-names>VJ</given-names></name>
<name name-style="western"><surname>Pujols</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Quaglia</surname><given-names>F</given-names></name>
<name name-style="western"><surname>Ruch</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Salvatore</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Schad</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Szabo</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Szaniszlo</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Tamana</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Tantos</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Veljkovic</surname><given-names>N</given-names></name>
<name name-style="western"><surname>Ventura</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Vranken</surname><given-names>W</given-names></name>
<name name-style="western"><surname>Dosztanyi</surname><given-names>Z</given-names></name>
<name name-style="western"><surname>Tompa</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Tosatto</surname><given-names>SCE</given-names></name>
<name name-style="western"><surname>Piovesan</surname><given-names>D</given-names></name>
</person-group><article-title>DisProt: intrinsic protein disorder annotation in 2020</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2020">2020</year><volume>48</volume><fpage>D269</fpage><lpage>D276</lpage><pub-id pub-id-type="doi">10.1093/nar/gkz975</pub-id><pub-id pub-id-type="pmid">31713636</pub-id><pub-id pub-id-type="pmcid">PMC7145575</pub-id></element-citation></ref><ref id="ref-17"><label>Haynes et al. (2006)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Haynes</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Oldfield</surname><given-names>CJ</given-names></name>
<name name-style="western"><surname>Ji</surname><given-names>F</given-names></name>
<name name-style="western"><surname>Klitgord</surname><given-names>N</given-names></name>
<name name-style="western"><surname>Cusick</surname><given-names>ME</given-names></name>
<name name-style="western"><surname>Radivojac</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Uversky</surname><given-names>VN</given-names></name>
<name name-style="western"><surname>Vidal</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Iakoucheva</surname><given-names>LM</given-names></name>
</person-group><article-title>Intrinsic disorder is a common feature of hub proteins from four eukaryotic interactomes</article-title><source>PLOS Computational Biology</source><year iso-8601-date="2006">2006</year><volume>2</volume><issue>8</issue><elocation-id>e100</elocation-id><pub-id pub-id-type="doi">10.1371/journal.pcbi.0020100</pub-id><pub-id pub-id-type="pmid">16884331</pub-id><pub-id pub-id-type="pmcid">PMC1526461</pub-id></element-citation></ref><ref id="ref-18"><label>He et al. (2009)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>He</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Wang</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Liu</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Xue</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Uversky</surname><given-names>VN</given-names></name>
<name name-style="western"><surname>Dunker</surname><given-names>AK</given-names></name>
</person-group><article-title>Predicting intrinsic disorder in proteins: an overview</article-title><source>Cell Research</source><year iso-8601-date="2009">2009</year><volume>19</volume><issue>8</issue><fpage>929</fpage><lpage>949</lpage><pub-id pub-id-type="doi">10.1038/cr.2009.87</pub-id><pub-id pub-id-type="pmid">19597536</pub-id></element-citation></ref><ref id="ref-19"><label>Hinton, Osindero &amp; Teh (2006)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hinton</surname><given-names>GE</given-names></name>
<name name-style="western"><surname>Osindero</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Teh</surname><given-names>YW</given-names></name>
</person-group><article-title>A fast learning algorithm for deep belief nets</article-title><source>Neural Computation</source><year iso-8601-date="2006">2006</year><volume>18</volume><issue>7</issue><fpage>1527</fpage><lpage>1554</lpage><pub-id pub-id-type="doi">10.1162/neco.2006.18.7.1527</pub-id><pub-id pub-id-type="pmid">16764513</pub-id></element-citation></ref><ref id="ref-20"><label>Hochreiter &amp; Schmidhuber (1997)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hochreiter</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Schmidhuber</surname><given-names>J</given-names></name>
</person-group><article-title>Long short-term memory</article-title><source>Neural Computation</source><year iso-8601-date="1997">1997</year><volume>9</volume><issue>8</issue><fpage>1735</fpage><lpage>1780</lpage><pub-id pub-id-type="doi">10.1162/neco.1997.9.8.1735</pub-id><pub-id pub-id-type="pmid">9377276</pub-id></element-citation></ref><ref id="ref-21"><label>Hu et al. (2021)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Hu</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Katuwawala</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Wang</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Wu</surname><given-names>Z</given-names></name>
<name name-style="western"><surname>Ghadermarzi</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Gao</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Kurgan</surname><given-names>L</given-names></name>
</person-group><article-title>flDPnn: accurate intrinsic disorder prediction with putative propensities of disorder functions</article-title><source>Nature Communications</source><year iso-8601-date="2021">2021</year><volume>12</volume><issue>1</issue><fpage>4438</fpage><pub-id pub-id-type="doi">10.1038/s41467-021-24773-7</pub-id><pub-id pub-id-type="pmcid">PMC8295265</pub-id><pub-id pub-id-type="pmid">34290238</pub-id></element-citation></ref><ref id="ref-22"><label>Iakoucheva et al. (2004)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Iakoucheva</surname><given-names>LM</given-names></name>
<name name-style="western"><surname>Radivojac</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Brown</surname><given-names>CJ</given-names></name>
<name name-style="western"><surname>O’Connor</surname><given-names>TR</given-names></name>
<name name-style="western"><surname>Sikes</surname><given-names>JG</given-names></name>
<name name-style="western"><surname>Obradovic</surname><given-names>Z</given-names></name>
<name name-style="western"><surname>Dunker</surname><given-names>AK</given-names></name>
</person-group><article-title>The importance of intrinsic disorder for protein phosphorylation</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2004">2004</year><volume>32</volume><issue>3</issue><fpage>1037</fpage><lpage>1049</lpage><pub-id pub-id-type="doi">10.1093/nar/gkh253</pub-id><pub-id pub-id-type="pmid">14960716</pub-id><pub-id pub-id-type="pmcid">PMC373391</pub-id></element-citation></ref><ref id="ref-23"><label>IDEAL (2025)</label><element-citation publication-type="other"><person-group person-group-type="author">
<collab>IDEAL</collab>
</person-group><article-title>History of IDEAL database</article-title><year iso-8601-date="2025">2025</year><uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.ideal-db.org/history.html">https://www.ideal-db.org/history.html</uri><date-in-citation content-type="access-date" iso-8601-date="2024-09-25">25 September 2024</date-in-citation></element-citation></ref><ref id="ref-24"><label>Ilzhofer, Heinzinger &amp; Rost (2022)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Ilzhofer</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Heinzinger</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Rost</surname><given-names>B</given-names></name>
</person-group><article-title>SETH predicts nuances of residue disorder from protein embeddings</article-title><source>Frontiers in Bioinformatics</source><year iso-8601-date="2022">2022</year><volume>2</volume><fpage>1019597</fpage><pub-id pub-id-type="doi">10.3389/fbinf.2022.1019597</pub-id><pub-id pub-id-type="pmid">36304335</pub-id><pub-id pub-id-type="pmcid">PMC9580958</pub-id></element-citation></ref><ref id="ref-25"><label>Kawashima &amp; Kanehisa (2000)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Kawashima</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Kanehisa</surname><given-names>M</given-names></name>
</person-group><article-title>AAindex: amino acid index database</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2000">2000</year><volume>28</volume><issue>1</issue><fpage>374</fpage><pub-id pub-id-type="doi">10.1093/nar/28.1.374</pub-id><pub-id pub-id-type="pmid">10592278</pub-id><pub-id pub-id-type="pmcid">PMC102411</pub-id></element-citation></ref><ref id="ref-26"><label>Kawashima et al. (2008)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Kawashima</surname><given-names>S</given-names></name>
<name name-style="western"><surname>Pokarowski</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Pokarowska</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Kolinski</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Katayama</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Kanehisa</surname><given-names>M</given-names></name>
</person-group><article-title>AAindex: amino acid index database, progress report 2008</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2008">2008</year><volume>36</volume><issue>Database</issue><fpage>D202</fpage><lpage>205</lpage><pub-id pub-id-type="doi">10.1093/nar/gkm998</pub-id><pub-id pub-id-type="pmid">17998252</pub-id><pub-id pub-id-type="pmcid">PMC2238890</pub-id></element-citation></ref><ref id="ref-27"><label>Lecun et al. (1998)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Lecun</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Bottou</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Bengio</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Haffner</surname><given-names>P</given-names></name>
</person-group><article-title>Gradient-based learning applied to document recognition</article-title><source>Proceedings of the IEEE</source><year iso-8601-date="1998">1998</year><volume>86</volume><issue>11</issue><fpage>2278</fpage><lpage>2324</lpage><pub-id pub-id-type="doi">10.1109/5.726791</pub-id></element-citation></ref><ref id="ref-28"><label>Matthews (1975)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Matthews</surname><given-names>BW</given-names></name>
</person-group><article-title>Comparison of the predicted and observed secondary structure of T4 phage lysozyme</article-title><source>Biochimica et Biophysica Acta (BBA)</source><year iso-8601-date="1975">1975</year><volume>405</volume><issue>2</issue><fpage>442</fpage><lpage>451</lpage><pub-id pub-id-type="doi">10.1016/0005-2795(75)90109-9</pub-id><pub-id pub-id-type="pmid">1180967</pub-id></element-citation></ref><ref id="ref-29"><label>McCulloch &amp; Pitts (1990)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>McCulloch</surname><given-names>WS</given-names></name>
<name name-style="western"><surname>Pitts</surname><given-names>W</given-names></name>
</person-group><article-title>A logical calculus of the ideas immanent in nervous activity</article-title><source>Bulletin of Mathematical Biology</source><year iso-8601-date="1990">1990</year><volume>52</volume><issue>1–2</issue><fpage>99</fpage><lpage>115</lpage><pub-id pub-id-type="doi">10.1007/bf02459570</pub-id><pub-id pub-id-type="pmid">2185863</pub-id></element-citation></ref><ref id="ref-30"><label>Meng, Uversky &amp; Kurgan (2017)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Meng</surname><given-names>F</given-names></name>
<name name-style="western"><surname>Uversky</surname><given-names>VN</given-names></name>
<name name-style="western"><surname>Kurgan</surname><given-names>L</given-names></name>
</person-group><article-title>Comprehensive review of methods for prediction of intrinsic disorder and its molecular functions</article-title><source>Cellular and Molecular Life Sciences</source><year iso-8601-date="2017">2017</year><volume>74</volume><issue>17</issue><fpage>3069</fpage><lpage>3090</lpage><pub-id pub-id-type="doi">10.1007/s00018-017-2555-4</pub-id><pub-id pub-id-type="pmid">28589442</pub-id><pub-id pub-id-type="pmcid">PMC11107660</pub-id></element-citation></ref><ref id="ref-31"><label>Meszaros, Erdos &amp; Dosztanyi (2018)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Meszaros</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Erdos</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Dosztanyi</surname><given-names>Z</given-names></name>
</person-group><article-title>IUPred2A: context-dependent prediction of protein disorder as a function of redox state and protein binding</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2018">2018</year><volume>46</volume><issue>W1</issue><fpage>W329</fpage><lpage>W337</lpage><pub-id pub-id-type="doi">10.1093/nar/gky384</pub-id><pub-id pub-id-type="pmid">29860432</pub-id><pub-id pub-id-type="pmcid">PMC6030935</pub-id></element-citation></ref><ref id="ref-32"><label>Minezaki et al. (2006)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Minezaki</surname><given-names>Y</given-names></name>
<name name-style="western"><surname>Homma</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Kinjo</surname><given-names>AR</given-names></name>
<name name-style="western"><surname>Nishikawa</surname><given-names>K</given-names></name>
</person-group><article-title>Human transcription factors contain a high fraction of intrinsically disordered regions essential for transcriptional regulation</article-title><source>Journal of Molecular Biology</source><year iso-8601-date="2006">2006</year><volume>359</volume><issue>4</issue><fpage>1137</fpage><lpage>1149</lpage><pub-id pub-id-type="doi">10.1016/j.jmb.2006.04.016</pub-id><pub-id pub-id-type="pmid">16697407</pub-id></element-citation></ref><ref id="ref-33"><label>Mirabello &amp; Wallner (2019)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Mirabello</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Wallner</surname><given-names>B</given-names></name>
</person-group><article-title>rawMSA: end-to-end deep learning using raw multiple sequence alignments</article-title><source>PLOS ONE</source><year iso-8601-date="2019">2019</year><volume>14</volume><issue>8</issue><elocation-id>e0220182</elocation-id><pub-id pub-id-type="doi">10.1371/journal.pone.0220182</pub-id><pub-id pub-id-type="pmid">31415569</pub-id><pub-id pub-id-type="pmcid">PMC6695225</pub-id></element-citation></ref><ref id="ref-34"><label>Moult et al. (2014)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Moult</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Fidelis</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Kryshtafovych</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Schwede</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Tramontano</surname><given-names>A</given-names></name>
</person-group><article-title>Critical assessment of methods of protein structure prediction (CASP)--round x</article-title><source>Proteins</source><year iso-8601-date="2014">2014</year><volume>82</volume><issue>Suppl 2</issue><fpage>1</fpage><lpage>6</lpage><pub-id pub-id-type="doi">10.1002/prot.24452</pub-id><pub-id pub-id-type="pmcid">PMC4394854</pub-id><pub-id pub-id-type="pmid">24344053</pub-id></element-citation></ref><ref id="ref-35"><label>Moult et al. (2003)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Moult</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Fidelis</surname><given-names>K</given-names></name>
<name name-style="western"><surname>Zemla</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Hubbard</surname><given-names>T</given-names></name>
</person-group><article-title>Critical assessment of methods of protein structure prediction (CASP)-round V</article-title><source>Proteins</source><year iso-8601-date="2003">2003</year><volume>53</volume><issue>Suppl 6</issue><fpage>334</fpage><lpage>339</lpage><pub-id pub-id-type="doi">10.1002/prot.10556</pub-id><pub-id pub-id-type="pmid">14579322</pub-id></element-citation></ref><ref id="ref-36"><label>Nair &amp; Hinton (2010)</label><element-citation publication-type="confproc"><person-group person-group-type="author">
<name name-style="western"><surname>Nair</surname><given-names>V</given-names></name>
<name name-style="western"><surname>Hinton</surname><given-names>G</given-names></name>
</person-group><article-title>Rectified linear units improve restricted boltzmann machines</article-title><year iso-8601-date="2010">2010</year><conf-name>Proceedings of the 27th International Conference on Machine Learning (ICML</conf-name><fpage>807</fpage><lpage>814</lpage></element-citation></ref><ref id="ref-37"><label>NCBI (2025)</label><element-citation publication-type="other"><person-group person-group-type="author">
<collab>NCBI</collab>
</person-group><article-title>GenBank statistics</article-title><year iso-8601-date="2025">2025</year><uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.ncbi.nlm.nih.gov/genbank/statistics/">https://www.ncbi.nlm.nih.gov/genbank/statistics/</uri><date-in-citation content-type="access-date" iso-8601-date="2024-09-25">25 September 2024</date-in-citation></element-citation></ref><ref id="ref-38"><label>Necci et al. (2021)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Necci</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Piovesan</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Predictors</surname><given-names>C</given-names></name>
<name name-style="western"><surname>DisProt</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Tosatto</surname><given-names>SCE</given-names></name>
</person-group><article-title>Critical assessment of protein intrinsic disorder prediction</article-title><source>Nature Methods</source><year iso-8601-date="2021">2021</year><volume>18</volume><issue>5</issue><fpage>472</fpage><lpage>481</lpage><pub-id pub-id-type="doi">10.1038/s41592-021-01117-3</pub-id><pub-id pub-id-type="pmid">33875885</pub-id><pub-id pub-id-type="pmcid">PMC8105172</pub-id></element-citation></ref><ref id="ref-39"><label>Oldfield &amp; Dunker (2014)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Oldfield</surname><given-names>CJ</given-names></name>
<name name-style="western"><surname>Dunker</surname><given-names>AK</given-names></name>
</person-group><article-title>Intrinsically disordered proteins and intrinsically disordered protein regions</article-title><source>Annual Review of Biochemistry</source><year iso-8601-date="2014">2014</year><volume>83</volume><issue>1</issue><fpage>553</fpage><lpage>584</lpage><pub-id pub-id-type="doi">10.1146/annurev-biochem-072711-164947</pub-id><pub-id pub-id-type="pmid">24606139</pub-id></element-citation></ref><ref id="ref-40"><label>Patil &amp; Nakamura (2006)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Patil</surname><given-names>A</given-names></name>
<name name-style="western"><surname>Nakamura</surname><given-names>H</given-names></name>
</person-group><article-title>Disordered domains and high surface charge confer hubs with the ability to interact with multiple proteins in interaction networks</article-title><source>FEBS Letters</source><year iso-8601-date="2006">2006</year><volume>580</volume><issue>8</issue><fpage>2041</fpage><lpage>2045</lpage><pub-id pub-id-type="doi">10.1016/j.febslet.2006.03.003</pub-id><pub-id pub-id-type="pmid">16542654</pub-id></element-citation></ref><ref id="ref-41"><label>Piovesan et al. (2018)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Piovesan</surname><given-names>D</given-names></name>
<name name-style="western"><surname>Tabaro</surname><given-names>F</given-names></name>
<name name-style="western"><surname>Paladin</surname><given-names>L</given-names></name>
<name name-style="western"><surname>Necci</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Micetic</surname><given-names>I</given-names></name>
<name name-style="western"><surname>Camilloni</surname><given-names>C</given-names></name>
<name name-style="western"><surname>Davey</surname><given-names>N</given-names></name>
<name name-style="western"><surname>Dosztanyi</surname><given-names>Z</given-names></name>
<name name-style="western"><surname>Meszaros</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Monzon</surname><given-names>AM</given-names></name>
<name name-style="western"><surname>Parisi</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Schad</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Sormanni</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Tompa</surname><given-names>P</given-names></name>
<name name-style="western"><surname>Vendruscolo</surname><given-names>M</given-names></name>
<name name-style="western"><surname>Vranken</surname><given-names>WF</given-names></name>
<name name-style="western"><surname>Tosatto</surname><given-names>SCE</given-names></name>
</person-group><article-title>MobiDB 3.0: more annotations for intrinsic disorder, conformational diversity and interactions in proteins</article-title><source>Nucleic Acids Research</source><year iso-8601-date="2018">2018</year><volume>46</volume><issue>D1</issue><fpage>D471</fpage><lpage>D476</lpage><pub-id pub-id-type="doi">10.1093/nar/gkx1071</pub-id><pub-id pub-id-type="pmid">29136219</pub-id><pub-id pub-id-type="pmcid">PMC5753340</pub-id></element-citation></ref><ref id="ref-42"><label>Rosenblatt (1958)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Rosenblatt</surname><given-names>F</given-names></name>
</person-group><article-title>The perceptron: a probabilistic model for information storage and organization in the brain</article-title><source>Psychological Review</source><year iso-8601-date="1958">1958</year><volume>65</volume><issue>6</issue><fpage>386</fpage><lpage>408</lpage><pub-id pub-id-type="doi">10.1037/h0042519</pub-id><pub-id pub-id-type="pmid">13602029</pub-id></element-citation></ref><ref id="ref-43"><label>Shendure &amp; Ji (2008)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Shendure</surname><given-names>J</given-names></name>
<name name-style="western"><surname>Ji</surname><given-names>H</given-names></name>
</person-group><article-title>Next-generation DNA sequencing</article-title><source>Nature Biotechnology</source><year iso-8601-date="2008">2008</year><volume>26</volume><issue>10</issue><fpage>1135</fpage><lpage>1145</lpage><pub-id pub-id-type="doi">10.1038/nbt1486</pub-id><pub-id pub-id-type="pmid">18846087</pub-id></element-citation></ref><ref id="ref-44"><label>Sirota et al. (2010)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Sirota</surname><given-names>FL</given-names></name>
<name name-style="western"><surname>Ooi</surname><given-names>HS</given-names></name>
<name name-style="western"><surname>Gattermayer</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Schneider</surname><given-names>G</given-names></name>
<name name-style="western"><surname>Eisenhaber</surname><given-names>F</given-names></name>
<name name-style="western"><surname>Maurer-Stroh</surname><given-names>S</given-names></name>
</person-group><article-title>Parameterization of disorder predictors for large-scale applications requiring high specificity by using an extended benchmark dataset</article-title><source>BMC Genomics</source><year iso-8601-date="2010">2010</year><volume>11</volume><fpage>S15</fpage><pub-id pub-id-type="doi">10.1186/1471-2164-11-S1-S15</pub-id><pub-id pub-id-type="pmcid">PMC2822529</pub-id><pub-id pub-id-type="pmid">20158872</pub-id></element-citation></ref><ref id="ref-45"><label>UniProt (2025)</label><element-citation publication-type="other"><person-group person-group-type="author">
<collab>UniProt</collab>
</person-group><article-title>The universal protein resource</article-title><year iso-8601-date="2025">2025</year><uri xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://www.uniprot.org/">https://www.uniprot.org/</uri><date-in-citation content-type="access-date" iso-8601-date="2024-09-25">25 September 2024</date-in-citation></element-citation></ref><ref id="ref-46"><label>Uversky (2002)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Uversky</surname><given-names>VN</given-names></name>
</person-group><article-title>Natively unfolded proteins: a point where biology waits for physics</article-title><source>Protein Science</source><year iso-8601-date="2002">2002</year><volume>11</volume><issue>4</issue><fpage>739</fpage><lpage>756</lpage><pub-id pub-id-type="doi">10.1110/ps.4210102</pub-id><pub-id pub-id-type="pmid">11910019</pub-id><pub-id pub-id-type="pmcid">PMC2373528</pub-id></element-citation></ref><ref id="ref-47"><label>Ward et al. (2004)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Ward</surname><given-names>JJ</given-names></name>
<name name-style="western"><surname>Sodhi</surname><given-names>JS</given-names></name>
<name name-style="western"><surname>McGuffin</surname><given-names>LJ</given-names></name>
<name name-style="western"><surname>Buxton</surname><given-names>BF</given-names></name>
<name name-style="western"><surname>Jones</surname><given-names>DT</given-names></name>
</person-group><article-title>Prediction and functional analysis of native disorder in proteins from the three kingdoms of life</article-title><source>Journal of Molecular Biology</source><year iso-8601-date="2004">2004</year><volume>337</volume><issue>3</issue><fpage>635</fpage><lpage>645</lpage><pub-id pub-id-type="doi">10.1016/j.jmb.2004.02.002</pub-id><pub-id pub-id-type="pmid">15019783</pub-id></element-citation></ref><ref id="ref-48"><label>Wright &amp; Dyson (1999)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Wright</surname><given-names>PE</given-names></name>
<name name-style="western"><surname>Dyson</surname><given-names>HJ</given-names></name>
</person-group><article-title>Intrinsically unstructured proteins: re-assessing the protein structure-function paradigm</article-title><source>Journal of Molecular Biology</source><year iso-8601-date="1999">1999</year><volume>293</volume><issue>2</issue><fpage>321</fpage><lpage>331</lpage><pub-id pub-id-type="doi">10.1006/jmbi.1999.3110</pub-id><pub-id pub-id-type="pmid">10550212</pub-id></element-citation></ref><ref id="ref-49"><label>Zhang et al. (2012)</label><element-citation publication-type="journal"><person-group person-group-type="author">
<name name-style="western"><surname>Zhang</surname><given-names>T</given-names></name>
<name name-style="western"><surname>Faraggi</surname><given-names>E</given-names></name>
<name name-style="western"><surname>Xue</surname><given-names>B</given-names></name>
<name name-style="western"><surname>Dunker</surname><given-names>AK</given-names></name>
<name name-style="western"><surname>Uversky</surname><given-names>VN</given-names></name>
<name name-style="western"><surname>Zhou</surname><given-names>Y</given-names></name>
</person-group><article-title>SPINE-D: accurate prediction of short and long disordered regions by a single neural-network based method</article-title><source>Journal of Biomolecular Structure and Dynamics</source><year iso-8601-date="2012">2012</year><volume>29</volume><issue>4</issue><fpage>799</fpage><lpage>813</lpage><pub-id pub-id-type="doi">10.1080/073911012010525022</pub-id><pub-id pub-id-type="pmid">22208280</pub-id><pub-id pub-id-type="pmcid">PMC3297974</pub-id></element-citation></ref></ref-list>
    <sec sec-type="data-availability">
      <title>Data Availability</title>
      <p>Demonstration content: the full text of this article is adapted from “DARUMA: a gateway to fast and easy prediction of intrinsically disordered regions” by Shimizu and colleagues (PeerJ Computer Science, 2025; https://doi.org/10.7717/peerj-cs.3343), which is available under a Creative Commons license (https://creativecommons.org/licenses/by/4.0/).</p>
    </sec>
  </back>
</article>
