
LRRpredictor-A New LRR Motif Detection Method for Irregular Motifs of Plant NLR Proteins Using an Ensemble of Classifiers


Eliza C Martin eliza.martin@biochim.roe.c.m. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania

C A Octavina 
Sukarta 
Laboratory of Nematology
Wageningen University and Research
6700ESWageningenThe Netherlands

Laurentiu Spiridon laurentiu.spiridon@biochim.rol.s. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania

Laurentiu G Grigore 
Space Comp SRL
041512BucharestRomania

Vlad Constantinescu vlad.ion.constantinescu@gmail.comv.c. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania

Robi Tacutu robi.tacutu@gmail.comr.t. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania

Aska Goverse 
Laboratory of Nematology
Wageningen University and Research
6700ESWageningenThe Netherlands

Andrei-Jose Petrescu 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania

LRRpredictor-A New LRR Motif Detection Method for Irregular Motifs of Plant NLR Proteins Using an Ensemble of Classifiers
10.3390/genes11030286Received: 7 February 2020; Accepted: 4 March 2020; Published: 8 March 2020genes G C A T T A C G G C A T Article * Correspondence: aska.goverse@wur.nl (A.G.); andrei.petrescu@biochim.ro (A.-J.P.);leucine-rich repeat predictionsupervised learningLRR motifLRR structureNOD-like receptorsR proteins
Leucine-rich-repeats (LRRs) belong to an archaic procaryal protein architecture that is widely involved in protein-protein interactions. In eukaryotes, LRR domains developed into key recognition modules in many innate immune receptor classes. Due to the high sequence variability imposed by recognition specificity, precise repeat delineation is often difficult especially in plant NOD-like Receptors (NLRs) notorious for showing far larger irregularities. To address this problem, we introduce here LRRpredictor, a method based on an ensemble of estimators designed to better identify LRR motifs in general but particularly adapted for handling more irregular LRR environments, thus allowing to compensate for the scarcity of structural data on NLR proteins. The extrapolation capacity tested on a set of annotated LRR domains from six immune receptor classes shows the ability of LRRpredictor to recover all previously defined specific motif consensuses and to extend the LRR motif coverage over annotated LRR domains. This analysis confirms the increased variability of LRR motifs in plant and vertebrate NLRs when compared to extracellular receptors, consistent with previous studies. Hence, LRRpredictor is able to provide novel insights into the diversification of LRR domains and a robust support for structure-informed analyses of LRRs in immune receptor functioning.Genes 2020, 11, 286 2 of 26 LRRK2 kinase enzyme, lead to Parkinson's disease and other associated inflammatory diseases[5,6], whereas mutations in leucine-rich proteoglycans have been previously shown to be involved in osteoarthritis[7], and last but not least PRELP mutations might have a role in Hutchinson-Gilford, an accelerated progeroid syndrome characterized by premature aging[8]. Hence, understanding the structural aspects of binding properties and specificities of LRR domains opens wide possibilities for receptor engineering with vast implications not only for improved crop resistance to plant diseases, but also for a wide range of medical applications.In innate immunity, LRR modules are found in various domain organizations in many receptor classes such as plant receptor-like kinases (RLK), receptor-like proteins (RLP), NOD-like receptors (NLR), or metazoan NLR and Toll-like receptors (TLR). In plant basal immunity, LRR N-terminal domains face the extracellular environment and are found in either receptor-like kinases (RLK) or receptor-like proteins (RLPs) depending on the presence or absence of a C-terminal kinase domain on the cytosolic side of the receptor. By contrast, LRRs constitute the C-terminal domains of intracellular NOD-like receptors (NLR), also known as resistance (R) proteins, and face the cytosolic environment to mediate resistance against specific pathogens. Depending on their N-terminal domain, which is either a coiled-coil (CC) or a toll-like receptor domain (TIR), R proteins fall into two main NLR classes: the CNL and TNL receptors, respectively[9]. Both these classes contain however a central nucleotide binding domain (NBS) which acts as a 'switch' that changes its conformation upon ADP/ATP binding [9,10].Metazoan NLRs show a similar organization with plant NLRs. They encode a variety of N-terminal 'sensors' (caspase activation and recruitment domains-CARD, baculovirus inhibitor of apoptosis repeat-BIR, etc.), the central 'switch' STAND domain (signal transduction ATPases with numerous domains) -NBS/NACHT domain (NAIP (neuronal apoptosis inhibitory protein), CIITA (MHC class II transcription activator), HET-E (incompatibility locus protein from Podospora anserina) and TP1(telomerase-associated protein)) and the LRR domain at the C-terminal end. Last but not least, we mention here the metazoan toll-like receptors (TLRs) that have an extracellular LRR sensor domain as seen in the RLK/RLP case and a TIR domain on the cytosolic side involved in signal transduction[11].From a structural point of view LRR domains have a solenoidal 'horseshoe' like 3D architecture composed of a variable number of repeats varying each from ≈15 to ≈30 amino acids in length. Repeats are held together through a network of hydrogen bonds which forms a beta sheet located on the ventral side of the 'horseshoe'. This is generated by a conserved sequence pattern named the LRR motif that in its minimal form is of the type 'LxxLxL' where L is generally leucine and to a lesser degree other hydrophobic amino acids[12]. Comprehensive sequence analysis of LRR immune receptors resulted in several classifications of LRR domains showing preferred amino acid conservation outside the minimal motif such as the two type classification proposed by Matsushima et al. [13]  for TLR receptors or the seven type classification proposed by Kobe and Kajava [14]  for all known LRR domains across all Kingdoms. However, exceptions to such rules are frequent as revealed by the Hidden Markov Model approach carried out by Ng et al. [15]. This highlighted the fact that most of the analyzed classes of human proteins containing LRR domains also display many irregular motifs alongside repeats showing the well-defined class specific motif[15].While the above mentioned receptor classes were shown to present LRR irregularities[15], studies on plant NLR proteins such as Lr10 and Pm3 from wheat, Rx1 and Gpa2 from potato, or ZAR1 from Arabidopsis show that their LRR domains have a far more variable and irregular structure than their extracellular counterparts[16][17][18][19][20][21][22]. These factors combined contribute to the challenge for the accurate prediction of LRR motifs in plant NLRs.A proper annotation of each LRR motif in a given LRR domain is instrumental in generating an accurate 3D model[12,23]and by this in properly defining the domain surface and identifying potential protein-protein interaction interfaces. An illustrative example is the conservation mapping performed by Helft et al. in 2011, which was used to identify new interaction partners of plant RLPs and RLKs by studying conserved 3D relationships among amino acids inferred from annotation of LRR repeats[24].

Introduction

The leucine-rich-repeat (LRR) domains are present in all of the tree of life branches. As they are involved in protein-protein interactions, LRR domains are found in receptors having a vast number of functions such as pathogen detection, immune response propagation, hormone perception, enzyme inhibition, or cell adhesion [1]. In both plants and mammals, a number of studies have detailed adverse effects associated with mutations in the LRR domains such as that reported for various immune-related receptors, resulting in compromised functions and enhanced disease progression [2]. For example, mutating a single residue in the LRR domain of the rice Pita receptor results in complete loss of recognition against the fungus Magnaporthe grisea [3] while mutations in the metazoan NLRC4-LRR contributes to autoinflammatory disease phenotypes [4]. Additionally, mutations in the Based on our previous work, identifying the individual true motifs in a LRR domain is hindered by the following: (a) in its minimal form, a 'LxxLxL' pattern is trivial and frequently occurs randomly in any protein; (b) in many cases several 'LxxLxL' patterns do overlap in less than 15 aa range in NLR-LRRs making the precise delineation difficult; (c) the number of 3D experimental structures from which to learn is low; and (d) this small 3D learning set is class and phyla biased-as around half of the structures are of mammalian origin while plant NLRs only have one recently documented structure [21,22].

Thus, given the above described indeterminacies the precise LRR motif identification becomes the most problematic step in the correct repeat delineation within a LRR domain. This also explains why LRR domains and their individual repeats are poorly annotated in genomes or protein databases in contrast to the better annotated, relatively more conserved NBS domain, which has therefore been used in phylogenetic analyses [10,25]. Hence, these major limitations hamper the study of NLRs at various levels such as in the context of plant innate immunity. To address these challenges, in this paper we propose a new LRR motif detection method: LRRpredictor, designed to be more sensitive to motif irregularities than the existing methods like LRRfinder [26] or LRRsearch [27] and to detect irregular and short LRR signatures as are often found in plant NLRs, but not limited to this class.

We assessed how LRRpredictor behaves within different classes of immune-related receptors that contain LRR domains, such as plant NLRs, RLPs, and RLKs and vertebrate NLRs and TLRs with the aim to provide novel insights into the diversification of LRR domains and their role in the functioning of immune receptors.


Materials and Methods


Assembly and Analysis of the LRR Structural Dataset

Various protein domain databases, such as CATH [28], Pfam [29], and Interpro collection [30] were used to obtain a dataset of 611 structure files of proteins annotated to contain LRR domains. These files were processed and filtered out to extract a clean set of LRR chains sharing less than 90% sequence identity using Pisces server [31]. This set containing 178 LRR chains were visually inspected and subjected to LRR repeat delineation based on the distinctive LRR ventral beta-sheet secondary structure pattern. Annotated LRR domains consisting in less than five LRR repeats, as well as incomplete repeats not covering at least five amino acids upstream and downstream of the "LxxLxL" minimal motif were further eliminated.

Using this procedure, we generated the 90% identity data set, ID90, consisting of 172 N-ter LRR 'entry' repeats (N), 1792 LRR 'core' repeats (L), and 154 C-ter LRR 'exit' repeats (C) (File S1). To avoid redundancy in the training data the level of identity has to be further significantly reduced. However, given the small size of ID90 (<180 chains), a trade-off between increase in entropy and loss of data had to be reached. As seen from Figure A1a, a proper inflection point shapes up at around 50% identity and was considered the best compromise in generating a nonredundant set of repeats. In practical terms, the nonredundant ID50 set was generated from ID90 by selecting repeats showing less than eight identical amino acids on a 16 amino acid window centered on the 'LxxLxL' minimal LRR motif, i.e., the window comprising five amino acids upstream and downstream 'LxxLxL'. This nonredundant ID50 set was comprised of 106 N-ter 'entry' repeats (N), 659 'core' repeats (L), and 88 C-ter 'exit' repeats (C), i.e., ≈40% of the 90ID set ( Figure 1, File S1).

Jensen-Shannon divergence (JSD) scores ( Figure 1e) were computed using Capra et al. implementation [32], using the BLOSUM62 matrix for background probabilities and a window parameter 0. The phyla distribution shown in Figure 1c was computed using the Environment for Tree Exploration (ETE3) library v3.1.1 [33]. 


Training and Testing Datasets Construction

In order to provide a representative collection of non-LRR examples, we selected a representative example of each CATH [28] domains' topology (except LRR) from a nonredundant dataset provided by CATH where all proteins share less than 20% identity or have a less than 60% overlap (cath-dataset-nonredundant-S20 set-09.12.2019). Given potential synchronization problems between various databases used to build the overall learning set comprising (a) the nonredundant 50ID LRRs, containing the 'entry'-, 'core'-, 'exit'-repeats and the flanking nonLRR domains when present and (b) the CATH nonLRR domains-the data was subjected to a third redundancy filter performed with a similar CATH methodology, aimed at eliminating sequences that fail one of the below bounds:

• the length of the alignment is over 100 and the identity is over 20%. • length of the alignment is between 40 and 100 with an identity over 20% and the overlap with respect to both sequences is more than 60%. • LRR repeats with alignments lengths ≥16 aa and ≥50% identical (equivalent of at most 8/16 aa constraint imposed initially on the motifs).

The final dataset built as above and used herein for training and testing classifiers, contains 648 LRR core repeats, 100 N-ter entry, and 67 C-ter exit nonredundant repeats (including the LRR domain flanking regions) and 875 non-LRR domains from CATH.

From this set, 1/5th was used to generate the test dataset, while the remaining 4/5 were used to build the training datasets, preserving the class ratio between the sets. The test dataset contains 40,241 amino acid samples of which only 150, i.e., less than 0.4%, are initiating LRR motifs. Similarly, over the training set less than 0.5% of the samples are LRR initiators. The training set was further split into four cross-validation sets that were used for parameter optimization. All these sets are provided in File S2.


Feature Selection and Data Pre-Processing

In developing LRRpredictor we tested sequence-based (SeqB) features: solely or combined with structural based (StrB) features. The SeqB features comprise position-specific scoring matrices PSSM over the above discussed 16 amino acids interval summing up to 320 features corresponding to 20 amino acid types over the 16 positions. The StrB features comprise: (a) the three state (H-helix, E-extended, C-coil) secondary structure probabilities, (b) the three class (B-buried, M-medium and E-exposed) residue relative solvent accessibility, RSA probabilities and (c) intrinsic disorder probability-summing up to seven extra structural features per residue, resulting in a total of 432 features per 16 aa window. The structural based predictions were performed with RaptorX-Property software [34][35][36][37]. Sequence PSSMs were computed on Uniprot20 protein sequence database, using HHblits [38,39] that is based on HMM-HMM alignments shown to improve accuracy of alignments at low sequence homology levels.

In the pre-processing stage, feature variables were normalized, centered, and rescaled, as standard procedure involves. Data whitening using principal component analysis (PCA) decomposition was not used as it did not provide better performance on the tested classifiers.


Machine Learning Model Selection

Several classifiers such as support vector classification (SVC) [40], multi-layer perceptron (MLP) [41,42], and AdaBoost [43] as well as several oversampling techniques such as Adasyn [44] and SMOTE-based varieties [45][46][47], or over-and under-sampling combined approaches SmoteTomek [48] and SmoteEEN [49], were tested and parameter optimized via cross-validation using Scikit-learn library v.0.22.1 [50]. Multiclass estimators for N-entry (N), core (L), and C-exit (C) motif types that use either one-vs.-one or one-vs.-rest approaches were also investigated, but they performed worse than when treating all LRR motifs as a single class.

The best performing classifiers with tuned parameters were further studied in the context of a soft voter (that averages predicted probabilities of the ensemble constituents), and a final predictor, Genes 2020, 11, 286 5 of 26 further referred to as LRRpredictor, was chosen based on its out-of-sample performance on test set and overfitting behavior on the training data. LRRpredictor is composed of a set of eight classifiers (C1-C8) that use different strategies and consider all N, L, C motif types as a single class, aggregated within an ensemble based on the soft voting scheme, as shown in Figure 2d.

Classifiers C1-C4 use solely sequence-based features while C5-C8 use both sequence and structural-based features. Classifiers C1 and C5 use the support vector classification (SVC) algorithm [40], with a radial basis function (RBF) kernel, one-vs.-rest ('ovr') decision function. The margin penalty and the RBF scale (gamma) parameters were optimized through grid search to 1 and 0.01 for C1 and 1 and 0.001 for C4, respectively. Class imbalance was treated by adjusting the SVM weights inversely proportional to class frequency and class probabilities were inferred using sigmoid probability calibration.

Classifiers C2, C3, C6, C7 use multi-layer perceptron (MLP) [41,42]. A depth of three hidden layers was sufficient to describe the system, as adding additional hidden layers provided little to no difference in out-of-sample performance. The number of hidden nodes for each hidden layer was selected via grid search as follows: C2 (300-250-100), C3 (250-150-100), C5 (250-150-100), C6 (125-100-10). Classifiers C2, C3, C7 use the Limited-Memory BFGS [51] solver, while C6 uses Adam [52] optimizer for stochastic gradient descent [53] with early-stopping over a validation fraction of 0.2. All four classifiers use rectified linear unit (ReLU) activation function [54].

Classifiers C3 and C7 approach the imbalance problem through synthetic resampling using the combined over-and under-sampling method SMOTETomek [48], as implemented in imbalanced-learn library v 0.6.1 [55].

Classifiers C4 and C8 use a ensemble boosting approach-AdaBoost [43]-using tree classifiers of depth 1, as base estimators, SAMME.R real boosting algorithm, and sigmoid probability calibration. A maximum number of 50 base estimators was selected to maximize performance while avoiding overfitting.


Assembly of Protein Family Sets Containing LRR Domains

In order to investigate LRRpredictor behavior on previously annotated LRR domains from various functional protein groups, we generated a collection of randomly selected 500 representatives from Uniprot50 database (i.e., below 50% identity between themselves at a given minimum overlap-version available at 20.11.2019-release-2019_10) which were annotated by Interpro to contain a LRR domain (IPR032675 and Interpro v77.0 protein2ipr database).

A total of six groups were generated: four groups of sequences of CNLs, TNLs, RLKs, and RLPs protein classes from flowering plants and two groups of TLRs and NLRs from vertebrates. Given the high conservation of vertebrate TLRs this set gathered only ≈350 sequences (File S3).

Within the CNL group, there were included only proteins annotated by Interpro to contain a single coiled-coil (CC) domain, a single NBS domain, and a LRR domain in this order, and sequences that contained a different domain organization, such as two annotated NBS domains or a different domain order were not included in the analysis. Similarly, for the TNL group we selected only sequences that contain a TIR-NBS-LRR domain organization. The RLK group was built with sequences displaying a "LRR-TM predicted region-kinase" domain organization, while the RLP group contained sequences with "LRR-TM" organization and did not contain other annotated domains by Interpro. In generating the vertebrate NLR group we included any annotated NACHT or NBS domains followed by a LRR domain annotation without discriminating on the N-terminal domain, as animal NLRs can have upstream of the NACHT/NBS domain a multitude of N-terminal domain types, while vertebrate TLRs group contains sequences with a "LRR-TM-TIR" configuration. Transmembrane predictions were performed using Phobius [56].

In analyzing the length of the LRR domains covered by individual repeat annotations, we used all Interpro annotation codes associated with LRR repeat types. We considered as having the status of 'annotated as domain' LRRs with the IPR032675 label and 'annotated as repeats' any amino acids Genes 2020, 11, 286 6 of 26 that had attached by at least one predictor part of Interpro collection one of the following tags: leucine-rich repeat (IPR001611), leucine-rich repeat, typical subtype (IPR003591), leucine-rich repeat, cysteine-containing subtype (IPR006553), leucine-rich repeat 2 (IPR013101), leucine-rich repeat 3 (IPR011713), leucine rich repeat 4 (IPR025875), BspA type leucine rich repeat region (IPR026906), CD180 leucine-rich repeat (IPR041281), DUF4458 domain-containing protein, leucine-rich repeat (IPR041403). Annotations referring to the N-ter cap of the LRR domain (IPR000372, IPR041302) were not considered as these are not LRR repeats.


Assessment of LRR Motif Conservation Across Protein Groups

Intra-and inter-group sequence variability was also analyzed using a subset of 1000 predicted 16 aa extended motifs from each group. In order to avoid a potential bias induced by false 'entry' (N) or 'exit' (C) repeats, only 'core' (L) repeats were used in this analysis. The similarity measure used here is the distance mapping defined by Halperin et al. [57]. This consists of the inner product of BLOSUM scores between each pair of amino acids summed up over the motif span, as this function can be used as a metric distance for several BLOSUM matrices. Considering d to be the distance between a pair of amino acids i and j, that have the s (i, j) BLOSUM score:
d(i, j) = s(i, i) + s( j, j) − 2·s(i, j)(1)
The distance between two sequences a and b of equal length l, would be the sum of distances of each pair of amino acids a i and b i across the length of the sequence:
D a,b = l i=0 d(a i , b i ),(2)
This definition of distance is expected to reflect amino acids compatibilities, as BLOSUM scores are inferred from amino acid mutation probabilities observed on large datasets. As a BLOSUM matrix we selected an updated version of the original BLOSUM matrix, which was recently recalculated on a large dataset and satisfies the triangle inequality. (RBLOSUM59_14.3) [58,59]. Starting from the above described distance function, we calculated Silhouette coefficients [60] between each pair of groups, and precomputed distances were used for manifold learning using metric multi-dimensional scaling (MDS) [61] as implemented in Scikit-learn library [50].

Sequences logos were generated using Weblogo [62], figures showing protein structures were obtained using PyMol [63], while other plots were generated in Microsoft Office or by using Matplotlib library [64].


Results


Available LRR Domains in Structural Data

A collection of 611 PDB structures previously annotated by several protein domain databases, such as CATH [28], Pfam [29], and Interpro-collection [30] to contain LRR horseshoe architectures was obtained. This collection was used to derive a clean set, ID90, of 178 LRR chains displaying 90% identity that was structurally analyzed in order to structurally delineate the LRR repeats based on the beta-sheet network. By this, a dataset of ≈2100 LRR motifs was obtained, as shown in Figure 1a. It is interesting to note here that less than 20% of these are annotated as LRR motifs in Pfam even though the 178 sequences were derived from known 3D structures.

The LRR motif annotation of each repeat was performed starting with the first position (L 0 ) of the minimal motif 'L 0 XXL 3 XL 5 ', position that marks the beginning of the ventral side of the horseshoe domain ( Figure 1b). Superposition of the 2100 repeats indicates that the structural similarity extends in most of the cases over five positions upstream and downstream of the minimal motif defining a 16 positions region which is referred herein as the 'extended' motif ( Figure A1d). Due to this, the structural Genes 2020, 11, 286 7 of 26 LRR diversity concentrates mainly onto the dorsal side of the horseshoe which imposes onto the curvature and the overall geometry of the domain ( Figure 1b).

As duplications of highly similar LRR repeats within the same LRR domain is abundant in the ID90 set, we opted to perform a second redundancy filter at the level of LRR repeats as described (M&M). This results in the ID50 nonredundant set consisting of ≈850 LRR repeats, that approximates well the ID90 distribution of lengths ( Figure A1c), phyla (Figure 1c), and the ratio between marginal N-terminal (N) and C-terminal (C) versus interior motifs (L) ( Figure A1b).

The 'entry' N-ter LRR motifs are less regular than the 'core' motifs, especially at the first hydrophobic position (L 0 ) that is often found solvent exposed, as this position marks the end of the inter-domain linker and the beginning of the LRR domain. By contrast, the 'exit' C-ter LRR motifs better resemble the 'core' motifs (L) amino acid composition and the conventional LRR motif 'L 0 xxL 3 xL 5 xx(N/C) 8 xL 10 ' (Figure 1d). Interestingly, the stringency for leucine occurrence sequentially decreases from L 0 to L 3 and L 5 in core repeats, allowing other amino acids to be present in L 3 and L 5 more frequently (Figure 1d). This structurally correlates with a larger accessible space of the protein core structure around L 3 and L 5 positions, as can be seen from Figures 1b and A1d. It is also worth noting that the third L -3 position upstream of LxxLxL has a significant hydrophobic propensity presumably allowing the solenoid to form (Figure 1d).

Another important facet that has to be carefully pondered is the high phyla bias of the structural data when compared to the baseline phyla distribution of the UniRef50 database. As can be seen from Figure 1c, around 50% of the repeats in ID50 are of mammalian origin while the UniRef50 baseline is of less than 3% in both annotated LRR proteins or any protein. Moreover, the ≈20% plant LRR motifs present in ID50 originate overwhelmingly from RLP and RLK proteins while plant NLRs are poorly represented in this set, with only a single 3D structure recently reported for the ZAR1 NLR protein from Arabidopsis thaliana [21,22]. well the ID90 distribution of lengths ( Figure A1c), phyla (Figure 1c), and the ratio between marginal N-terminal (N) and C-terminal (C) versus interior motifs (L) ( Figure A1b). The 'entry' N-ter LRR motifs are less regular than the 'core' motifs, especially at the first hydrophobic position (L0) that is often found solvent exposed, as this position marks the end of the inter-domain linker and the beginning of the LRR domain. By contrast, the 'exit' C-ter LRR motifs better resemble the 'core' motifs (L) amino acid composition and the conventional LRR motif 'L0xxL3xL5xx(N/C)8xL10' (Figure 1d). Interestingly, the stringency for leucine occurrence sequentially decreases from L0 to L3 and L5 in core repeats, allowing other amino acids to be present in L3 and L5 more frequently (Figure 1d). This structurally correlates with a larger accessible space of the protein core structure around L3 and L5 positions, as can be seen from Figures 1b and A1d. It is also worth noting that the third L-3 position upstream of LxxLxL has a significant hydrophobic propensity presumably allowing the solenoid to form (Figure 1d).

Another important facet that has to be carefully pondered is the high phyla bias of the structural data when compared to the baseline phyla distribution of the UniRef50 database. As can be seen from Figure 1c, around 50% of the repeats in ID50 are of mammalian origin while the UniRef50 baseline is of less than 3% in both annotated LRR proteins or any protein. Moreover, the ≈20% plant LRR motifs present in ID50 originate overwhelmingly from RLP and RLK proteins while plant NLRs are poorly represented in this set, with only a single 3D structure recently reported for the ZAR1 NLR protein from Arabidopsis thaliana [21,22].  (PDB: 6J5W). The hydrophobic positions in the minimal 'L 0 xxL 3 xL 5 ' motif are shown in orange. The first N-entry repeat (blue) and the last C-exit repeat (red) are also mapped on the structure. (c) Phyla distribution of the initial LRR motif set ID90, the 50% identity trimmed LRR motifs set (ID50), annotated LRR proteins and all proteins from the UniRef50 database (from left to right). Percent values corresponding to the mammals group are shown in red. (d) Frequency plot of amino acid composition of the N-entry, core and C-exit motifs on the 50% identity trimmed set. Amino acids are colored according to their properties as follows: hydrophobic (yellow), acidic (red), basic (blue), asparagine and glutamine (purple), proline and glycine (green), others (black). (e) Jensen-Shannon divergence (JSD) score for each position of the LRR motif at different identity thresholds. Higher values show increased conservation.


Development of the LRRpredictor Method

In order to train a machine learning (ML) estimator for detecting LRR motifs we used an overall dataset comprising the filtered LRR ID50 dataset and a collection of 875 non-LRR domains composed of one representative of each CATH topology ( Figure 2a).

As discussed in Section 1, the sequence patterns corresponding to the ≈850 actual true structural LRR motifs identified in ID50 are quite common in any protein. We will name here such sequence patterns as potential motifs. As expected, Table 1 shows that potential motifs occur with more or less equal probability in both the LRR and non-LRR domains of the overall dataset. Moreover, even when taking into account only LRR domains the number of potential motifs is larger than the number of true structural LRR motifs (Table 1). This allows the ML estimators to learn to detect true motifs from the far larger set of potential motifs by taking into account the larger 16 amino acid sequence context in which the true motifs are embedded. In this way the method developed herein can be used not only to delineate repeats in a given LRR domain but also to discriminate between protein products that do not have LRR domains from those hosting such domains.  In developing LRRpredictor we tested 'sequence-based' features based on position-specific scoring matrices-PSSMs either solely or combined with 'structural-based' features as described in Section 2 ( Figure 2c). PSSM profiles are expected to provide context information on the overall sequence, to highlight the key amino acids position that are conserved, as the amino acids scores are derived from amino acid substitution probabilities conditioned by the homologues family they belong to. Therefore, it is expected that irregular LRR motifs would be more detectable when using sequence profiles, rather than amino acid sequence alone. scoring matrices-PSSMs either solely or combined with 'structural-based' features as described in Section 2 ( Figure 2c). PSSM profiles are expected to provide context information on the overall sequence, to highlight the key amino acids position that are conserved, as the amino acids scores are derived from amino acid substitution probabilities conditioned by the homologues family they belong to. Therefore, it is expected that irregular LRR motifs would be more detectable when using sequence profiles, rather than amino acid sequence alone.  The dataset was split into five parts: one part was initially separated as test set and the other four were used as a training set in parameter tuning using a four-fold cross-validation (CV) approach, where models were iteratively trained on three of the CV sets and tested on the remaining fourth ( Figure 2b). A pool of estimators (representing algorithms for classification) that used either (1) sequence-based or (2) both sequence and structural features and (3) various imbalance class treatments were optimized via cross-validation. Finally, best performing estimators were studied in the context of an ensemble estimator. The selected ensemble classifier, further referred to as LRRpredictor is a soft voter aggregating eight classifiers C1-C8 (Figure 2d) which were trained to detect the LRR motif starting position-i.e., L 0 position from the minimalistic LRR motif 'L 0 xxL 3 xL 5 '.

Finally, LRRpredictor was trained on the entire training set (all four CV sets) and tested on the test set which had been set aside.


Assessment of LRRpredictor Performance

The precision of LRRpredictor given by the fraction of true-positives (TP) predicted results over the sum of true-positives (TP) and false-positives (FP) varies between 89% and 97% on the test set and within cross-validation sets (Figure 3a). Similarly, the recall (also known as sensitivity), given by the fraction of TP over TP + false-negatives (FN) varies between 85% and 93%, while the F1-score (representing the harmonic mean between precision and recall) varies between 87% and 95% on the test set and cross-validation sets (Figure 3a,b).  [26] and LRRsearch [27] (computed on their webservers using default parameters).

As seen in Figure 4a, repeat lengths are rarely found outside the 19-35aa range, cases in which prediction becomes ambiguous. Too short repeats are improbable due to structural constraints and might indicate false positive predictions. Similarly, too long repeats-over 40 amino acids-could indicate either the presence of undetected repeats (false negatives) or cases in which an insertion or 'island' shapes up protruding the horseshoe structure (Figure 4a). Very large gaps between LRR motifs (more than 100 aa) were not included in computing the length distribution as these are rather indicating the presence of an inserted domain flanked by two LRR domains.

We further analyzed the percent of the annotated LRR domain span that is covered by LRRpredictor and compared the predicted LRR motifs to LRRfinder [26] and LRRsearch [27] predictions and to the existing motif annotations from Interpro collection. In doing so we defined as predicted repeats motifs separated by 15-35 amino acids. Predicted motifs that superpose or cluster within 15 amino acids were counted only once, while when the distance between two motifs was higher than 35, the repeat was considered to be a potential terminal repeat or contain a domain break and the first 24 aa of such a stretch was assigned as a predicted repeat, given that this is the most frequent repeat length over the structural data.  [26] and LRRsearch [27] (computed on their webservers using default parameters).


LRRpredictor Behavior on Protein Families Containing LRR Domains

As the available structural data is scarce, we further evaluated the extrapolation capabilities of LRRpredictor on a set of LRR domains annotated in Interpro collection. Groups of the most representative protein functional classes containing LRR domains were generated as follows: four groups from flowering plants-resistance proteins (CNL plants and TNL plants ) and extracellular receptors (RLK plants and RLP plants ) and two groups from vertebrates-NLR vert and TLR vert as described in Section 2.

Selected sequences from each group were subjected to LRRpredictor motif detection. The repeat length distribution of the predicted LRR repeats (Figure 4a), is consistent with previously reported lengths within all protein groups of the seven type Kobe-Kajava (KK) classification [14,65]. The repeat length distribution of extracellular LRR domains (RLK plants , RLP plants , and TLR vert ) show a sharp peak at 24 amino acids, in agreement with the most frequent repeat length within plant-specific (PS) from KK classification [14,65]. As they often contain large helices over the dorsal side of the LRR horseshoe, vertebrate NLRs repeats have longer lengths (25-30 aa) as previously shown by the same classification, while plant NLRs (CNL plants and TNL plants ) have a larger distribution with a lower peak shaping up toward lower value side (20-24 aa) of repeat lengths range. (Figure 4b). For all six receptor classes analyzed herein, both LRRfinder and LRRsearch slightly increase the LRR coverage as compared to Interpro annotations especially in the case of extracellular receptors, with LRRsearch surpassing LRRfinder in the case of plant NLRs (Figure 4b).

As also can be seen from Figure 4b, in comparison to Interpro and the two predictors mentioned above, LRRpredictor covers far larger regions of LRR domains with coverage percentages (CP) exceeding 60% and almost complete coverage in over 50% in all six groups (Figure 4b). It is interesting to note that Interpro annotation of extracellular LRR domains also include the N-terminal cap region, that is not formally a LRR repeat. This results in the fact that LRRpredictor covers in most cases only ≈90% of this domain, instead of 100% as in NLR groups (Figure 4b). 


Predicted Repeats Consensus in Each Class

Further, the amino acid composition of the predicted LRR motifs was investigated solely on the 'core' predicted LRR repeats, i.e., repeats that are flanked by other predicted repeats within a 15-35 As seen in Figure 4a, repeat lengths are rarely found outside the 19-35aa range, cases in which prediction becomes ambiguous. Too short repeats are improbable due to structural constraints and might indicate false positive predictions. Similarly, too long repeats-over 40 amino acids-could indicate either the presence of undetected repeats (false negatives) or cases in which an insertion or 'island' shapes up protruding the horseshoe structure (Figure 4a). Very large gaps between LRR motifs (more than 100 aa) were not included in computing the length distribution as these are rather indicating the presence of an inserted domain flanked by two LRR domains.

We further analyzed the percent of the annotated LRR domain span that is covered by LRRpredictor and compared the predicted LRR motifs to LRRfinder [26] and LRRsearch [27] predictions and to the existing motif annotations from Interpro collection. In doing so we defined as predicted repeats motifs separated by 15-35 amino acids. Predicted motifs that superpose or cluster within 15 amino acids were counted only once, while when the distance between two motifs was higher than 35, the repeat was considered to be a potential terminal repeat or contain a domain break and the first 24 aa of such a stretch was assigned as a predicted repeat, given that this is the most frequent repeat length over the structural data.

The repeat coverage of analyzed LRR domains predicted by LRRpredictor, LRRfinder and LRRsearch were compared to the extent Interpro repeat annotations using a coverage percentage (CP) defined as the ratio between the sum of predicted/annotated repeat length vs the overall LRR domain length (Figure 4b).

Plant NLRs from flowering plants show the lowest level of repeat annotation as 75% and 50% of CNL and TNL LRRs in Interpro lack any repeat annotation resulting in CP = 0% (Figure 4b).

In comparison, repeats in vertebrate NLRs are better annotated in a CP ranging within 20-60% of the LRR domain. Even higher Interpro repeat annotations are shown by the extracellular plant and vertebrate receptors with CP ranging most frequently between 30% and 80% of the LRR domain size (Figure 4b). For all six receptor classes analyzed herein, both LRRfinder and LRRsearch slightly increase the LRR coverage as compared to Interpro annotations especially in the case of extracellular receptors, with LRRsearch surpassing LRRfinder in the case of plant NLRs (Figure 4b).

As also can be seen from Figure 4b, in comparison to Interpro and the two predictors mentioned above, LRRpredictor covers far larger regions of LRR domains with coverage percentages (CP) exceeding 60% and almost complete coverage in over 50% in all six groups (Figure 4b). It is interesting to note that Interpro annotation of extracellular LRR domains also include the N-terminal cap region, that is not formally a LRR repeat. This results in the fact that LRRpredictor covers in most cases only ≈90% of this domain, instead of 100% as in NLR groups (Figure 4b).


Predicted Repeats Consensus in Each Class

Further, the amino acid composition of the predicted LRR motifs was investigated solely on the 'core' predicted LRR repeats, i.e., repeats that are flanked by other predicted repeats within a 15-35 aa range. In short, the results presented below clearly indicate that LRRpredictor is able to detect and reproduce all the consensus motifs previously defined for well-studied classes of RLKs, NLRs, and TLRs ( Figure 5). This is especially the case for vertebrate NLRs. The consensus follows the ribosomal inhibitor (RI) type -'x -3 xxL 0 xxL 3 xL 5 xx(N/C) 8 xL 10 xxxgoxxLxxoLxx' [14,65], with position '-3' being less relevant for this class of repeats. Additionally, the vertebrate TLRs predicted motif consensus matches the "T" type motif: L -3 xxL 0 xxL 3 xL 5 xxN 8 xL 10 xxL 13 xxxx(F/L) 18 xxL 21 xx defined in Matushima et al. classification [13] rather than the less encountered "S" type motif: L -3 xxL 0 xxL 3 xL 5 xxN 8 xL 10 xxL 13 Px(x)LPxx.

In the case of plant extracellular receptors, the predicted motifs from RLK plant and RLP plant groups show a prolonged pattern that is in perfect agreement with the plant-specific (PS) type from Kobe and Kajava classification [14,65]-L -3 xxL 0 xxL 3 xL 5 xxN 8 xL 10 (S/T) 11 GxIPxxLxxLGx. Interestingly, the kinase containing receptors (RLK) have a more prominent consensus ( Figure 5).

On the other hand, the predicted motifs in plant NLRs comprising the CNL plant and TNL plant groups display a remote similarity with the cysteine-containing (CC) type as defined by Kobe and Kajava classification [14,65]:

"(C/L) -3 xxL 0 xxL 3 xL 5 xxC 8 xxITDxxOxxL(A/G) xx"-where O is any nonpolar residue. While the extended motif is satisfied (16 aa), a difference worth noting is that in both CNL and TNL groups cysteine is rare in position '-3' and outside this region any similarity with CC-type ends. Both plant NLR groups mainly confine their consensus to only the minimal L 0 xxL 3 xL 5 motif, with TNL extending it a little bit with C 8 position. By contrast, in plant extracellular receptors the consensus expands beyond the 16 amino acids of the 'extended' region covering all the four sides of the LRR solenoid. Despite being analogous in composition, the TNL plant group consensus is more pronounced, especially at positions C 8 and L 11 ( Figure 5).

In all six classes L 0 , L 3 , and L 5 of minimal motif are as expected overwhelmingly hydrophobic, with all three positions occupied by leucine in around 50% of the cases, except CNLs where leucine occurrence seems less stringent ( Figure 6). When compared to the Kobe and Kajava classification, the majority of the motifs fall under the expected class and very few cross terms are seen between them ( Figure 6).

While the extended motif is satisfied (16 aa), a difference worth noting is that in both CNL and TNL groups cysteine is rare in position '-3' and outside this region any similarity with CC-type ends. Both plant NLR groups mainly confine their consensus to only the minimal L0xxL3xL5 motif, with TNL extending it a little bit with C8 position. By contrast, in plant extracellular receptors the consensus expands beyond the 16 amino acids of the 'extended' region covering all the four sides of the LRR solenoid. Despite being analogous in composition, the TNLplant group consensus is more pronounced, especially at positions C8 and L11 ( Figure 5).  In all six classes L0, L3, and L5 of minimal motif are as expected overwhelmingly hydrophobic, with all three positions occupied by leucine in around 50% of the cases, except CNLs where leucine occurrence seems less stringent ( Figure 6). When compared to the Kobe and Kajava classification, the majority of the motifs fall under the expected class and very few cross terms are seen between them ( Figure 6).

CNLs and TNLs seem more dispersed even on a shorter 11 amino acid window consensus (W11), while the extracellular receptors obey in over 60% of the cases the corresponding W11 pattern that is shared simultaneous by all three classes ( Figure 6).  [14] predicted with LRRpredictor across the six receptor classes. As the motif consensuses from KK classification were very strict, we adapted these consensuses to different sequences windows (W6, W11, W16, or more) centered around the minimal motif as shown in the table. Percentages of the predicted motifs compatible with each consensus are shown with grey bars.


LRR Motifs Variability Across Classes

Sequence variability is of critical importance for LRR domain function and in contrast to their common structural pattern, a wide spread in the sequence space is expected. To assess this, we analyzed the extended motifs, predicted by LRRpredictor, both the intra-and inter-group sequence similarity. This was performed over subsets of randomly selected 1000 examples of 'core' (L) motifs from each group. We selected as similarity measure a metric distance function [57] derived from BLOSUM scores which reflect the structural compatibility between amino acids, as described in Figure 6. Distribution of LRR motif types defined by Kobe and Kajava (KK) [14] predicted with LRRpredictor across the six receptor classes. As the motif consensuses from KK classification were very strict, we adapted these consensuses to different sequences windows (W6, W11, W16, or more) centered around the minimal motif as shown in the table. Percentages of the predicted motifs compatible with each consensus are shown with grey bars.

CNLs and TNLs seem more dispersed even on a shorter 11 amino acid window consensus (W11), while the extracellular receptors obey in over 60% of the cases the corresponding W11 pattern that is shared simultaneous by all three classes ( Figure 6).


LRR Motifs Variability Across Classes

Sequence variability is of critical importance for LRR domain function and in contrast to their common structural pattern, a wide spread in the sequence space is expected. To assess this, we analyzed the extended motifs, predicted by LRRpredictor, both the intra-and inter-group sequence similarity. This was performed over subsets of randomly selected 1000 examples of 'core' (L) motifs from each group. We selected as similarity measure a metric distance function [57] derived from BLOSUM scores which reflect the structural compatibility between amino acids, as described in Section 2. Using this metric, we calculated the distance between each predicted LRR motif from all groups and analyzed how these distances behave intra-and inter-groups.

Intra-group all-vs.-all distances distribution shows that the extracellular groups RLK, RLP from plants and TLRs from vertebrates form a denser group in terms of conservation, than plant and vertebrate NLRs (Figure 7a left). Figure 7b shows the silhouette coefficients. These scores show how separated two given clusters are, based on the distance between samples from each group, the maximal value of 1 corresponding to perfectly separated clusters, value 0 corresponds to clusters that coincide, while negative values with a minimum of -1 correspond to the case where samples from one group actually cluster better with the opposite group that is being compared. Silhouette coefficient of all versus all analyzed groups indicate that the NLR groups form a rather overlapping cluster, that has an increased variability among its sample motifs (i.e., expanded cluster) (Figure 7b left). Extracellular plant receptors RLK and RLP clusters are overlapping and have a more reduced span in terms of variability (i.e., more conserved motifs), while vertebrate TLR overlap plant RLK and RLP receptors have a slightly increased variability (Figure 7a,b left). Interestingly, within the minimal LRR motif region 'L 0 XXL 3 XL 5 ' there are no significant differences between groups (Figure 7a,b right). To have an overall view on the sequence dispersion in each protein class containing LRR domains Figure 7c shows the 2D embedding of the high dimensional sequence space of both the extended and minimal motifs of each class. Nonetheless such a reduction gives only a rough representation of distance relations between clusters in the original space as the normalized stress parameter (stress-1) of this 2D embedding is 0.25 and 0.21 for the extended and minimal motif space, respectively [66]. 


LRRpredictor Specificity Tested on Solenoid Architectures

From a structural point of view the LRR protein architecture belongs to the larger class of solenoidal architectures which are defined by specific repeated structural patterns. Given the repetitiveness of such structures we asked if LRRpredictor is able to discriminate between LRR motifs and other repetitive sequence patterns. The main candidates considered for possible misclassifications are two classes of beta sheet repeat proteins-which are the closest structural To have an overall view on the sequence dispersion in each protein class containing LRR domains Figure 7c shows the 2D embedding of the high dimensional sequence space of both the extended and minimal motifs of each class. Nonetheless such a reduction gives only a rough representation of distance relations between clusters in the original space as the normalized stress parameter (stress-1) of this 2D embedding is 0.25 and 0.21 for the extended and minimal motif space, respectively [66].


LRRpredictor Specificity Tested on Solenoid Architectures

From a structural point of view the LRR protein architecture belongs to the larger class of solenoidal architectures which are defined by specific repeated structural patterns. Given the repetitiveness of such structures we asked if LRRpredictor is able to discriminate between LRR motifs and other repetitive sequence patterns. The main candidates considered for possible misclassifications are two classes of beta sheet repeat proteins-which are the closest structural relatives of LRR domains: pectate lyases (PeLs) and trimeric LpxA architectures and two helical repetitive classes: armadillo and ankiryin architecture ( Figure A2b). To this end, 50 sequences from each of the above four classes annotated as such by Interpro were randomly selected from UniRef50. Figure A2a shows the probabilities returned by LRRpredictor that the potential motifs occurring in the 200 sequences are true LRR structural motifs. As can be seen in all four classes taken into account, the vast majority of potential motifs have a probability lower than 10% to be true motifs. Only 0.1% of such sites show a probability between 10% and 20% to be true motifs and none of these sites reaches a threshold of 40% for being a true LRR motif ( Figure A2a). From a technical point of view this result shows that LRRpredictor is highly specific for LRR domains. On the other hand this result is even more interesting from a structural and biological point of view indicating that even if LRRs and PeLs were considered to be members of the same LRR superfamily [67] the structural principles upon which they are built are different and presumably the two classes have diverged very early in evolution.


Discussion

Given the high number of indeterminacies generated by sequence variability, a proper annotation of LRR motifs and the correct delineation of repeats is critical in identifying potential protein-protein interaction sites of LRR domains.

Here, we show that LRRpredictor is able to address this problem and by this, can be of use as a new tool in the analysis of especially plant NLR sequences that display a larger variability and irregularity as compared to other LRR domains [9,68]. This often results in the superposition or presence in less than a minimal repeat distance of potential alternative LRR motifs, as can be seen from Figure 8 illustrating such indeterminacies found on a 150 amino acid stretch from the potato CNL Gpa2 LRR domain. were considered to be members of the same LRR superfamily [67] the structural principles upon which they are built are different and presumably the two classes have diverged very early in evolution.


Discussion

Given the high number of indeterminacies generated by sequence variability, a proper annotation of LRR motifs and the correct delineation of repeats is critical in identifying potential protein-protein interaction sites of LRR domains.

Here, we show that LRRpredictor is able to address this problem and by this, can be of use as a new tool in the analysis of especially plant NLR sequences that display a larger variability and irregularity as compared to other LRR domains [9,68]. This often results in the superposition or presence in less than a minimal repeat distance of potential alternative LRR motifs, as can be seen from Figure 8 illustrating such indeterminacies found on a 150 amino acid stretch from the potato CNL Gpa2 LRR domain. Given the scarcity of structural learning data consisting of less than 180 LRR structures with lower than 90% identity and only ≈850 motifs at hand in ID50 (<50% identity), in order to maximize LRRpredictor extrapolation abilities, the method was set to rely on aggregating a collection of eight classifiers based on different strategies, two of them designed to perform a massive oversampling of the real data ( Figure 2).

In this context, LRRpredictor shows to perform well, with overall precision, recall, and F1 scores ranging between 85% and 97% on both test and cross validation sets (Figure 3a). In addition, LRRpredictor increases its performances when taking into account only the 'core' repeats (L), as the main prediction problems relate only to the N-'entry' repeats (N)-i.e., the first repeat of the LRR Figure 8. LRR motif and repeat indeterminacies onto a 150 aa stretch in Gpa2 potato NLR. Potential motifs that follow the minimal 'LxxLxL' pattern (where L is any hydrophobic amino acid) are illustrated above the sequence with black bars and yellow highlight, while LRRpredictor results are shown above with blue bars.

Given the scarcity of structural learning data consisting of less than 180 LRR structures with lower than 90% identity and only ≈850 motifs at hand in ID50 (<50% identity), in order to maximize LRRpredictor extrapolation abilities, the method was set to rely on aggregating a collection of eight classifiers based on different strategies, two of them designed to perform a massive oversampling of the real data ( Figure 2).

In this context, LRRpredictor shows to perform well, with overall precision, recall, and F1 scores ranging between 85% and 97% on both test and cross validation sets (Figure 3a). In addition, LRRpredictor increases its performances when taking into account only the 'core' repeats (L), as the main prediction problems relate only to the N-'entry' repeats (N)-i.e., the first repeat of the LRR domain (Figure 3a, Table A1). This can be explained in part by the increased irregularity of the sequence in this region, but also by the small sample size of the N-'entry' (N) motifs when compared to the 'core' (L) motifs.

It is also important to note here the fact that false positives are almost never found in nonLRR domains but always in proteins containing LRR domains (Table A1). Here, such false positives shape up in close vicinity to the marginal repeats-where the LRR motif characteristics are more diffuse, or in linkers or different domains neighboring the LRR, but found in a 'one repeat range' to the N-entry motif.

Other false predictions are caused by alignment artefacts. These yield to an offset of 1-3 amino acids in the predicted LRR motif starting position. Alignment artefacts are also frequently seen in regions with high beta structure propensity of insertion loops or 'islands' protruding from the LRR domain structures. This is mainly due to the fact that the multiple alignment on which PSSM relies forces the protruding loop in the queried sequence to align to regular repeats in the template LRRs of the database.

Unfortunately, the number of such insertion loops or 'islands' is so small in ID90/ID50 that estimators cannot learn from the existing data to discriminate such false positives. Thus, only careful structural analysis performed in later modelling stages can handle such cases.

Results on both cross-validation and test sets show that estimators using structural features in addition to the sequence based features (C5-C8) perform on average only slightly better compared to those sequence based only (C1-C4), with some interesting improvements on F1 scores (Figure 3b). This only marginal improvement may indicate that RaptorX-Property [34] training on the overall structural database that might have marginally overlapped with our testing dataset did not affect the results. Nevertheless, C5-C8 are expected to be better extrapolators (Table A1), while the structural predictions on which (C5-C8) are based, and that are present in the output file can prove instrumental in further dealing with ambiguous cases where two LRR motif signatures partially superpose or are within the limit of a repeat. Figures 3c and 4b compare predictions of three existing engines. LRRpredictor outperforms LRRsearch [27] and LRRfinder [26]. This is expected as the two previous methods were designed to focus mainly on specific LRR classes such as vertebrate TLRs or NLRs, respectively, while LRRpredictor relies on a newer larger dataset and was designed to identify LRR motifs in general. However, despite focusing on specific protein classes, both LRRsearch and LRRfinder show comparable efficiency in covering annotated LRR domains in plant extracellular receptors but decreased capabilities on plant NLRs (CNLs and TNLs) (Figure 4b). Furthermore, both LRRsearch and LRRfinder were intended for fast computation and they use a predefined PSSM matrix computed on a curated collection of LRR domains, instead of performing case by case basis sequence profiles as our method does.

However, the increased performance of LRRpredictor comes with an attached computational cost and is not easily scalable for scanning large protein sequences databases such UniprotKB. The main reason for this is that generating case by case sequence profiles and performing predictions for each estimator aggregated in LRRpredictor is more computationally demanding than LRRfinder and LRRsearch workflow.

Another matter of concern was related to the phyla bias of the database on which LRRpredictor relies, as ≈50% of ID90 have mammalian origin while the share of mammalian-from total-annotated LRRs in UniRef50 is only 2% (Figure 1c). Moreover, groups such as plant NLRs are extremely poorly represented, as only very recently the first plant NLR structure was reported [21,22].

In this context, in order to investigate the extrapolation capabilities of LRRpredictor we used a set of LRR domains annotated in Interpro collection from the six most representative immune receptor classes: R-proteins and extracellular receptors from flowering plants (CNL plants , TNL plants , RLK plants , RLP plants ) and their vertebrate counterparts (NLR vert , TLR vert ). The LRR motifs predicted by LRRpredictor show a good coverage of the LRR domains annotated by Interpro and follow the expected repeat length distribution for all these six classes [14,65] (Figure 4a,b). Moreover, the predicted motifs reproduce the expected LRR motif consensus of each protein class ( Figure 5) from Kobe and Kajava classification [14,65]. Combined, these indicate that LRRpredictor is able to extrapolate well in different LRR motif classes which is especially important for plant NLRs.

Analysis of LRRpredictor detected motifs showed clear differences between the six classes within the extended 16 aa motif. Whether variation in these extended motifs directly relate to the functional diversification of the different receptor classes still remains to be addressed. By contrast, within the minimal 6 aa LRR motif region-L 0 XXL 3 XL 5 -there are no significant differences between the six groups ( Figure 7). This might suggest a common root of minimal structural criteria imposed by the solenoidal architecture from which the six classes have diverged to fulfil specific tasks in specific environments. For receptor function, such a solenoidal domain organization in which only three positions over a ≈25 repeat length are loosely conserved has two-fold evolutionary advantages: first the solenoid architecture ensures a large solvent exposed surface area [10] and second a high sequence variability can be achieved without disturbing the tertiary structure.

The increased conservation seen at the level of the extended motif among all three extracellular LRR classes-plant RLK, RLP and vertebrate TLRs-when compared to plant and vertebrate NLRs could be related to N-glycosylation and the constraints imposed by the extracellular environment. On the one hand, plant NLRs recognize directly or indirectly a suite of pathogen effectors or (perturbations) of their host targets conferring host specific immunity. Single amino acid changes in the effector can already be detected or are sufficient to evade recognition by a NLR, resulting in a co-evolutionary arms race between pathogen effectors and host immune receptor [69,70]. In contrast, extracellular LRRs recognize often conserved microbial patterns to confer basal immunity thus lacking such a strong driver for diversification [71]. Vertebrate NLRs act more like basal immune receptors in innate immunity, recognizing conserved microbe-associated molecular patterns (MAMPs). The greater diversifying selection imposed by fast-evolving effectors may therefore account for the co-evolution of structurally highly variable LRR motifs in plant NLRs. In the future, it will be interesting to relate our LRR structural annotations to specific functional NLR sub-classes. This is relevant, for instance, as some plant NLRs-types are described to have a downstream 'helper' function rather than a role as a canonical 'sensor'.

Another aspect is that LRR domains in plant NLRs have a dual role. They not only contribute to pathogen recognition, but also negatively regulate the switch function [72]. Hence, it will be interesting to link LRR structural annotations to specific intramolecular domain interactions between LRRs and other NLR subdomains to better understand the co-evolution of protein domains in NLRs. It is shown that subtle mutations in the interface between LRR and NB-ARC can have a major effect on NLR functioning, often resulting in constitutive immune activation or a complete loss-of-function [17,72]. This shows the tight link between structural and functional constraints underlying the shaping of NLRs in plants. Additionally, the link between LRR structural annotations and complex formation with other host proteins will be interesting to assess. LRR domains are known to interact with other components like chaperones (e.g., SGT1) which are required for proper NLR folding and functioning [73], or kinases (e.g., ZED1, RKS1) [21,22,74] but also NLR hetero-and homodimers are often formed [9,75,76] which could impose additional structural constraints on the shape and irregularity of LRR domains in plant NLRs.


Conclusions

The results presented herein indicate that LRRpredictor shows a good performance on the available 3D data and good extrapolation capabilities on plant NLRs (CNL/TNL), which are poorly represented in the training dataset. Predicted LRR repeats using LRRpredictor significantly increase the coverage of Interpro annotated LRR domains from main immune receptors groups. In addition, these predicted repeats are consistent with previously defined motif consensuses from all studied groups and also follow the repeat length range specific to each class. In conclusion, LRRpredictor is a tool worth using in research topics related to understanding immune receptors functions and structure-informed strategies for pathogen control technologies.  loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures [22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L0xxL3xL5' motif are shown in orange and position N8 in purple.   Table A1. Detailed performance analysis on LRRpredictor and its classifiers. Precision recall and F1 scores are shown for in-sample (i.e., training data) and out-of-sample data (i.e., test data that was not used in training), for both cross-validation and test phase. In the cross-validation stage, classifiers were trained on three of the cross-validation (CV) sets and tested on the fourth set in an iterative manner, while in testing stage, classifiers were trained on all four CV sets and evaluated on the test set left aside from the beginning. The counts for true-negatives (TN), false-positives (FP), false-negative (FN), and true-positive (TP) within each set are also shown. As marginal repeats (N-entry and C-exit types) have a lower detection rate, also included is the recall calculated only with respect to 'core' repeats (L), indicated with blue font. Performance scores shading is according to a value based colormap from yellow (0.75) to blue (1.00).


Dataset Classifier

In   

Figure 1 .
1Available leucine-rich-repeat (LRR) domains in structural data. (a) LRR structural dataset construction. (b) LRR domain horseshoe architecture illustrated on the only plant NLR cryo-EM structure available-ZAR1-from Arabidopsis thaliana (left) and zoom-in view of a LRR repeat (right) (PDB: 6J5W). The hydrophobic positions in the minimal 'L0xxL3xL5' motif are shown in orange. The first N-entry repeat (blue) and the last C-exit repeat (red) are also mapped on the structure. (c) Phyla distribution of the initial LRR motif set ID90, the 50% identity trimmed LRR motifs set (ID50), annotated LRR proteins and all proteins from the UniRef50 database (from left to right). Percent values corresponding to the mammals group are shown in red. (d) Frequency plot of amino acid composition of the N-entry, core and C-exit motifs on the 50% identity trimmed set. Amino acids are colored according to their properties as follows: hydrophobic (yellow), acidic (red), basic (blue), asparagine and glutamine (purple), proline and glycine (green), others (black). (e) Jensen-Shannon

Figure 1 .
1Available leucine-rich-repeat (LRR) domains in structural data. (a) LRR structural dataset construction. (b) LRR domain horseshoe architecture illustrated on the only plant NLR cryo-EM structure available-ZAR1-from Arabidopsis thaliana (left) and zoom-in view of a LRR repeat (right)

L
-strictly leucine; Ł-hydrophobic without leucine (I, V, M, F, W, Y, C, A); L-hydrophobic (L, I, V, M, F, W, Y, C, A); x-any amino acid.

Figure 2 .
2LRRpredictor training and testing workflow: (a) training and testing dataset construction. (b) schematic representation of the training and testing procedure, (c) selected features, and (d) selected classifiers aggregated into LRRpredictor.

Figure 2 .
2LRRpredictor training and testing workflow: (a) training and testing dataset construction. (b) schematic representation of the training and testing procedure, (c) selected features, and (d) selected classifiers aggregated into LRRpredictor.

Figure 3 .
3LRRpredictor performance analysis: (a) LRRpredictor performance across datasets: precision, recall, and F1 scores are shown either considering all the LRR motif types (N-entry, core, and C-exit types), either solely core motifs (L); also shown are the true negative (TN), false positive (FP), false negative (FN) and true positive (TP) counts. (b) F1 scores of LRRpredictor and its individual classifiers. (c) Comparison between LRRpredictor and other LRR motif predictors: LRRfinder

Figure 3 .
3LRRpredictor performance analysis: (a) LRRpredictor performance across datasets: precision, recall, and F1 scores are shown either considering all the LRR motif types (N-entry, core, and C-exit types), either solely core motifs (L); also shown are the true negative (TN), false positive (FP), false negative (FN) and true positive (TP) counts. (b) F1 scores of LRRpredictor and its individual classifiers. (c) Comparison between LRRpredictor and other LRR motif predictors: LRRfinder

Figure 4 .
4LRRpredictor behavior on Interpro annotated LRR domains from different classes. (a) Length distribution of the predicted repeats using LRRpredictor within each protein group. Cterminal motifs were not used in computing the distribution. Repeat lengths size prone to ambiguity-i.e., either too short (potential FP) or too long (potential FN)-are shaded in red. (b) Distributions of the Interpro annotated LRR domain length that is covered by Interpro LRR repeat annotations (grey) or by predicted repeats using LRRpredictor (blue), LRRfinder (green), and LRRsearch (purple). Coverage percent distributions are shown within each protein group.

Figure 4 .
4LRRpredictor behavior on Interpro annotated LRR domains from different classes. (a) Length distribution of the predicted repeats using LRRpredictor within each protein group. C-terminal motifs were not used in computing the distribution. Repeat lengths size prone to ambiguity-i.e., either too short (potential FP) or too long (potential FN)-are shaded in red. (b) Distributions of the Interpro annotated LRR domain length that is covered by Interpro LRR repeat annotations (grey) or by predicted repeats using LRRpredictor (blue), LRRfinder (green), and LRRsearch (purple). Coverage percent distributions are shown within each protein group.

Figure 5 .
5Consensuses of the LRR motifs predicted by LRRpredictor across different classes. Logo heights correspond to amino acid relative entropy (in bits), higher heights implying higher conservation. A consensus for each class is displayed bellow each logo, highly conserved positions being shown in black boxes, while less conserved in gray. Minimal motif 'L0xxL3xL5' (green line) and the extended motif (black line) are indicated below each logo. Amino acids are colored according to their properties as inFigure 1d.

Figure 5 .
5Consensuses of the LRR motifs predicted by LRRpredictor across different classes. Logo heights correspond to amino acid relative entropy (in bits), higher heights implying higher conservation. A consensus for each class is displayed bellow each logo, highly conserved positions being shown in black boxes, while less conserved in gray. Minimal motif 'L 0 xxL 3 xL 5 ' (green line) and the extended motif (black line) are indicated below each logo. Amino acids are colored according to their properties as inFigure 1d.Genes 2019, 10, x FOR PEER REVIEW 13 of 24

Figure 6 .
6Distribution of LRR motif types defined byKobe and Kajava (KK)  

Genes 2019 ,
201910, x FOR PEER REVIEW 14 of 24

Figure 7 .
7LRR motifs variability in different protein classes. (a) Intra-group all-vs.-all distances on the extended (left) and minimal (right) motif (b) Silhouette coefficients inter-groups extended (left) and minimal (right) motif. (c) Histogram of a 2D embedding approximating the true distances between points for the extended (left) and minimal (right) motif. Histograms were computed using a 20 × 20 bins grid. Extended and minimal motif histograms cannot be compared as they refer to different sequence spaces.

Figure 7 .
7LRR motifs variability in different protein classes. (a) Intra-group all-vs.-all distances on the extended (left) and minimal (right) motif (b) Silhouette coefficients inter-groups extended (left) and minimal (right) motif. (c) Histogram of a 2D embedding approximating the true distances between points for the extended (left) and minimal (right) motif. Histograms were computed using a 20 × 20 bins grid. Extended and minimal motif histograms cannot be compared as they refer to different sequence spaces.

Genes 2019 ,
201910, x FOR PEER REVIEW 15 of 24

Figure 8 .
8LRR motif and repeat indeterminacies onto a 150 aa stretch in Gpa2 potato NLR. Potential motifs that follow the minimal 'LxxLxL' pattern (where L is any hydrophobic amino acid) are illustrated above the sequence with black bars and yellow highlight, while LRRpredictor results are shown above with blue bars.

Figure A1 .
A1Available LRR domains structural data. (a) Identity cut-off versus loss of data: plots of the loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures[22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L0xxL3xL5' motif are shown in orange and position N8 in purple.

Figure A1 .
A1Available LRR domains structural data. (a) Identity cut-off versus loss of data: plots of the loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures[22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L 0 xxL 3 xL 5 ' motif are shown in orange and position N 8 in purple.

Figure A2 .
A2(a) LRRpredictor behavior on other solenoidal architectures. Shown are occurrence counts of LRR-like patterns versus LRRpredictor probabilities counts histogram. (b) Overall 3D structure of the four examined classes of solenoidal proteins[80][81][82][83].

Figure A2 .
A2(a) LRRpredictor behavior on other solenoidal architectures. Shown are occurrence counts of LRR-like patterns versus LRRpredictor probabilities counts histogram. (b) Overall 3D structure of the four examined classes of solenoidal proteins[80][81][82][83].

Table 1 .
1Occurrence of LRR sequence patterns in the overall dataset used to train the machine learning (ML) estimators. Training & Testing Dataset (CV 1-4 and Test Sets)Full NonLRR Proteins 
LRR Proteins 



Table A1 .
A1Cont.Dataset 
Classifier 

In-Sample 
Out-Of Sample 

Precision Recall F1-Score 
Precision Recall F1-Score 

TN 
FP 
FN 
TP 
Recall on Core(L) Only 
-
Non-LRR 
Proteins 

LRR 
Proteins 

N-Entry 
(N) 

Core 
(L) 

C-Exit 
(C) 

N-Entry 
(N) 

Core 
(L) 

C-Exit 
(C) 

Test 

C1 
0.900 
0.997 
0.946 
0.874 
0.880 
0.877 
35107 
0 
19 
6 
10 
2 
13 
109 
10 
0.916 
C2 
0.962 
0.956 
0.959 
0.941 
0.847 
0.891 
35118 
0 
8 
8 
12 
3 
11 
107 
9 
0.899 
C3 
0.882 
0.896 
0.889 
0.852 
0.847 
0.850 
35104 
1 
21 
8 
13 
2 
11 
106 
10 
0.891 
C4 
0.940 
0.874 
0.906 
0.907 
0.840 
0.872 
35113 
1 
12 
8 
14 
2 
11 
105 
10 
0.882 
C5 
0.895 
0.934 
0.914 
0.862 
0.873 
0.868 
35105 
1 
20 
7 
10 
2 
12 
109 
10 
0.916 
C6 
0.940 
0.901 
0.920 
0.928 
0.860 
0.893 
35116 
0 
10 
7 
12 
2 
12 
107 
10 
0.899 
C7 
0.990 
1.000 
0.995 
0.827 
0.827 
0.827 
35100 
4 
22 
7 
16 
3 
12 
103 
9 
0.866 
C8 
0.942 
0.874 
0.906 
0.920 
0.840 
0.878 
35115 
0 
11 
9 
13 
2 
10 
106 
10 
0.891 
LRRpredictor 
0.943 
0.928 
0.936 
0.928 
0.860 
0.893 
35116 
0 
10 
7 
12 
2 
12 
107 
10 
0.899 


Structural Principles of Leucine-Rich Repeat (LRR) Proteins. P Enkhbayar, M Kamiya, M Osaki, T Matsumoto, N Matsushima, 10.1002/prot.10605Proteins Struct. Funct. Bioinform. 54PubMedEnkhbayar, P.; Kamiya, M.; Osaki, M.; Matsumoto, T.; Matsushima, N. Structural Principles of Leucine-Rich Repeat (LRR) Proteins. Proteins Struct. Funct. Bioinform. 2004, 54, 394-403. [CrossRef] [PubMed]

A mutation within the leucine-rich repeat domain of the arabidopsis disease resistance gene RPS5 partially suppresses multiple bacterial and downy mildew resistance genes. R F Warren, A Henk, P Mowery, E Holub, R W Innes, 10.1105/tpc.10.9.1439Plant Cell. 10PubMedWarren, R.F.; Henk, A.; Mowery, P.; Holub, E.; Innes, R.W. A mutation within the leucine-rich repeat domain of the arabidopsis disease resistance gene RPS5 partially suppresses multiple bacterial and downy mildew resistance genes. Plant Cell 1998, 10, 1439-1452. [CrossRef] [PubMed]

Direct interaction of resistance gene and avirulence gene products confers rice blast resistance. Y Jia, S A Mcadams, G T Bryan, H P Hershey, B Valent, 10.1093/emboj/19.15.4004EMBO J. 19PubMedJia, Y.; McAdams, S.A.; Bryan, G.T.; Hershey, H.P.; Valent, B. Direct interaction of resistance gene and avirulence gene products confers rice blast resistance. EMBO J. 2000, 19, 4004-4014. [CrossRef] [PubMed]

Autoinflammatory mutation in NLRC4 reveals a leucine-rich repeat (LRR)-LRR oligomerization interface. F Moghaddas, P Zeng, Y Zhang, H Schützle, S Brenner, S R Hofmann, R Berner, Y Zhao, B Lu, X Chen, 10.1016/j.jaci.2018.04.033J. Allergy Clin. Immunol. 142PubMedMoghaddas, F.; Zeng, P.; Zhang, Y.; Schützle, H.; Brenner, S.; Hofmann, S.R.; Berner, R.; Zhao, Y.; Lu, B.; Chen, X.; et al. Autoinflammatory mutation in NLRC4 reveals a leucine-rich repeat (LRR)-LRR oligomerization interface. J. Allergy Clin. Immunol. 2018, 142, 1956-1967.e6. [CrossRef] [PubMed]

Cloning of the gene containing mutations that cause PARK8-linked Parkinson's disease. C Paisán-Ruíz, S Jain, E W Evans, W P Gilks, J Simón, M Van Der Brug, A L De Munain, S Aparicio, A M Gil, N Khan, 10.1016/j.neuron.2004.10.023Neuron. 44PubMedPaisán-Ruíz, C.; Jain, S.; Evans, E.W.; Gilks, W.P.; Simón, J.; Van Der Brug, M.; De Munain, A.L.; Aparicio, S.; Gil, A.M.; Khan, N.; et al. Cloning of the gene containing mutations that cause PARK8-linked Parkinson's disease. Neuron 2004, 44, 595-600. [CrossRef] [PubMed]

Mutations in LRRK2 cause autosomal-dominant parkinsonism with pleomorphic pathology. A Zimprich, S Biskup, P Leitner, P Lichtner, M Farrer, S Lincoln, J Kachergus, M Hulihan, R J Uitti, D B Calne, 10.1016/j.neuron.2004.11.005Neuron. 44PubMedZimprich, A.; Biskup, S.; Leitner, P.; Lichtner, P.; Farrer, M.; Lincoln, S.; Kachergus, J.; Hulihan, M.; Uitti, R.J.; Calne, D.B.; et al. Mutations in LRRK2 cause autosomal-dominant parkinsonism with pleomorphic pathology. Neuron 2004, 44, 601-607. [CrossRef] [PubMed]

The role of small leucine-rich proteoglycans in osteoarthritis pathogenesis. G X Ni, Z Li, Y Z Zhou, 10.1016/j.joca.2014.04.026Osteoarthritis Cartilage. 22Ni, G.X.; Li, Z.; Zhou, Y.Z. The role of small leucine-rich proteoglycans in osteoarthritis pathogenesis. Osteoarthritis Cartilage. 2014, 22, 896-903. [CrossRef]

. M Lewis, Collagen Prelp, Hutchinson-Gilford Progeria, 10.1016/S1568-1637(02)00044-2Ageing Res. Rev. 2Lewis, M. PRELP, collagen, and a theory of Hutchinson-Gilford progeria. Ageing Res. Rev. 2003, 2, 95-105. [CrossRef]

Structure-informed insights for NLR functioning in plant immunity. O C A Sukarta, E J Slootweg, A Goverse, 10.1016/j.semcdb.2016.05.012Semin. Cell Dev. Biol. 56Sukarta, O.C.A.; Slootweg, E.J.; Goverse, A. Structure-informed insights for NLR functioning in plant immunity. Semin. Cell Dev. Biol. 2016, 56, 134-149. [CrossRef]

The NBS-LRR architectures of plant R-proteins and metazoan NLRs evolved in independent events. J M Urbach, F M Ausubel, 10.1073/pnas.1619730114Proc. Natl. Acad. Sci. Natl. Acad. SciUSA114Urbach, J.M.; Ausubel, F.M. The NBS-LRR architectures of plant R-proteins and metazoan NLRs evolved in independent events. Proc. Natl. Acad. Sci. USA 2017, 114, 1063-1068. [CrossRef]

Comparative Geometrical Analysis of Leucine-Rich Repeat Structures in the Nod-Like and Toll-Like Receptors in Vertebrate Innate Immunity. N Matsushima, H Miyashita, P Enkhbayar, R H Kretsinger, 10.3390/biom5031955Biomolecules. 5PubMedMatsushima, N.; Miyashita, H.; Enkhbayar, P.; Kretsinger, R.H. Comparative Geometrical Analysis of Leucine-Rich Repeat Structures in the Nod-Like and Toll-Like Receptors in Vertebrate Innate Immunity. Biomolecules 2015, 5, 1955-1978. [CrossRef] [PubMed]

Assessment of the ability to model proteins with leucine-rich repeats in light of the latest structural information. A V Kajava, B Kobe, 10.1110/ps.4010102Protein Sci. 11Kajava, A.V.; Kobe, B. Assessment of the ability to model proteins with leucine-rich repeats in light of the latest structural information. Protein Sci. 2002, 11, 1082-1090. [CrossRef]

Comparative sequence analysis of leucine-rich repeats (LRRs) within vertebrate toll-like receptors. N Matsushima, T Tanaka, P Enkhbayar, T Mikami, M Taga, K Yamada, Y Kuroki, 10.1186/1471-2164-8-124BMC Genom. 8PubMedMatsushima, N.; Tanaka, T.; Enkhbayar, P.; Mikami, T.; Taga, M.; Yamada, K.; Kuroki, Y. Comparative sequence analysis of leucine-rich repeats (LRRs) within vertebrate toll-like receptors. BMC Genom. 2007, 8, 124. [CrossRef] [PubMed]

The leucine-rich repeat as a protein recognition motif. B Kobe, A V Kajava, 10.1016/S0959-440X(01)00266-4Curr. Opin. Struct. Biol. 11Kobe, B.; Kajava, A.V. The leucine-rich repeat as a protein recognition motif. Curr. Opin. Struct. Biol. 2001, 11, 725-732. [CrossRef]

Human leucine-rich repeat proteins: A genome-wide bioinformatic categorization and functional analysis in innate immunity. A C Y Ng, J M Eisenberg, R J W Heath, A Huett, C M Robinson, G J Nau, R J Xavier, 10.1073/pnas.1000093107Proc. Natl. Acad. Sci. Natl. Acad. SciUSA108PubMedNg, A.C.Y.; Eisenberg, J.M.; Heath, R.J.W.; Huett, A.; Robinson, C.M.; Nau, G.J.; Xavier, R.J. Human leucine-rich repeat proteins: A genome-wide bioinformatic categorization and functional analysis in innate immunity. Proc. Natl. Acad. Sci. USA 2011, 108, 4631-4638. [CrossRef] [PubMed]

Ancient diversity of splicing motifs and protein surfaces in the wild emmer wheat (Triticum dicoccoides) LR10 coiled coil (CC) and leucine-rich repeat (LRR) domains. H Sela, L N Spiridon, A J Petrescu, M Akerman, Y Mandel-Gutfreund, E Nevo, C Loutre, B Keller, A H Schulman, T Fahima, 10.1111/j.1364-3703.2011.00744.xMol. Plant Pathol. 13Sela, H.; Spiridon, L.N.; Petrescu, A.J.; Akerman, M.; Mandel-Gutfreund, Y.; Nevo, E.; Loutre, C.; Keller, B.; Schulman, A.H.; Fahima, T. Ancient diversity of splicing motifs and protein surfaces in the wild emmer wheat (Triticum dicoccoides) LR10 coiled coil (CC) and leucine-rich repeat (LRR) domains. Mol. Plant Pathol. 2012, 13, 276-287. [CrossRef]

Structural determinants at the interface of the ARC2 and leucine-rich repeat domains control the activation of the plant immune receptors Rx1 and Gpa2. E J Slootweg, L N Spiridon, J Roosien, P Butterbach, R Pomp, L Westerhof, R Wilbers, E Bakker, J Bakker, A J Petrescu, 10.1104/pp.113.218842Plant Physiol. 162Slootweg, E.J.; Spiridon, L.N.; Roosien, J.; Butterbach, P.; Pomp, R.; Westerhof, L.; Wilbers, R.; Bakker, E.; Bakker, J.; Petrescu, A.J.; et al. Structural determinants at the interface of the ARC2 and leucine-rich repeat domains control the activation of the plant immune receptors Rx1 and Gpa2. Plant Physiol. 2013, 162, 1510-1528. [CrossRef]

Three-Dimensional Modeling and Diversity Analysis Reveals Distinct AVR Recognition Sites and Evolutionary Pathways in Wild and Domesticated Wheat Pm3 R Genes. H Sela, L N Spiridon, H Ashkenazi, N K Bhullar, S Brunner, A.-J Petrescu, T Fahima, B Keller, T Jordan, 10.1094/MPMI-01-14-0009-RMol. Plant-Microbe Interact. 27Sela, H.; Spiridon, L.N.; Ashkenazi, H.; Bhullar, N.K.; Brunner, S.; Petrescu, A.-J.; Fahima, T.; Keller, B.; Jordan, T. Three-Dimensional Modeling and Diversity Analysis Reveals Distinct AVR Recognition Sites and Evolutionary Pathways in Wild and Domesticated Wheat Pm3 R Genes. Mol. Plant-Microbe Interact. 2014, 27, 835-845. [CrossRef]

An LRR/Malectin receptor-like kinase mediates resistance to non-adapted and adapted powdery mildew fungi in barley and wheat. J Rajaraman, D Douchkov, G Hensel, F L Stefanato, A Gordon, N Ereful, O F Caldararu, A J Petrescu, J Kumlehn, L A Boyd, 10.3389/fpls.2016.01836Front. Plant Sci. 7Rajaraman, J.; Douchkov, D.; Hensel, G.; Stefanato, F.L.; Gordon, A.; Ereful, N.; Caldararu, O.F.; Petrescu, A.J.; Kumlehn, J.; Boyd, L.A.; et al. An LRR/Malectin receptor-like kinase mediates resistance to non-adapted and adapted powdery mildew fungi in barley and wheat. Front. Plant Sci. 2016, 7, 1836. [CrossRef]

Structure-function analysis of ZAR1 immune receptor reveals key molecular interactions for activity. M Baudin, K J Schreiber, E C Martin, A J Petrescu, J D Lewis, 10.1111/tpj.14547Plant J. 101Baudin, M.; Schreiber, K.J.; Martin, E.C.; Petrescu, A.J.; Lewis, J.D. Structure-function analysis of ZAR1 immune receptor reveals key molecular interactions for activity. Plant J 2020, 101, 352-370. [CrossRef]

Reconstitution and structure of a plant NLR resistosome conferring immunity. J Wang, M Hu, J Wang, J Qi, Z Han, G Wang, Y Qi, H.-W Wang, J.-M Zhou, J Chai, 10.1126/science.aav5870Science. 364Wang, J.; Hu, M.; Wang, J.; Qi, J.; Han, Z.; Wang, G.; Qi, Y.; Wang, H.-W.; Zhou, J.-M.; Chai, J. Reconstitution and structure of a plant NLR resistosome conferring immunity. Science 2019, 364, eaav5870. [CrossRef]

Ligand-triggered allosteric ADP release primes a plant NLR complex. J Wang, J Wang, M Hu, S Wu, J Qi, G Wang, Z Han, Y Qi, N Gao, H W Wang, 10.1126/science.aav5868Science. 364eaav5868. [CrossRefWang, J.; Wang, J.; Hu, M.; Wu, S.; Qi, J.; Wang, G.; Han, Z.; Qi, Y.; Gao, N.; Wang, H.W.; et al. Ligand-triggered allosteric ADP release primes a plant NLR complex. Science 2019, 364, eaav5868. [CrossRef]

Modeling of the three-dimensional structure of proteins with the typical leucine-rich repeats. A V Kajava, G Vassart, S J Wodak, 10.1016/S0969-2126(01)00222-2Structure. 3Kajava, A.V.; Vassart, G.; Wodak, S.J. Modeling of the three-dimensional structure of proteins with the typical leucine-rich repeats. Structure 1995, 3, 867-877. [CrossRef]

LRR conservation mapping to predict functional sites within protein leucine-rich repeat domains. L Helft, V Reddy, X Chen, T Koller, L Federici, J Fernández-Recio, R Gupta, A Bent, 10.1371/journal.pone.0021614PLoS ONE. 6Helft, L.; Reddy, V.; Chen, X.; Koller, T.; Federici, L.; Fernández-Recio, J.; Gupta, R.; Bent, A. LRR conservation mapping to predict functional sites within protein leucine-rich repeat domains. PLoS ONE 2011, 6, e21614. [CrossRef]

Out of Water: The Origin and Early Diversification of Plant R-Genes. Y Gao, W Wang, T Zhang, Z Gong, H Zhao, G Z Han, 10.1104/pp.18.00185Plant Physiol. 177Gao, Y.; Wang, W.; Zhang, T.; Gong, Z.; Zhao, H.; Han, G.Z. Out of Water: The Origin and Early Diversification of Plant R-Genes. Plant Physiol. 2018, 177, 82-89. [CrossRef]

0: A webserver for the prediction of leucine-rich repeats. V Offord, D Werling, Lrrfinder2, 10.1177/1753425912465661Innate Immun. 19Offord, V.; Werling, D. LRRfinder2.0: A webserver for the prediction of leucine-rich repeats. Innate Immun. 2013, 19, 398-402. [CrossRef]

LRRsearch: An asynchronous server-based application for the prediction of leucine-rich repeat motifs and an integrative database of NOD-like receptors. A Bej, B R Sahoo, B Swain, M Basu, P Jayasankar, M Samanta, 10.1016/j.compbiomed.2014.07.016Comput. Biol. Med. 53Bej, A.; Sahoo, B.R.; Swain, B.; Basu, M.; Jayasankar, P.; Samanta, M. LRRsearch: An asynchronous server-based application for the prediction of leucine-rich repeat motifs and an integrative database of NOD-like receptors. Comput. Biol. Med. 2014, 53, 164-170. [CrossRef]

CATH: An expanded resource to predict protein function through structure and sequence. N L Dawson, T E Lewis, S Das, J G Lees, D Lee, P Ashford, C A Orengo, I Sillitoe, 10.1093/nar/gkw1098Nucleic Acids Res. 45Dawson, N.L.; Lewis, T.E.; Das, S.; Lees, J.G.; Lee, D.; Ashford, P.; Orengo, C.A.; Sillitoe, I. CATH: An expanded resource to predict protein function through structure and sequence. Nucleic Acids Res. 2017, 45, D289-D295. [CrossRef]

The Pfam protein families database in 2019. S El-Gebali, J Mistry, A Bateman, S R Eddy, A Luciani, S C Potter, M Qureshi, L J Richardson, G A Salazar, A Smart, 10.1093/nar/gky995Nucleic Acids Res. 47El-Gebali, S.; Mistry, J.; Bateman, A.; Eddy, S.R.; Luciani, A.; Potter, S.C.; Qureshi, M.; Richardson, L.J.; Salazar, G.A.; Smart, A.; et al. The Pfam protein families database in 2019. Nucleic Acids Res. 2019, 47, D427-D432. [CrossRef]

InterPro in 2019: Improving coverage, classification and access to protein sequence annotations. A L Mitchell, T K Attwood, P C Babbitt, M Blum, P Bork, A Bridge, S D Brown, H Y Chang, S El-Gebali, M I Fraser, 10.1093/nar/gky1100Nucleic Acids Res. 47Mitchell, A.L.; Attwood, T.K.; Babbitt, P.C.; Blum, M.; Bork, P.; Bridge, A.; Brown, S.D.; Chang, H.Y.; El-Gebali, S.; Fraser, M.I.; et al. InterPro in 2019: Improving coverage, classification and access to protein sequence annotations. Nucleic Acids Res. 2019, 47, D351-D360. [CrossRef]

PISCES: A protein sequence culling server. G Wang, R L Dunbrack, 10.1093/bioinformatics/btg224Bioinformatics. 19Wang, G.; Dunbrack, R.L. PISCES: A protein sequence culling server. Bioinformatics 2003, 19, 1589-1591. [CrossRef]

Predicting functionally important residues from sequence conservation. J A Capra, M Singh, 10.1093/bioinformatics/btm270Bioinformatics. 23Capra, J.A.; Singh, M. Predicting functionally important residues from sequence conservation. Bioinformatics 2007, 23, 1875-1882. [CrossRef]

ETE 3: Reconstruction, Analysis, and Visualization of Phylogenomic Data. J Huerta-Cepas, F Serra, P Bork, 10.1093/molbev/msw046Mol. Biol. Evol. 33Huerta-Cepas, J.; Serra, F.; Bork, P. ETE 3: Reconstruction, Analysis, and Visualization of Phylogenomic Data. Mol. Biol. Evol. 2016, 33, 1635-1638. [CrossRef]

RaptorX-Property: A web server for protein structure property prediction. S Wang, W Li, S Liu, J Xu, 10.1093/nar/gkw306Nucleic Acids Res. 44Wang, S.; Li, W.; Liu, S.; Xu, J. RaptorX-Property: A web server for protein structure property prediction. Nucleic Acids Res. 2016, 44, W430-W435. [CrossRef]

AUC-maximized deep convolutional neural fields for protein sequence labeling. S Wang, S Sun, J Xu, Proceedings of the Lecture Notes in Computer Science. the Lecture Notes in Computer ScienceWang, S.; Sun, S.; Xu, J. AUC-maximized deep convolutional neural fields for protein sequence labeling. In Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics);

. Springer, 9852Berlin, GermanySpringer: Berlin, Germany, 2016; Volume 9852 LNAI, pp. 1-16.

Proteome-level protein disorder prediction by AUC-maximized deep convolutional neural fields. S Wang, J Ma, J Xu, Aucpred, Proceedings of the Bioinformatics. the BioinformaticsOxford, UKOxford University Press32Wang, S.; Ma, J.; Xu, J. AUCpreD: Proteome-level protein disorder prediction by AUC-maximized deep convolutional neural fields. In Proceedings of the Bioinformatics; Oxford University Press: Oxford, UK, 2016; Volume 32, pp. i672-i679.

Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields. S Wang, J Peng, J Ma, J Xu, 10.1038/srep18962Sci. Rep. Wang, S.; Peng, J.; Ma, J.; Xu, J. Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields. Sci. Rep. 2016, 6, 18962. [CrossRef]

Lightning-fast iterative protein sequence searching by HMM-HMM alignment. M Remmert, A Biegert, A Hauser, J Söding, Hhblits, 10.1038/nmeth.1818Nat. Methods. 9Remmert, M.; Biegert, A.; Hauser, A.; Söding, J. HHblits: Lightning-fast iterative protein sequence searching by HMM-HMM alignment. Nat. Methods 2012, 9, 173-175. [CrossRef]

HH-suite3 for fast remote homology detection and deep protein annotation. M Steinegger, M Meier, M Mirdita, H Vöhringer, S J Haunsberger, J Söding, 10.1186/s12859-019-3019-7BMC Bioinform. 20Steinegger, M.; Meier, M.; Mirdita, M.; Vöhringer, H.; Haunsberger, S.J.; Söding, J. HH-suite3 for fast remote homology detection and deep protein annotation. BMC Bioinform. 2019, 20, 473. [CrossRef]

Support-vector networks. C Cortes, V Vapnik, 10.1007/BF00994018Mach. Learn. 20Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273-297. [CrossRef]

Fuzzy Sets, and Classification. S K Pal, S Mitra, Multilayer Perceptron, 10.1109/72.159058IEEE Trans. Neural Netw. 3Pal, S.K.; Mitra, S. Multilayer Perceptron, Fuzzy Sets, and Classification. IEEE Trans. Neural Netw. 1992, 3, 683-697. [CrossRef]

The perceptron: A probabilistic model for information storage and organization in the brain. F Rosenblatt, 10.1037/h0042519Psychol. Rev. 65Rosenblatt, F. The perceptron: A probabilistic model for information storage and organization in the brain. Psychol. Rev. 1958, 65, 386-408. [CrossRef]

A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. Y Freund, R E Schapire, 10.1006/jcss.1997.1504J. Comput. Syst. Sci. 55Freund, Y.; Schapire, R.E. A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. J. Comput. Syst. Sci. 1997, 55, 119-139. [CrossRef]

Adaptive synthetic sampling approach for imbalanced learning. H He, Y Bai, E A Garcia, S Li, Adasyn, Proceedings of the 2008 IEEE International Joint Conference on Neural Networks. the 2008 IEEE International Joint Conference on Neural NetworksPiscataway, NJ, USAIEEEHe, H.; Bai, Y.; Garcia, E.A.; Li, S. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In Proceedings of the 2008 IEEE International Joint Conference on Neural Networks; IEEE: Piscataway, NJ, USA, 2008; pp. 1322-1328.

Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning. H Han, W.-Y Wang, B.-H Mao, Springer3644Berlin/Heidelberg, GermanyHan, H.; Wang, W.-Y.; Mao, B.-H. Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning; Springer: Berlin/Heidelberg, Germany, 2005; Volume 3644.

Synthetic minority over-sampling technique. N V Chawla, K W Bowyer, L O Hall, W P Kegelmeyer, Smote, 10.1613/jair.953J. Artif. Intell. Res. 16Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002, 16, 321-357. [CrossRef]

Borderline Over-sampling for Imbalanced Data Classification. H M Nguyen, E W Cooper, K Kamei, Proceedings: Fifth International Workshop on Computational Intelligence & Applications. Fifth International Workshop on Computational Intelligence & ApplicationsPiscataway, NJ, USAIEEENguyen, H.M.; Cooper, E.W.; Kamei, K. Borderline Over-sampling for Imbalanced Data Classification. In Proceedings: Fifth International Workshop on Computational Intelligence & Applications; IEEE: Piscataway, NJ, USA, 2009; Volume 2009, pp. 24-29.

Balancing Training Data for Automated Annotation of Keywords: A Case Study. G E Batista, A L C Bazzan, M C Monard, WOB. Porto Alegre, BrazilUFRGSBatista, G.E.; Bazzan, A.L.C.; Monard, M.C. Balancing Training Data for Automated Annotation of Keywords: A Case Study. In WOB; UFRGS: Porto Alegre, Brazil, 2003; pp. 10-18.

A study of the behavior of several methods for balancing machine learning training data. G E Batista, R C Prati, M C Monard, 10.1145/1007730.1007735ACM SIGKDD Explor. Newsl. 6Batista, G.E.; Prati, R.C.; Monard, M.C. A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explor. Newsl. 2004, 6, 20-29. [CrossRef]

Scikit-learn: Machine Learning in Python. F Pedregosa, G Varoquaux, A Gramfort, V Michel, B Thirion, O Grisel, M Blondel, J. Mach. Learn. Res. 12Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825-2830.

On the limited memory BFGS method for large scale optimization. D C Liu, J Nocedal, 10.1007/BF01589116Math. Program. 45Liu, D.C.; Nocedal, J. On the limited memory BFGS method for large scale optimization. Math. Program. 1989, 45, 503-528. [CrossRef]

A method for stochastic optimization. D P Kingma, J L Ba, Adam, Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning Representations. the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning RepresentationsSan Diego, CA, USAICLRKingma, D.P.; Ba, J.L. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning Representations; ICLR: San Diego, CA, USA, 2015.

. H Robbins, S Monro, 10.1214/aoms/1177729586A Stochastic Approximation Method. Ann. Math. Stat. 22Robbins, H.; Monro, S. A Stochastic Approximation Method. Ann. Math. Stat. 1951, 22, 400-407. [CrossRef]

Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. R H R Hahnioser, R Sarpeshkar, M A Mahowald, R J Douglas, H S Seung, 10.1038/35016072Nature. 405Hahnioser, R.H.R.; Sarpeshkar, R.; Mahowald, M.A.; Douglas, R.J.; Seung, H.S. Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. Nature 2000, 405, 947-951. [CrossRef]

Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning. G Lemaitre, F Nogueira, C K Aridas, J. Mach. Learn. Res. 18Lemaitre, G.; Nogueira, F.; Aridas, C.K. Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning. J. Mach. Learn. Res. 2017, 18, 1-5.

A combined transmembrane topology and signal peptide prediction method. L Käll, A Krogh, E L L Sonnhammer, 10.1016/j.jmb.2004.03.016J. Mol. Biol. 338Käll, L.; Krogh, A.; Sonnhammer, E.L.L. A combined transmembrane topology and signal peptide prediction method. J. Mol. Biol. 2004, 338, 1027-1036. [CrossRef]

Detecting protein sequence conservation via metric embeddings. E Halperin, J Buhler, R Karp, R Krauthgamer, B Westover, 10.1093/bioinformatics/btg1016Bioinformatics. 19Halperin, E.; Buhler, J.; Karp, R.; Krauthgamer, R.; Westover, B. Detecting protein sequence conservation via metric embeddings. Bioinformatics 2003, 19, 122-129. [CrossRef]

RBLOSUM performs better than CorBLOSUM with lesser error per query. R Govindarajan, B C Leela, A S Nair, 10.1186/s13104-018-3415-5BMC Res. Notes. 11PubMedGovindarajan, R.; Leela, B.C.; Nair, A.S. RBLOSUM performs better than CorBLOSUM with lesser error per query. BMC Res. Notes 2018, 11, 328. [CrossRef] [PubMed]

BLOSUM62 miscalculations improve search performance. M P Styczynski, K L Jensen, I Rigoutsos, G Stephanopoulos, 10.1038/nbt0308-274Nat. Biotechnol. 26PubMedStyczynski, M.P.; Jensen, K.L.; Rigoutsos, I.; Stephanopoulos, G. BLOSUM62 miscalculations improve search performance. Nat. Biotechnol. 2008, 26, 274-275. [CrossRef] [PubMed]

Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. P J Rousseeuw, 10.1016/0377-0427(87)90125-7J. Comput. Appl. Math. 20Rousseeuw, P.J. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 1987, 20, 53-65. [CrossRef]

Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. J B Kruskal, 10.1007/BF02289565Psychometrika. 29Kruskal, J.B. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 1964, 29, 1-27. [CrossRef]

A Sequence Logo Generator. G E Crooks, G Hon, J.-M Chandonia, S E Brenner, Weblogo, 10.1101/gr.849004Genome Res. 14Crooks, G.E.; Hon, G.; Chandonia, J.-M.; Brenner, S.E. WebLogo: A Sequence Logo Generator. Genome Res. 2004, 14, 1188-1190. [CrossRef]

The PyMOL Molecular Graphics System, Version 2.2.3. L L C Schrödinger, 10Schrödinger, L.L.C. The PyMOL Molecular Graphics System, Version 2.2.3. Available online: https: //pymol.org/2/ (accessed on 10 November 2019).

Matplotlib: A 2D graphics environment. J D Hunter, 10.1109/MCSE.2007.55Comput. Sci. Eng. 9Hunter, J.D. Matplotlib: A 2D graphics environment. Comput. Sci. Eng. 2007, 9, 99-104. [CrossRef]

Structural diversity of leucine-rich repeat proteins. A V Kajava, 10.1006/jmbi.1998.1643J. Mol. Biol. 277Kajava, A.V. Structural diversity of leucine-rich repeat proteins. J. Mol. Biol. 1998, 277, 519-527. [CrossRef]

Modern Multidimensional Scaling. I Borg, P J Groenen, SpringerBerlin, GermanyMDS Models and Measures of FitBorg, I.; Groenen, P.J.F. Modern Multidimensional Scaling, 2nd ed.; Chapter: MDS Models and Measures of Fit; Springer: Berlin, Germany, 2005; pp. 37-61.

The relationship between the L1 and L2 domains of the insulin and epidermal growth factor receptors and leucine-rich repeat modules. C W Ward, T P Garrett, 10.1186/1471-2105-2-4BMC Bioinform. 2001, 2, 4. [CrossRefWard, C.W.; Garrett, T.P.J. The relationship between the L1 and L2 domains of the insulin and epidermal growth factor receptors and leucine-rich repeat modules. BMC Bioinform. 2001, 2, 4. [CrossRef]

The leucine-rich repeat domain in plant innate immunity: A wealth of possibilities. M Padmanabhan, P Cournoyer, S P Dinesh-Kumar, 10.1111/j.1462-5822.2008.01260.xCell. Microbiol. 11Padmanabhan, M.; Cournoyer, P.; Dinesh-Kumar, S.P. The leucine-rich repeat domain in plant innate immunity: A wealth of possibilities. Cell. Microbiol. 2009, 11, 191-198. [CrossRef]

Plant immunity: Towards an integrated view of plantĝ€ pathogen interactions. P N Dodds, J P Rathjen, 10.1038/nrg2812Nat. Rev. Genet. 11Dodds, P.N.; Rathjen, J.P. Plant immunity: Towards an integrated view of plantĝ€ pathogen interactions. Nat. Rev. Genet. 2010, 11, 539-548. [CrossRef]

Co-evolutionary interactions between host resistance and pathogen effector genes in flax rust disease. M Ravensdale, A Nemri, P H Thrall, J G Ellis, P N Dodds, 10.1111/j.1364-3703.2010.00657.xMol. Plant Pathol. 12Ravensdale, M.; Nemri, A.; Thrall, P.H.; Ellis, J.G.; Dodds, P.N. Co-evolutionary interactions between host resistance and pathogen effector genes in flax rust disease. Mol. Plant Pathol. 2011, 12, 93-102. [CrossRef]

Function of Nod-like receptors in microbial recognition and host defense. L Franchi, N Warner, K Viani, G Nuñez, 10.1111/j.1600-065X.2008.00734.xImmunol. Rev. 227Franchi, L.; Warner, N.; Viani, K.; Nuñez, G. Function of Nod-like receptors in microbial recognition and host defense. Immunol. Rev. 2009, 227, 106-128. [CrossRef]

Regulation and evolution of NLR genes: A close interconnection for plant immunity. G M Borrelli, E Mazzucotelli, D Marone, C Crosatti, V Michelotti, G Valè, A M Mastrangelo, 10.3390/ijms19061662Int. J. Mol. Sci. Borrelli, G.M.; Mazzucotelli, E.; Marone, D.; Crosatti, C.; Michelotti, V.; Valè, G.; Mastrangelo, A.M. Regulation and evolution of NLR genes: A close interconnection for plant immunity. Int. J. Mol. Sci. 2018, 19, 1662. [CrossRef]

Molecular genetic evidence for the role of SGT1 in the intramolecular complementation of Bs2 protein activity in Nicotiana benthamiana. R T Leister, D Dahlbeck, B Day, Y Li, O Chesnokova, B J Staskawicz, 10.1105/tpc.104.029637Plant Cell. 17Leister, R.T.; Dahlbeck, D.; Day, B.; Li, Y.; Chesnokova, O.; Staskawicz, B.J. Molecular genetic evidence for the role of SGT1 in the intramolecular complementation of Bs2 protein activity in Nicotiana benthamiana. Plant Cell 2005, 17, 1268-1278. [CrossRef]

The Arabidopsis ZED1 pseudokinase is required for ZAR1-mediated immunity induced by the Pseudomonas syringae type III effector HopZ1a. J D Lewis, A H Lee, .-Y Hassan, J A Wan, J Hurley, B Jhingree, J R Wang, P W Lo, T Youn, J.-Y Guttman, D S , 10.1073/pnas.1315520110Proc. Natl. Acad. Sci. Natl. Acad. SciUSA110Lewis, J.D.; Lee, A.H.-Y.; Hassan, J.A.; Wan, J.; Hurley, B.; Jhingree, J.R.; Wang, P.W.; Lo, T.; Youn, J.-Y.; Guttman, D.S.; et al. The Arabidopsis ZED1 pseudokinase is required for ZAR1-mediated immunity induced by the Pseudomonas syringae type III effector HopZ1a. Proc. Natl. Acad. Sci. USA 2013, 110, 18722-18727. [CrossRef]

Elicitor-mediated oligomerization of the tobacco N disease resistance protein. P Mestre, D C Baulcombe, 10.1105/tpc.105.037234Plant Cell. 18Mestre, P.; Baulcombe, D.C. Elicitor-mediated oligomerization of the tobacco N disease resistance protein. Plant Cell 2006, 18, 491-501. [CrossRef]

Protein-protein interactions in the RPS4/RRS1 immune receptor complex. S U Huh, V Cevik, P Ding, Z Duxbury, Y Ma, L Tomlinson, P F Sarris, J D G Jones, 10.1371/journal.ppat.1006376PLoS Pathog. 13Huh, S.U.; Cevik, V.; Ding, P.; Duxbury, Z.; Ma, Y.; Tomlinson, L.; Sarris, P.F.; Jones, J.D.G. Protein-protein interactions in the RPS4/RRS1 immune receptor complex. PLoS Pathog. 2017, 13, e1006376. [CrossRef]

Crystal structure of NLRC4 reveals its autoinhibition mechanism. Z Hu, C Yan, P Liu, Z Huang, R Ma, C Zhang, R Wang, Y Zhang, F Martinon, D Miao, 10.1126/science.1236381Science. 341Hu, Z.; Yan, C.; Liu, P.; Huang, Z.; Ma, R.; Zhang, C.; Wang, R.; Zhang, Y.; Martinon, F.; Miao, D.; et al. Crystal structure of NLRC4 reveals its autoinhibition mechanism. Science 2013, 341, 172-175. [CrossRef]

Structural basis for flg22-induced activation of the Arabidopsis FLS2-BAK1 immune complex. Y Sun, L Li, A P Macho, Z Han, Z Hu, C Zipfel, J.-M Zhou, J Chai, 10.1126/science.1243825Science. 342Sun, Y.; Li, L.; Macho, A.P.; Han, Z.; Hu, Z.; Zipfel, C.; Zhou, J.-M.; Chai, J. Structural basis for flg22-induced activation of the Arabidopsis FLS2-BAK1 immune complex. Science 2013, 342, 624-628. [CrossRef]

Crystal structure of human toll-like receptor 3. J Choe, M S Kelker, I A Wilson, 10.1126/science.1115253Science. 22Choe, J.; Kelker, M.S.; Wilson, I.A. Crystal structure of human toll-like receptor 3. Science 2005, 22, 581-585. [CrossRef]

The structure of Bacillus subtilis pectate lyase in complex with calcium. R Pickersgill, J Jenkins, G Harris, W Nasser, J Robert-Baudouy, 10.1038/nsb1094-717Nat. Struct. Biol. 1Pickersgill, R.; Jenkins, J.; Harris, G.; Nasser, W.; Robert-Baudouy, J. The structure of Bacillus subtilis pectate lyase in complex with calcium. Nat. Struct. Biol. 1994, 1, 717-723. [CrossRef]

Crystal structure and catalytic mechanism of PglD from Campylobacter jejuni. N B Olivier, B Imperiali, 10.1074/jbc.M801207200J. Biol. Chem. 283Olivier, N.B.; Imperiali, B. Crystal structure and catalytic mechanism of PglD from Campylobacter jejuni. J. Biol. Chem. 2008, 283, 27937-27946. [CrossRef]

Three-dimensional structure of the armadillo repeat region of β-catenin. A H Huber, W J Nelson, W I Weis, 10.1016/S0092-8674(00)80352-9Cell. 90Huber, A.H.; Nelson, W.J.; Weis, W.I. Three-dimensional structure of the armadillo repeat region of β-catenin. Cell 1997, 90, 871-882. [CrossRef]

. N Takahashi, S Hamada-Nakahara, Y Itoh, K Takemura, A Shimada, Y Ueda, M Kitamata, R Matsuoka, K Hanawa-Suetsugu, Y Senju, 10.1038/ncomms5994Nat. Commun. 5et al. TRPV4 channel activity is modulated by direct interaction of the ankyrin domain to PI(4,5)P 2Takahashi, N.; Hamada-Nakahara, S.; Itoh, Y.; Takemura, K.; Shimada, A.; Ueda, Y.; Kitamata, M.; Matsuoka, R.; Hanawa-Suetsugu, K.; Senju, Y.; et al. TRPV4 channel activity is modulated by direct interaction of the ankyrin domain to PI(4,5)P 2 . Nat. Commun. 2014, 5, 4994. [CrossRef]

This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. © 2020 by the authors. Licensee MDPI. Basel, Switzerland© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

Leucine-rich-repeats (LRRs) belong to an archaic procaryal protein architecture that is widely involved in protein-protein interactions. In eukaryotes, LRR domains developed into key recognition modules in many innate immune receptor classes. Due to the high sequence variability imposed by recognition specificity, precise repeat delineation is often difficult especially in plant NOD-like Receptors (NLRs) notorious for showing far larger irregularities. To address this problem, we introduce here LRRpredictor, a method based on an ensemble of estimators designed to better identify LRR motifs in general but particularly adapted for handling more irregular LRR environments, thus allowing to compensate for the scarcity of structural data on NLR proteins. The extrapolation capacity tested on a set of annotated LRR domains from six immune receptor classes shows the ability of LRRpredictor to recover all previously defined specific motif consensuses and to extend the LRR motif coverage over annotated LRR domains. This analysis confirms the increased variability of LRR motifs in plant and vertebrate NLRs when compared to extracellular receptors, consistent with previous studies. Hence, LRRpredictor is able to provide novel insights into the diversification of LRR domains and a robust support for structure-informed analyses of LRRs in immune receptor functioning.Genes 2020, 11, 286 2 of 26 LRRK2 kinase enzyme, lead to Parkinson's disease and other associated inflammatory diseases[5,6], whereas mutations in leucine-rich proteoglycans have been previously shown to be involved in osteoarthritis[7], and last but not least PRELP mutations might have a role in Hutchinson-Gilford, an accelerated progeroid syndrome characterized by premature aging[8]. Hence, understanding the structural aspects of binding properties and specificities of LRR domains opens wide possibilities for receptor engineering with vast implications not only for improved crop resistance to plant diseases, but also for a wide range of medical applications.In innate immunity, LRR modules are found in various domain organizations in many receptor classes such as plant receptor-like kinases (RLK), receptor-like proteins (RLP), NOD-like receptors (NLR), or metazoan NLR and Toll-like receptors (TLR). In plant basal immunity, LRR N-terminal domains face the extracellular environment and are found in either receptor-like kinases (RLK) or receptor-like proteins (RLPs) depending on the presence or absence of a C-terminal kinase domain on the cytosolic side of the receptor. By contrast, LRRs constitute the C-terminal domains of intracellular NOD-like receptors (NLR), also known as resistance (R) proteins, and face the cytosolic environment to mediate resistance against specific pathogens. Depending on their N-terminal domain, which is either a coiled-coil (CC) or a toll-like receptor domain (TIR), R proteins fall into two main NLR classes: the CNL and TNL receptors, respectively[9]. Both these classes contain however a central nucleotide binding domain (NBS) which acts as a 'switch' that changes its conformation upon ADP/ATP binding [9,10].Metazoan NLRs show a similar organization with plant NLRs. They encode a variety of N-terminal 'sensors' (caspase activation and recruitment domains-CARD, baculovirus inhibitor of apoptosis repeat-BIR, etc.), the central 'switch' STAND domain (signal transduction ATPases with numerous domains) -NBS/NACHT domain (NAIP (neuronal apoptosis inhibitory protein), CIITA (MHC class II transcription activator), HET-E (incompatibility locus protein from Podospora anserina) and TP1(telomerase-associated protein)) and the LRR domain at the C-terminal end. Last but not least, we mention here the metazoan toll-like receptors (TLRs) that have an extracellular LRR sensor domain as seen in the RLK/RLP case and a TIR domain on the cytosolic side involved in signal transduction[11].From a structural point of view LRR domains have a solenoidal 'horseshoe' like 3D architecture composed of a variable number of repeats varying each from ≈15 to ≈30 amino acids in length. Repeats are held together through a network of hydrogen bonds which forms a beta sheet located on the ventral side of the 'horseshoe'. This is generated by a conserved sequence pattern named the LRR motif that in its minimal form is of the type 'LxxLxL' where L is generally leucine and to a lesser degree other hydrophobic amino acids[12]. Comprehensive sequence analysis of LRR immune receptors resulted in several classifications of LRR domains showing preferred amino acid conservation outside the minimal motif such as the two type classification proposed by Matsushima et al. [13]  for TLR receptors or the seven type classification proposed by Kobe and Kajava [14]  for all known LRR domains across all Kingdoms. However, exceptions to such rules are frequent as revealed by the Hidden Markov Model approach carried out by Ng et al. [15]. This highlighted the fact that most of the analyzed classes of human proteins containing LRR domains also display many irregular motifs alongside repeats showing the well-defined class specific motif[15].While the above mentioned receptor classes were shown to present LRR irregularities[15], studies on plant NLR proteins such as Lr10 and Pm3 from wheat, Rx1 and Gpa2 from potato, or ZAR1 from Arabidopsis show that their LRR domains have a far more variable and irregular structure than their extracellular counterparts[16][17][18][19][20][21][22]. These factors combined contribute to the challenge for the accurate prediction of LRR motifs in plant NLRs.A proper annotation of each LRR motif in a given LRR domain is instrumental in generating an accurate 3D model[12,23]and by this in properly defining the domain surface and identifying potential protein-protein interaction interfaces. An illustrative example is the conservation mapping performed by Helft et al. in 2011, which was used to identify new interaction partners of plant RLPs and RLKs by studying conserved 3D relationships among amino acids inferred from annotation of LRR repeats[24].
Eliza C Martin eliza.martin@biochim.roe.c.m. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania
 C A Octavina  Sukarta 
Laboratory of Nematology
Wageningen University and Research
6700ESWageningenThe Netherlands
 Laurentiu Spiridon laurentiu.spiridon@biochim.rol.s. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania
 Laurentiu G Grigore 
Space Comp SRL
041512BucharestRomania
 Vlad Constantinescu vlad.ion.constantinescu@gmail.comv.c. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania
 Robi Tacutu robi.tacutu@gmail.comr.t. 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania
 Aska Goverse 
Laboratory of Nematology
Wageningen University and Research
6700ESWageningenThe Netherlands
 Andrei-Jose Petrescu 
Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania

Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania Laboratory of Nematology
Wageningen University and Research
6700ESWageningenThe Netherlands Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania Space Comp SRL
041512BucharestRomania Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania Laboratory of Nematology
Wageningen University and Research
6700ESWageningenThe Netherlands Department of Bioinformatics and Structural Biochemistry
Institute of Biochemistry of the Romanian Academy
Splaiul Independentei 296060031BucharestRomania
P Enkhbayar,  M Kamiya,  M Osaki,  T Matsumoto,  N Matsushima,  R F Warren,  A Henk,  P Mowery,  E Holub,  R W Innes,  Y Jia,  S A Mcadams,  G T Bryan,  H P Hershey,  B Valent,  F Moghaddas,  P Zeng,  Y Zhang,  H Schützle,  S Brenner,  S R Hofmann,  R Berner,  Y Zhao,  B Lu,  X Chen,  C Paisán-Ruíz,  S Jain,  E W Evans,  W P Gilks,  J Simón,  M Van Der Brug,  A L De Munain,  S Aparicio,  A M Gil,  N Khan,  A Zimprich,  S Biskup,  P Leitner,  P Lichtner,  M Farrer,  S Lincoln,  J Kachergus,  M Hulihan,  R J Uitti,  D B Calne,  G X Ni,  Z Li,  Y Z Zhou,  M Lewis,  Collagen Prelp,  Hutchinson-Gilford Progeria,  O C A Sukarta,  E J Slootweg,  A Goverse,  J M Urbach,  F M Ausubel,  N Matsushima,  H Miyashita,  P Enkhbayar,  R H Kretsinger,  A V Kajava,  B Kobe,  N Matsushima,  T Tanaka,  P Enkhbayar,  T Mikami,  M Taga,  K Yamada,  Y Kuroki,  B Kobe,  A V Kajava,  A C Y Ng,  J M Eisenberg,  R J W Heath,  A Huett,  C M Robinson,  G J Nau,  R J Xavier,  H Sela,  L N Spiridon,  A J Petrescu,  M Akerman,  Y Mandel-Gutfreund,  E Nevo,  C Loutre,  B Keller,  A H Schulman,  T Fahima,  E J Slootweg,  L N Spiridon,  J Roosien,  P Butterbach,  R Pomp,  L Westerhof,  R Wilbers,  E Bakker,  J Bakker,  A J Petrescu,  H Sela,  L N Spiridon,  H Ashkenazi,  N K Bhullar,  S Brunner,  A.-J Petrescu,  T Fahima,  B Keller,  T Jordan,  J Rajaraman,  D Douchkov,  G Hensel,  F L Stefanato,  A Gordon,  N Ereful,  O F Caldararu,  A J Petrescu,  J Kumlehn,  L A Boyd,  M Baudin,  K J Schreiber,  E C Martin,  A J Petrescu,  J D Lewis,  J Wang,  M Hu,  J Wang,  J Qi,  Z Han,  G Wang,  Y Qi,  H.-W Wang,  J.-M Zhou,  J Chai,  J Wang,  J Wang,  M Hu,  S Wu,  J Qi,  G Wang,  Z Han,  Y Qi,  N Gao,  H W Wang,  A V Kajava,  G Vassart,  S J Wodak,  L Helft,  V Reddy,  X Chen,  T Koller,  L Federici,  J Fernández-Recio,  R Gupta,  A Bent,  Y Gao,  W Wang,  T Zhang,  Z Gong,  H Zhao,  G Z Han,  V Offord,  D Werling,  Lrrfinder2,  A Bej,  B R Sahoo,  B Swain,  M Basu,  P Jayasankar,  M Samanta,  N L Dawson,  T E Lewis,  S Das,  J G Lees,  D Lee,  P Ashford,  C A Orengo,  I Sillitoe,  S El-Gebali,  J Mistry,  A Bateman,  S R Eddy,  A Luciani,  S C Potter,  M Qureshi,  L J Richardson,  G A Salazar,  A Smart,  A L Mitchell,  T K Attwood,  P C Babbitt,  M Blum,  P Bork,  A Bridge,  S D Brown,  H Y Chang,  S El-Gebali,  M I Fraser,  G Wang,  R L Dunbrack,  J A Capra,  M Singh,  J Huerta-Cepas,  F Serra,  P Bork,  S Wang,  W Li,  S Liu,  J Xu,  S Wang,  S Sun,  J Xu,  Springer,  S Wang,  J Ma,  J Xu,  Aucpred,  S Wang,  J Peng,  J Ma,  J Xu,  M Remmert,  A Biegert,  A Hauser,  J Söding,  Hhblits,  M Steinegger,  M Meier,  M Mirdita,  H Vöhringer,  S J Haunsberger,  J Söding,  C Cortes,  V Vapnik,  S K Pal,  S Mitra,  Multilayer Perceptron,  F Rosenblatt,  Y Freund,  R E Schapire,  H He,  Y Bai,  E A Garcia,  S Li,  Adasyn,  H Han,  W.-Y Wang,  B.-H Mao,  N V Chawla,  K W Bowyer,  L O Hall,  W P Kegelmeyer,  Smote,  H M Nguyen,  E W Cooper,  K Kamei,  G E Batista,  A L C Bazzan,  M C Monard,  G E Batista,  R C Prati,  M C Monard,  F Pedregosa,  G Varoquaux,  A Gramfort,  V Michel,  B Thirion,  O Grisel,  M Blondel,  D C Liu,  J Nocedal,  D P Kingma,  J L Ba,  Adam,  H Robbins,  S Monro,  R H R Hahnioser,  R Sarpeshkar,  M A Mahowald,  R J Douglas,  H S Seung,  G Lemaitre,  F Nogueira,  C K Aridas,  L Käll,  A Krogh,  E L L Sonnhammer,  E Halperin,  J Buhler,  R Karp,  R Krauthgamer,  B Westover,  R Govindarajan,  B C Leela,  A S Nair,  M P Styczynski,  K L Jensen,  I Rigoutsos,  G Stephanopoulos,  P J Rousseeuw,  J B Kruskal,  G E Crooks,  G Hon,  J.-M Chandonia,  S E Brenner,  Weblogo,  L L C Schrödinger,  J D Hunter,  A V Kajava,  I Borg,  P J Groenen,  C W Ward,  T P Garrett,  M Padmanabhan,  P Cournoyer,  S P Dinesh-Kumar,  P N Dodds,  J P Rathjen,  M Ravensdale,  A Nemri,  P H Thrall,  J G Ellis,  P N Dodds,  L Franchi,  N Warner,  K Viani,  G Nuñez,  G M Borrelli,  E Mazzucotelli,  D Marone,  C Crosatti,  V Michelotti,  G Valè,  A M Mastrangelo,  R T Leister,  D Dahlbeck,  B Day,  Y Li,  O Chesnokova,  B J Staskawicz,  J D Lewis,  A H Lee,  .-Y Hassan,  J A Wan,  J Hurley,  B Jhingree,  J R Wang,  P W Lo,  T Youn,  J.-Y Guttman,  D S ,  P Mestre,  D C Baulcombe,  S U Huh,  V Cevik,  P Ding,  Z Duxbury,  Y Ma,  L Tomlinson,  P F Sarris,  J D G Jones,  Z Hu,  C Yan,  P Liu,  Z Huang,  R Ma,  C Zhang,  R Wang,  Y Zhang,  F Martinon,  D Miao,  Y Sun,  L Li,  A P Macho,  Z Han,  Z Hu,  C Zipfel,  J.-M Zhou,  J Chai,  J Choe,  M S Kelker,  I A Wilson,  R Pickersgill,  J Jenkins,  G Harris,  W Nasser,  J Robert-Baudouy,  N B Olivier,  B Imperiali,  A H Huber,  W J Nelson,  W I Weis,  N Takahashi,  S Hamada-Nakahara,  Y Itoh,  K Takemura,  A Shimada,  Y Ueda,  M Kitamata,  R Matsuoka,  K Hanawa-Suetsugu,  Y Senju, 
P M M T N R F A P E R W Y S A G T H P B F P Y H S S R R Y B X C S E W W P J M A L S A M N A S P P M S J M R J D B G X Z Y Z M Collagen O C A E J A J M F M N H P R H A V B N T P T M K Y B A V A C Y J M R J W A C M G J R J H L N A J M Y E C B A H T E J L N J P R L R E J A J H L N H N K S A.-J T B T J D G F L A N O F A J J L A M K J E C A J J D J M J J Z G Y H.-W J.-M J J J M S J G Z Y N H W A V G S J L V X T L J R A Y W T Z H G Z V D A B R B M P M N L T E S J G D P C A I S J A S R A S C M L J G A A A L T K P C M P A S D H Y S M I G R L J A M J F P S W S J S S J S J J S J J J M A A J M M M H S J J C V S K S F Y R E H Y E A S H W.-Y B.-H N V K W L O W P H M E W K G E A L C M C G E R C M C F G A V B O M D C J D P J L H S R H R R M A R J H S G F C K L A E L L E J R R B R B C A S M P K L I G P J J B G E G J.-M S E L L C J D A V I P J C W T P M P S P P N J P M A P H J G P N L N K G G M E D C V G A M R T D B Y O B J J D A H .-Y J A J B J R P W T J.-Y D S P D C S U V P Z Y L P F J D G Z C P Z R C R Y F D Y L A P Z Z C J.-M J J M S I A R J G W J N B B A H W J W I N S Y K A Y M R K Y
Enkhbayar Kamiya Osaki Matsumoto Matsushima Warren Henk Mowery Holub Innes Jia Mcadams Bryan Hershey Valent Moghaddas Zeng Zhang Schützle Brenner Hofmann Berner Zhao Lu Chen Paisán-Ruíz Jain Evans Gilks Simón Van Der Brug De Munain Aparicio Gil Khan Zimprich Biskup Leitner Lichtner Farrer Lincoln Kachergus Hulihan Uitti Calne Ni Li Zhou Lewis Prelp Hutchinson-Gilford Progeria Sukarta Slootweg Goverse Urbach Ausubel Matsushima Miyashita Enkhbayar Kretsinger Kajava Kobe Matsushima Tanaka Enkhbayar Mikami Taga Yamada Kuroki Kobe Kajava Ng Eisenberg Heath Huett Robinson Nau Xavier Sela Spiridon Petrescu Akerman Mandel-Gutfreund Nevo Loutre Keller Schulman Fahima Slootweg Spiridon Roosien Butterbach Pomp Westerhof Wilbers Bakker Bakker Petrescu Sela Spiridon Ashkenazi Bhullar Brunner Petrescu Fahima Keller Jordan Rajaraman Douchkov Hensel Stefanato Gordon Ereful Caldararu Petrescu Kumlehn Boyd Baudin Schreiber Martin Petrescu Lewis Wang Hu Wang Qi Han Wang Qi Wang Zhou Chai Wang Wang Hu Wu Qi Wang Han Qi Gao Wang Kajava Vassart Wodak Helft Reddy Chen Koller Federici Fernández-Recio Gupta Bent Gao Wang Zhang Gong Zhao Han Offord Werling Lrrfinder2 Bej Sahoo Swain Basu Jayasankar Samanta Dawson Lewis Das Lees Lee Ashford Orengo Sillitoe El-Gebali Mistry Bateman Eddy Luciani Potter Qureshi Richardson Salazar Smart Mitchell Attwood Babbitt Blum Bork Bridge Brown Chang El-Gebali Fraser Wang Dunbrack Capra Singh Huerta-Cepas Serra Bork Wang Li Liu Xu Wang Sun Xu Springer Wang Ma Xu Aucpred Wang Peng Ma Xu Remmert Biegert Hauser Söding Hhblits Steinegger Meier Mirdita Vöhringer Haunsberger Söding Cortes Vapnik Pal Mitra Multilayer Perceptron Rosenblatt Freund Schapire He Bai Garcia Li Adasyn Han Wang Mao Chawla Bowyer Hall Kegelmeyer Smote Nguyen Cooper Kamei Batista Bazzan Monard Batista Prati Monard Pedregosa Varoquaux Gramfort Michel Thirion Grisel Blondel Liu Nocedal Kingma Ba Adam Robbins Monro Hahnioser Sarpeshkar Mahowald Douglas Seung Lemaitre Nogueira Aridas Käll Krogh Sonnhammer Halperin Buhler Karp Krauthgamer Westover Govindarajan Leela Nair Styczynski Jensen Rigoutsos Stephanopoulos Rousseeuw Kruskal Crooks Hon Chandonia Brenner Weblogo Schrödinger Hunter Kajava Borg Groenen Ward Garrett Padmanabhan Cournoyer Dinesh-Kumar Dodds Rathjen Ravensdale Nemri Thrall Ellis Dodds Franchi Warner Viani Nuñez Borrelli Mazzucotelli Marone Crosatti Michelotti Valè Mastrangelo Leister Dahlbeck Day Li Chesnokova Staskawicz Lewis Lee Hassan Wan Hurley Jhingree Wang Lo Youn Guttman Mestre Baulcombe Huh Cevik Ding Duxbury Ma Tomlinson Sarris Jones Hu Yan Liu Huang Ma Zhang Wang Zhang Martinon Miao Sun Li Macho Han Hu Zipfel Zhou Chai Choe Kelker Wilson Pickersgill Jenkins Harris Nasser Robert-Baudouy Olivier Imperiali Huber Nelson Weis Takahashi Hamada-Nakahara Itoh Takemura Shimada Ueda Kitamata Matsuoka Hanawa-Suetsugu Senju
Structural Principles of Leucine-Rich Repeat (LRR) Proteins. P Enkhbayar, M Kamiya, M Osaki, T Matsumoto, N Matsushima, 10.1002/prot.10605Proteins Struct. Funct. Bioinform. 54PubMedEnkhbayar, P.; Kamiya, M.; Osaki, M.; Matsumoto, T.; Matsushima, N. Structural Principles of Leucine-Rich Repeat (LRR) Proteins. Proteins Struct. Funct. Bioinform. 2004, 54, 394-403. [CrossRef] [PubMed] A mutation within the leucine-rich repeat domain of the arabidopsis disease resistance gene RPS5 partially suppresses multiple bacterial and downy mildew resistance genes. R F Warren, A Henk, P Mowery, E Holub, R W Innes, 10.1105/tpc.10.9.1439Plant Cell. 10PubMedWarren, R.F.; Henk, A.; Mowery, P.; Holub, E.; Innes, R.W. A mutation within the leucine-rich repeat domain of the arabidopsis disease resistance gene RPS5 partially suppresses multiple bacterial and downy mildew resistance genes. Plant Cell 1998, 10, 1439-1452. [CrossRef] [PubMed] Direct interaction of resistance gene and avirulence gene products confers rice blast resistance. Y Jia, S A Mcadams, G T Bryan, H P Hershey, B Valent, 10.1093/emboj/19.15.4004EMBO J. 19PubMedJia, Y.; McAdams, S.A.; Bryan, G.T.; Hershey, H.P.; Valent, B. Direct interaction of resistance gene and avirulence gene products confers rice blast resistance. EMBO J. 2000, 19, 4004-4014. [CrossRef] [PubMed] Autoinflammatory mutation in NLRC4 reveals a leucine-rich repeat (LRR)-LRR oligomerization interface. F Moghaddas, P Zeng, Y Zhang, H Schützle, S Brenner, S R Hofmann, R Berner, Y Zhao, B Lu, X Chen, 10.1016/j.jaci.2018.04.033J. Allergy Clin. Immunol. 142PubMedMoghaddas, F.; Zeng, P.; Zhang, Y.; Schützle, H.; Brenner, S.; Hofmann, S.R.; Berner, R.; Zhao, Y.; Lu, B.; Chen, X.; et al. Autoinflammatory mutation in NLRC4 reveals a leucine-rich repeat (LRR)-LRR oligomerization interface. J. Allergy Clin. Immunol. 2018, 142, 1956-1967.e6. [CrossRef] [PubMed] Cloning of the gene containing mutations that cause PARK8-linked Parkinson's disease. C Paisán-Ruíz, S Jain, E W Evans, W P Gilks, J Simón, M Van Der Brug, A L De Munain, S Aparicio, A M Gil, N Khan, 10.1016/j.neuron.2004.10.023Neuron. 44PubMedPaisán-Ruíz, C.; Jain, S.; Evans, E.W.; Gilks, W.P.; Simón, J.; Van Der Brug, M.; De Munain, A.L.; Aparicio, S.; Gil, A.M.; Khan, N.; et al. Cloning of the gene containing mutations that cause PARK8-linked Parkinson's disease. Neuron 2004, 44, 595-600. [CrossRef] [PubMed] Mutations in LRRK2 cause autosomal-dominant parkinsonism with pleomorphic pathology. A Zimprich, S Biskup, P Leitner, P Lichtner, M Farrer, S Lincoln, J Kachergus, M Hulihan, R J Uitti, D B Calne, 10.1016/j.neuron.2004.11.005Neuron. 44PubMedZimprich, A.; Biskup, S.; Leitner, P.; Lichtner, P.; Farrer, M.; Lincoln, S.; Kachergus, J.; Hulihan, M.; Uitti, R.J.; Calne, D.B.; et al. Mutations in LRRK2 cause autosomal-dominant parkinsonism with pleomorphic pathology. Neuron 2004, 44, 601-607. [CrossRef] [PubMed] The role of small leucine-rich proteoglycans in osteoarthritis pathogenesis. G X Ni, Z Li, Y Z Zhou, 10.1016/j.joca.2014.04.026Osteoarthritis Cartilage. 22Ni, G.X.; Li, Z.; Zhou, Y.Z. The role of small leucine-rich proteoglycans in osteoarthritis pathogenesis. Osteoarthritis Cartilage. 2014, 22, 896-903. [CrossRef] . M Lewis, Collagen Prelp, Hutchinson-Gilford Progeria, 10.1016/S1568-1637(02)00044-2Ageing Res. Rev. 2Lewis, M. PRELP, collagen, and a theory of Hutchinson-Gilford progeria. Ageing Res. Rev. 2003, 2, 95-105. [CrossRef] Structure-informed insights for NLR functioning in plant immunity. O C A Sukarta, E J Slootweg, A Goverse, 10.1016/j.semcdb.2016.05.012Semin. Cell Dev. Biol. 56Sukarta, O.C.A.; Slootweg, E.J.; Goverse, A. Structure-informed insights for NLR functioning in plant immunity. Semin. Cell Dev. Biol. 2016, 56, 134-149. [CrossRef] The NBS-LRR architectures of plant R-proteins and metazoan NLRs evolved in independent events. J M Urbach, F M Ausubel, 10.1073/pnas.1619730114Proc. Natl. Acad. Sci. Natl. Acad. SciUSA114Urbach, J.M.; Ausubel, F.M. The NBS-LRR architectures of plant R-proteins and metazoan NLRs evolved in independent events. Proc. Natl. Acad. Sci. USA 2017, 114, 1063-1068. [CrossRef] Comparative Geometrical Analysis of Leucine-Rich Repeat Structures in the Nod-Like and Toll-Like Receptors in Vertebrate Innate Immunity. N Matsushima, H Miyashita, P Enkhbayar, R H Kretsinger, 10.3390/biom5031955Biomolecules. 5PubMedMatsushima, N.; Miyashita, H.; Enkhbayar, P.; Kretsinger, R.H. Comparative Geometrical Analysis of Leucine-Rich Repeat Structures in the Nod-Like and Toll-Like Receptors in Vertebrate Innate Immunity. Biomolecules 2015, 5, 1955-1978. [CrossRef] [PubMed] Assessment of the ability to model proteins with leucine-rich repeats in light of the latest structural information. A V Kajava, B Kobe, 10.1110/ps.4010102Protein Sci. 11Kajava, A.V.; Kobe, B. Assessment of the ability to model proteins with leucine-rich repeats in light of the latest structural information. Protein Sci. 2002, 11, 1082-1090. [CrossRef] Comparative sequence analysis of leucine-rich repeats (LRRs) within vertebrate toll-like receptors. N Matsushima, T Tanaka, P Enkhbayar, T Mikami, M Taga, K Yamada, Y Kuroki, 10.1186/1471-2164-8-124BMC Genom. 8PubMedMatsushima, N.; Tanaka, T.; Enkhbayar, P.; Mikami, T.; Taga, M.; Yamada, K.; Kuroki, Y. Comparative sequence analysis of leucine-rich repeats (LRRs) within vertebrate toll-like receptors. BMC Genom. 2007, 8, 124. [CrossRef] [PubMed] The leucine-rich repeat as a protein recognition motif. B Kobe, A V Kajava, 10.1016/S0959-440X(01)00266-4Curr. Opin. Struct. Biol. 11Kobe, B.; Kajava, A.V. The leucine-rich repeat as a protein recognition motif. Curr. Opin. Struct. Biol. 2001, 11, 725-732. [CrossRef] Human leucine-rich repeat proteins: A genome-wide bioinformatic categorization and functional analysis in innate immunity. A C Y Ng, J M Eisenberg, R J W Heath, A Huett, C M Robinson, G J Nau, R J Xavier, 10.1073/pnas.1000093107Proc. Natl. Acad. Sci. Natl. Acad. SciUSA108PubMedNg, A.C.Y.; Eisenberg, J.M.; Heath, R.J.W.; Huett, A.; Robinson, C.M.; Nau, G.J.; Xavier, R.J. Human leucine-rich repeat proteins: A genome-wide bioinformatic categorization and functional analysis in innate immunity. Proc. Natl. Acad. Sci. USA 2011, 108, 4631-4638. [CrossRef] [PubMed] Ancient diversity of splicing motifs and protein surfaces in the wild emmer wheat (Triticum dicoccoides) LR10 coiled coil (CC) and leucine-rich repeat (LRR) domains. H Sela, L N Spiridon, A J Petrescu, M Akerman, Y Mandel-Gutfreund, E Nevo, C Loutre, B Keller, A H Schulman, T Fahima, 10.1111/j.1364-3703.2011.00744.xMol. Plant Pathol. 13Sela, H.; Spiridon, L.N.; Petrescu, A.J.; Akerman, M.; Mandel-Gutfreund, Y.; Nevo, E.; Loutre, C.; Keller, B.; Schulman, A.H.; Fahima, T. Ancient diversity of splicing motifs and protein surfaces in the wild emmer wheat (Triticum dicoccoides) LR10 coiled coil (CC) and leucine-rich repeat (LRR) domains. Mol. Plant Pathol. 2012, 13, 276-287. [CrossRef] Structural determinants at the interface of the ARC2 and leucine-rich repeat domains control the activation of the plant immune receptors Rx1 and Gpa2. E J Slootweg, L N Spiridon, J Roosien, P Butterbach, R Pomp, L Westerhof, R Wilbers, E Bakker, J Bakker, A J Petrescu, 10.1104/pp.113.218842Plant Physiol. 162Slootweg, E.J.; Spiridon, L.N.; Roosien, J.; Butterbach, P.; Pomp, R.; Westerhof, L.; Wilbers, R.; Bakker, E.; Bakker, J.; Petrescu, A.J.; et al. Structural determinants at the interface of the ARC2 and leucine-rich repeat domains control the activation of the plant immune receptors Rx1 and Gpa2. Plant Physiol. 2013, 162, 1510-1528. [CrossRef] Three-Dimensional Modeling and Diversity Analysis Reveals Distinct AVR Recognition Sites and Evolutionary Pathways in Wild and Domesticated Wheat Pm3 R Genes. H Sela, L N Spiridon, H Ashkenazi, N K Bhullar, S Brunner, A.-J Petrescu, T Fahima, B Keller, T Jordan, 10.1094/MPMI-01-14-0009-RMol. Plant-Microbe Interact. 27Sela, H.; Spiridon, L.N.; Ashkenazi, H.; Bhullar, N.K.; Brunner, S.; Petrescu, A.-J.; Fahima, T.; Keller, B.; Jordan, T. Three-Dimensional Modeling and Diversity Analysis Reveals Distinct AVR Recognition Sites and Evolutionary Pathways in Wild and Domesticated Wheat Pm3 R Genes. Mol. Plant-Microbe Interact. 2014, 27, 835-845. [CrossRef] An LRR/Malectin receptor-like kinase mediates resistance to non-adapted and adapted powdery mildew fungi in barley and wheat. J Rajaraman, D Douchkov, G Hensel, F L Stefanato, A Gordon, N Ereful, O F Caldararu, A J Petrescu, J Kumlehn, L A Boyd, 10.3389/fpls.2016.01836Front. Plant Sci. 7Rajaraman, J.; Douchkov, D.; Hensel, G.; Stefanato, F.L.; Gordon, A.; Ereful, N.; Caldararu, O.F.; Petrescu, A.J.; Kumlehn, J.; Boyd, L.A.; et al. An LRR/Malectin receptor-like kinase mediates resistance to non-adapted and adapted powdery mildew fungi in barley and wheat. Front. Plant Sci. 2016, 7, 1836. [CrossRef] Structure-function analysis of ZAR1 immune receptor reveals key molecular interactions for activity. M Baudin, K J Schreiber, E C Martin, A J Petrescu, J D Lewis, 10.1111/tpj.14547Plant J. 101Baudin, M.; Schreiber, K.J.; Martin, E.C.; Petrescu, A.J.; Lewis, J.D. Structure-function analysis of ZAR1 immune receptor reveals key molecular interactions for activity. Plant J 2020, 101, 352-370. [CrossRef] Reconstitution and structure of a plant NLR resistosome conferring immunity. J Wang, M Hu, J Wang, J Qi, Z Han, G Wang, Y Qi, H.-W Wang, J.-M Zhou, J Chai, 10.1126/science.aav5870Science. 364Wang, J.; Hu, M.; Wang, J.; Qi, J.; Han, Z.; Wang, G.; Qi, Y.; Wang, H.-W.; Zhou, J.-M.; Chai, J. Reconstitution and structure of a plant NLR resistosome conferring immunity. Science 2019, 364, eaav5870. [CrossRef] Ligand-triggered allosteric ADP release primes a plant NLR complex. J Wang, J Wang, M Hu, S Wu, J Qi, G Wang, Z Han, Y Qi, N Gao, H W Wang, 10.1126/science.aav5868Science. 364eaav5868. [CrossRefWang, J.; Wang, J.; Hu, M.; Wu, S.; Qi, J.; Wang, G.; Han, Z.; Qi, Y.; Gao, N.; Wang, H.W.; et al. Ligand-triggered allosteric ADP release primes a plant NLR complex. Science 2019, 364, eaav5868. [CrossRef] Modeling of the three-dimensional structure of proteins with the typical leucine-rich repeats. A V Kajava, G Vassart, S J Wodak, 10.1016/S0969-2126(01)00222-2Structure. 3Kajava, A.V.; Vassart, G.; Wodak, S.J. Modeling of the three-dimensional structure of proteins with the typical leucine-rich repeats. Structure 1995, 3, 867-877. [CrossRef] LRR conservation mapping to predict functional sites within protein leucine-rich repeat domains. L Helft, V Reddy, X Chen, T Koller, L Federici, J Fernández-Recio, R Gupta, A Bent, 10.1371/journal.pone.0021614PLoS ONE. 6Helft, L.; Reddy, V.; Chen, X.; Koller, T.; Federici, L.; Fernández-Recio, J.; Gupta, R.; Bent, A. LRR conservation mapping to predict functional sites within protein leucine-rich repeat domains. PLoS ONE 2011, 6, e21614. [CrossRef] Out of Water: The Origin and Early Diversification of Plant R-Genes. Y Gao, W Wang, T Zhang, Z Gong, H Zhao, G Z Han, 10.1104/pp.18.00185Plant Physiol. 177Gao, Y.; Wang, W.; Zhang, T.; Gong, Z.; Zhao, H.; Han, G.Z. Out of Water: The Origin and Early Diversification of Plant R-Genes. Plant Physiol. 2018, 177, 82-89. [CrossRef] 0: A webserver for the prediction of leucine-rich repeats. V Offord, D Werling, Lrrfinder2, 10.1177/1753425912465661Innate Immun. 19Offord, V.; Werling, D. LRRfinder2.0: A webserver for the prediction of leucine-rich repeats. Innate Immun. 2013, 19, 398-402. [CrossRef] LRRsearch: An asynchronous server-based application for the prediction of leucine-rich repeat motifs and an integrative database of NOD-like receptors. A Bej, B R Sahoo, B Swain, M Basu, P Jayasankar, M Samanta, 10.1016/j.compbiomed.2014.07.016Comput. Biol. Med. 53Bej, A.; Sahoo, B.R.; Swain, B.; Basu, M.; Jayasankar, P.; Samanta, M. LRRsearch: An asynchronous server-based application for the prediction of leucine-rich repeat motifs and an integrative database of NOD-like receptors. Comput. Biol. Med. 2014, 53, 164-170. [CrossRef] CATH: An expanded resource to predict protein function through structure and sequence. N L Dawson, T E Lewis, S Das, J G Lees, D Lee, P Ashford, C A Orengo, I Sillitoe, 10.1093/nar/gkw1098Nucleic Acids Res. 45Dawson, N.L.; Lewis, T.E.; Das, S.; Lees, J.G.; Lee, D.; Ashford, P.; Orengo, C.A.; Sillitoe, I. CATH: An expanded resource to predict protein function through structure and sequence. Nucleic Acids Res. 2017, 45, D289-D295. [CrossRef] The Pfam protein families database in 2019. S El-Gebali, J Mistry, A Bateman, S R Eddy, A Luciani, S C Potter, M Qureshi, L J Richardson, G A Salazar, A Smart, 10.1093/nar/gky995Nucleic Acids Res. 47El-Gebali, S.; Mistry, J.; Bateman, A.; Eddy, S.R.; Luciani, A.; Potter, S.C.; Qureshi, M.; Richardson, L.J.; Salazar, G.A.; Smart, A.; et al. The Pfam protein families database in 2019. Nucleic Acids Res. 2019, 47, D427-D432. [CrossRef] InterPro in 2019: Improving coverage, classification and access to protein sequence annotations. A L Mitchell, T K Attwood, P C Babbitt, M Blum, P Bork, A Bridge, S D Brown, H Y Chang, S El-Gebali, M I Fraser, 10.1093/nar/gky1100Nucleic Acids Res. 47Mitchell, A.L.; Attwood, T.K.; Babbitt, P.C.; Blum, M.; Bork, P.; Bridge, A.; Brown, S.D.; Chang, H.Y.; El-Gebali, S.; Fraser, M.I.; et al. InterPro in 2019: Improving coverage, classification and access to protein sequence annotations. Nucleic Acids Res. 2019, 47, D351-D360. [CrossRef] PISCES: A protein sequence culling server. G Wang, R L Dunbrack, 10.1093/bioinformatics/btg224Bioinformatics. 19Wang, G.; Dunbrack, R.L. PISCES: A protein sequence culling server. Bioinformatics 2003, 19, 1589-1591. [CrossRef] Predicting functionally important residues from sequence conservation. J A Capra, M Singh, 10.1093/bioinformatics/btm270Bioinformatics. 23Capra, J.A.; Singh, M. Predicting functionally important residues from sequence conservation. Bioinformatics 2007, 23, 1875-1882. [CrossRef] ETE 3: Reconstruction, Analysis, and Visualization of Phylogenomic Data. J Huerta-Cepas, F Serra, P Bork, 10.1093/molbev/msw046Mol. Biol. Evol. 33Huerta-Cepas, J.; Serra, F.; Bork, P. ETE 3: Reconstruction, Analysis, and Visualization of Phylogenomic Data. Mol. Biol. Evol. 2016, 33, 1635-1638. [CrossRef] RaptorX-Property: A web server for protein structure property prediction. S Wang, W Li, S Liu, J Xu, 10.1093/nar/gkw306Nucleic Acids Res. 44Wang, S.; Li, W.; Liu, S.; Xu, J. RaptorX-Property: A web server for protein structure property prediction. Nucleic Acids Res. 2016, 44, W430-W435. [CrossRef] AUC-maximized deep convolutional neural fields for protein sequence labeling. S Wang, S Sun, J Xu, Proceedings of the Lecture Notes in Computer Science. the Lecture Notes in Computer ScienceWang, S.; Sun, S.; Xu, J. AUC-maximized deep convolutional neural fields for protein sequence labeling. In Proceedings of the Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); . Springer, 9852Berlin, GermanySpringer: Berlin, Germany, 2016; Volume 9852 LNAI, pp. 1-16. Proteome-level protein disorder prediction by AUC-maximized deep convolutional neural fields. S Wang, J Ma, J Xu, Aucpred, Proceedings of the Bioinformatics. the BioinformaticsOxford, UKOxford University Press32Wang, S.; Ma, J.; Xu, J. AUCpreD: Proteome-level protein disorder prediction by AUC-maximized deep convolutional neural fields. In Proceedings of the Bioinformatics; Oxford University Press: Oxford, UK, 2016; Volume 32, pp. i672-i679. Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields. S Wang, J Peng, J Ma, J Xu, 10.1038/srep18962Sci. Rep. Wang, S.; Peng, J.; Ma, J.; Xu, J. Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields. Sci. Rep. 2016, 6, 18962. [CrossRef] Lightning-fast iterative protein sequence searching by HMM-HMM alignment. M Remmert, A Biegert, A Hauser, J Söding, Hhblits, 10.1038/nmeth.1818Nat. Methods. 9Remmert, M.; Biegert, A.; Hauser, A.; Söding, J. HHblits: Lightning-fast iterative protein sequence searching by HMM-HMM alignment. Nat. Methods 2012, 9, 173-175. [CrossRef] HH-suite3 for fast remote homology detection and deep protein annotation. M Steinegger, M Meier, M Mirdita, H Vöhringer, S J Haunsberger, J Söding, 10.1186/s12859-019-3019-7BMC Bioinform. 20Steinegger, M.; Meier, M.; Mirdita, M.; Vöhringer, H.; Haunsberger, S.J.; Söding, J. HH-suite3 for fast remote homology detection and deep protein annotation. BMC Bioinform. 2019, 20, 473. [CrossRef] Support-vector networks. C Cortes, V Vapnik, 10.1007/BF00994018Mach. Learn. 20Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273-297. [CrossRef] Fuzzy Sets, and Classification. S K Pal, S Mitra, Multilayer Perceptron, 10.1109/72.159058IEEE Trans. Neural Netw. 3Pal, S.K.; Mitra, S. Multilayer Perceptron, Fuzzy Sets, and Classification. IEEE Trans. Neural Netw. 1992, 3, 683-697. [CrossRef] The perceptron: A probabilistic model for information storage and organization in the brain. F Rosenblatt, 10.1037/h0042519Psychol. Rev. 65Rosenblatt, F. The perceptron: A probabilistic model for information storage and organization in the brain. Psychol. Rev. 1958, 65, 386-408. [CrossRef] A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. Y Freund, R E Schapire, 10.1006/jcss.1997.1504J. Comput. Syst. Sci. 55Freund, Y.; Schapire, R.E. A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. J. Comput. Syst. Sci. 1997, 55, 119-139. [CrossRef] Adaptive synthetic sampling approach for imbalanced learning. H He, Y Bai, E A Garcia, S Li, Adasyn, Proceedings of the 2008 IEEE International Joint Conference on Neural Networks. the 2008 IEEE International Joint Conference on Neural NetworksPiscataway, NJ, USAIEEEHe, H.; Bai, Y.; Garcia, E.A.; Li, S. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In Proceedings of the 2008 IEEE International Joint Conference on Neural Networks; IEEE: Piscataway, NJ, USA, 2008; pp. 1322-1328. Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning. H Han, W.-Y Wang, B.-H Mao, Springer3644Berlin/Heidelberg, GermanyHan, H.; Wang, W.-Y.; Mao, B.-H. Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning; Springer: Berlin/Heidelberg, Germany, 2005; Volume 3644. Synthetic minority over-sampling technique. N V Chawla, K W Bowyer, L O Hall, W P Kegelmeyer, Smote, 10.1613/jair.953J. Artif. Intell. Res. 16Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002, 16, 321-357. [CrossRef] Borderline Over-sampling for Imbalanced Data Classification. H M Nguyen, E W Cooper, K Kamei, Proceedings: Fifth International Workshop on Computational Intelligence & Applications. Fifth International Workshop on Computational Intelligence & ApplicationsPiscataway, NJ, USAIEEENguyen, H.M.; Cooper, E.W.; Kamei, K. Borderline Over-sampling for Imbalanced Data Classification. In Proceedings: Fifth International Workshop on Computational Intelligence & Applications; IEEE: Piscataway, NJ, USA, 2009; Volume 2009, pp. 24-29. Balancing Training Data for Automated Annotation of Keywords: A Case Study. G E Batista, A L C Bazzan, M C Monard, WOB. Porto Alegre, BrazilUFRGSBatista, G.E.; Bazzan, A.L.C.; Monard, M.C. Balancing Training Data for Automated Annotation of Keywords: A Case Study. In WOB; UFRGS: Porto Alegre, Brazil, 2003; pp. 10-18. A study of the behavior of several methods for balancing machine learning training data. G E Batista, R C Prati, M C Monard, 10.1145/1007730.1007735ACM SIGKDD Explor. Newsl. 6Batista, G.E.; Prati, R.C.; Monard, M.C. A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explor. Newsl. 2004, 6, 20-29. [CrossRef] Scikit-learn: Machine Learning in Python. F Pedregosa, G Varoquaux, A Gramfort, V Michel, B Thirion, O Grisel, M Blondel, J. Mach. Learn. Res. 12Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825-2830. On the limited memory BFGS method for large scale optimization. D C Liu, J Nocedal, 10.1007/BF01589116Math. Program. 45Liu, D.C.; Nocedal, J. On the limited memory BFGS method for large scale optimization. Math. Program. 1989, 45, 503-528. [CrossRef] A method for stochastic optimization. D P Kingma, J L Ba, Adam, Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning Representations. the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning RepresentationsSan Diego, CA, USAICLRKingma, D.P.; Ba, J.L. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning Representations; ICLR: San Diego, CA, USA, 2015. . H Robbins, S Monro, 10.1214/aoms/1177729586A Stochastic Approximation Method. Ann. Math. Stat. 22Robbins, H.; Monro, S. A Stochastic Approximation Method. Ann. Math. Stat. 1951, 22, 400-407. [CrossRef] Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. R H R Hahnioser, R Sarpeshkar, M A Mahowald, R J Douglas, H S Seung, 10.1038/35016072Nature. 405Hahnioser, R.H.R.; Sarpeshkar, R.; Mahowald, M.A.; Douglas, R.J.; Seung, H.S. Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. Nature 2000, 405, 947-951. [CrossRef] Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning. G Lemaitre, F Nogueira, C K Aridas, J. Mach. Learn. Res. 18Lemaitre, G.; Nogueira, F.; Aridas, C.K. Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning. J. Mach. Learn. Res. 2017, 18, 1-5. A combined transmembrane topology and signal peptide prediction method. L Käll, A Krogh, E L L Sonnhammer, 10.1016/j.jmb.2004.03.016J. Mol. Biol. 338Käll, L.; Krogh, A.; Sonnhammer, E.L.L. A combined transmembrane topology and signal peptide prediction method. J. Mol. Biol. 2004, 338, 1027-1036. [CrossRef] Detecting protein sequence conservation via metric embeddings. E Halperin, J Buhler, R Karp, R Krauthgamer, B Westover, 10.1093/bioinformatics/btg1016Bioinformatics. 19Halperin, E.; Buhler, J.; Karp, R.; Krauthgamer, R.; Westover, B. Detecting protein sequence conservation via metric embeddings. Bioinformatics 2003, 19, 122-129. [CrossRef] RBLOSUM performs better than CorBLOSUM with lesser error per query. R Govindarajan, B C Leela, A S Nair, 10.1186/s13104-018-3415-5BMC Res. Notes. 11PubMedGovindarajan, R.; Leela, B.C.; Nair, A.S. RBLOSUM performs better than CorBLOSUM with lesser error per query. BMC Res. Notes 2018, 11, 328. [CrossRef] [PubMed] BLOSUM62 miscalculations improve search performance. M P Styczynski, K L Jensen, I Rigoutsos, G Stephanopoulos, 10.1038/nbt0308-274Nat. Biotechnol. 26PubMedStyczynski, M.P.; Jensen, K.L.; Rigoutsos, I.; Stephanopoulos, G. BLOSUM62 miscalculations improve search performance. Nat. Biotechnol. 2008, 26, 274-275. [CrossRef] [PubMed] Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. P J Rousseeuw, 10.1016/0377-0427(87)90125-7J. Comput. Appl. Math. 20Rousseeuw, P.J. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 1987, 20, 53-65. [CrossRef] Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. J B Kruskal, 10.1007/BF02289565Psychometrika. 29Kruskal, J.B. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 1964, 29, 1-27. [CrossRef] A Sequence Logo Generator. G E Crooks, G Hon, J.-M Chandonia, S E Brenner, Weblogo, 10.1101/gr.849004Genome Res. 14Crooks, G.E.; Hon, G.; Chandonia, J.-M.; Brenner, S.E. WebLogo: A Sequence Logo Generator. Genome Res. 2004, 14, 1188-1190. [CrossRef] The PyMOL Molecular Graphics System, Version 2.2.3. L L C Schrödinger, 10Schrödinger, L.L.C. The PyMOL Molecular Graphics System, Version 2.2.3. Available online: https: //pymol.org/2/ (accessed on 10 November 2019). Matplotlib: A 2D graphics environment. J D Hunter, 10.1109/MCSE.2007.55Comput. Sci. Eng. 9Hunter, J.D. Matplotlib: A 2D graphics environment. Comput. Sci. Eng. 2007, 9, 99-104. [CrossRef] Structural diversity of leucine-rich repeat proteins. A V Kajava, 10.1006/jmbi.1998.1643J. Mol. Biol. 277Kajava, A.V. Structural diversity of leucine-rich repeat proteins. J. Mol. Biol. 1998, 277, 519-527. [CrossRef] Modern Multidimensional Scaling. I Borg, P J Groenen, SpringerBerlin, GermanyMDS Models and Measures of FitBorg, I.; Groenen, P.J.F. Modern Multidimensional Scaling, 2nd ed.; Chapter: MDS Models and Measures of Fit; Springer: Berlin, Germany, 2005; pp. 37-61. The relationship between the L1 and L2 domains of the insulin and epidermal growth factor receptors and leucine-rich repeat modules. C W Ward, T P Garrett, 10.1186/1471-2105-2-4BMC Bioinform. 2001, 2, 4. [CrossRefWard, C.W.; Garrett, T.P.J. The relationship between the L1 and L2 domains of the insulin and epidermal growth factor receptors and leucine-rich repeat modules. BMC Bioinform. 2001, 2, 4. [CrossRef] The leucine-rich repeat domain in plant innate immunity: A wealth of possibilities. M Padmanabhan, P Cournoyer, S P Dinesh-Kumar, 10.1111/j.1462-5822.2008.01260.xCell. Microbiol. 11Padmanabhan, M.; Cournoyer, P.; Dinesh-Kumar, S.P. The leucine-rich repeat domain in plant innate immunity: A wealth of possibilities. Cell. Microbiol. 2009, 11, 191-198. [CrossRef] Plant immunity: Towards an integrated view of plantĝ€ pathogen interactions. P N Dodds, J P Rathjen, 10.1038/nrg2812Nat. Rev. Genet. 11Dodds, P.N.; Rathjen, J.P. Plant immunity: Towards an integrated view of plantĝ€ pathogen interactions. Nat. Rev. Genet. 2010, 11, 539-548. [CrossRef] Co-evolutionary interactions between host resistance and pathogen effector genes in flax rust disease. M Ravensdale, A Nemri, P H Thrall, J G Ellis, P N Dodds, 10.1111/j.1364-3703.2010.00657.xMol. Plant Pathol. 12Ravensdale, M.; Nemri, A.; Thrall, P.H.; Ellis, J.G.; Dodds, P.N. Co-evolutionary interactions between host resistance and pathogen effector genes in flax rust disease. Mol. Plant Pathol. 2011, 12, 93-102. [CrossRef] Function of Nod-like receptors in microbial recognition and host defense. L Franchi, N Warner, K Viani, G Nuñez, 10.1111/j.1600-065X.2008.00734.xImmunol. Rev. 227Franchi, L.; Warner, N.; Viani, K.; Nuñez, G. Function of Nod-like receptors in microbial recognition and host defense. Immunol. Rev. 2009, 227, 106-128. [CrossRef] Regulation and evolution of NLR genes: A close interconnection for plant immunity. G M Borrelli, E Mazzucotelli, D Marone, C Crosatti, V Michelotti, G Valè, A M Mastrangelo, 10.3390/ijms19061662Int. J. Mol. Sci. Borrelli, G.M.; Mazzucotelli, E.; Marone, D.; Crosatti, C.; Michelotti, V.; Valè, G.; Mastrangelo, A.M. Regulation and evolution of NLR genes: A close interconnection for plant immunity. Int. J. Mol. Sci. 2018, 19, 1662. [CrossRef] Molecular genetic evidence for the role of SGT1 in the intramolecular complementation of Bs2 protein activity in Nicotiana benthamiana. R T Leister, D Dahlbeck, B Day, Y Li, O Chesnokova, B J Staskawicz, 10.1105/tpc.104.029637Plant Cell. 17Leister, R.T.; Dahlbeck, D.; Day, B.; Li, Y.; Chesnokova, O.; Staskawicz, B.J. Molecular genetic evidence for the role of SGT1 in the intramolecular complementation of Bs2 protein activity in Nicotiana benthamiana. Plant Cell 2005, 17, 1268-1278. [CrossRef] The Arabidopsis ZED1 pseudokinase is required for ZAR1-mediated immunity induced by the Pseudomonas syringae type III effector HopZ1a. J D Lewis, A H Lee, .-Y Hassan, J A Wan, J Hurley, B Jhingree, J R Wang, P W Lo, T Youn, J.-Y Guttman, D S , 10.1073/pnas.1315520110Proc. Natl. Acad. Sci. Natl. Acad. SciUSA110Lewis, J.D.; Lee, A.H.-Y.; Hassan, J.A.; Wan, J.; Hurley, B.; Jhingree, J.R.; Wang, P.W.; Lo, T.; Youn, J.-Y.; Guttman, D.S.; et al. The Arabidopsis ZED1 pseudokinase is required for ZAR1-mediated immunity induced by the Pseudomonas syringae type III effector HopZ1a. Proc. Natl. Acad. Sci. USA 2013, 110, 18722-18727. [CrossRef] Elicitor-mediated oligomerization of the tobacco N disease resistance protein. P Mestre, D C Baulcombe, 10.1105/tpc.105.037234Plant Cell. 18Mestre, P.; Baulcombe, D.C. Elicitor-mediated oligomerization of the tobacco N disease resistance protein. Plant Cell 2006, 18, 491-501. [CrossRef] Protein-protein interactions in the RPS4/RRS1 immune receptor complex. S U Huh, V Cevik, P Ding, Z Duxbury, Y Ma, L Tomlinson, P F Sarris, J D G Jones, 10.1371/journal.ppat.1006376PLoS Pathog. 13Huh, S.U.; Cevik, V.; Ding, P.; Duxbury, Z.; Ma, Y.; Tomlinson, L.; Sarris, P.F.; Jones, J.D.G. Protein-protein interactions in the RPS4/RRS1 immune receptor complex. PLoS Pathog. 2017, 13, e1006376. [CrossRef] Crystal structure of NLRC4 reveals its autoinhibition mechanism. Z Hu, C Yan, P Liu, Z Huang, R Ma, C Zhang, R Wang, Y Zhang, F Martinon, D Miao, 10.1126/science.1236381Science. 341Hu, Z.; Yan, C.; Liu, P.; Huang, Z.; Ma, R.; Zhang, C.; Wang, R.; Zhang, Y.; Martinon, F.; Miao, D.; et al. Crystal structure of NLRC4 reveals its autoinhibition mechanism. Science 2013, 341, 172-175. [CrossRef] Structural basis for flg22-induced activation of the Arabidopsis FLS2-BAK1 immune complex. Y Sun, L Li, A P Macho, Z Han, Z Hu, C Zipfel, J.-M Zhou, J Chai, 10.1126/science.1243825Science. 342Sun, Y.; Li, L.; Macho, A.P.; Han, Z.; Hu, Z.; Zipfel, C.; Zhou, J.-M.; Chai, J. Structural basis for flg22-induced activation of the Arabidopsis FLS2-BAK1 immune complex. Science 2013, 342, 624-628. [CrossRef] Crystal structure of human toll-like receptor 3. J Choe, M S Kelker, I A Wilson, 10.1126/science.1115253Science. 22Choe, J.; Kelker, M.S.; Wilson, I.A. Crystal structure of human toll-like receptor 3. Science 2005, 22, 581-585. [CrossRef] The structure of Bacillus subtilis pectate lyase in complex with calcium. R Pickersgill, J Jenkins, G Harris, W Nasser, J Robert-Baudouy, 10.1038/nsb1094-717Nat. Struct. Biol. 1Pickersgill, R.; Jenkins, J.; Harris, G.; Nasser, W.; Robert-Baudouy, J. The structure of Bacillus subtilis pectate lyase in complex with calcium. Nat. Struct. Biol. 1994, 1, 717-723. [CrossRef] Crystal structure and catalytic mechanism of PglD from Campylobacter jejuni. N B Olivier, B Imperiali, 10.1074/jbc.M801207200J. Biol. Chem. 283Olivier, N.B.; Imperiali, B. Crystal structure and catalytic mechanism of PglD from Campylobacter jejuni. J. Biol. Chem. 2008, 283, 27937-27946. [CrossRef] Three-dimensional structure of the armadillo repeat region of β-catenin. A H Huber, W J Nelson, W I Weis, 10.1016/S0092-8674(00)80352-9Cell. 90Huber, A.H.; Nelson, W.J.; Weis, W.I. Three-dimensional structure of the armadillo repeat region of β-catenin. Cell 1997, 90, 871-882. [CrossRef] . N Takahashi, S Hamada-Nakahara, Y Itoh, K Takemura, A Shimada, Y Ueda, M Kitamata, R Matsuoka, K Hanawa-Suetsugu, Y Senju, 10.1038/ncomms5994Nat. Commun. 5et al. TRPV4 channel activity is modulated by direct interaction of the ankyrin domain to PI(4,5)P 2Takahashi, N.; Hamada-Nakahara, S.; Itoh, Y.; Takemura, K.; Shimada, A.; Ueda, Y.; Kitamata, M.; Matsuoka, R.; Hanawa-Suetsugu, K.; Senju, Y.; et al. TRPV4 channel activity is modulated by direct interaction of the ankyrin domain to PI(4,5)P 2 . Nat. Commun. 2014, 5, 4994. [CrossRef] This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. © 2020 by the authors. Licensee MDPI. Basel, Switzerland© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Structural Principles of Leucine-Rich Repeat (LRR) Proteins A mutation within the leucine-rich repeat domain of the arabidopsis disease resistance gene RPS5 partially suppresses multiple bacterial and downy mildew resistance genes Direct interaction of resistance gene and avirulence gene products confers rice blast resistance Autoinflammatory mutation in NLRC4 reveals a leucine-rich repeat (LRR)-LRR oligomerization interface Cloning of the gene containing mutations that cause PARK8-linked Parkinson's disease Mutations in LRRK2 cause autosomal-dominant parkinsonism with pleomorphic pathology The role of small leucine-rich proteoglycans in osteoarthritis pathogenesis Structure-informed insights for NLR functioning in plant immunity The NBS-LRR architectures of plant R-proteins and metazoan NLRs evolved in independent events Comparative Geometrical Analysis of Leucine-Rich Repeat Structures in the Nod-Like and Toll-Like Receptors in Vertebrate Innate Immunity Assessment of the ability to model proteins with leucine-rich repeats in light of the latest structural information Comparative sequence analysis of leucine-rich repeats (LRRs) within vertebrate toll-like receptors The leucine-rich repeat as a protein recognition motif Human leucine-rich repeat proteins: A genome-wide bioinformatic categorization and functional analysis in innate immunity Ancient diversity of splicing motifs and protein surfaces in the wild emmer wheat (Triticum dicoccoides) LR10 coiled coil (CC) and leucine-rich repeat (LRR) domains Structural determinants at the interface of the ARC2 and leucine-rich repeat domains control the activation of the plant immune receptors Rx1 and Gpa2 Three-Dimensional Modeling and Diversity Analysis Reveals Distinct AVR Recognition Sites and Evolutionary Pathways in Wild and Domesticated Wheat Pm3 R Genes An LRR/Malectin receptor-like kinase mediates resistance to non-adapted and adapted powdery mildew fungi in barley and wheat Structure-function analysis of ZAR1 immune receptor reveals key molecular interactions for activity Reconstitution and structure of a plant NLR resistosome conferring immunity Ligand-triggered allosteric ADP release primes a plant NLR complex Modeling of the three-dimensional structure of proteins with the typical leucine-rich repeats LRR conservation mapping to predict functional sites within protein leucine-rich repeat domains Out of Water: The Origin and Early Diversification of Plant R-Genes 0: A webserver for the prediction of leucine-rich repeats LRRsearch: An asynchronous server-based application for the prediction of leucine-rich repeat motifs and an integrative database of NOD-like receptors CATH: An expanded resource to predict protein function through structure and sequence The Pfam protein families database in 2019 InterPro in 2019: Improving coverage, classification and access to protein sequence annotations PISCES: A protein sequence culling server Predicting functionally important residues from sequence conservation ETE 3: Reconstruction, Analysis, and Visualization of Phylogenomic Data RaptorX-Property: A web server for protein structure property prediction AUC-maximized deep convolutional neural fields for protein sequence labeling Proteome-level protein disorder prediction by AUC-maximized deep convolutional neural fields Protein Secondary Structure Prediction Using Deep Convolutional Neural Fields Lightning-fast iterative protein sequence searching by HMM-HMM alignment HH-suite3 for fast remote homology detection and deep protein annotation Support-vector networks Fuzzy Sets, and Classification The perceptron: A probabilistic model for information storage and organization in the brain A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting Adaptive synthetic sampling approach for imbalanced learning Synthetic minority over-sampling technique Borderline Over-sampling for Imbalanced Data Classification Balancing Training Data for Automated Annotation of Keywords: A Case Study A study of the behavior of several methods for balancing machine learning training data Scikit-learn: Machine Learning in Python On the limited memory BFGS method for large scale optimization A method for stochastic optimization Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning A combined transmembrane topology and signal peptide prediction method Detecting protein sequence conservation via metric embeddings RBLOSUM performs better than CorBLOSUM with lesser error per query BLOSUM62 miscalculations improve search performance Silhouettes: A graphical aid to the interpretation and validation of cluster analysis Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis A Sequence Logo Generator Matplotlib: A 2D graphics environment Structural diversity of leucine-rich repeat proteins The leucine-rich repeat domain in plant innate immunity: A wealth of possibilities Plant immunity: Towards an integrated view of plantĝ€ pathogen interactions Co-evolutionary interactions between host resistance and pathogen effector genes in flax rust disease Function of Nod-like receptors in microbial recognition and host defense Regulation and evolution of NLR genes: A close interconnection for plant immunity Molecular genetic evidence for the role of SGT1 in the intramolecular complementation of Bs2 protein activity in Nicotiana benthamiana The Arabidopsis ZED1 pseudokinase is required for ZAR1-mediated immunity induced by the Pseudomonas syringae type III effector HopZ1a Elicitor-mediated oligomerization of the tobacco N disease resistance protein Protein-protein interactions in the RPS4/RRS1 immune receptor complex Crystal structure of NLRC4 reveals its autoinhibition mechanism Structural basis for flg22-induced activation of the Arabidopsis FLS2-BAK1 immune complex Crystal structure of human toll-like receptor 3 The structure of Bacillus subtilis pectate lyase in complex with calcium Crystal structure and catalytic mechanism of PglD from Campylobacter jejuni Three-dimensional structure of the armadillo repeat region of β-catenin This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license
Proteins Struct. Funct. Bioinform Plant Cell EMBO J J. Allergy Clin. Immunol Neuron Neuron Osteoarthritis Cartilage Ageing Res. Rev Semin. Cell Dev. Biol Proc. Natl. Acad. Sci Biomolecules Protein Sci BMC Genom Curr. Opin. Struct. Biol Proc. Natl. Acad. Sci Mol. Plant Pathol Plant Physiol Mol. Plant-Microbe Interact Front. Plant Sci Plant J Science Science Structure PLoS ONE Plant Physiol Innate Immun Comput. Biol. Med Nucleic Acids Res Nucleic Acids Res Nucleic Acids Res Bioinformatics Bioinformatics Mol. Biol. Evol Nucleic Acids Res Proceedings of the Lecture Notes in Computer Science Proceedings of the Bioinformatics Sci. Rep Nat. Methods BMC Bioinform Mach. Learn IEEE Trans. Neural Netw Psychol. Rev J. Comput. Syst. Sci Proceedings of the 2008 IEEE International Joint Conference on Neural Networks Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning J. Artif. Intell. Res Proceedings: Fifth International Workshop on Computational Intelligence & Applications WOB ACM SIGKDD Explor. Newsl J. Mach. Learn. Res Math. Program Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning Representations A Stochastic Approximation Method. Ann. Math. Stat Nature J. Mach. Learn. Res J. Mol. Biol Bioinformatics BMC Res. Notes Nat. Biotechnol J. Comput. Appl. Math Psychometrika Genome Res The PyMOL Molecular Graphics System, Version 2.2.3 Comput. Sci. Eng J. Mol. Biol Modern Multidimensional Scaling The relationship between the L1 and L2 domains of the insulin and epidermal growth factor receptors and leucine-rich repeat modules Cell. Microbiol Nat. Rev. Genet Mol. Plant Pathol Immunol. Rev Int. J. Mol. Sci Plant Cell Proc. Natl. Acad. Sci Plant Cell PLoS Pathog Science Science Science Nat. Struct. Biol J. Biol. Chem Cell Nat. Commun © 2020 by the authors. Licensee MDPI Natl. Acad. SciUSA Natl. Acad. SciUSA the Lecture Notes in Computer Science the BioinformaticsOxford, UK the 2008 IEEE International Joint Conference on Neural NetworksPiscataway, NJ, USA Fifth International Workshop on Computational Intelligence & ApplicationsPiscataway, NJ, USA Porto Alegre, Brazil the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings; International Conference on Learning RepresentationsSan Diego, CA, USA Natl. Acad. SciUSA Basel, Switzerland

Figure 1 .
1Available leucine-rich-repeat (LRR) domains in structural data. (a) LRR structural dataset construction. (b) LRR domain horseshoe architecture illustrated on the only plant NLR cryo-EM structure available-ZAR1-from Arabidopsis thaliana (left) and zoom-in view of a LRR repeat (right) (PDB: 6J5W). The hydrophobic positions in the minimal 'L0xxL3xL5' motif are shown in orange. The first N-entry repeat (blue) and the last C-exit repeat (red) are also mapped on the structure. (c) Phyla distribution of the initial LRR motif set ID90, the 50% identity trimmed LRR motifs set (ID50), annotated LRR proteins and all proteins from the UniRef50 database (from left to right). Percent values corresponding to the mammals group are shown in red. (d) Frequency plot of amino acid composition of the N-entry, core and C-exit motifs on the 50% identity trimmed set. Amino acids are colored according to their properties as follows: hydrophobic (yellow), acidic (red), basic (blue), asparagine and glutamine (purple), proline and glycine (green), others (black). (e) Jensen-Shannon 
Figure 1 .
1Available leucine-rich-repeat (LRR) domains in structural data. (a) LRR structural dataset construction. (b) LRR domain horseshoe architecture illustrated on the only plant NLR cryo-EM structure available-ZAR1-from Arabidopsis thaliana (left) and zoom-in view of a LRR repeat (right) 
L
-strictly leucine; Ł-hydrophobic without leucine (I, V, M, F, W, Y, C, A); L-hydrophobic (L, I, V, M, F, W, Y, C, A); x-any amino acid. 
Figure 2 .
2LRRpredictor training and testing workflow: (a) training and testing dataset construction. (b) schematic representation of the training and testing procedure, (c) selected features, and (d) selected classifiers aggregated into LRRpredictor. 
Figure 2 .
2LRRpredictor training and testing workflow: (a) training and testing dataset construction. (b) schematic representation of the training and testing procedure, (c) selected features, and (d) selected classifiers aggregated into LRRpredictor. 
Figure 3 .
3LRRpredictor performance analysis: (a) LRRpredictor performance across datasets: precision, recall, and F1 scores are shown either considering all the LRR motif types (N-entry, core, and C-exit types), either solely core motifs (L); also shown are the true negative (TN), false positive (FP), false negative (FN) and true positive (TP) counts. (b) F1 scores of LRRpredictor and its individual classifiers. (c) Comparison between LRRpredictor and other LRR motif predictors: LRRfinder 
Figure 3 .
3LRRpredictor performance analysis: (a) LRRpredictor performance across datasets: precision, recall, and F1 scores are shown either considering all the LRR motif types (N-entry, core, and C-exit types), either solely core motifs (L); also shown are the true negative (TN), false positive (FP), false negative (FN) and true positive (TP) counts. (b) F1 scores of LRRpredictor and its individual classifiers. (c) Comparison between LRRpredictor and other LRR motif predictors: LRRfinder 
Figure 4 .
4LRRpredictor behavior on Interpro annotated LRR domains from different classes. (a) Length distribution of the predicted repeats using LRRpredictor within each protein group. Cterminal motifs were not used in computing the distribution. Repeat lengths size prone to ambiguity-i.e., either too short (potential FP) or too long (potential FN)-are shaded in red. (b) Distributions of the Interpro annotated LRR domain length that is covered by Interpro LRR repeat annotations (grey) or by predicted repeats using LRRpredictor (blue), LRRfinder (green), and LRRsearch (purple). Coverage percent distributions are shown within each protein group. 
Figure 4 .
4LRRpredictor behavior on Interpro annotated LRR domains from different classes. (a) Length distribution of the predicted repeats using LRRpredictor within each protein group. C-terminal motifs were not used in computing the distribution. Repeat lengths size prone to ambiguity-i.e., either too short (potential FP) or too long (potential FN)-are shaded in red. (b) Distributions of the Interpro annotated LRR domain length that is covered by Interpro LRR repeat annotations (grey) or by predicted repeats using LRRpredictor (blue), LRRfinder (green), and LRRsearch (purple). Coverage percent distributions are shown within each protein group. 
Figure 5 .
5Consensuses of the LRR motifs predicted by LRRpredictor across different classes. Logo heights correspond to amino acid relative entropy (in bits), higher heights implying higher conservation. A consensus for each class is displayed bellow each logo, highly conserved positions being shown in black boxes, while less conserved in gray. Minimal motif 'L0xxL3xL5' (green line) and the extended motif (black line) are indicated below each logo. Amino acids are colored according to their properties as inFigure 1d. 
Figure 5 .
5Consensuses of the LRR motifs predicted by LRRpredictor across different classes. Logo heights correspond to amino acid relative entropy (in bits), higher heights implying higher conservation. A consensus for each class is displayed bellow each logo, highly conserved positions being shown in black boxes, while less conserved in gray. Minimal motif 'L 0 xxL 3 xL 5 ' (green line) and the extended motif (black line) are indicated below each logo. Amino acids are colored according to their properties as inFigure 1d.Genes 2019, 10, x FOR PEER REVIEW 13 of 24 
Figure 6 .
6Distribution of LRR motif types defined byKobe and Kajava (KK)   
Genes 2019 ,
201910, x FOR PEER REVIEW 14 of 24 
Figure 7 .
7LRR motifs variability in different protein classes. (a) Intra-group all-vs.-all distances on the extended (left) and minimal (right) motif (b) Silhouette coefficients inter-groups extended (left) and minimal (right) motif. (c) Histogram of a 2D embedding approximating the true distances between points for the extended (left) and minimal (right) motif. Histograms were computed using a 20 × 20 bins grid. Extended and minimal motif histograms cannot be compared as they refer to different sequence spaces. 
Figure 7 .
7LRR motifs variability in different protein classes. (a) Intra-group all-vs.-all distances on the extended (left) and minimal (right) motif (b) Silhouette coefficients inter-groups extended (left) and minimal (right) motif. (c) Histogram of a 2D embedding approximating the true distances between points for the extended (left) and minimal (right) motif. Histograms were computed using a 20 × 20 bins grid. Extended and minimal motif histograms cannot be compared as they refer to different sequence spaces. 
Genes 2019 ,
201910, x FOR PEER REVIEW 15 of 24 
Figure 8 .
8LRR motif and repeat indeterminacies onto a 150 aa stretch in Gpa2 potato NLR. Potential motifs that follow the minimal 'LxxLxL' pattern (where L is any hydrophobic amino acid) are illustrated above the sequence with black bars and yellow highlight, while LRRpredictor results are shown above with blue bars. 
Figure A1 .
A1Available LRR domains structural data. (a) Identity cut-off versus loss of data: plots of the loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures[22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L0xxL3xL5' motif are shown in orange and position N8 in purple. 
Figure A1 .
A1Available LRR domains structural data. (a) Identity cut-off versus loss of data: plots of the loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures[22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L 0 xxL 3 xL 5 ' motif are shown in orange and position N 8 in purple. 
Figure A2 .
A2(a) LRRpredictor behavior on other solenoidal architectures. Shown are occurrence counts of LRR-like patterns versus LRRpredictor probabilities counts histogram. (b) Overall 3D structure of the four examined classes of solenoidal proteins[80][81][82][83]. 
Figure A2 .
A2(a) LRRpredictor behavior on other solenoidal architectures. Shown are occurrence counts of LRR-like patterns versus LRRpredictor probabilities counts histogram. (b) Overall 3D structure of the four examined classes of solenoidal proteins[80][81][82][83]. 
Table 1 .
1Occurrence of LRR sequence patterns in the overall dataset used to train the machine learning (ML) estimators. Training & Testing Dataset (CV 1-4 and Test Sets)Full NonLRR Proteins 
LRR Proteins 

 
Table A1 .
A1Cont.Dataset 
Classifier 

In-Sample 
Out-Of Sample 

Precision Recall F1-Score 
Precision Recall F1-Score 

TN 
FP 
FN 
TP 
Recall on Core(L) Only 
-
Non-LRR 
Proteins 

LRR 
Proteins 

N-Entry 
(N) 

Core 
(L) 

C-Exit 
(C) 

N-Entry 
(N) 

Core 
(L) 

C-Exit 
(C) 

Test 

C1 
0.900 
0.997 
0.946 
0.874 
0.880 
0.877 
35107 
0 
19 
6 
10 
2 
13 
109 
10 
0.916 
C2 
0.962 
0.956 
0.959 
0.941 
0.847 
0.891 
35118 
0 
8 
8 
12 
3 
11 
107 
9 
0.899 
C3 
0.882 
0.896 
0.889 
0.852 
0.847 
0.850 
35104 
1 
21 
8 
13 
2 
11 
106 
10 
0.891 
C4 
0.940 
0.874 
0.906 
0.907 
0.840 
0.872 
35113 
1 
12 
8 
14 
2 
11 
105 
10 
0.882 
C5 
0.895 
0.934 
0.914 
0.862 
0.873 
0.868 
35105 
1 
20 
7 
10 
2 
12 
109 
10 
0.916 
C6 
0.940 
0.901 
0.920 
0.928 
0.860 
0.893 
35116 
0 
10 
7 
12 
2 
12 
107 
10 
0.899 
C7 
0.990 
1.000 
0.995 
0.827 
0.827 
0.827 
35100 
4 
22 
7 
16 
3 
12 
103 
9 
0.866 
C8 
0.942 
0.874 
0.906 
0.920 
0.840 
0.878 
35115 
0 
11 
9 
13 
2 
10 
106 
10 
0.891 
LRRpredictor 
0.943 
0.928 
0.936 
0.928 
0.860 
0.893 
35116 
0 
10 
7 
12 
2 
12 
107 
10 
0.899 

Available leucine-rich-repeat (LRR) domains in structural data. (a) LRR structural dataset construction. (b) LRR domain horseshoe architecture illustrated on the only plant NLR cryo-EM structure available-ZAR1-from Arabidopsis thaliana (left) and zoom-in view of a LRR repeat (right) (PDB: 6J5W). The hydrophobic positions in the minimal 'L0xxL3xL5' motif are shown in orange. The first N-entry repeat (blue) and the last C-exit repeat (red) are also mapped on the structure. (c) Phyla distribution of the initial LRR motif set ID90, the 50% identity trimmed LRR motifs set (ID50), annotated LRR proteins and all proteins from the UniRef50 database (from left to right). Percent values corresponding to the mammals group are shown in red. (d) Frequency plot of amino acid composition of the N-entry, core and C-exit motifs on the 50% identity trimmed set. Amino acids are colored according to their properties as follows: hydrophobic (yellow), acidic (red), basic (blue), asparagine and glutamine (purple), proline and glycine (green), others (black). (e) Jensen-Shannon Available leucine-rich-repeat (LRR) domains in structural data. (a) LRR structural dataset construction. (b) LRR domain horseshoe architecture illustrated on the only plant NLR cryo-EM structure available-ZAR1-from Arabidopsis thaliana (left) and zoom-in view of a LRR repeat (right) -strictly leucine; Ł-hydrophobic without leucine (I, V, M, F, W, Y, C, A); L-hydrophobic (L, I, V, M, F, W, Y, C, A); x-any amino acid. LRRpredictor training and testing workflow: (a) training and testing dataset construction. (b) schematic representation of the training and testing procedure, (c) selected features, and (d) selected classifiers aggregated into LRRpredictor. LRRpredictor training and testing workflow: (a) training and testing dataset construction. (b) schematic representation of the training and testing procedure, (c) selected features, and (d) selected classifiers aggregated into LRRpredictor. LRRpredictor performance analysis: (a) LRRpredictor performance across datasets: precision, recall, and F1 scores are shown either considering all the LRR motif types (N-entry, core, and C-exit types), either solely core motifs (L); also shown are the true negative (TN), false positive (FP), false negative (FN) and true positive (TP) counts. (b) F1 scores of LRRpredictor and its individual classifiers. (c) Comparison between LRRpredictor and other LRR motif predictors: LRRfinder LRRpredictor performance analysis: (a) LRRpredictor performance across datasets: precision, recall, and F1 scores are shown either considering all the LRR motif types (N-entry, core, and C-exit types), either solely core motifs (L); also shown are the true negative (TN), false positive (FP), false negative (FN) and true positive (TP) counts. (b) F1 scores of LRRpredictor and its individual classifiers. (c) Comparison between LRRpredictor and other LRR motif predictors: LRRfinder LRRpredictor behavior on Interpro annotated LRR domains from different classes. (a) Length distribution of the predicted repeats using LRRpredictor within each protein group. Cterminal motifs were not used in computing the distribution. Repeat lengths size prone to ambiguity-i.e., either too short (potential FP) or too long (potential FN)-are shaded in red. (b) Distributions of the Interpro annotated LRR domain length that is covered by Interpro LRR repeat annotations (grey) or by predicted repeats using LRRpredictor (blue), LRRfinder (green), and LRRsearch (purple). Coverage percent distributions are shown within each protein group. LRRpredictor behavior on Interpro annotated LRR domains from different classes. (a) Length distribution of the predicted repeats using LRRpredictor within each protein group. C-terminal motifs were not used in computing the distribution. Repeat lengths size prone to ambiguity-i.e., either too short (potential FP) or too long (potential FN)-are shaded in red. (b) Distributions of the Interpro annotated LRR domain length that is covered by Interpro LRR repeat annotations (grey) or by predicted repeats using LRRpredictor (blue), LRRfinder (green), and LRRsearch (purple). Coverage percent distributions are shown within each protein group. Consensuses of the LRR motifs predicted by LRRpredictor across different classes. Logo heights correspond to amino acid relative entropy (in bits), higher heights implying higher conservation. A consensus for each class is displayed bellow each logo, highly conserved positions being shown in black boxes, while less conserved in gray. Minimal motif 'L0xxL3xL5' (green line) and the extended motif (black line) are indicated below each logo. Amino acids are colored according to their properties as inFigure 1d. Consensuses of the LRR motifs predicted by LRRpredictor across different classes. Logo heights correspond to amino acid relative entropy (in bits), higher heights implying higher conservation. A consensus for each class is displayed bellow each logo, highly conserved positions being shown in black boxes, while less conserved in gray. Minimal motif 'L 0 xxL 3 xL 5 ' (green line) and the extended motif (black line) are indicated below each logo. Amino acids are colored according to their properties as inFigure 1d.Genes 2019, 10, x FOR PEER REVIEW 13 of 24 Distribution of LRR motif types defined byKobe and Kajava (KK)   10, x FOR PEER REVIEW 14 of 24 LRR motifs variability in different protein classes. (a) Intra-group all-vs.-all distances on the extended (left) and minimal (right) motif (b) Silhouette coefficients inter-groups extended (left) and minimal (right) motif. (c) Histogram of a 2D embedding approximating the true distances between points for the extended (left) and minimal (right) motif. Histograms were computed using a 20 × 20 bins grid. Extended and minimal motif histograms cannot be compared as they refer to different sequence spaces. LRR motifs variability in different protein classes. (a) Intra-group all-vs.-all distances on the extended (left) and minimal (right) motif (b) Silhouette coefficients inter-groups extended (left) and minimal (right) motif. (c) Histogram of a 2D embedding approximating the true distances between points for the extended (left) and minimal (right) motif. Histograms were computed using a 20 × 20 bins grid. Extended and minimal motif histograms cannot be compared as they refer to different sequence spaces. 10, x FOR PEER REVIEW 15 of 24 LRR motif and repeat indeterminacies onto a 150 aa stretch in Gpa2 potato NLR. Potential motifs that follow the minimal 'LxxLxL' pattern (where L is any hydrophobic amino acid) are illustrated above the sequence with black bars and yellow highlight, while LRRpredictor results are shown above with blue bars. Available LRR domains structural data. (a) Identity cut-off versus loss of data: plots of the loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures[22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L0xxL3xL5' motif are shown in orange and position N8 in purple. Available LRR domains structural data. (a) Identity cut-off versus loss of data: plots of the loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures[22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L 0 xxL 3 xL 5 ' motif are shown in orange and position N 8 in purple. (a) LRRpredictor behavior on other solenoidal architectures. Shown are occurrence counts of LRR-like patterns versus LRRpredictor probabilities counts histogram. (b) Overall 3D structure of the four examined classes of solenoidal proteins[80][81][82][83]. (a) LRRpredictor behavior on other solenoidal architectures. Shown are occurrence counts of LRR-like patterns versus LRRpredictor probabilities counts histogram. (b) Overall 3D structure of the four examined classes of solenoidal proteins[80][81][82][83]. Occurrence of LRR sequence patterns in the overall dataset used to train the machine learning (ML) estimators. Training & Testing Dataset (CV 1-4 and Test Sets) Cont.
The leucine-rich-repeat (LRR) domains are present in all of the tree of life branches. As they are involved in protein-protein interactions, LRR domains are found in receptors having a vast number of functions such as pathogen detection, immune response propagation, hormone perception, enzyme inhibition, or cell adhesion [1]. In both plants and mammals, a number of studies have detailed adverse effects associated with mutations in the LRR domains such as that reported for various immune-related receptors, resulting in compromised functions and enhanced disease progression [2]. For example, mutating a single residue in the LRR domain of the rice Pita receptor results in complete loss of recognition against the fungus Magnaporthe grisea [3] while mutations in the metazoan NLRC4-LRR contributes to autoinflammatory disease phenotypes [4]. Additionally, mutations in the Based on our previous work, identifying the individual true motifs in a LRR domain is hindered by the following: (a) in its minimal form, a 'LxxLxL' pattern is trivial and frequently occurs randomly in any protein; (b) in many cases several 'LxxLxL' patterns do overlap in less than 15 aa range in NLR-LRRs making the precise delineation difficult; (c) the number of 3D experimental structures from which to learn is low; and (d) this small 3D learning set is class and phyla biased-as around half of the structures are of mammalian origin while plant NLRs only have one recently documented structure [21,22]. Thus, given the above described indeterminacies the precise LRR motif identification becomes the most problematic step in the correct repeat delineation within a LRR domain. This also explains why LRR domains and their individual repeats are poorly annotated in genomes or protein databases in contrast to the better annotated, relatively more conserved NBS domain, which has therefore been used in phylogenetic analyses [10,25]. Hence, these major limitations hamper the study of NLRs at various levels such as in the context of plant innate immunity. To address these challenges, in this paper we propose a new LRR motif detection method: LRRpredictor, designed to be more sensitive to motif irregularities than the existing methods like LRRfinder [26] or LRRsearch [27] and to detect irregular and short LRR signatures as are often found in plant NLRs, but not limited to this class. We assessed how LRRpredictor behaves within different classes of immune-related receptors that contain LRR domains, such as plant NLRs, RLPs, and RLKs and vertebrate NLRs and TLRs with the aim to provide novel insights into the diversification of LRR domains and their role in the functioning of immune receptors. Various protein domain databases, such as CATH [28], Pfam [29], and Interpro collection [30] were used to obtain a dataset of 611 structure files of proteins annotated to contain LRR domains. These files were processed and filtered out to extract a clean set of LRR chains sharing less than 90% sequence identity using Pisces server [31]. This set containing 178 LRR chains were visually inspected and subjected to LRR repeat delineation based on the distinctive LRR ventral beta-sheet secondary structure pattern. Annotated LRR domains consisting in less than five LRR repeats, as well as incomplete repeats not covering at least five amino acids upstream and downstream of the "LxxLxL" minimal motif were further eliminated. Using this procedure, we generated the 90% identity data set, ID90, consisting of 172 N-ter LRR 'entry' repeats (N), 1792 LRR 'core' repeats (L), and 154 C-ter LRR 'exit' repeats (C) (File S1). To avoid redundancy in the training data the level of identity has to be further significantly reduced. However, given the small size of ID90 (<180 chains), a trade-off between increase in entropy and loss of data had to be reached. As seen from Figure A1a, a proper inflection point shapes up at around 50% identity and was considered the best compromise in generating a nonredundant set of repeats. In practical terms, the nonredundant ID50 set was generated from ID90 by selecting repeats showing less than eight identical amino acids on a 16 amino acid window centered on the 'LxxLxL' minimal LRR motif, i.e., the window comprising five amino acids upstream and downstream 'LxxLxL'. This nonredundant ID50 set was comprised of 106 N-ter 'entry' repeats (N), 659 'core' repeats (L), and 88 C-ter 'exit' repeats (C), i.e., ≈40% of the 90ID set ( Figure 1, File S1). Jensen-Shannon divergence (JSD) scores ( Figure 1e) were computed using Capra et al. implementation [32], using the BLOSUM62 matrix for background probabilities and a window parameter 0. The phyla distribution shown in Figure 1c was computed using the Environment for Tree Exploration (ETE3) library v3.1.1 [33].  In order to provide a representative collection of non-LRR examples, we selected a representative example of each CATH [28] domains' topology (except LRR) from a nonredundant dataset provided by CATH where all proteins share less than 20% identity or have a less than 60% overlap (cath-dataset-nonredundant-S20 set-09.12.2019). Given potential synchronization problems between various databases used to build the overall learning set comprising (a) the nonredundant 50ID LRRs, containing the 'entry'-, 'core'-, 'exit'-repeats and the flanking nonLRR domains when present and (b) the CATH nonLRR domains-the data was subjected to a third redundancy filter performed with a similar CATH methodology, aimed at eliminating sequences that fail one of the below bounds: • the length of the alignment is over 100 and the identity is over 20%. • length of the alignment is between 40 and 100 with an identity over 20% and the overlap with respect to both sequences is more than 60%. • LRR repeats with alignments lengths ≥16 aa and ≥50% identical (equivalent of at most 8/16 aa constraint imposed initially on the motifs). The final dataset built as above and used herein for training and testing classifiers, contains 648 LRR core repeats, 100 N-ter entry, and 67 C-ter exit nonredundant repeats (including the LRR domain flanking regions) and 875 non-LRR domains from CATH. From this set, 1/5th was used to generate the test dataset, while the remaining 4/5 were used to build the training datasets, preserving the class ratio between the sets. The test dataset contains 40,241 amino acid samples of which only 150, i.e., less than 0.4%, are initiating LRR motifs. Similarly, over the training set less than 0.5% of the samples are LRR initiators. The training set was further split into four cross-validation sets that were used for parameter optimization. All these sets are provided in File S2. In developing LRRpredictor we tested sequence-based (SeqB) features: solely or combined with structural based (StrB) features. The SeqB features comprise position-specific scoring matrices PSSM over the above discussed 16 amino acids interval summing up to 320 features corresponding to 20 amino acid types over the 16 positions. The StrB features comprise: (a) the three state (H-helix, E-extended, C-coil) secondary structure probabilities, (b) the three class (B-buried, M-medium and E-exposed) residue relative solvent accessibility, RSA probabilities and (c) intrinsic disorder probability-summing up to seven extra structural features per residue, resulting in a total of 432 features per 16 aa window. The structural based predictions were performed with RaptorX-Property software [34][35][36][37]. Sequence PSSMs were computed on Uniprot20 protein sequence database, using HHblits [38,39] that is based on HMM-HMM alignments shown to improve accuracy of alignments at low sequence homology levels. In the pre-processing stage, feature variables were normalized, centered, and rescaled, as standard procedure involves. Data whitening using principal component analysis (PCA) decomposition was not used as it did not provide better performance on the tested classifiers. Several classifiers such as support vector classification (SVC) [40], multi-layer perceptron (MLP) [41,42], and AdaBoost [43] as well as several oversampling techniques such as Adasyn [44] and SMOTE-based varieties [45][46][47], or over-and under-sampling combined approaches SmoteTomek [48] and SmoteEEN [49], were tested and parameter optimized via cross-validation using Scikit-learn library v.0.22.1 [50]. Multiclass estimators for N-entry (N), core (L), and C-exit (C) motif types that use either one-vs.-one or one-vs.-rest approaches were also investigated, but they performed worse than when treating all LRR motifs as a single class. The best performing classifiers with tuned parameters were further studied in the context of a soft voter (that averages predicted probabilities of the ensemble constituents), and a final predictor, Genes 2020, 11, 286 5 of 26 further referred to as LRRpredictor, was chosen based on its out-of-sample performance on test set and overfitting behavior on the training data. LRRpredictor is composed of a set of eight classifiers (C1-C8) that use different strategies and consider all N, L, C motif types as a single class, aggregated within an ensemble based on the soft voting scheme, as shown in Figure 2d. Classifiers C1-C4 use solely sequence-based features while C5-C8 use both sequence and structural-based features. Classifiers C1 and C5 use the support vector classification (SVC) algorithm [40], with a radial basis function (RBF) kernel, one-vs.-rest ('ovr') decision function. The margin penalty and the RBF scale (gamma) parameters were optimized through grid search to 1 and 0.01 for C1 and 1 and 0.001 for C4, respectively. Class imbalance was treated by adjusting the SVM weights inversely proportional to class frequency and class probabilities were inferred using sigmoid probability calibration. Classifiers C2, C3, C6, C7 use multi-layer perceptron (MLP) [41,42]. A depth of three hidden layers was sufficient to describe the system, as adding additional hidden layers provided little to no difference in out-of-sample performance. The number of hidden nodes for each hidden layer was selected via grid search as follows: C2 (300-250-100), C3 (250-150-100), C5 (250-150-100), C6 (125-100-10). Classifiers C2, C3, C7 use the Limited-Memory BFGS [51] solver, while C6 uses Adam [52] optimizer for stochastic gradient descent [53] with early-stopping over a validation fraction of 0.2. All four classifiers use rectified linear unit (ReLU) activation function [54]. Classifiers C3 and C7 approach the imbalance problem through synthetic resampling using the combined over-and under-sampling method SMOTETomek [48], as implemented in imbalanced-learn library v 0.6.1 [55]. Classifiers C4 and C8 use a ensemble boosting approach-AdaBoost [43]-using tree classifiers of depth 1, as base estimators, SAMME.R real boosting algorithm, and sigmoid probability calibration. A maximum number of 50 base estimators was selected to maximize performance while avoiding overfitting. In order to investigate LRRpredictor behavior on previously annotated LRR domains from various functional protein groups, we generated a collection of randomly selected 500 representatives from Uniprot50 database (i.e., below 50% identity between themselves at a given minimum overlap-version available at 20.11.2019-release-2019_10) which were annotated by Interpro to contain a LRR domain (IPR032675 and Interpro v77.0 protein2ipr database). A total of six groups were generated: four groups of sequences of CNLs, TNLs, RLKs, and RLPs protein classes from flowering plants and two groups of TLRs and NLRs from vertebrates. Given the high conservation of vertebrate TLRs this set gathered only ≈350 sequences (File S3). Within the CNL group, there were included only proteins annotated by Interpro to contain a single coiled-coil (CC) domain, a single NBS domain, and a LRR domain in this order, and sequences that contained a different domain organization, such as two annotated NBS domains or a different domain order were not included in the analysis. Similarly, for the TNL group we selected only sequences that contain a TIR-NBS-LRR domain organization. The RLK group was built with sequences displaying a "LRR-TM predicted region-kinase" domain organization, while the RLP group contained sequences with "LRR-TM" organization and did not contain other annotated domains by Interpro. In generating the vertebrate NLR group we included any annotated NACHT or NBS domains followed by a LRR domain annotation without discriminating on the N-terminal domain, as animal NLRs can have upstream of the NACHT/NBS domain a multitude of N-terminal domain types, while vertebrate TLRs group contains sequences with a "LRR-TM-TIR" configuration. Transmembrane predictions were performed using Phobius [56]. In analyzing the length of the LRR domains covered by individual repeat annotations, we used all Interpro annotation codes associated with LRR repeat types. We considered as having the status of 'annotated as domain' LRRs with the IPR032675 label and 'annotated as repeats' any amino acids Genes 2020, 11, 286 6 of 26 that had attached by at least one predictor part of Interpro collection one of the following tags: leucine-rich repeat (IPR001611), leucine-rich repeat, typical subtype (IPR003591), leucine-rich repeat, cysteine-containing subtype (IPR006553), leucine-rich repeat 2 (IPR013101), leucine-rich repeat 3 (IPR011713), leucine rich repeat 4 (IPR025875), BspA type leucine rich repeat region (IPR026906), CD180 leucine-rich repeat (IPR041281), DUF4458 domain-containing protein, leucine-rich repeat (IPR041403). Annotations referring to the N-ter cap of the LRR domain (IPR000372, IPR041302) were not considered as these are not LRR repeats. Intra-and inter-group sequence variability was also analyzed using a subset of 1000 predicted 16 aa extended motifs from each group. In order to avoid a potential bias induced by false 'entry' (N) or 'exit' (C) repeats, only 'core' (L) repeats were used in this analysis. The similarity measure used here is the distance mapping defined by Halperin et al. [57]. This consists of the inner product of BLOSUM scores between each pair of amino acids summed up over the motif span, as this function can be used as a metric distance for several BLOSUM matrices. Considering d to be the distance between a pair of amino acids i and j, that have the s (i, j) BLOSUM score: The distance between two sequences a and b of equal length l, would be the sum of distances of each pair of amino acids a i and b i across the length of the sequence: This definition of distance is expected to reflect amino acids compatibilities, as BLOSUM scores are inferred from amino acid mutation probabilities observed on large datasets. As a BLOSUM matrix we selected an updated version of the original BLOSUM matrix, which was recently recalculated on a large dataset and satisfies the triangle inequality. (RBLOSUM59_14.3) [58,59]. Starting from the above described distance function, we calculated Silhouette coefficients [60] between each pair of groups, and precomputed distances were used for manifold learning using metric multi-dimensional scaling (MDS) [61] as implemented in Scikit-learn library [50]. Sequences logos were generated using Weblogo [62], figures showing protein structures were obtained using PyMol [63], while other plots were generated in Microsoft Office or by using Matplotlib library [64]. A collection of 611 PDB structures previously annotated by several protein domain databases, such as CATH [28], Pfam [29], and Interpro-collection [30] to contain LRR horseshoe architectures was obtained. This collection was used to derive a clean set, ID90, of 178 LRR chains displaying 90% identity that was structurally analyzed in order to structurally delineate the LRR repeats based on the beta-sheet network. By this, a dataset of ≈2100 LRR motifs was obtained, as shown in Figure 1a. It is interesting to note here that less than 20% of these are annotated as LRR motifs in Pfam even though the 178 sequences were derived from known 3D structures. The LRR motif annotation of each repeat was performed starting with the first position (L 0 ) of the minimal motif 'L 0 XXL 3 XL 5 ', position that marks the beginning of the ventral side of the horseshoe domain ( Figure 1b). Superposition of the 2100 repeats indicates that the structural similarity extends in most of the cases over five positions upstream and downstream of the minimal motif defining a 16 positions region which is referred herein as the 'extended' motif ( Figure A1d). Due to this, the structural Genes 2020, 11, 286 7 of 26 LRR diversity concentrates mainly onto the dorsal side of the horseshoe which imposes onto the curvature and the overall geometry of the domain ( Figure 1b). As duplications of highly similar LRR repeats within the same LRR domain is abundant in the ID90 set, we opted to perform a second redundancy filter at the level of LRR repeats as described (M&M). This results in the ID50 nonredundant set consisting of ≈850 LRR repeats, that approximates well the ID90 distribution of lengths ( Figure A1c), phyla (Figure 1c), and the ratio between marginal N-terminal (N) and C-terminal (C) versus interior motifs (L) ( Figure A1b). The 'entry' N-ter LRR motifs are less regular than the 'core' motifs, especially at the first hydrophobic position (L 0 ) that is often found solvent exposed, as this position marks the end of the inter-domain linker and the beginning of the LRR domain. By contrast, the 'exit' C-ter LRR motifs better resemble the 'core' motifs (L) amino acid composition and the conventional LRR motif 'L 0 xxL 3 xL 5 xx(N/C) 8 xL 10 ' (Figure 1d). Interestingly, the stringency for leucine occurrence sequentially decreases from L 0 to L 3 and L 5 in core repeats, allowing other amino acids to be present in L 3 and L 5 more frequently (Figure 1d). This structurally correlates with a larger accessible space of the protein core structure around L 3 and L 5 positions, as can be seen from Figures 1b and A1d. It is also worth noting that the third L -3 position upstream of LxxLxL has a significant hydrophobic propensity presumably allowing the solenoid to form (Figure 1d). Another important facet that has to be carefully pondered is the high phyla bias of the structural data when compared to the baseline phyla distribution of the UniRef50 database. As can be seen from Figure 1c, around 50% of the repeats in ID50 are of mammalian origin while the UniRef50 baseline is of less than 3% in both annotated LRR proteins or any protein. Moreover, the ≈20% plant LRR motifs present in ID50 originate overwhelmingly from RLP and RLK proteins while plant NLRs are poorly represented in this set, with only a single 3D structure recently reported for the ZAR1 NLR protein from Arabidopsis thaliana [21,22]. well the ID90 distribution of lengths ( Figure A1c), phyla (Figure 1c), and the ratio between marginal N-terminal (N) and C-terminal (C) versus interior motifs (L) ( Figure A1b). The 'entry' N-ter LRR motifs are less regular than the 'core' motifs, especially at the first hydrophobic position (L0) that is often found solvent exposed, as this position marks the end of the inter-domain linker and the beginning of the LRR domain. By contrast, the 'exit' C-ter LRR motifs better resemble the 'core' motifs (L) amino acid composition and the conventional LRR motif 'L0xxL3xL5xx(N/C)8xL10' (Figure 1d). Interestingly, the stringency for leucine occurrence sequentially decreases from L0 to L3 and L5 in core repeats, allowing other amino acids to be present in L3 and L5 more frequently (Figure 1d). This structurally correlates with a larger accessible space of the protein core structure around L3 and L5 positions, as can be seen from Figures 1b and A1d. It is also worth noting that the third L-3 position upstream of LxxLxL has a significant hydrophobic propensity presumably allowing the solenoid to form (Figure 1d). Another important facet that has to be carefully pondered is the high phyla bias of the structural data when compared to the baseline phyla distribution of the UniRef50 database. As can be seen from Figure 1c, around 50% of the repeats in ID50 are of mammalian origin while the UniRef50 baseline is of less than 3% in both annotated LRR proteins or any protein. Moreover, the ≈20% plant LRR motifs present in ID50 originate overwhelmingly from RLP and RLK proteins while plant NLRs are poorly represented in this set, with only a single 3D structure recently reported for the ZAR1 NLR protein from Arabidopsis thaliana [21,22].  (PDB: 6J5W). The hydrophobic positions in the minimal 'L 0 xxL 3 xL 5 ' motif are shown in orange. The first N-entry repeat (blue) and the last C-exit repeat (red) are also mapped on the structure. (c) Phyla distribution of the initial LRR motif set ID90, the 50% identity trimmed LRR motifs set (ID50), annotated LRR proteins and all proteins from the UniRef50 database (from left to right). Percent values corresponding to the mammals group are shown in red. (d) Frequency plot of amino acid composition of the N-entry, core and C-exit motifs on the 50% identity trimmed set. Amino acids are colored according to their properties as follows: hydrophobic (yellow), acidic (red), basic (blue), asparagine and glutamine (purple), proline and glycine (green), others (black). (e) Jensen-Shannon divergence (JSD) score for each position of the LRR motif at different identity thresholds. Higher values show increased conservation. In order to train a machine learning (ML) estimator for detecting LRR motifs we used an overall dataset comprising the filtered LRR ID50 dataset and a collection of 875 non-LRR domains composed of one representative of each CATH topology ( Figure 2a). As discussed in Section 1, the sequence patterns corresponding to the ≈850 actual true structural LRR motifs identified in ID50 are quite common in any protein. We will name here such sequence patterns as potential motifs. As expected, Table 1 shows that potential motifs occur with more or less equal probability in both the LRR and non-LRR domains of the overall dataset. Moreover, even when taking into account only LRR domains the number of potential motifs is larger than the number of true structural LRR motifs (Table 1). This allows the ML estimators to learn to detect true motifs from the far larger set of potential motifs by taking into account the larger 16 amino acid sequence context in which the true motifs are embedded. In this way the method developed herein can be used not only to delineate repeats in a given LRR domain but also to discriminate between protein products that do not have LRR domains from those hosting such domains.  In developing LRRpredictor we tested 'sequence-based' features based on position-specific scoring matrices-PSSMs either solely or combined with 'structural-based' features as described in Section 2 ( Figure 2c). PSSM profiles are expected to provide context information on the overall sequence, to highlight the key amino acids position that are conserved, as the amino acids scores are derived from amino acid substitution probabilities conditioned by the homologues family they belong to. Therefore, it is expected that irregular LRR motifs would be more detectable when using sequence profiles, rather than amino acid sequence alone. scoring matrices-PSSMs either solely or combined with 'structural-based' features as described in Section 2 ( Figure 2c). PSSM profiles are expected to provide context information on the overall sequence, to highlight the key amino acids position that are conserved, as the amino acids scores are derived from amino acid substitution probabilities conditioned by the homologues family they belong to. Therefore, it is expected that irregular LRR motifs would be more detectable when using sequence profiles, rather than amino acid sequence alone.  The dataset was split into five parts: one part was initially separated as test set and the other four were used as a training set in parameter tuning using a four-fold cross-validation (CV) approach, where models were iteratively trained on three of the CV sets and tested on the remaining fourth ( Figure 2b). A pool of estimators (representing algorithms for classification) that used either (1) sequence-based or (2) both sequence and structural features and (3) various imbalance class treatments were optimized via cross-validation. Finally, best performing estimators were studied in the context of an ensemble estimator. The selected ensemble classifier, further referred to as LRRpredictor is a soft voter aggregating eight classifiers C1-C8 (Figure 2d) which were trained to detect the LRR motif starting position-i.e., L 0 position from the minimalistic LRR motif 'L 0 xxL 3 xL 5 '. Finally, LRRpredictor was trained on the entire training set (all four CV sets) and tested on the test set which had been set aside. The precision of LRRpredictor given by the fraction of true-positives (TP) predicted results over the sum of true-positives (TP) and false-positives (FP) varies between 89% and 97% on the test set and within cross-validation sets (Figure 3a). Similarly, the recall (also known as sensitivity), given by the fraction of TP over TP + false-negatives (FN) varies between 85% and 93%, while the F1-score (representing the harmonic mean between precision and recall) varies between 87% and 95% on the test set and cross-validation sets (Figure 3a,b).  [26] and LRRsearch [27] (computed on their webservers using default parameters). As seen in Figure 4a, repeat lengths are rarely found outside the 19-35aa range, cases in which prediction becomes ambiguous. Too short repeats are improbable due to structural constraints and might indicate false positive predictions. Similarly, too long repeats-over 40 amino acids-could indicate either the presence of undetected repeats (false negatives) or cases in which an insertion or 'island' shapes up protruding the horseshoe structure (Figure 4a). Very large gaps between LRR motifs (more than 100 aa) were not included in computing the length distribution as these are rather indicating the presence of an inserted domain flanked by two LRR domains. We further analyzed the percent of the annotated LRR domain span that is covered by LRRpredictor and compared the predicted LRR motifs to LRRfinder [26] and LRRsearch [27] predictions and to the existing motif annotations from Interpro collection. In doing so we defined as predicted repeats motifs separated by 15-35 amino acids. Predicted motifs that superpose or cluster within 15 amino acids were counted only once, while when the distance between two motifs was higher than 35, the repeat was considered to be a potential terminal repeat or contain a domain break and the first 24 aa of such a stretch was assigned as a predicted repeat, given that this is the most frequent repeat length over the structural data.  [26] and LRRsearch [27] (computed on their webservers using default parameters). As the available structural data is scarce, we further evaluated the extrapolation capabilities of LRRpredictor on a set of LRR domains annotated in Interpro collection. Groups of the most representative protein functional classes containing LRR domains were generated as follows: four groups from flowering plants-resistance proteins (CNL plants and TNL plants ) and extracellular receptors (RLK plants and RLP plants ) and two groups from vertebrates-NLR vert and TLR vert as described in Section 2. Selected sequences from each group were subjected to LRRpredictor motif detection. The repeat length distribution of the predicted LRR repeats (Figure 4a), is consistent with previously reported lengths within all protein groups of the seven type Kobe-Kajava (KK) classification [14,65]. The repeat length distribution of extracellular LRR domains (RLK plants , RLP plants , and TLR vert ) show a sharp peak at 24 amino acids, in agreement with the most frequent repeat length within plant-specific (PS) from KK classification [14,65]. As they often contain large helices over the dorsal side of the LRR horseshoe, vertebrate NLRs repeats have longer lengths (25-30 aa) as previously shown by the same classification, while plant NLRs (CNL plants and TNL plants ) have a larger distribution with a lower peak shaping up toward lower value side (20-24 aa) of repeat lengths range. (Figure 4b). For all six receptor classes analyzed herein, both LRRfinder and LRRsearch slightly increase the LRR coverage as compared to Interpro annotations especially in the case of extracellular receptors, with LRRsearch surpassing LRRfinder in the case of plant NLRs (Figure 4b). As also can be seen from Figure 4b, in comparison to Interpro and the two predictors mentioned above, LRRpredictor covers far larger regions of LRR domains with coverage percentages (CP) exceeding 60% and almost complete coverage in over 50% in all six groups (Figure 4b). It is interesting to note that Interpro annotation of extracellular LRR domains also include the N-terminal cap region, that is not formally a LRR repeat. This results in the fact that LRRpredictor covers in most cases only ≈90% of this domain, instead of 100% as in NLR groups (Figure 4b).  Further, the amino acid composition of the predicted LRR motifs was investigated solely on the 'core' predicted LRR repeats, i.e., repeats that are flanked by other predicted repeats within a 15-35 As seen in Figure 4a, repeat lengths are rarely found outside the 19-35aa range, cases in which prediction becomes ambiguous. Too short repeats are improbable due to structural constraints and might indicate false positive predictions. Similarly, too long repeats-over 40 amino acids-could indicate either the presence of undetected repeats (false negatives) or cases in which an insertion or 'island' shapes up protruding the horseshoe structure (Figure 4a). Very large gaps between LRR motifs (more than 100 aa) were not included in computing the length distribution as these are rather indicating the presence of an inserted domain flanked by two LRR domains. We further analyzed the percent of the annotated LRR domain span that is covered by LRRpredictor and compared the predicted LRR motifs to LRRfinder [26] and LRRsearch [27] predictions and to the existing motif annotations from Interpro collection. In doing so we defined as predicted repeats motifs separated by 15-35 amino acids. Predicted motifs that superpose or cluster within 15 amino acids were counted only once, while when the distance between two motifs was higher than 35, the repeat was considered to be a potential terminal repeat or contain a domain break and the first 24 aa of such a stretch was assigned as a predicted repeat, given that this is the most frequent repeat length over the structural data. The repeat coverage of analyzed LRR domains predicted by LRRpredictor, LRRfinder and LRRsearch were compared to the extent Interpro repeat annotations using a coverage percentage (CP) defined as the ratio between the sum of predicted/annotated repeat length vs the overall LRR domain length (Figure 4b). Plant NLRs from flowering plants show the lowest level of repeat annotation as 75% and 50% of CNL and TNL LRRs in Interpro lack any repeat annotation resulting in CP = 0% (Figure 4b). In comparison, repeats in vertebrate NLRs are better annotated in a CP ranging within 20-60% of the LRR domain. Even higher Interpro repeat annotations are shown by the extracellular plant and vertebrate receptors with CP ranging most frequently between 30% and 80% of the LRR domain size (Figure 4b). For all six receptor classes analyzed herein, both LRRfinder and LRRsearch slightly increase the LRR coverage as compared to Interpro annotations especially in the case of extracellular receptors, with LRRsearch surpassing LRRfinder in the case of plant NLRs (Figure 4b). As also can be seen from Figure 4b, in comparison to Interpro and the two predictors mentioned above, LRRpredictor covers far larger regions of LRR domains with coverage percentages (CP) exceeding 60% and almost complete coverage in over 50% in all six groups (Figure 4b). It is interesting to note that Interpro annotation of extracellular LRR domains also include the N-terminal cap region, that is not formally a LRR repeat. This results in the fact that LRRpredictor covers in most cases only ≈90% of this domain, instead of 100% as in NLR groups (Figure 4b). Further, the amino acid composition of the predicted LRR motifs was investigated solely on the 'core' predicted LRR repeats, i.e., repeats that are flanked by other predicted repeats within a 15-35 aa range. In short, the results presented below clearly indicate that LRRpredictor is able to detect and reproduce all the consensus motifs previously defined for well-studied classes of RLKs, NLRs, and TLRs ( Figure 5). This is especially the case for vertebrate NLRs. The consensus follows the ribosomal inhibitor (RI) type -'x -3 xxL 0 xxL 3 xL 5 xx(N/C) 8 xL 10 xxxgoxxLxxoLxx' [14,65], with position '-3' being less relevant for this class of repeats. Additionally, the vertebrate TLRs predicted motif consensus matches the "T" type motif: L -3 xxL 0 xxL 3 xL 5 xxN 8 xL 10 xxL 13 xxxx(F/L) 18 xxL 21 xx defined in Matushima et al. classification [13] rather than the less encountered "S" type motif: L -3 xxL 0 xxL 3 xL 5 xxN 8 xL 10 xxL 13 Px(x)LPxx. In the case of plant extracellular receptors, the predicted motifs from RLK plant and RLP plant groups show a prolonged pattern that is in perfect agreement with the plant-specific (PS) type from Kobe and Kajava classification [14,65]-L -3 xxL 0 xxL 3 xL 5 xxN 8 xL 10 (S/T) 11 GxIPxxLxxLGx. Interestingly, the kinase containing receptors (RLK) have a more prominent consensus ( Figure 5). On the other hand, the predicted motifs in plant NLRs comprising the CNL plant and TNL plant groups display a remote similarity with the cysteine-containing (CC) type as defined by Kobe and Kajava classification [14,65]: "(C/L) -3 xxL 0 xxL 3 xL 5 xxC 8 xxITDxxOxxL(A/G) xx"-where O is any nonpolar residue. While the extended motif is satisfied (16 aa), a difference worth noting is that in both CNL and TNL groups cysteine is rare in position '-3' and outside this region any similarity with CC-type ends. Both plant NLR groups mainly confine their consensus to only the minimal L 0 xxL 3 xL 5 motif, with TNL extending it a little bit with C 8 position. By contrast, in plant extracellular receptors the consensus expands beyond the 16 amino acids of the 'extended' region covering all the four sides of the LRR solenoid. Despite being analogous in composition, the TNL plant group consensus is more pronounced, especially at positions C 8 and L 11 ( Figure 5). In all six classes L 0 , L 3 , and L 5 of minimal motif are as expected overwhelmingly hydrophobic, with all three positions occupied by leucine in around 50% of the cases, except CNLs where leucine occurrence seems less stringent ( Figure 6). When compared to the Kobe and Kajava classification, the majority of the motifs fall under the expected class and very few cross terms are seen between them ( Figure 6). While the extended motif is satisfied (16 aa), a difference worth noting is that in both CNL and TNL groups cysteine is rare in position '-3' and outside this region any similarity with CC-type ends. Both plant NLR groups mainly confine their consensus to only the minimal L0xxL3xL5 motif, with TNL extending it a little bit with C8 position. By contrast, in plant extracellular receptors the consensus expands beyond the 16 amino acids of the 'extended' region covering all the four sides of the LRR solenoid. Despite being analogous in composition, the TNLplant group consensus is more pronounced, especially at positions C8 and L11 ( Figure 5).  In all six classes L0, L3, and L5 of minimal motif are as expected overwhelmingly hydrophobic, with all three positions occupied by leucine in around 50% of the cases, except CNLs where leucine occurrence seems less stringent ( Figure 6). When compared to the Kobe and Kajava classification, the majority of the motifs fall under the expected class and very few cross terms are seen between them ( Figure 6). CNLs and TNLs seem more dispersed even on a shorter 11 amino acid window consensus (W11), while the extracellular receptors obey in over 60% of the cases the corresponding W11 pattern that is shared simultaneous by all three classes ( Figure 6).  [14] predicted with LRRpredictor across the six receptor classes. As the motif consensuses from KK classification were very strict, we adapted these consensuses to different sequences windows (W6, W11, W16, or more) centered around the minimal motif as shown in the table. Percentages of the predicted motifs compatible with each consensus are shown with grey bars. Sequence variability is of critical importance for LRR domain function and in contrast to their common structural pattern, a wide spread in the sequence space is expected. To assess this, we analyzed the extended motifs, predicted by LRRpredictor, both the intra-and inter-group sequence similarity. This was performed over subsets of randomly selected 1000 examples of 'core' (L) motifs from each group. We selected as similarity measure a metric distance function [57] derived from BLOSUM scores which reflect the structural compatibility between amino acids, as described in Figure 6. Distribution of LRR motif types defined by Kobe and Kajava (KK) [14] predicted with LRRpredictor across the six receptor classes. As the motif consensuses from KK classification were very strict, we adapted these consensuses to different sequences windows (W6, W11, W16, or more) centered around the minimal motif as shown in the table. Percentages of the predicted motifs compatible with each consensus are shown with grey bars. CNLs and TNLs seem more dispersed even on a shorter 11 amino acid window consensus (W11), while the extracellular receptors obey in over 60% of the cases the corresponding W11 pattern that is shared simultaneous by all three classes ( Figure 6). Sequence variability is of critical importance for LRR domain function and in contrast to their common structural pattern, a wide spread in the sequence space is expected. To assess this, we analyzed the extended motifs, predicted by LRRpredictor, both the intra-and inter-group sequence similarity. This was performed over subsets of randomly selected 1000 examples of 'core' (L) motifs from each group. We selected as similarity measure a metric distance function [57] derived from BLOSUM scores which reflect the structural compatibility between amino acids, as described in Section 2. Using this metric, we calculated the distance between each predicted LRR motif from all groups and analyzed how these distances behave intra-and inter-groups. Intra-group all-vs.-all distances distribution shows that the extracellular groups RLK, RLP from plants and TLRs from vertebrates form a denser group in terms of conservation, than plant and vertebrate NLRs (Figure 7a left). Figure 7b shows the silhouette coefficients. These scores show how separated two given clusters are, based on the distance between samples from each group, the maximal value of 1 corresponding to perfectly separated clusters, value 0 corresponds to clusters that coincide, while negative values with a minimum of -1 correspond to the case where samples from one group actually cluster better with the opposite group that is being compared. Silhouette coefficient of all versus all analyzed groups indicate that the NLR groups form a rather overlapping cluster, that has an increased variability among its sample motifs (i.e., expanded cluster) (Figure 7b left). Extracellular plant receptors RLK and RLP clusters are overlapping and have a more reduced span in terms of variability (i.e., more conserved motifs), while vertebrate TLR overlap plant RLK and RLP receptors have a slightly increased variability (Figure 7a,b left). Interestingly, within the minimal LRR motif region 'L 0 XXL 3 XL 5 ' there are no significant differences between groups (Figure 7a,b right). To have an overall view on the sequence dispersion in each protein class containing LRR domains Figure 7c shows the 2D embedding of the high dimensional sequence space of both the extended and minimal motifs of each class. Nonetheless such a reduction gives only a rough representation of distance relations between clusters in the original space as the normalized stress parameter (stress-1) of this 2D embedding is 0.25 and 0.21 for the extended and minimal motif space, respectively [66].  From a structural point of view the LRR protein architecture belongs to the larger class of solenoidal architectures which are defined by specific repeated structural patterns. Given the repetitiveness of such structures we asked if LRRpredictor is able to discriminate between LRR motifs and other repetitive sequence patterns. The main candidates considered for possible misclassifications are two classes of beta sheet repeat proteins-which are the closest structural To have an overall view on the sequence dispersion in each protein class containing LRR domains Figure 7c shows the 2D embedding of the high dimensional sequence space of both the extended and minimal motifs of each class. Nonetheless such a reduction gives only a rough representation of distance relations between clusters in the original space as the normalized stress parameter (stress-1) of this 2D embedding is 0.25 and 0.21 for the extended and minimal motif space, respectively [66]. From a structural point of view the LRR protein architecture belongs to the larger class of solenoidal architectures which are defined by specific repeated structural patterns. Given the repetitiveness of such structures we asked if LRRpredictor is able to discriminate between LRR motifs and other repetitive sequence patterns. The main candidates considered for possible misclassifications are two classes of beta sheet repeat proteins-which are the closest structural relatives of LRR domains: pectate lyases (PeLs) and trimeric LpxA architectures and two helical repetitive classes: armadillo and ankiryin architecture ( Figure A2b). To this end, 50 sequences from each of the above four classes annotated as such by Interpro were randomly selected from UniRef50. Figure A2a shows the probabilities returned by LRRpredictor that the potential motifs occurring in the 200 sequences are true LRR structural motifs. As can be seen in all four classes taken into account, the vast majority of potential motifs have a probability lower than 10% to be true motifs. Only 0.1% of such sites show a probability between 10% and 20% to be true motifs and none of these sites reaches a threshold of 40% for being a true LRR motif ( Figure A2a). From a technical point of view this result shows that LRRpredictor is highly specific for LRR domains. On the other hand this result is even more interesting from a structural and biological point of view indicating that even if LRRs and PeLs were considered to be members of the same LRR superfamily [67] the structural principles upon which they are built are different and presumably the two classes have diverged very early in evolution. Given the high number of indeterminacies generated by sequence variability, a proper annotation of LRR motifs and the correct delineation of repeats is critical in identifying potential protein-protein interaction sites of LRR domains. Here, we show that LRRpredictor is able to address this problem and by this, can be of use as a new tool in the analysis of especially plant NLR sequences that display a larger variability and irregularity as compared to other LRR domains [9,68]. This often results in the superposition or presence in less than a minimal repeat distance of potential alternative LRR motifs, as can be seen from Figure 8 illustrating such indeterminacies found on a 150 amino acid stretch from the potato CNL Gpa2 LRR domain. were considered to be members of the same LRR superfamily [67] the structural principles upon which they are built are different and presumably the two classes have diverged very early in evolution. Given the high number of indeterminacies generated by sequence variability, a proper annotation of LRR motifs and the correct delineation of repeats is critical in identifying potential protein-protein interaction sites of LRR domains. Here, we show that LRRpredictor is able to address this problem and by this, can be of use as a new tool in the analysis of especially plant NLR sequences that display a larger variability and irregularity as compared to other LRR domains [9,68]. This often results in the superposition or presence in less than a minimal repeat distance of potential alternative LRR motifs, as can be seen from Figure 8 illustrating such indeterminacies found on a 150 amino acid stretch from the potato CNL Gpa2 LRR domain. Given the scarcity of structural learning data consisting of less than 180 LRR structures with lower than 90% identity and only ≈850 motifs at hand in ID50 (<50% identity), in order to maximize LRRpredictor extrapolation abilities, the method was set to rely on aggregating a collection of eight classifiers based on different strategies, two of them designed to perform a massive oversampling of the real data ( Figure 2). In this context, LRRpredictor shows to perform well, with overall precision, recall, and F1 scores ranging between 85% and 97% on both test and cross validation sets (Figure 3a). In addition, LRRpredictor increases its performances when taking into account only the 'core' repeats (L), as the main prediction problems relate only to the N-'entry' repeats (N)-i.e., the first repeat of the LRR Figure 8. LRR motif and repeat indeterminacies onto a 150 aa stretch in Gpa2 potato NLR. Potential motifs that follow the minimal 'LxxLxL' pattern (where L is any hydrophobic amino acid) are illustrated above the sequence with black bars and yellow highlight, while LRRpredictor results are shown above with blue bars. Given the scarcity of structural learning data consisting of less than 180 LRR structures with lower than 90% identity and only ≈850 motifs at hand in ID50 (<50% identity), in order to maximize LRRpredictor extrapolation abilities, the method was set to rely on aggregating a collection of eight classifiers based on different strategies, two of them designed to perform a massive oversampling of the real data ( Figure 2). In this context, LRRpredictor shows to perform well, with overall precision, recall, and F1 scores ranging between 85% and 97% on both test and cross validation sets (Figure 3a). In addition, LRRpredictor increases its performances when taking into account only the 'core' repeats (L), as the main prediction problems relate only to the N-'entry' repeats (N)-i.e., the first repeat of the LRR domain (Figure 3a, Table A1). This can be explained in part by the increased irregularity of the sequence in this region, but also by the small sample size of the N-'entry' (N) motifs when compared to the 'core' (L) motifs. It is also important to note here the fact that false positives are almost never found in nonLRR domains but always in proteins containing LRR domains (Table A1). Here, such false positives shape up in close vicinity to the marginal repeats-where the LRR motif characteristics are more diffuse, or in linkers or different domains neighboring the LRR, but found in a 'one repeat range' to the N-entry motif. Other false predictions are caused by alignment artefacts. These yield to an offset of 1-3 amino acids in the predicted LRR motif starting position. Alignment artefacts are also frequently seen in regions with high beta structure propensity of insertion loops or 'islands' protruding from the LRR domain structures. This is mainly due to the fact that the multiple alignment on which PSSM relies forces the protruding loop in the queried sequence to align to regular repeats in the template LRRs of the database. Unfortunately, the number of such insertion loops or 'islands' is so small in ID90/ID50 that estimators cannot learn from the existing data to discriminate such false positives. Thus, only careful structural analysis performed in later modelling stages can handle such cases. Results on both cross-validation and test sets show that estimators using structural features in addition to the sequence based features (C5-C8) perform on average only slightly better compared to those sequence based only (C1-C4), with some interesting improvements on F1 scores (Figure 3b). This only marginal improvement may indicate that RaptorX-Property [34] training on the overall structural database that might have marginally overlapped with our testing dataset did not affect the results. Nevertheless, C5-C8 are expected to be better extrapolators (Table A1), while the structural predictions on which (C5-C8) are based, and that are present in the output file can prove instrumental in further dealing with ambiguous cases where two LRR motif signatures partially superpose or are within the limit of a repeat. Figures 3c and 4b compare predictions of three existing engines. LRRpredictor outperforms LRRsearch [27] and LRRfinder [26]. This is expected as the two previous methods were designed to focus mainly on specific LRR classes such as vertebrate TLRs or NLRs, respectively, while LRRpredictor relies on a newer larger dataset and was designed to identify LRR motifs in general. However, despite focusing on specific protein classes, both LRRsearch and LRRfinder show comparable efficiency in covering annotated LRR domains in plant extracellular receptors but decreased capabilities on plant NLRs (CNLs and TNLs) (Figure 4b). Furthermore, both LRRsearch and LRRfinder were intended for fast computation and they use a predefined PSSM matrix computed on a curated collection of LRR domains, instead of performing case by case basis sequence profiles as our method does. However, the increased performance of LRRpredictor comes with an attached computational cost and is not easily scalable for scanning large protein sequences databases such UniprotKB. The main reason for this is that generating case by case sequence profiles and performing predictions for each estimator aggregated in LRRpredictor is more computationally demanding than LRRfinder and LRRsearch workflow. Another matter of concern was related to the phyla bias of the database on which LRRpredictor relies, as ≈50% of ID90 have mammalian origin while the share of mammalian-from total-annotated LRRs in UniRef50 is only 2% (Figure 1c). Moreover, groups such as plant NLRs are extremely poorly represented, as only very recently the first plant NLR structure was reported [21,22]. In this context, in order to investigate the extrapolation capabilities of LRRpredictor we used a set of LRR domains annotated in Interpro collection from the six most representative immune receptor classes: R-proteins and extracellular receptors from flowering plants (CNL plants , TNL plants , RLK plants , RLP plants ) and their vertebrate counterparts (NLR vert , TLR vert ). The LRR motifs predicted by LRRpredictor show a good coverage of the LRR domains annotated by Interpro and follow the expected repeat length distribution for all these six classes [14,65] (Figure 4a,b). Moreover, the predicted motifs reproduce the expected LRR motif consensus of each protein class ( Figure 5) from Kobe and Kajava classification [14,65]. Combined, these indicate that LRRpredictor is able to extrapolate well in different LRR motif classes which is especially important for plant NLRs. Analysis of LRRpredictor detected motifs showed clear differences between the six classes within the extended 16 aa motif. Whether variation in these extended motifs directly relate to the functional diversification of the different receptor classes still remains to be addressed. By contrast, within the minimal 6 aa LRR motif region-L 0 XXL 3 XL 5 -there are no significant differences between the six groups ( Figure 7). This might suggest a common root of minimal structural criteria imposed by the solenoidal architecture from which the six classes have diverged to fulfil specific tasks in specific environments. For receptor function, such a solenoidal domain organization in which only three positions over a ≈25 repeat length are loosely conserved has two-fold evolutionary advantages: first the solenoid architecture ensures a large solvent exposed surface area [10] and second a high sequence variability can be achieved without disturbing the tertiary structure. The increased conservation seen at the level of the extended motif among all three extracellular LRR classes-plant RLK, RLP and vertebrate TLRs-when compared to plant and vertebrate NLRs could be related to N-glycosylation and the constraints imposed by the extracellular environment. On the one hand, plant NLRs recognize directly or indirectly a suite of pathogen effectors or (perturbations) of their host targets conferring host specific immunity. Single amino acid changes in the effector can already be detected or are sufficient to evade recognition by a NLR, resulting in a co-evolutionary arms race between pathogen effectors and host immune receptor [69,70]. In contrast, extracellular LRRs recognize often conserved microbial patterns to confer basal immunity thus lacking such a strong driver for diversification [71]. Vertebrate NLRs act more like basal immune receptors in innate immunity, recognizing conserved microbe-associated molecular patterns (MAMPs). The greater diversifying selection imposed by fast-evolving effectors may therefore account for the co-evolution of structurally highly variable LRR motifs in plant NLRs. In the future, it will be interesting to relate our LRR structural annotations to specific functional NLR sub-classes. This is relevant, for instance, as some plant NLRs-types are described to have a downstream 'helper' function rather than a role as a canonical 'sensor'. Another aspect is that LRR domains in plant NLRs have a dual role. They not only contribute to pathogen recognition, but also negatively regulate the switch function [72]. Hence, it will be interesting to link LRR structural annotations to specific intramolecular domain interactions between LRRs and other NLR subdomains to better understand the co-evolution of protein domains in NLRs. It is shown that subtle mutations in the interface between LRR and NB-ARC can have a major effect on NLR functioning, often resulting in constitutive immune activation or a complete loss-of-function [17,72]. This shows the tight link between structural and functional constraints underlying the shaping of NLRs in plants. Additionally, the link between LRR structural annotations and complex formation with other host proteins will be interesting to assess. LRR domains are known to interact with other components like chaperones (e.g., SGT1) which are required for proper NLR folding and functioning [73], or kinases (e.g., ZED1, RKS1) [21,22,74] but also NLR hetero-and homodimers are often formed [9,75,76] which could impose additional structural constraints on the shape and irregularity of LRR domains in plant NLRs. The results presented herein indicate that LRRpredictor shows a good performance on the available 3D data and good extrapolation capabilities on plant NLRs (CNL/TNL), which are poorly represented in the training dataset. Predicted LRR repeats using LRRpredictor significantly increase the coverage of Interpro annotated LRR domains from main immune receptors groups. In addition, these predicted repeats are consistent with previously defined motif consensuses from all studied groups and also follow the repeat length range specific to each class. In conclusion, LRRpredictor is a tool worth using in research topics related to understanding immune receptors functions and structure-informed strategies for pathogen control technologies.  loss of samples (left) and increase in entropy (right) at different identity thresholds. Displayed is the Shannon entropy averaged over the 16 amino acid extended motif. (b) Composition of LRR motif types: N-entry (N), core (L), and C-exit (C) LRR motifs in the initial set (ID90) and in the 50% identity trimmed dataset (ID50). (c) LRR repeat length distribution at different identity thresholds. C-exit motifs were not used. (d) Structural superposition of the LRR repeats from a plant NLR, vertebrate NLR, plant RLK and vertebrate TLR structures [22,[77][78][79] (from left to right). Hydrophobic positions of the minimal 'L0xxL3xL5' motif are shown in orange and position N8 in purple.   Table A1. Detailed performance analysis on LRRpredictor and its classifiers. Precision recall and F1 scores are shown for in-sample (i.e., training data) and out-of-sample data (i.e., test data that was not used in training), for both cross-validation and test phase. In the cross-validation stage, classifiers were trained on three of the cross-validation (CV) sets and tested on the fourth set in an iterative manner, while in testing stage, classifiers were trained on all four CV sets and evaluated on the test set left aside from the beginning. The counts for true-negatives (TN), false-positives (FP), false-negative (FN), and true-positive (TP) within each set are also shown. As marginal repeats (N-entry and C-exit types) have a lower detection rate, also included is the recall calculated only with respect to 'core' repeats (L), indicated with blue font. Performance scores shading is according to a value based colormap from yellow (0.75) to blue (1.00). In   
Introduction Materials and Methods Assembly and Analysis of the LRR Structural Dataset Training and Testing Datasets Construction Feature Selection and Data Pre-Processing Machine Learning Model Selection Assembly of Protein Family Sets Containing LRR Domains Assessment of LRR Motif Conservation Across Protein Groups Results Available LRR Domains in Structural Data Development of the LRRpredictor Method Assessment of LRRpredictor Performance LRRpredictor Behavior on Protein Families Containing LRR Domains Predicted Repeats Consensus in Each Class Predicted Repeats Consensus in Each Class LRR Motifs Variability Across Classes LRR Motifs Variability Across Classes LRRpredictor Specificity Tested on Solenoid Architectures LRRpredictor Specificity Tested on Solenoid Architectures Discussion Discussion Conclusions Dataset Classifier Figure 1 . Figure 1 . L Figure 2 . Figure 2 . Figure 3 . Figure 3 . Figure 4 . Figure 4 . Figure 5 . Figure 5 . Figure 6 . Genes 2019 , Figure 7 . Figure 7 . Genes 2019 , Figure 8 . Figure A1 . Figure A1 . Figure A2 . Figure A2 . Table 1 . Table A1 .
Full NonLRR Proteins 
LRR Proteins 

 Dataset 
Classifier 

In-Sample 
Out-Of Sample 

Precision Recall F1-Score 
Precision Recall F1-Score 

TN 
FP 
FN 
TP 
Recall on Core(L) Only 
-
Non-LRR 
Proteins 

LRR 
Proteins 

N-Entry 
(N) 

Core 
(L) 

C-Exit 
(C) 

N-Entry 
(N) 

Core 
(L) 

C-Exit 
(C) 

Test 

C1 
0.900 
0.997 
0.946 
0.874 
0.880 
0.877 
35107 
0 
19 
6 
10 
2 
13 
109 
10 
0.916 
C2 
0.962 
0.956 
0.959 
0.941 
0.847 
0.891 
35118 
0 
8 
8 
12 
3 
11 
107 
9 
0.899 
C3 
0.882 
0.896 
0.889 
0.852 
0.847 
0.850 
35104 
1 
21 
8 
13 
2 
11 
106 
10 
0.891 
C4 
0.940 
0.874 
0.906 
0.907 
0.840 
0.872 
35113 
1 
12 
8 
14 
2 
11 
105 
10 
0.882 
C5 
0.895 
0.934 
0.914 
0.862 
0.873 
0.868 
35105 
1 
20 
7 
10 
2 
12 
109 
10 
0.916 
C6 
0.940 
0.901 
0.920 
0.928 
0.860 
0.893 
35116 
0 
10 
7 
12 
2 
12 
107 
10 
0.899 
C7 
0.990 
1.000 
0.995 
0.827 
0.827 
0.827 
35100 
4 
22 
7 
16 
3 
12 
103 
9 
0.866 
C8 
0.942 
0.874 
0.906 
0.920 
0.840 
0.878 
35115 
0 
11 
9 
13 
2 
10 
106 
10 
0.891 
LRRpredictor 
0.943 
0.928 
0.936 
0.928 
0.860 
0.893 
35116 
0 
10 
7 
12 
2 
12 
107 
10 
0.899 
