Next Article in Journal
Sodium Nitroprusside-Induced Activation of Vascular Smooth Muscle BK Channels Is Mediated by PKG Rather Than by a Direct Interaction with NO
Next Article in Special Issue
Binding Networks Identify Targetable Protein Pockets for Mechanism-Based Drug Design
Previous Article in Journal
Identification of Kukoamine A, Zeaxanthin, and Clexane as New Furin Inhibitors
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJMS
Volume 23
Issue 5
10.3390/ijms23052797
ijms-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Unsupervised Learning in Drug Design from Self-Organization to Deep Chemistry

by
Jaroslaw Polanski
Institute of Chemistry, Faculty of Science and Technology, University of Silesia, Szkolna 9, 40-006 Katowice, Poland
Int. J. Mol. Sci. 2022, 23(5), 2797; https://doi.org/10.3390/ijms23052797
Submission received: 3 February 2022 / Revised: 27 February 2022 / Accepted: 27 February 2022 / Published: 3 March 2022
(This article belongs to the Special Issue Complexity and Networking in Molecular Systems)
Browse Figures
Review Reports Versions Notes

Abstract

:
The availability of computers has brought novel prospects in drug design. Neural networks (NN) were an early tool that cheminformatics tested for converting data into drugs. However, the initial interest faded for almost two decades. The recent success of Deep Learning (DL) has inspired a renaissance of neural networks for their potential application in deep chemistry. DL targets direct data analysis without any human intervention. Although back-propagation NN is the main algorithm in the DL that is currently being used, unsupervised learning can be even more efficient. We review self-organizing maps (SOM) in mapping molecular representations from the 1990s to the current deep chemistry. We discovered the enormous efficiency of SOM not only for features that could be expected by humans, but also for those that are not trivial to human chemists. We reviewed the DL projects in the current literature, especially unsupervised architectures. DL appears to be efficient in pattern recognition (Deep Face) or chess (Deep Blue). However, an efficient deep chemistry is still a matter for the future. This is because the availability of measured property data in chemistry is still limited.

1. Introduction

The availability of computers has brought novel prospects in drug design. The tautological term rational drug design (irrational design would be contrary to logic), coined for computer technologies, illustrates the high expectations in this area. However, after a few years of early fascination, in the late 1990s, medicinal chemists observed that the in silico methods did not live up to their promise. New ideas for increasing the efficiency of computer-assisted drug discovery and development were needed [1]. This reflection inspired the formation of cheminformatics. Because cheminformatics currently attempts to organize all of the research that connects chemistry and computer science, we often forget that drug design was its first task.
Neural networks (NN) were an early tool that cheminformatics tested for converting data into drugs. Predicting properties and molecular mapping were among the applications. However, the initial interest faded for almost two decades. The confidence in NN waned. The methods seemed to be too obscure to support rational methods. It was only recently when there has been a renaissance of NNs. An NN is still a black box, but at the same time, it behaves like a magic tool. The success of deep learning (DL), an NN method that insists that machine learning can solve problems by learning from experience, is among the concepts that have caused this effect. Automated drug design is a novel paradigm and a priority [2]. DL performs direct data analysis without any human intervention. DL appears to be surprisingly efficient in pattern recognition (Deep Face), language translation, and chess: after a single win by Kasparov over Deep Blue in the late 1990s, no human has succeeded against a machine.
Generally, current applications of unsupervised learning in DL are still rare. However, in drug design, unsupervised architectures can be surprisingly broadly observed, indicating the efficiency of the method and the fact that we need to process sizeable molecular data when measured properties are not available. This publication reviews recent applications of the DL algorithms for drug design, comparing them to the early unsupervised neural networks. In particular, in unsupervised learning applications for mapping molecular representations, we can still recognize the early neural network protoplasts.

2. Artificial Intelligence, Machine or Deep Learning—Magic Tools or a Viral Buzz

Artificial intelligence (AI) is a popular term that appears relatively early, describing our potential for imitating natural human capabilities with computers [3]. The precise meaning of AI is vague. AI engages computer sciences and a variety of humanities, e.g., psychology and neurology. In the more narrow meaning, McCarthy defines AI as the science and engineering of making intelligent machines, especially intelligent computer programs [4].
Machine learning is a method of data processing by various in silico algorithms. This term refers to various methods, including decision trees, naive Bayes classifiers, random forest, support vector machine, hidden Markov models, and other data processing algorithms capable of handling big data. Machine learning can involve supervised, unsupervised, or reinforcement learning, depending upon the targeted outcome of data processing. In supervised systems, we attempt to predict the output values represented by the so-called training labels. We focus on searching for natural patterns and structures within the data with unsupervised methods. We do not use any training labels here. In turn, in reinforcement learning, machines can interact with the environment and get a reward for a proper action or behavior [5].
The term Deep Learning was coined by Rina Dechter in 1986 [6] and gained popularity with Igor Aizenberg, who searched for the ability to learn higher-level features from raw input data using multiple layer neural network architectures [7]. Geoffrey Hinton from the University of Toronto and Google provided recent inspiration in this field [8]. Autonomic behavior without any human intervention is among the desired functionalities. We usually associate DL with back-propagation, a specific NN architecture that is widely used in DL systems. Although back-propagation enables a variety of DL applications to be developed, DL can also involve other neural architectures, in particular deep, SOM architectures, e.g., with convolutional layers for clustering and visualizing image data [9]. An excellent introduction to DL methods and perspectives can be found in the Hinton interview [8]. Schneider indicates that we should not overestimate DL’s magic wands, which is a reincarnation of the early neural network methods developed in the 1990s [2]. DL algorithms process big data. In other words, DL guides us through big data and avoids routine chemistry. However, when discussing the perspectives of automated drug design and discovery, Schneider signifies the importance of DL methods by indicating their pattern recognition capabilities, especially when patterns escape the medicinal chemistry rationale [2]. In turn, Bajorath enlightened more critical issues, concluding that: we are still far from ‘true’ AI in discovery settings where algorithms would make compound decisions beyond human reasoning [10,11]. Often much simpler classifiers (logistic regression, decision lists) after preprocessing can give comparable results to more complex classifiers, deep neural networks, boosted decision trees, and random forests [12]. We should not increase model complexity if not needed.

3. From Chemical Compounds to Drugs and Materials: Defining the Problem

Molecular design in drug and materials discovery can be defined in a mathematical form as mapping molecular properties to descriptors P → S. This procedure is known as a direct (Q)SAR problem and is only very rarely realized [1]. Practically, the majority of drug design methods rely on S → P mapping in which we form a model that is hopefully predictive enough to design novel compounds (having a certain calculable S) from a series of active drug or material candidates (having a certain calculable S and measured properties). The predicted P values for the calculated S can be proven after new compounds are synthesized (Figure 1). A variety of methods can use the single or the multiple chemotype and property domains. In particular, QSAR and m-QSAR usually model single chemotype domains and property domains. On the other hand, the diversity-oriented synthesis DOS (FOS: function-oriented synthesis; BIOS: biologically oriented synthesis) uses multiple domains. In turn, the chemotype domain definition is not crucial for OMICS projects (genomics, proteomics, lipidomics). While the early NN approaches usually processed single-chemotype domains, the current approaches are multi-chemotype projects. The next question refers to the molecular representation that is to be used in the calculation. Molecular representations are descriptors or properties [13]. Two available options are feature engineering and feature learning [14]. The term feature indicates that we are following the lexicon of informatics more than that of chemistry. The meaning of feature is somewhere between a (chemical) property or descriptor and a variable. When contrasting engineering vs. learning features, we focus on the autonomic capabilities of an algorithm. In feature engineering, we need human intervention to design variables that are then analyzed by algorithms. In turn, computers should be fully autonomous in feature learning, which means that the algorithm selects the features from among the raw data. In the chemical context, feature engineering asks how to construct a molecular representation. Which data should represent chemical compounds in a model? Feature learning is an algorithm capable of autonomous feature engineering by computer, thereby enabling the molecular representation that is suitable for the individual project to be determined.
Especially in the context of DL, the ability of feature learning is a critical issue because DL should be able to autonomously select features, i.e., molecular representations. Efficient feature learning still seems to be a matter for the future deep chemistry, while deep chess or deep face applications are now commonly available. Let us try to answer the question of what the reason for that is. More or less, DL processes big data. On the one hand, the ability to learn higher-level features is an advantage. On the other hand, we need big high-quality data to train a network. The human population is almost eight billion, and as many potential face data are readily available. By comparison, we only have ca. 2000 registered drugs (new molecular entities) and the registered chemical compounds count millions (more than 200,000,000 compounds). We have drug candidate databases that collect millions of chemical structures and their properties (ChEMBL, PubChem, ZINC), but not all of the data therein are measured properties. If we use databases in materials discovery, the data availability is even lower [15].
Schneider reported 70 million single SAR data points to illustrate how big the available data are [2]. Errors in the data are also a problem. For example, protein X-ray data needs the so-called data curation before use. In chess, a player’s errors will result in defeat, thus providing a clear signal to the deep algorithm. In turn, there is no straightforward relationship for the raw drug or materials data and project results, which are often uncertain. Chemistry and drug and materials discovery is a soft science. Therefore, the current practice still needs human feature engineering.
Chuang et al. [15] indicated the essential features of molecular representations necessary for medicinal chemistry. Molecular representations that are used for data processing should be (i) expressive, i.e., capable of coding an entire diversity of molecular data; (ii) parsimonious, simple but not too simple; (iii) invariant, should not change, for example, with a changing atom numbering pattern and (iv) interpretable; humans should be able to interpret the rules that are discovered by machine learning in order to easily find those that describe the data and not the artifacts or noises. Chuang et al. [15] also enumerated the human interpretable representations of molecules: (i) a bond-like notation with an atom as the vertex and bonds as the edges; (ii) 3D visual representations; (iii) multiple conformers (aligned poses); (iv) canonical SMILES and (v) computed molecular descriptors.
Grebner et al. evaluated the molecular representations available for virtual screening in drug design. How big are the representations that they form and how big is big enough? Virtual means that we screen billions of molecular representations. Comparing the novelty vs. accuracy vs. calculation speed for 2D, 3D and structure-based representations indicated that novelty and accuracy increases from 2D to SBDD while speed increases in the opposite direction. Because economy is essential in drug design, the authors compared the timings and estimated CPU/GPU costs for various representations (SBDD). For example, generating the conformer sets for 1010 molecules using the cloud-based workflow ORION technology is feasible within two to three days and can cost 20,000 USD, while a 3D high-quality comparison using the FastROCS method can cost as little as 100 USD per query [16].

4. Self-Organizing Mapping of Molecular Representations

Basically, neural networks (NN) are computer algorithms based on an alleged similarity to the human brain. A reader can find a brief but illustrative introduction to the chemical applications in the early references [17] or [18]. Figure 2 illustrates the differences in the supervised vs. unsupervised architectures. In both methods, we present molecular representations to the subsequent inputs and optimize the network to minimize the errors between the expected and actual output produced (supervised learning) or between the similarity of the signals and output. Supervised learning requires that the inputs involve labels, i.e., specific data for error optimization, while in unsupervised learning, the error is minimized by comparing the individual inputs. The details of the individual methods and examples of their applications can be found in many references, e.g., [17,18].
Intuitively, a molecular surface is an area that determines the drug-receptor interactions. Actually, the molecular surface is a representation that is of essential importance for drug design. In the early 1990s, Zupan and Gasteiger designed a scheme for mapping 3D molecular surfaces to a 2D representation. An application of the torus topology in this operation enabled the 3D topology to be fully preserved within a 2D map [17,18] Technically, the whole molecular surface can be observed within the map, the one that is normally seen from the observer’s point of view and the side of the molecule that is normally hidden from the observer. The maps were colored by electrostatic potential. Because the molecular surface and its electrostatic potential are closely associated with drug-receptor interactions, they mapped several molecules in an attempt to find the similarities between the drugs that stimulated the associated receptors [18,19].
An interesting feature of the SOM network is its ability to compare molecular surfaces [19,20]. In Figure 3, the surfaces of butane and propane are compared. Colors of the molecular fragments code the respective methyl (CH3) or methylene (CH3) formations. The answer to the question about the difference between butane and propane is an obvious chemical routine. Propane and butane are members of a homological series with a clear difference of single methylene (CH2). It is the same answer from chemical analysis; the formal chemical matter difference will amount to the weight of CH2. However, the answer from topology is not so obvious. If we superimpose the molecules without cutting them, then the difference is that the terminal methyl group of the larger butane will not find its counterpart in the propane molecule. However, this answer is not so clear because, in a butane vs. propane superimposition, the propane CH3 (four atoms) meets the butane CH2 (three atoms). Despite this uncertainty, the network identifies the disparity of the molecular pair as the lack of an uninterrupted surface correspondence (the upper part of Figure 3b). However, if the network parameters are changed, a pair of comparative maps can be observed (Figure 3b, bottom), which is a surprise for a chemist. The difference is now three distinct wholes on the surface. This picture needs careful analysis in order to understand the network signal. Accordingly, the hydrogen of the propane terminal CH3 group can take a similar position to the carbon atom of the terminal methyl of butane (Figure 3). This comparison can be identified as a fuzzy topology. Therefore, the SOM network not only indicates a feature that is trivial for humans or what they might expect (topology) but also a feature that one should also perceive but is overlooked, for example, due to a routine (fuzzy topology). Can this ability be used in drug design? Usually, the molecules are superimposed before the SOM comparison. However, in the comparative mapping of molecules discovered serendipitously in the Technical University of Munich in the early 1990s, a series of CBG steroid data was directly projected onto an SOM network that had been trained with the most active CBG analog. The data were used without any preprocessing or superimposition. The molecular surface was used directly as a result of the 3D simulator CORINA. The resulting series of comparative SOMs (Figure 4) are amazing. All of the low-activity compounds are highly white (full with empty neurons), while those with a high (H) or medium (M) activity are colored (black in the white and black representation). Interestingly, compound 21 was presented in the original paper with an error and provided a map full of whites, but after correction, the proper map was obtained, which may reveal an unbelievable competence of the simple SOM architecture for drug discovery. It should be remembered that the chemotypes of the series are not significantly diversified and that the rigid steroid structures form clear shape patterns. The 1990s were not a time when the chemical audience could accept that a comparison of molecules that were not superimposed could bring any informative results [21]. We published a study of the SOM patterns of fully superimposed structures [19] or the auto-correlation function for coding 3D CBG steroids along with the comparative SOM architecture [22]. Later, we developed the Comparative Molecular Surface Analysis coupling SOM with a PLS analysis, a method similar to the Comparative Molecular Field Analysis for modeling 3D QSARs [23,24,25]. CoMSA can be interpreted as being a fuzzy complementation of CoMFA.
Because molecular surfaces are generated from atomic 3D coordinates and atomic radiuses, the crude atomic representation could be used to feed the SOM network. A receptor-like neural network is an SOM network that has been fed with 3D atomic data [26] in which the NN is learning the data of the most active analog as the best-known template that resembles the receptor. Then, this network processes the 3D atomic coordinates of the other CBG series that have not been superimposed. Similar SOM structures will be developed for the atomic coordinates and the similarity of resulting maps will depend on the similarity to the atomic coordinates of the most active analog. As the atomic coordinates are processed, the molecular shape is a factor that limits the pattern of the map. Interestingly, when the atomic charges and not the shape are the limiting factors (testosterone binding globulin, TBG), the method fails and must be redesigned to simulate the so-called induced-fit drug-receptor interactions [26].
The atomic representations by the Cartesian coordinates are the essential pieces of information that were processed by the SOM architectures of the 1990s. In turn, contemporary deep chemistry most often uses SMILES, simple and computer-ready interpretable data. SMILES are, however, linear, while molecules are 3D objects. From this point of view, atomic coordinate data map the molecular shape landscape more naturally than SMILES. For a discussion on the use of SMILES in deep chemistry see reference [27].
4D QSAR is a method that uses multiple conformer ensembles for ligand-based molecular design [28]. For a recent review, compare the references [29,30]. Molecular dynamics are used to generate the so-called pose (multiple conformer-like) representations. The method uses voxels, i.e., small cubics, to define the spatial location of individual ligand atoms. Replacing the classical 4D QSAR voxels with the SOM representations (4D SOM-QSAR) improves the efficiency and stability of the method [31,32,33,34]. It also improves its predictive power.
Finally, an SOM network operates as a clustering tool, which forms a latent-like space and even in early applications could process large molecular representations of the size of 105 [35]. This scheme has been popular in recent deep architectures. The early examples are mapping the 3D atomic data of HIV1 integrase inhibitors [35] or dopamine vs. benzodiazepine agonists [36]. For the topographic version, see reference [37]. In such an application, the network is fed with the molecular data for the whole library of molecules. An SOM network trained on a series of chemical compounds with a known functionality or activity level (training series) distributes them within the map. Then, the trained network used to cluster the designed molecules enables the activity for these novel analogs to be predicted depending on the similarity to the training library. This method, which is used for high throughput virtual screening, is both quick and relatively efficient. For example, for HIV1 integrase inhibitors the network was used to project in latent space 26,784 virtual compounds [35]. A variety of SOM modifications known as topographic mappings were published in the late 1990s by the group of Bishop [38]. The introduction to this method in the context of drug design and a comprehensive review can be found in the reference [37]. Recently, Qian et al. discussed the perspectives for using SOM in materials design mainly as a clustering tool [39].

5. Deep Learning for Processing Molecular Data in Drug Design

The potential profits of DL in rational drug discovery were recently reviewed in the references [40,41,42,43]. Multilayer structures enable the extraction of cascade features that work with nonlinear functions [2]. The main DL algorithm is a multilayer back-propagation that has been optimized for various tasks. Hinton explains the efficiency of this method by the fact that much effort has been expended to optimize it [8]. He also signifies that other architectures, particularly the unsupervised ones, can appear to be even more efficient. Table 1 presents individual examples of DL representations in drug design and indicates the supervised and unsupervised schemes. We can observe that unsupervised schemes are used surprisingly broadly. Probably, this indicates not only the efficiency of the method but also the fact that we need to process a sizeable molecular data share that is virtually generated, i.e., the measured properties do not label this portion of the data. The DL lexicon uses the term generative models (generative chemistry) for unsupervised algorithms to stress the difference between the classical design based on the local domain molecular exploration vs. the DL systematic continuous screening. Born and Manica [42] predicted that multimodal deep learning chemistry using disparate sources to generate molecules would be the next challenge in DL in the near future. The Variational Autoencoder (VAE) method [44] was developed as an algorithm to learn continuous molecular representations. This method was used by Gomez-Bombarelli et al. for an automatic chemical design using a data-driven continuous representation of molecules. In the critical operation of the latent space formation, the architecture analyzes the similarity of the SMILES codes of the candidate and the known inhibitor structures. A deep neural network involves three coupled functions: an encoder, a decoder and a predictor (Figure 5). The encoder converts the SMILES data into a continuous-like molecular representation, forming the latent molecular space in unsupervised learning. The distance in the space from the known highly active molecules defines the drug-likeness potential of the candidate structure. Such a latent representation enables the automatic generation of novel structures by perturbing or interpolating between the input chemical structures. Because SMILES codes represent molecules, this space can easily be decoded back to discrete molecular representations. On the other hand, the supervised perceptron algorithm predicts the biological properties from the latent space representation [45].
Self-organizing maps (SOMs) are used to quickly identify the potent DDR1 kinase inhibitors in the DL method. The SOM-based reward function scores the compound novelty based on the known DDR1 kinase inhibitors and patented structure data. The entire study, which involved a final synthesis and testing, was a 46-day-long project [46]. The authors used six data sets (1) a large ZINC-extracted data set, (2) known DDR1 kinase inhibitors, (3) common kinase inhibitors, (4) active compounds vs. non-kinase targets, (5) patented DDR1 kinase candidate structures and (6) 3D structures for the DDR1 inhibitors. Data processing involved operations such as (1) general and specific kinase self-organizing mapping (SOM), (2) modeling the pharmacophore by the crystal structures of the compounds in a complex with DDR1 or Sammon mapping. The study involves 40 structures (randomly selected) that covered the resulting chemical space and the distribution of the RMSD values. A chemical synthesis proved the calculation results.
Table
Table 1. Recent DL applications in drug design.
Table 1. Recent DL applications in drug design.
ProblemData/Learning TypeReference
DNA subregion bindingIn vitro HTS/convolutional neural networks[47]
Protein function3D electron density/convolutional filters[48]
GenomicsGene expression contrastive divergence (unsupervised) [49]; back-propagation (supervised) [50]; multilayer perceptron [51] supervised[49,50,51]
Pharmacodynamics (DeepDTI)Drug-protein interaction/unsupervised/then supervised [52]; supervised [53][52,53]
DeepAffinityCompound-protein affinity/supervised[54]
DeepTox toxicityToxic data/multi-task networks (supervised)[55]
Drug IC50Mol. descriptors/supervised[56]
VAE chemical propertiesSMILES; molecular graphs/unsupervised[45,57,58,59,60]
VAE/GENTRL DDR1 small molecule designSMILES; Kohonen-SOM based reward function/semi-supervised[46]
VAE/Graph encodersMolecular graphs/unsupervised[61,62,63]
Protein-ligand pairSMILES; voxels/unsupervised[64,65]
CMap/gen perturbagensGen-expression profiles/unsupervised[66]
Scaffold generationmolecular graphs; physicochemical properties; fragments/unsupervised[67,68,69,70,71,72,73,74,75]
Blaschke et al. [76] indicates that although generative modelling was applied in de novo design of novel active ligands [46] chemical diversity of the compounds often imitates to closely previous chemotypes [77,78,79].
Property prediction and molecular modeling are autonomous areas related to drug design. The prospects of applying deep learning in property prediction were reviewed recently by Walters and Barzilay [80]. The main conclusion is that training data is critical in generating any machine learning model. Although we have large property databases (PubChem or ChEMBL), the quality of these data can sometimes be questionable. In turn, pharmaceutical company data are structured inconsistently and not shared eagerly and therefore are hard to use in predictive property modeling. The early neural network models used fingerprints or other molecular descriptors as molecular representations. Then we should weigh the contribution of the individual features within the model, or in other words, we use feature engineering schemes. Current representations targeted at property prediction can learn features directly from the data, mapping SMILES or graphs into dense continuous vectors. Generative modeling allows de novo molecular design. The encoded SMILES or molecular graphs are mapped into the latent molecular space, which, unlike typical discrete representations, is designed to be smooth. Practically, the smoothness of such latent maps could, however, be questioned. [80]. This fact also indicates the limitation of SMILES which are linear, while molecules are 3D objects. Moreover, the SMILES of very similar objects can be completely different. In turn, the space 3D coordinates seem to be more natural. Such representations are typically used for noting X-ray structures. The 3D coordinates naturally represent molecular space, although the multi-conformation can be a problem. However, we should remember that deep learning operates by comparing similarities so that similar structures will generate similar conformations.
Molecular modeling is another exciting area for applying deep learning; for a recent review, see reference [81]. In molecular modeling, molecules (small molecules or macromolecules) are handled as geometric representations in 3D Euclidean space. Molecular representations used to simulate deep learning models are SMILES or sparse molecular graphs or amino acid sequence data. Deep learning-based molecular modeling could improve navigating chemical space, changing data mining in cheminformatics. For a detailed discussion of the problems, the reader should compare the review [81].

6. Feature Engineering vs. Feature Learning—A Lesson from Deep Retrosynthetic Approaches

Computer-assisted synthesis design (CASD) is an in silico application that has recently significantly profited from NN. CASD explores the potential ways to obtain a specific molecule by searching and probing a synthesis tree among potential reactions and reagents. Retrosynthesis is a method designed by Corey to solve this problem [82]. Corey also programmed the first software (LHASA, Harvard, Cambridge, MA, USA) to get computer assistance in the field. However, until recently, computers defeated the competition. Currently, there is tremendous interest in applying NN architectures in CASD [83,84]. DL is more and more competent here; however, humans still appear to be better at finding the critical disconnections within complex natural product molecules and human-machine cooperation wins the competition [85,86,87,88,89]. In conclusion, we still need feature engineering. However, neural networks have to support humans to succeed additionally.

7. Conclusions

The development of efficient DL methods can be observed in deep face (face recognition) and deep blue (chess playing) recently. These developments inspired the rebirth of using neural networks in drug design. The data in drug design are getting bigger and bigger; the 70 million SAR data points can illustrate data availability here [2]. The DL algorithms fit big data processing well. The most crucial advantage of DL is its ability to operate autonomously, which is a priority when automated drug design is the novel paradigm of the targeted future of medicinal chemistry. The so-called feature learning, i.e., the ability for autonomous feature selection, is a central quality of DL. Computer-aided synthesis design (CASD) is an example of enormous developments in recent years. The lesson from CASD is that a full feature learning mode is still a matter for the future. The most efficient methods still need human engineering features.
We should not overestimate DL’s magic wands, reincarnating the early neural network methods developed in the 1990s. Although DL algorithms currently use the supervised mode, the hope is that unsupervised algorithms could be even more efficient. We can observe that the unsupervised schemes are already used in drug design surprisingly broad. Probably, this indicates not only the efficiency of the method but also the fact that we need to process a sizeable molecular data share that is virtually generated, i.e., the measured properties do not label this portion of the data. This publication reviewed the current DL applications and compared them to the early unsupervised.

Funding

This research was funded by NCN Kraków, OPUS 2018/29/B/ST8/02303.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The support from Swoboda Badan—II edycja (Photo-organic) is acknowledged.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Polanski, J. Chemoinformatics: From Chemical Art to Chemistry in Silico. In Encyclopedia of Bioinformatics and Computational Biology; Elsevier: Amsterdam, The Netherlands, 2019; pp. 601–618. ISBN 978-0-12-811432-2. [Google Scholar] [CrossRef]
  2. Schneider, G. Automating Drug Discovery. Nat. Rev. Drug Discov. 2017, 17, 97–113. [Google Scholar] [CrossRef] [PubMed]
  3. Dreyfus, H.L. What Computers Can’t Do—The Limits of Artificial Intelligence; Harper and Row: New York, NY, USA, 1979. [Google Scholar]
  4. McCarthy. What is AI?/Basic Questions. Available online: http://jmc.stanford.edu/artificial-intelligence/what-is-ai/index.html#:~:text=What%20is%20artificial%20intelligence%3F,methods%20that%20are%20biologically%20observable (accessed on 26 February 2022).
  5. Sutton, R.S.; Barto, A.G. Reinforcement Learning: An Introduction; MIT Press: Cambridge, MA, USA; Cambridge Mass: Cambridge, MA, USA, 2018. [Google Scholar]
  6. Dechter, R. Learning While Searching in Constraint-Satisfaction-Problems. In Proceedings of the 5th National Conference on Artificial Intelligence, Philadelphia, PA, USA, 11–15 August 1986; Volume 1. [Google Scholar]
  7. Aizenberg, I.; Aizenberg, N.N.; Vandewalle, J.P. Multi-Valued and Universal Binary Neurons: Theory, Learning and Applications; Springer: Berlin/Heidelberg, Germany, 2000. [Google Scholar]
  8. Flow, T. A Fireside Chat with Turing Award Winner Geoffrey Hinton, Pioneer of Deep Learning. Available online: https://www.youtube.com/watch?v=UTfQwTuri8Y (accessed on 1 February 2022).
  9. Ferles, C.; Papanikolaou, Y.; Savaidis, S.P.; Mitilineos, S.A. Deep Self-Organizing Map of Convolutional Layers for Clustering and Visualizing Image Data. Mach. Learn. Knowl. Extr. 2021, 3, 879–899. [Google Scholar] [CrossRef]
  10. Bajorath, J. State-of-the-art of artificial intelligence in medicinal chemistry. Future Sci. OA 2021, 7, FSO702. [Google Scholar] [CrossRef] [PubMed]
  11. Medina-Franco, J.L.; Martinez-Mayorga, K.; Fernández-de Gortari, E.; Kirchmair, J.; Bajorath, J. Rationality over fashion and hype in drug design. F1000Research 2021, 10, 397. [Google Scholar] [CrossRef] [PubMed]
  12. Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 2019, 1, 206–215. [Google Scholar] [CrossRef] [Green Version]
  13. Polanski, J.; Gasteiger, J. Computer Representation of Chemical Compounds. In Handbook of Computational Chemistry; Leszczynski, J., Kaczmarek-Kedziera, A., Puzyn, T., Papadopoulos, M.G., Reis, H., Shukla, M.K.K., Eds.; Springer International Publishing: Cham, Switzerland, 2017; pp. 1997–2039. ISBN 978-3-319-27281-8. [Google Scholar]
  14. Chuang, K.V.; Gunsalus, L.M.; Keiser, M.J. Learning molecular representations for medicinal chemistry: Miniperspective. J. Med. Chem. 2020, 63, 8705–8722. [Google Scholar] [CrossRef]
  15. Lach, D.; Zhdan, U.; Smolinski, A.; Polanski, J. Functional and Material Properties in Nanocatalyst Design: A Data Handling and Sharing Problem. Int. J. Mol. Sci. 2021, 22, 5176. [Google Scholar] [CrossRef]
  16. Grebner, C.; Malmerberg, E.; Shewmaker, A.; Batista, J.; Nicholls, A.; Sadowski, J. Virtual screening in the cloud: How big is big enough? J. Chem. Inf. Modeling 2019, 60, 4274–4282. [Google Scholar] [CrossRef]
  17. Gasteiger, J.; Zupan, J. Neural networks in chemistry. Angew. Chem. Int. Ed. 1993, 32, 503–527. [Google Scholar] [CrossRef]
  18. Zupan, J.; Gasteiger, J. Neural Networks in Chemistry and Drug Design; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 1999. [Google Scholar]
  19. Anzali, S.; Barnickel, G.; Krug, M.; Sadowski, J.; Wagener, M.; Gasteiger, J.; Polanski, J. The comparison of geometric and electronic properties of molecular surfaces by neural networks: Application to the analysis of corticosteroid-binding globulin activity of steroids. J. Comput. Aided Mol. Des. 1996, 10, 521–534. [Google Scholar] [CrossRef]
  20. Polanski, J.; Zouhiri, F.; Jeanson, L.; Desmaële, D.; d’Angelo, J.; Mouscadet, J.-F.; Gieleciak, R.; Gasteiger, J.; Le Bret, M. Use of the Kohonen neural network for rapid screening of ex vivo anti-HIV activity of styrylquinolines. J. Med. Chem. 2002, 45, 4647–4654. [Google Scholar] [CrossRef]
  21. Polanski, J. Applications of neural self-organizing maps in chemistry. Wiad. Chem. 1996, 50, 11–12. [Google Scholar]
  22. Wagener, M.; Sadowski, J.; Gasteiger, J. Autocorrelation of molecular surface properties for modeling corticosteroid binding globulin and cytosolic Ah receptor activity by neural networks. J. Am. Chem. Soc. 1995, 29, 7769–7775. [Google Scholar] [CrossRef]
  23. Polanski, J.; Walczak, B. The comparative molecular surface analysis (COMSA): A novel tool for molecular design. Comput. Chem. 2000, 24, 615–625. [Google Scholar] [CrossRef]
  24. Polanski, J. Self-organizing neural networks for pharmacophore mapping. Adv. Drug Deliv. Rev. 2003, 55, 1149–1162. [Google Scholar] [CrossRef]
  25. Polanski, J. Drug design using comparative molecular surface analysis. Expert Opin. Drug Discov. 2006, 1, 693–707. [Google Scholar] [CrossRef]
  26. Polanski, J. The receptor-like neural network for modeling corticosteroid and testosterone binding globulins. J. Chem. Inf. Comput. Sci. 1997, 37, 553–561. [Google Scholar] [CrossRef]
  27. Hirohara, M.; Saito, Y.; Koda, Y.; Sato, K.; Sakakibara, Y. Convolutional neural network based on SMILES representation of compounds for detecting chemical motif. BMC Bioinform. 2018, 19, 83–94. [Google Scholar] [CrossRef]
  28. Hopfinger, A.J.; Wang, S.; Tokarski, J.S.; Jin, B.; Albuquerque, M.; Madhav, P.J.; Duraiswami, C. Construction of 3D-QSAR models using the 4D-QSAR analysis formalism. J. Am. Chem. Soc. 1997, 119, 10509–10524. [Google Scholar] [CrossRef]
  29. Axelrod, S.; Gomez-Bombarelli, R. Molecular machine learning with conformer ensembles. arXiv 2020, arXiv:2012.08452. [Google Scholar]
  30. Bak, A. Two Decades of 4D-QSAR: A Dying Art or Staging a Comeback? Int. J. Mol. Sci. 2021, 22, 5212. [Google Scholar] [CrossRef]
  31. Bak, A.; Polanski, J. Modeling robust QSAR 3: SOM-4D-QSAR with iterative variable elimination IVE-PLS: Application to steroid, azo dye, and benzoic acid series. J. Chem. Inf. Modeling 2007, 47, 1469–1480. [Google Scholar] [CrossRef]
  32. Polanski, J.; Bak, A. Modeling Steric and Electronic Effects in 3D-and 4D-QSAR Schemes: Predicting Benzoic pKa Values and Steroid CBG Binding Affinities. J. Chem. Inf. Comput. Sci. 2003, 43, 2081–2092. [Google Scholar] [CrossRef]
  33. Bak, A.; Polanski, J. A 4D-QSAR study on anti-HIV HEPT analogues. Bioorganic Med. Chem. 2006, 14, 273–279. [Google Scholar] [CrossRef]
  34. Polanski, J.; Bak, A.; Gieleciak, R.; Magdziarz, T. Modeling robust QSAR. J. Chem. Inf. Modeling 2006, 46, 2310–2318. [Google Scholar] [CrossRef]
  35. Niedbala, H.; Polanski, J.; Gieleciak, R.; Musiol, R.; Tabak, D.; Podeszwa, B.; Bak, A.; Palka, A.; Mouscadet, J.-F.; Gasteiger, J.; et al. Comparative molecular surface analysis (CoMSA) for virtual combinatorial library screening of styrylquinoline HIV-1 blocking agents. Comb. Chem. High Throughput Screen. 2006, 9, 753–770. [Google Scholar] [CrossRef]
  36. Anzali, S.; Gasteiger, J.; Holzgrabe, U.; Polanski, J.; Sadowski, J.; Teckentrup, A.; Wagener, M. The use of self-organizing neural networks in drug design. Perspect. Drug Discov. Des. 1998, 9, 273–299. [Google Scholar] [CrossRef]
  37. Horvath, D.; Marcou, G.; Varnek, A. Generative topographic mapping in drug design. Drug Discov. Today Technol. 2019, 32, 99–107. [Google Scholar] [CrossRef]
  38. Bishop, C.M.; Svensén, M.; Williams, C.K. GTM: The generative topographic mapping. Neural Comput. 1998, 10, 215–234. [Google Scholar] [CrossRef]
  39. Qian, J.; Nguyen, N.P.; Oya, Y.; Kikugawa, G.; Okabe, T.; Huang, Y.; Ohuchi, F.S. Introducing self-organized maps (SOM) as a visualization tool for materials research and education. Results Mater. 2019, 4, 100020. [Google Scholar] [CrossRef]
  40. Jing, Y.; Bian, Y.; Hu, Z.; Wang, L.; Xie, X.Q.S. Deep learning for drug design: An artificial intelligence paradigm for drug discovery in the big data era. AAPS J. 2018, 20, 1–10. [Google Scholar]
  41. Zhang, L.; Tan, J.; Han, D.; Zhu, H. From machine learning to deep learning: Progress in machine intelligence for rational drug discovery. Drug Discov. Today 2017, 22, 1680–1685. [Google Scholar] [CrossRef] [PubMed]
  42. Born, J.; Manica, M. Trends in Deep Learning for Property-driven Drug Design. Curr. Med. Chem. 2021, 28, 7862–7886. [Google Scholar] [CrossRef] [PubMed]
  43. Lipinski, C.F.; Maltarollo, V.G.; Oliveira, P.R.; da Silva, A.B.; Honorio, K.M. Advances and perspectives in applying deep learning for drug design and discovery. Front. Robot. AI 2019, 6, 108. [Google Scholar] [CrossRef] [Green Version]
  44. Kingma, D.P.; Welling, M. Auto-encoding Variational Bayes. arXiv 2013, arXiv:1312.6114. [Google Scholar]
  45. Gomez-Bombarelli, R.; Wei, J.N.; Duvenaud, D.; Hernandez-Lobato, J.M.; Sanchez-Lengeling, B.; Sheberla, D.; Aguilera-Iparraguirre, J.; Hirzel, T.D.; Adams, R.P.; Aspuru-Guzik, A. Automatic chemical design using a data-driven continuous representation of molecules. ACS Cent. Sci. 2018, 4, 268–276. [Google Scholar] [CrossRef]
  46. Zhavoronkov, A.; Ivanenkov, Y.A.; Aliper, A.; Veselov, M.S.; Aladinskiy, V.A.; Aladinskaya, A.V.; Terentiev, V.A.; Polykovskiy, D.A.; Kuznetsov, M.D.; Asadulaev, A.; et al. Deep learning enables rapid identification of potent DDR1 kinase inhibitors. Nat. Biotechnol. 2019, 37, 1038–1040. [Google Scholar] [CrossRef]
  47. Wang, M.D.; Hassanzadeh, H.R. DeeperBind: Enhancing prediction of sequence specificities of DNA binding proteins. arXiv 2017, arXiv:1611.05777. [Google Scholar]
  48. Golkov, V.; Skwark, M.J.; Mirchev, A.; Dikov, G.; Geanes, A.R.; Mendenhall, J.; Meiler, J.; Cremers, D. 3D deep learning for biological function prediction from physical fields. In Proceedings of the 2020 International Conference on 3D Vision (3DV), Fukuoka, Japan, 25–28 November 2020; pp. 928–937. [Google Scholar]
  49. Liang, M.; Li, Z.; Chen, T.; Zeng, J. Integrative data analysis of multi-platform cancer data with a multimodal deep learning approach. IEEE/ACM Trans. Comput. Biol. Bioinform. 2014, 12, 928–937. [Google Scholar] [CrossRef]
  50. Alipanahi, B.; Delong, A.; Weirauch, M.T.; Frey, B.J. Predicting the sequence specificities of DNA-and RNA-binding proteins by deep learning. Nat. Biotechnol. 2015, 33, 831–838. [Google Scholar] [CrossRef]
  51. Aliper, A.; Plis, S.; Artemov, A.; Ulloa, A.; Mamoshina, P.; Zhavoronkov, A. Deep learning applications for predicting pharmacological properties of drugs and drug repurposing using transcriptomic data. Mol. Pharm. 2016, 13, 2524–2530. [Google Scholar] [CrossRef] [Green Version]
  52. Wen, M.; Zhang, Z.; Niu, S.; Sha, H.; Yang, R.; Yun, Y.; Lu, H. Deep-learning-based drug–target interaction prediction. J. Proteome Res. 2017, 16, 1401–1409. [Google Scholar] [CrossRef]
  53. Kwon, S.; Yoon, S. DeepCCI: End-to-end deep learning for chemical-chemical interaction prediction. arXiv 2017, arXiv:1704.08432. [Google Scholar]
  54. Karimi, M.; Wu, D.; Wang, Z.; Shen, Y. DeepAffinity: Interpretable deep learning of compound-protein affinity through unified recurrent and convolutional neural networks. Bioinformatics 2019, 35, 3329–3338. [Google Scholar] [CrossRef] [Green Version]
  55. Mayr, A.; Klambauer, G.; Unterthiner, T.; Hochreiter, S. DeepTox: Toxicity prediction using deep learning. Front. Environ. Sci. 2016, 3, 80. [Google Scholar] [CrossRef] [Green Version]
  56. Menden, M.P.; Iorio, F.; Garnett, M.; McDermott, U.; Benes, C.H.; Ballester, P.J.; Saez-Rodriguez, J. Machine learning prediction of cancer cell sensitivity to drugs based on genomic and chemical properties. PLoS ONE 2013, 8, e61318. [Google Scholar] [CrossRef] [Green Version]
  57. Kwon, Y.; Yoo, J.; Choi, Y.-S.; Son, W.-J.; Lee, D.; Kang, S. Efficient learning of non-autoregressive graph variational autoencoders for molecular graph generation. J. Cheminform. 2019, 11, 70. [Google Scholar] [CrossRef] [Green Version]
  58. Domenico, A.; Nicola, G.; Daniela, T.; Fulvio, C.; Nicola, A.; Orazio, N. De novo drug design of targeted chemical libraries based on artificial intelligence and pair-based multiobjective optimization. J. Chem. Inf. Model. 2020, 60, 4582–4593. [Google Scholar] [CrossRef]
  59. Polykovskiy, D.; Zhebrak, A.; Vetrov, D.; Ivanenkov, Y.; Aladinskiy, V.; Mamoshina, P.; Bozdaganyan, M.; Aliper, A.; Zhavoronkov, A.; Kadurin, A. Entangled conditional adversarial autoencoder for de novo drug discovery. Mol. Pharm. 2018, 15, 4398–4405. [Google Scholar] [CrossRef]
  60. Putin, E.; Asadulaev, A.; Vanhaelen, Q.; Ivanenkov, Y.; Aladinskaya, A.V.; Aliper, A.; Zhavoronkov, A. Adversarial threshold neural computer for molecular de novo design. Mol. Pharm. 2018, 15, 4386–4397. [Google Scholar] [CrossRef] [Green Version]
  61. Simonovsky, M.; Komodakis, N. GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders. In Proceedings of the 27th International Conference on Artificial Neural Networks, Rhodes, Greece, 4–7 October 2018; Springer: Cham, Switzerland, 2018; Volume 11139, pp. 412–422. [Google Scholar]
  62. Kipf, T.N.; Welling, M. Variational graph auto-encoders. arXiv 2016, arXiv:1611.07308. [Google Scholar]
  63. De Cao, N.; Kipf, T. MolGAN: An implicit generative model for small molecular graphs. arXiv 2018, arXiv:1805.11973. [Google Scholar]
  64. Aumentado-Armstrong, T. Latent molecular optimization for targeted therapeutic design. arXiv 2018, arXiv:1809.02032. [Google Scholar]
  65. Skalic, M.; Sabbadin, D.; Sattarov, B.; Sciabola, S.; De Fabritiis, G. From target to drug: Generative modeling for the multimodal structure-based ligand design. Mol. Pharm. 2019, 16, 4282–4291. [Google Scholar] [CrossRef] [PubMed]
  66. Masuda, T.; Ragoza, M.; Koes, D.R. Generating 3D molecular structures conditional on a receptor binding site with deep generative models. arXiv 2020, arXiv:2010.14442. [Google Scholar]
  67. Subramanian, A.; Narayan, R.; Corsello, S.M.; Peck, D.D.; Natoli, T.E.; Lu, X.; Gould, J.; Davis, J.F.; Tubelli, A.A.; Asiedu, J.K.; et al. A next generation connectivity map: L1000 platform and the first 1,000,000 profiles. Cell 2017, 171, 1437–1452.e17. [Google Scholar] [CrossRef] [PubMed]
  68. Arus-Pous, J.; Patronov, A.; Bjerrum, E.J.; Tyrchan, C.; Reymond, J.L.; Chen, H.; Engkvist, O. SMILES-based deep generative scaffold decorator for de-novo drug design. J. Cheminform. 2020, 12, 38. [Google Scholar] [CrossRef]
  69. Li, Y.; Hu, J.; Wang, Y.; Zhou, J.; Zhang, L.; Liu, Z. Deepscaffold: A comprehensive tool for scaffold-based de novo drug discovery using deep learning. J. Chem. Inf. Model. 2020, 60, 77–91. [Google Scholar] [CrossRef]
  70. Lim, J.; Hwang, S.Y.; Moon, S.; Kim, S.; Kim, W.Y. Scaffold-based molecular design with a graph generative model. Chem. Sci. 2019, 11, 1153–1164. [Google Scholar] [CrossRef] [Green Version]
  71. Zheng, S.; Yan, X.; Gu, Q.; Yang, Y.; Du, Y.; Lu, Y.; Xu, J. QBMG: Quasi-biogenic molecule generator with deep recurrent neural network. J. Cheminform. 2019, 11, 5. [Google Scholar] [CrossRef] [Green Version]
  72. Li, Y.; Zhang, L.; Liu, Z. Multi-objective de novo drug design with conditional graph generative model. J. Cheminform. 2018, 10, 33. [Google Scholar] [CrossRef] [Green Version]
  73. Maziarka, Ł.; Pocha, A.; Kaczmarczyk, J.; Rataj, K.; Danel, T.; Warchoł, M. Mol-CycleGAN: A generative model for molecular optimization. J. Cheminform. 2020, 12, 2. [Google Scholar] [CrossRef] [Green Version]
  74. Zhou, Z.; Kearnes, S.; Li, L.; Zare, R.N.; Riley, P. Optimization of molecules via deep reinforcement learning. Sci. Rep. 2019, 9, 10752. [Google Scholar] [CrossRef]
  75. Imrie, F.; Bradley, A.R.; van der Schaar, M.; Deane, C.M. Deep generative models for 3D linker design. J. Chem. Inf. Model. 2020, 60, 1983–1995. [Google Scholar] [CrossRef] [Green Version]
  76. Blaschke, T.; Engkvist, O.; Bajorath, J.; Chen, H. Memory-assisted reinforcement learning for diverse molecular de novo design. J. Cheminform. 2020, 12, 1–7. [Google Scholar] [CrossRef]
  77. Polykovskiy, D.; Zhebrak, A.; Sanchez-Lengeling, B.; Golovanov, S.; Tatanov, O.; Belyaev, S.; Kurbanov, R.; Artamonov, A.; Aladinskiy, V.; Veselov, M.; et al. Molecular sets (MOSES): A benchmarking platform for molecular generation models. Front. Pharmacol. 2020, 11, 1931. [Google Scholar] [CrossRef]
  78. Benhenda, M. ChemGAN challenge for drug discovery: Can AI reproduce natural chemical diversity? arXiv 2017, arXiv:1708.08227. [Google Scholar]
  79. Brown, N.; Fiscato, M.; Segler, M.H.; Vaucher, A.C. GuacaMol: Benchmarking models for de novo molecular design. J. Chem. Inf. Modeling 2019, 59, 1096–1108. [Google Scholar] [CrossRef]
  80. Walters, W.P.; Barzilay, R. Applications of deep learning in molecule generation and molecular property prediction. Acc. Chem. Res. 2020, 54, 263–270. [Google Scholar] [CrossRef]
  81. Zhang, J.; Lei, Y.K.; Zhang, Z.; Chang, J.; Li, M.; Han, X.; Yang, L.; Yang, Y.I.; Gao, Y.Q. A perspective on deep learning for molecular modeling and simulations. J. Phys. Chem. A 2020, 124, 6745–6763. [Google Scholar] [CrossRef]
  82. Corey, E.J. General methods for the construction of complex molecules. Pure Appl. Chem. 1967, 14, 19–38. [Google Scholar] [CrossRef]
  83. Harel, S.; Radinsky, K. Prototype-based compound discovery using deep generative models. Mol. Pharm. 2018, 15, 4406–4416. [Google Scholar] [CrossRef]
  84. Segler, M.H.; Preuss, M.; Waller, M.P. Planning chemical syntheses with deep neural networks and symbolic AI. Nature 2018, 555, 604–610. [Google Scholar] [CrossRef] [Green Version]
  85. Tetko, I.V.; Karpov, P.; Van Deursen, R.; Godin, G. State-of-the-art augmented NLP transformer models for direct and single-step retrosynthesis. Nat. Commun. 2020, 11, 5575. [Google Scholar] [CrossRef]
  86. Cadeddu, A.; Wylie, E.K.; Jurczak, J.; Wampler-Doty, M.; Grzybowski, B.A. Organic chemistry as a language and the implications of chemical linguistics for structural and retrosynthetic analyses. Angew. Chem. Int. Ed. 2014, 53, 8108–8112. [Google Scholar] [CrossRef]
  87. Badowski, T.; Gajewska, E.P.; Molga, K.; Grzybowski, B.A. Synergy between expert and machine-learning approaches allows for improved retrosynthetic planning. Angew. Chem. Int. Ed. 2020, 59, 725–730. [Google Scholar] [CrossRef] [PubMed]
  88. Grzybowski, B.A.; Szymkuć, S.; Gajewska, E.P.; Molga, K.; Dittwald, P.; Wołos, A.; Klucznik, T. Chematica: A story of computer code that started to think like a chemist. Chem 2018, 4, 390–398. [Google Scholar] [CrossRef]
  89. Mikulak-Klucznik, B.; Gołębiowska, P.; Bayly, A.A.; Popik, O.; Klucznik, T.; Szymkuć, S.; Gajewska, E.P.; Dittwald, P.; Staszewska-Krajewska, O.; Beker, W.; et al. Computational planning of the synthesis of complex natural products. Nature 2020, 588, 83–88. [Google Scholar] [CrossRef] [PubMed]
Ijms 23 02797 g001 550
Figure 1. The direct drug design problem can be defined as mapping property to structure (P → S)3. Mainly, it is realized in the indirect mode by structure to property mapping (S → P). Individual methods allow to include various domains (S → P)1 or (S → P)2. Domain diversity is indicated schematically by colors.
Figure 1. The direct drug design problem can be defined as mapping property to structure (P → S)3. Mainly, it is realized in the indirect mode by structure to property mapping (S → P). Individual methods allow to include various domains (S → P)1 or (S → P)2. Domain diversity is indicated schematically by colors.
Ijms 23 02797 g001
Ijms 23 02797 g002 550
Figure 2. Supervised learning vs. unsupervised learning architectures. Both modes demand optimization; however, while in supervised learning, we need a label within the inputs which we use to estimate the error between the label and the output value, in unsupervised learning, the error is minimized by comparing the unlabeled inputs.
Figure 2. Supervised learning vs. unsupervised learning architectures. Both modes demand optimization; however, while in supervised learning, we need a label within the inputs which we use to estimate the error between the label and the output value, in unsupervised learning, the error is minimized by comparing the unlabeled inputs.
Ijms 23 02797 g002
Ijms 23 02797 g003 550
Figure 3. The propane vs. butane colored by methyl (yellow or blue in butane, yellow or green in propane) and methylene (red or green in butane, red in propane) fragments (a) provides a series of two types of CoMSA (SOM) projections (b), depending upon the SOM network regulation. Two types of patterns (b) can be explained by fuzzy topology (c). Details in text.
Figure 3. The propane vs. butane colored by methyl (yellow or blue in butane, yellow or green in propane) and methylene (red or green in butane, red in propane) fragments (a) provides a series of two types of CoMSA (SOM) projections (b), depending upon the SOM network regulation. Two types of patterns (b) can be explained by fuzzy topology (c). Details in text.
Ijms 23 02797 g003
Ijms 23 02797 g004 550
Figure 4. A series of CBG steroid surface data projected by CoMSA (SOM) without superimposition [21]. Without a single misinterpretation, H (high) and M (medium) activity compounds can be differentiated from the L (low) activity compounds. Details in text. Copyright © 1996 Polish Chemical Society.
Figure 4. A series of CBG steroid surface data projected by CoMSA (SOM) without superimposition [21]. Without a single misinterpretation, H (high) and M (medium) activity compounds can be differentiated from the L (low) activity compounds. Details in text. Copyright © 1996 Polish Chemical Society.
Ijms 23 02797 g004
Ijms 23 02797 g005 550
Figure 5. Automatic chemical design using a data-driven continuous representation of molecules. In the critical operation of the latent space formation, the architecture analyzes the similarity of the SMILES codes of the candidate and the known inhibitor structures. A deep neural network involves three coupled functions: an encoder, a decoder (a) and a predictor (b) [45]. Copyright © 2018 American Chemical Society.
Figure 5. Automatic chemical design using a data-driven continuous representation of molecules. In the critical operation of the latent space formation, the architecture analyzes the similarity of the SMILES codes of the candidate and the known inhibitor structures. A deep neural network involves three coupled functions: an encoder, a decoder (a) and a predictor (b) [45]. Copyright © 2018 American Chemical Society.
Ijms 23 02797 g005
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Polanski, J. Unsupervised Learning in Drug Design from Self-Organization to Deep Chemistry. Int. J. Mol. Sci. 2022, 23, 2797. https://doi.org/10.3390/ijms23052797

AMA Style

Polanski J. Unsupervised Learning in Drug Design from Self-Organization to Deep Chemistry. International Journal of Molecular Sciences. 2022; 23(5):2797. https://doi.org/10.3390/ijms23052797

Chicago/Turabian Style

Polanski, Jaroslaw. 2022. "Unsupervised Learning in Drug Design from Self-Organization to Deep Chemistry" International Journal of Molecular Sciences 23, no. 5: 2797. https://doi.org/10.3390/ijms23052797

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop