Chemical Science · 2021 · 101 citations · 25 references
PharmacyChemistryComputational BiologyComputational ChemistryGenerative DesignChemical Space ExplorationDe Novo Drug DesignMolecular ModelingAttentionGenerative Design AlgorithmsLatent Space ExplorationModel Space ExplorationModel-guided ExplorationMolecular Representation LearningMolecular RepresentationsRepresentation Learning For Molecules
-VAE models and show that those with attention are able to learn a complex "molecular grammar" while improving performance on downstream tasks such as accurately sampling from the latent space ("model memory") or exploring novel chemistries not present in the training data. There is a notable relationship between a model's architecture, the structure of its latent memory and its performance during inference. We demonstrate that there is an unavoidable tradeoff between model exploration and validity that is a function of the complexity of the latent memory. However, novel sampling schemes may be used that optimize this tradeoff. We anticipate that attention will play an important role in future molecular design algorithms that can make efficient use of the detailed molecular substructures learned by the transformer.
25
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text
PubChem Substance and Compound databases
Sunghwan Kim, Paul Thiessen, Evan Bolton et al. · Nucleic Acids Research · 2015 · 5.5K citations · Full text
Pharmacy, Biochemistry, Chemistry +16