npj Computational Materials · 2019 · 63 citations · 85 references
Natural SciencesMaterials EngineeringMaterials ScienceComputational Materials ScienceElectronic MaterialsMachine LearningCrystalline MaterialsGraph-based LearningHigh-throughput Materials ScreeningMaterial ModelingProperty EstimationStructure-property RelationshipsData-driven Materials DiscoveryElectronic Property PredictionLight Gradient Boosting MachineMachine Learning Property PredictionMaterials Data MiningMaterials Property PredictionOptoelectronic PropertiesPhysical Properties
Abstract A public data-analytics competition was organized by the Novel Materials Discovery (NOMAD) Centre of Excellence and hosted by the online platform Kaggle by using a dataset of 3,000 (Al x Ga y In 1– x – y ) 2 O 3 compounds. Its aim was to identify the best machine-learning (ML) model for the prediction of two key physical properties that are relevant for optoelectronic applications: the electronic bandgap energy and the crystalline formation energy. Here, we present a summary of the top-three ranked ML approaches. The first-place solution was based on a crystal-graph representation that is novel for the ML of properties of materials. The second-place model combined many candidate descriptors from a set of compositional, atomic-environment-based, and average structural properties with the light gradient-boosting machine regression model. The third-place model employed the smooth overlap of atomic position representation with a neural network. The Pearson correlation among the prediction errors of nine ML models (obtained by combining the top-three ranked representations with all three employed regression models) was examined by using the Pearson correlation to gain insight into whether the representation or the regression model determines the overall model performance. Ensembling relatively decorrelated models (based on the Pearson correlation) leads to an even higher prediction accuracy.
85
Automatic differentiation in PyTorch
Adam Paszke, Sam Gross, Soumith Chintala et al. · 2017 · 11.1K citations
LightGBM: A Highly Efficient Gradient Boosting Decision Tree
Guolin Ke, Qi Meng, Thomas Finley et al. · HAL (Le Centre pour la Communication Scientifique Directe) · 2017 · 9.5K citations · Full text