Concepedia

Goal-Oriented Sensitivity Analysis of Hyperparameters in Deep Learning

Paul Novello, Gaël Poëtte, David Lugato, Pietro Marco Congedo

Journal of Scientific Computing · 2023 · 27 citations · 27 references

Open access

Concepts

ComputingComputer ScienceArtificial IntelligenceMachine LearningOptimizationDeep LearningLoss FunctionNeural NetworksOptimization For Machine LearningParameter OptimizationSensitivity AnalysisHyperparameter OptimizationHyperparameter TuningParameter Sensitivity AnalysisSensitivity Analysis In Optimization ModelsSensitivity Analysis Of Model Parameters

References

27

Adam: A Method for Stochastic Optimization

Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text

Computing, Computer Science, Algorithms +16

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Sergey Ioffe, Christian Szegedy · arXiv (Cornell University) · 2015 · 24.4K citations · Full text

Computing, Computer Science, Artificial Intelligence +15

Xception: Deep Learning with Depthwise Separable Convolutions

François Chollet · 2017 · 19K citations

Computing, Computer Science, Computer Vision +7

Random search for hyper-parameter optimization

James Bergstra, Yoshua Bengio · 2012 · 7.9K citations

Natural Sciences, Computer Science, Algorithms +8

Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric Hypothesis

Joseph B. Kruskal · Psychometrika · 1964 · 7.4K citations

Social Sciences, Educational Measurement, Psychometrics +10