International Journal of Online and Biomedical Engineering (iJOE) · 2022 · 65 citations · 71 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingNeural NetworksOptimization For Machine LearningParameter OptimizationPattern RecognitionBehavior AnalyticsHyperparameter OptimizationHyperparameter TuningOptimization Algorithms
Machine-learning (ML) methods often utilized in applications like computer vision, recommendation systems, natural language processing (NLP), as well as user behavior analytics. Neural Networks (NNs) are one of the most es-sential ways to ML; the most challenging element of designing a NN is de-termining which hyperparameters to employ to generate the optimal model, in which hyperparameter optimization improves NN performance. This study includes a brief explanation regarding a few types of NN as well as some methods for hyperparameter optimization, as well as previous work results in enhancing ANN performance using optimization methods that aid research-ers and data analysts in developing better ML models via identifying the ap-propriate hyperparameter configurations.
71
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
A Fast Learning Algorithm for Deep Belief Nets
Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.4K citations
Random search for hyper-parameter optimization
James Bergstra, Yoshua Bengio · 2012 · 7.9K citations
Algorithms for hyper-parameter optimization
James Bergstra, Yoshua Bengio · 2011 · 3.2K citations · Full text