IEEE Transactions on Knowledge and Data Engineering · 2024 · 44 citations · 55 references
ComputingData ScienceFeature EngineeringMachine LearningDimensionality ReductionEvolutionary ComputationFeature SelectionGenetic AlgorithmsMulti-task LearningEvolutionary Feature SelectionHigh-dimensional Feature SelectionMulti-task Feature SelectionMulti-task Neural NetworksMultitask Learning
Feature selection is a crucial step in data mining to enhance model performance by reducing data dimensionality. However, the increasing dimensionality of collected data exacerbates the challenge known as the “curse of dimensionality”, where computation grows exponentially with the number of dimensions. To tackle this issue, evolutionary computational (EC) approaches have gained popularity due to their simplicity and applicability. Unfortunately, the diverse designs of EC methods result in varying abilities to handle different data, often underutilizing and not sharing information effectively. In this article, we propose a novel approach called PSO-based Multi-task Evolutionary Learning (MEL) that leverages multi-task learning to address these challenges. By incorporating information sharing between different feature selection tasks, MEL achieves enhanced learning ability and efficiency. We evaluate the effectiveness of MEL through extensive experiments on 22 high-dimensional datasets. Comparing against 24 EC approaches, our method exhibits strong competitiveness. In addition, we have open-sourced our code on GitHub.
55
James Kennedy, R.C. Eberhart · 2002 · 47.5K citations
Optimization by Simulated Annealing
Scott Kirkpatrick, C. D. Gelatt, M.P. Vecchi · Science · 1983 · 44.6K citations
Seyedali Mirjalili, Seyed Mohammad Mirjalili, Seyed Mohammad Mirjalili et al. · Advances in Engineering Software · 2014 · 18.4K citations · Full text
The Whale Optimization Algorithm
Seyedali Mirjalili, Andrew Lewis · Advances in Engineering Software · 2016 · 14K citations