Deep learning has recently been utilized with great success in a large number of diverse application domains, such as visual and face recognition, natural language processing, speech recognition, and handwriting identification. Convolutional neural networks, that belong to the deep learning models, are a subtype of artificial neural networks, which are inspired by the complex structure of the human brain and are often used for image classification tasks. One of the biggest challenges in all deep neural networks is the overfitting issue, which happens when the model performs well on the training data, but fails to make accurate predictions for the new data that is fed into the model. Several regularization methods have been introduced to prevent the overfitting problem. In the research presented in this manuscript, the overfitting challenge was tackled by selecting a proper value for the regularization parameter dropout by utilizing a swarm intelligence approach. Notwithstanding that the swarm algorithms have already been successfully applied to this domain, according to the available literature survey, their potential is still not fully investigated. Finding the optimal value of dropout is a challenging and time-consuming task if it is performed manually. Therefore, this research proposes an automated framework based on the hybridized sine cosine algorithm for tackling this major deep learning issue. The first experiment was conducted over four benchmark datasets: MNIST, CIFAR10, Semeion, and UPS, while the second experiment was performed on the brain tumor magnetic resonance imaging classification task. The obtained experimental results are compared to those generated by several similar approaches. The overall experimental results indicate that the proposed method outperforms other state-of-the-art methods included in the comparative analysis in terms of classification error and accuracy.
- MeSH
- Algorithms MeSH
- Humans MeSH
- Magnetic Resonance Imaging MeSH
- Brain Neoplasms * MeSH
- Neural Networks, Computer * MeSH
- Handwriting MeSH
- Check Tag
- Humans MeSH
- Publication type
- Journal Article MeSH
- Research Support, Non-U.S. Gov't MeSH
The sine-cosine algorithm (SCA) is a new population-based meta-heuristic algorithm. In addition to exploiting sine and cosine functions to perform local and global searches (hence the name sine-cosine), the SCA introduces several random and adaptive parameters to facilitate the search process. Although it shows promising results, the search process of the SCA is vulnerable to local minima/maxima due to the adoption of a fixed switch probability and the bounded magnitude of the sine and cosine functions (from -1 to 1). In this paper, we propose a new hybrid Q-learning sine-cosine- based strategy, called the Q-learning sine-cosine algorithm (QLSCA). Within the QLSCA, we eliminate the switching probability. Instead, we rely on the Q-learning algorithm (based on the penalty and reward mechanism) to dynamically identify the best operation during runtime. Additionally, we integrate two new operations (Lévy flight motion and crossover) into the QLSCA to facilitate jumping out of local minima/maxima and enhance the solution diversity. To assess its performance, we adopt the QLSCA for the combinatorial test suite minimization problem. Experimental results reveal that the QLSCA is statistically superior with regard to test suite size reduction compared to recent state-of-the-art strategies, including the original SCA, the particle swarm test generator (PSTG), adaptive particle swarm optimization (APSO) and the cuckoo search strategy (CS) at the 95% confidence level. However, concerning the comparison with discrete particle swarm optimization (DPSO), there is no significant difference in performance at the 95% confidence level. On a positive note, the QLSCA statistically outperforms the DPSO in certain configurations at the 90% confidence level.
- MeSH
- Algorithms * MeSH
- Heuristics * MeSH
- Computer Simulation MeSH
- Publication type
- Journal Article MeSH
- Research Support, Non-U.S. Gov't MeSH
... 4.0 Introduction 155 -- 4.1 Classical Formulas for Equally Spaced Abscissas 156 -- 4.2 Elementary Algorithms ... ... Functions, Spherical -- Bessel Functions 283 -- 6.7 Spherical Harmonics 292 -- 6.8 Fresnel Integrals, Cosine ... ... and Sine Integrals 297 -- 6.9 Dawson’s Integral 302 -- 6.10 Generalized Fermi-Dirac Integrals 304 -- ... ... Matrix 583 -- 11.5 Hermitian Matrices 590 -- 11.6 Real Nonsymmetric Matrices 590 -- 11.7 The QR Algorithm ... ... and Cosine Transforms 620 -- 12.5 FFT in Two or More Dimensions 627 -- 12.6 Fourier Transforms of Real ...
3rd ed. xxi, 1235 s. : il. ; 27 cm + 1 CD-ROM
- MeSH
- Mathematical Computing MeSH
- Mathematics MeSH
- Numerical Analysis, Computer-Assisted * MeSH
- Publication type
- Monograph MeSH
- Conspectus
- Počítačová věda. Výpočetní technika. Informační technologie
- NML Fields
- přírodní vědy
- přírodní vědy
... 2.4.6 Other point singularities 92 -- 2.4.7 Angular delta functions 94 -- 3 FOURIER ANALYSIS 95 -- 3.1 SINES ... ... , COSINES AND COMPLEX EXPONENTIALS 97 -- 3.1.1 Orthogonality on a finite interval 97 -- 3.1.2 Complex ... ... 1052 -- 15.4.1 Linear iterative algorithms 1053 -- 15.4.2 Noise propagation in linear algorithms 1054 ... ... iterations 1063 -- 15.4.5 Projections onto convex sets 1064 -- 15.4.6 MLEM algorithm 1069 -- 15.4.7 ... ... Noise propagation in nonlinear algorithms 1072 -- 15.4.8 Stochastic algorithms 1074 -- 16 PLANAR IMAGING ...
Wiley series in pure and applied optics
[1st ed.] xli, 1540 s. : il.