Optimization algorithms

This chapter introduces some commonly used optimization techniques, including classical gradient-based methods, gradient-free methods, and the new optimizers for deep learning. It also introduces evolutionary algorithms and nature-inspired algorithms for optimization and computational intelligence.