Tanh (Hyperbolic Tangent)

Softmax

ReLU (Rectified Linear Unit)

Sigmoid

Inability to handle non-linear relationships

Decision trees are robust to outlier

Limited interpretability of the model

Tendency to overfit the training data

Mean squared error

Mean relative error

Mean absolute error

Root mean squared error

Linear, binary

Linear, numeric

Nonlinear, binary

Nonlinear, numeric

Mutation

Crossover

Selection

Fitness function

Normalize data

Compute gradients

Update parameters

Define architecture

To reduce the size of a dataset

To improve the performance of a model

To increase the size of a dataset

To improve the quality of a dataset