Table 13 Supported activation functions
From: A machine learning platform for the discovery of materials
Name | Form |
|---|---|
Hyperbolic tangent | \(f(x) = \tanh x\) |
Rectified linear unit | \(f(x) = \max \{ 0, x \}\) |
Sigmoid | \(f(x) = \frac{1}{1 + e^{-1}}\) |
Softmax | \(f(x_{i}) = \frac{e^{x_{i}}}{\sum _{j}e^{x_{j}}}\) |