Skip to main content

Table 13 Supported activation functions

From: A machine learning platform for the discovery of materials

Name Form
Hyperbolic tangent \(f(x) = \tanh x\)
Rectified linear unit \(f(x) = \max \{ 0, x \}\)
Sigmoid \(f(x) = \frac{1}{1 + e^{-1}}\)
Softmax \(f(x_{i}) = \frac{e^{x_{i}}}{\sum _{j}e^{x_{j}}}\)