Table 1 Comparisons of performance for the activation functions Beaf, ELU, and GeLU on Lipophilicity and PDBbind datasets (lower values are better)
From: Double-head transformer neural network for molecular property prediction
| Â | GeLU | ELU | Beaf |
|---|---|---|---|
Lipophilicity | \(0.635\pm 0.040\) | \(0.723\pm 0.037\) | \(0.577\pm 0.049\) |
PDBbind | \(2.019\pm 0.278\) | \(2.054\pm 0.265\) | \(1.771\pm 0.300\) |