Block | Layers | Input dimensions | Output dimensions | Dropout rate |
---|---|---|---|---|
Input | Concatenation | 512\(^{1}\), 512\(^{2}\) | 1024 | Â |
Block 1 | FC layer | 1024 | 2048 | Â |
GeLU & Dropout | 2048 | 2048 | 0.1 | |
Block 2 | FC layer | 2048 | 1024 | Â |
GeLU & Dropout | 1024 | 1024 | 0.1 | |
Block 3 | FC layer | 1024 | 512 | Â |
GeLU & Dropout | 512 | 512 | 0.1 | |
Output | FC layer | 512 | 1 | Â |