Fig. 4From: Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in moleculesOverview of DDP training. Each process independently loads and processes a batch of data and synchronizes local gradients with others through a gradient aggregation process which requires global communicationsBack to article page