I am not very sure how the VPN communication would work with DPP but as it is encrypted communication it may be a bottleneck…
Please see also How to run Trainer.fit() and Trainer.test() in DDP distributed mode
1 Like