Distributed training of neural networks

Distributed training of neural networks is something I’ve always wanted to try but couldn’t find much information about it. It seems most people train their models on a single machine. In fact it makes sense because training on a single machine is much more efficient than distributed training. Distributed training incurs additional cost and is […]