Distributed

The following pages describe the APIs used to easily perform communication between different processes in CuPy.

init_process_group(n_devices, rank, *[, …])

Start cupyx.distributed and obtain a communicator.

NCCLBackend(n_devices, rank[, host, port, …])

Interface that uses NVIDIA’s NCCL to perform communications.