MPI4PyDist

class mmeval.core.dist_backends.MPI4PyDist

A distributed communication backend for mpi4py.

all_gather_object(obj: Any) → List[Any]

All gather the given object from the current process group and returns a list consisting gathered object of each process.

参数

obj (any) – Any pickle-able python object for all gather.

返回

A list of the all gathered object.

返回类型

list

broadcast_object(obj: Any, src: int = 0) → Any

Broadcast the given object from source process to the current process group.

参数

• obj (any) – Any pickle-able python object for broadcast.

• src (int) – The source rank index.

返回

The broadcast object.

返回类型

any

property is_initialized: bool

Returns True if the distributed environment has been initialized.

返回

Returns True if the distributed environment has been initialized, otherwise returns False.

返回类型

bool

property rank: int

Returns the rank index of the current process group.

property world_size: int

Returns the world size of the current process group.