torch.cuda

Random Number Generator

Communication collectives

Streams and events

Memory management

NVIDIA Tools Extension (NVTX)