This chapter gives an overview of the CUDA development tools, and the software environments that can host CUDA applications. Sections are devoted to the various tools in the NVIDIA toolkit:
nvcc, the CUDA compiler driver,
ptxas, the PTX assembler,
cuobjdump, the CUDA object file dump utility,
cuda-gdb and compute-sanitizer, the debugger and correctness
checkers,
Nsight Systems and Nsight Compute, the profilers, and
nvidia-smi, the NVIDIA System Management Interface.
Finally, Section 4.7 surveys the cloud providers that rent GPU-capable servers over the Internet.
This chapter is intended more as a reference than as a tutorial. Example usages are given in Part 3 (Select Applications).