TensorRT Documentations and API References
Introduction
I have been using TensorRT a lot and I look at the TensorRT documentations and API references of different versions from time to time. Finding the right version of the TensorRT documentation and API references and switching versions could be a bit tricky.
In this blog post, I would like to share how to access the TensorRT documentations and API references of different versions.
TensorRT
TensorRT Documentations
There are two highest level entry points for accessing the TensorRT documentation of different versions. The first one is the NVIDIA TensorRT Documentation Archive. The second one is the NVIDIA TensorRT Documentation Latest. Currently, the versions of the TensorRT documentations hosted in these two locations have no overlap.
The URL pattern for the TensorRT documentation of a specific archive version is as follows:
https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-<version>/index.html
The URL pattern for the TensorRT documentation of a specific latest version is as follows:
https://docs.nvidia.com/deeplearning/tensorrt/<latest version>/index.html
Some of the URLs for the TensorRT documentation of different archive versions are as follows:
- TensorRT 10.7.0: https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-1070/index.html
- TensorRT 8.6.1: https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-861/index.html
Some of the URLs for the TensorRT documentation of different latest versions are as follows:
- TensorRT 10.11.0: https://docs.nvidia.com/deeplearning/tensorrt/10.11.0/index.html
TensorRT API References
Once we have accessed the TensorRT documentation, we could see that there are various sections, including quick start guide, release notes, API references, and developer guide. The API references can be accessed via the links in the section of API reference.
The URL pattern for the TensorRT API references of a specific archive version and programming language is as follows:
https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-<version>/api/<programming language>-api/index.html
The URL pattern for the TensorRT API references of a specific latest version and programming language is as follows:
https://docs.nvidia.com/deeplearning/tensorrt/<latest version>/_static/<programming language>-api/index.html
Some of the URLs for the TensorRT C++ API references of different archive versions are as follows:
- TensorRT 10.7.0: https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-1070/api/c_api/index.html
- TensorRT 8.6.1: https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-861/api/c_api/index.html
Some of the URLs for the TensorRT Python API references of different archive versions are as follows:
- TensorRT 10.7.0: https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-1070/api/python_api/index.html
- TensorRT 8.6.1: https://docs.nvidia.com/deeplearning/tensorrt/archives/tensorrt-861/api/python_api/index.html
Some of the URLs for the TensorRT C++ API references of different latest versions are as follows:
Some of the URLs for the TensorRT Python API references of different latest versions are as follows:
- TensorRT 10.11.0: https://docs.nvidia.com/deeplearning/tensorrt/10.11.0/_static/python-api/index.html
TensorRT for DRIVE OS
The development of TensorRT applications for NVIDIA DRIVE OS can be different from the development of TensorRT applications for conventional platforms. Their development guide and API references can also be different in some places. Therefore, the TensorRT documentations and API references for NVIDIA DRIVE OS are bundled with the NVIDIA DRIVE OS documentations and are hosted in a different location.
TensorRT Documentations
The highest level entry point for accessing the TensorRT documentation of different versions is the NVIDIA Drive Documentation Archive. For each DRIVE OS with DriveWorks in the list, we could find the corresponding TensorRT documentation. For example, NVIDIA TensorRT 8.6
is used for NVIDIA DRIVE OS 6.0.8.1 with DriveWorks 5.14 for NVIDIA Developers
.
The URL pattern for the TensorRT documentation of a specific version is as follows:
https://developer.nvidia.com/docs/drive/drive-os/<DRIVE OS version>/public/drive-os-tensorrt/index.html
The TensorRT version corresponding to the DRIVE OS version is described in the TensorRT documentation.
Some of the URLs for the TensorRT documentation of different DRIVE OS versions and their corresponding TensorRT versions are as follows:
DRIVE OS 6.0.10 (TensorRT 8.6.13): https://developer.nvidia.com/docs/drive/drive-os/6.0.10/public/drive-os-tensorrt/index.html
DRIVE OS 6.0.9 (TensorRT 8.6.12): https://developer.nvidia.com/docs/drive/drive-os/6.0.9/public/drive-os-tensorrt/index.html
DRIVE OS 6.0.8 (TensorRT 8.6.11): https://developer.nvidia.com/docs/drive/drive-os/6.0.8/public/drive-os-tensorrt/index.html
DRIVE OS 6.0.9.2 (TensorRT 8.6.13): https://developer.nvidia.com/docs/drive/drive-os/6.0.9.2/public/drive-os-tensorrt/index.html
DRIVE OS 6.0.8.1 (TensorRT 8.6.11): https://developer.nvidia.com/docs/drive/drive-os/6.0.8.1/public/drive-os-tensorrt/index.html
For some reasons, some of the latest versions of TensorRT for DriveOS are not listed in the archive. But we could still access the TensorRT documentation of the latest versions by using the URL pattern above, as long as we know the latest versions of DRIVE OS.
TensorRT API References
Once we have accessed the TensorRT documentation, we could see that there are sections of release notes, API references, and developer guide. The API references can be accessed via the links in the section of API reference.
The URL pattern for the TensorRT API references of different versions and programming languages is as follows:
https://developer.nvidia.com/docs/drive/drive-os/<DRIVE OS version>/public/drive-os-tensorrt/api-reference/docs/<programming language>/index.html
Some of the URLs for the TensorRT C++ API references of different versions are as follows:
DRIVE OS 6.0.10 (TensorRT 8.6.13): https://developer.nvidia.com/docs/drive/drive-os/6.0.10/public/drive-os-tensorrt/api-reference/docs/cpp/index.html
DRIVE OS 6.0.9 (TensorRT 8.6.12): https://developer.nvidia.com/docs/drive/drive-os/6.0.9/public/drive-os-tensorrt/api-reference/docs/cpp/index.html
DRIVE OS 6.0.8 (TensorRT 8.6.11): https://developer.nvidia.com/docs/drive/drive-os/6.0.8/public/drive-os-tensorrt/api-reference/docs/cpp/index.html
DRIVE OS 6.0.9.2 (TensorRT 8.6.13): https://developer.nvidia.com/docs/drive/drive-os/6.0.9.2/public/drive-os-tensorrt/api-reference/docs/cpp/index.html
DRIVE OS 6.0.8.1 (TensorRT 8.6.11): https://developer.nvidia.com/docs/drive/drive-os/6.0.8.1/public/drive-os-tensorrt/api-reference/docs/cpp/index.html
Some of the URLs for the TensorRT Python API references of different versions are as follows:
DRIVE OS 6.0.10 (TensorRT 8.6.13): https://developer.nvidia.com/docs/drive/drive-os/6.0.10/public/drive-os-tensorrt/api-reference/docs/python/index.html
DRIVE OS 6.0.9 (TensorRT 8.6.12): https://developer.nvidia.com/docs/drive/drive-os/6.0.9/public/drive-os-tensorrt/api-reference/docs/python/index.html
DRIVE OS 6.0.8 (TensorRT 8.6.11): https://developer.nvidia.com/docs/drive/drive-os/6.0.8/public/drive-os-tensorrt/api-reference/docs/python/index.html
DRIVE OS 6.0.9.2 (TensorRT 8.6.13): https://developer.nvidia.com/docs/drive/drive-os/6.0.9.2/public/drive-os-tensorrt/api-reference/docs/python/index.html
DRIVE OS 6.0.8.1 (TensorRT 8.6.11): https://developer.nvidia.com/docs/drive/drive-os/6.0.8.1/public/drive-os-tensorrt/api-reference/docs/python/index.html
References
TensorRT Documentations and API References
https://leimao.github.io/blog/TensorRT-Documentations-API-References/