# PyProf **Repository Path**: mirrors_NVIDIA/PyProf ## Basic Information - **Project Name**: PyProf - **Description**: A GPU performance profiling tool for PyTorch models - **Primary Language**: Unknown - **License**: Apache-2.0 - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2020-08-18 - **Last Updated**: 2026-03-29 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README .. # Copyright (c) 2020-2021, NVIDIA CORPORATION. All rights reserved. # # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. |License| PyProf - PyTorch Profiling tool =============================== **ANNOUNCEMENT:** On June 30th 2021, NVIDIA will no longer make contributions to the PyProf repository. To profile models in PyTorch, please use `NVIDIA Deep Learning Profiler (DLProf) `_ DLProf can help data scientists, engineers, and researchers understand and improve performance of their models by analyzing text reports or visualizing the reports in a web browser with the DLProf Viewer DLProf is available on NGC or as a python PIP wheel installation. To look for continued development on PyProf, please use https://github.com/adityaiitb/PyProf .. overview-begin-marker-do-not-remove PyProf is a tool that profiles and analyzes the GPU performance of PyTorch models. PyProf aggregates kernel performance from `Nsight Systems `_ or `NvProf `_ and provides the following additional features: * Identifies the layer that launched a kernel: e.g. the association of `ComputeOffsetsKernel` with a concrete PyTorch layer or API is not obvious. * Identifies the tensor dimensions and precision: without knowing the tensor dimensions and precision, it's impossible to reason about whether the actual (silicon) kernel time is close to maximum performance of such a kernel on the GPU. Knowing the tensor dimensions and precision, we can figure out the FLOPs and bandwidth required by a layer, and then determine how close to maximum performance the kernel is for that operation. * Forward-backward correlation: PyProf determines what the forward pass step is that resulted in the particular weight and data gradients (wgrad, dgrad), which makes it possible to determine the tensor dimensions required by these backprop steps to assess their performance. * Determines Tensor Core usage: PyProf can highlight the kernels that use `Tensor Cores `_. * Correlate the line in the user's code that launched a particular kernel (program trace). .. overview-end-marker-do-not-remove The current release of PyProf is 3.10.0 and is available in the 21.04 release of the PyTorch container on `NVIDIA GPU Cloud (NGC) `_. The branch for this release is `r21.04 `_. Quick Installation Instructions ------------------------------- .. quick-install-start-marker-do-not-remove * Clone the git repository :: $ git clone https://github.com/NVIDIA/PyProf.git * Navigate to the top level PyProf directory * Install PyProf :: $ pip install . * Verify installation is complete with pip list :: $ pip list | grep pyprof * Should display :: pyprof 3.11.0.dev0 .. quick-install-end-marker-do-not-remove Quick Start Instructions ------------------------ .. quick-start-start-marker-do-not-remove * Add the following lines to the PyTorch network you want to profile: :: import torch.cuda.profiler as profiler import pyprof pyprof.init() * Profile with NVProf or Nsight Systems to generate a SQL file. :: $ nsys profile -f true -o net --export sqlite python net.py * Run the parse.py script to generate the dictionary. :: $ python -m pyprof.parse net.sqlite > net.dict * Run the prof.py script to generate the reports. :: $ python -m pyprof.prof --csv net.dict .. quick-start-end-marker-do-not-remove Documentation ------------- The User Guide can be found in the `documentation for current release `_, and provides instructions on how to install and profile with PyProf. A complete `Quick Start Guide `_ provides step-by-step instructions to get you quickly started using PyProf. An `FAQ `_ provides answers for frequently asked questions. The `Release Notes `_ indicate the required versions of the NVIDIA Driver and CUDA, and also describe which GPUs are supported by PyProf Presentation and Papers ^^^^^^^^^^^^^^^^^^^^^^^ * `Automating End-toEnd PyTorch Profiling `_. * `Presentation slides `_. Contributing ------------ Contributions to PyProf are more than welcome. To contribute make a pull request and follow the guidelines outlined in the `Contributing `_ document. Reporting problems, asking questions ------------------------------------ We appreciate any feedback, questions or bug reporting regarding this project. When help with code is needed, follow the process outlined in the Stack Overflow (https://stackoverflow.com/help/mcve) document. Ensure posted examples are: * minimal – use as little code as possible that still produces the same problem * complete – provide all parts needed to reproduce the problem. Check if you can strip external dependency and still show the problem. The less time we spend on reproducing problems the more time we have to fix it * verifiable – test the code you're about to provide to make sure it reproduces the problem. Remove all other problems that are not related to your request/question. .. |License| image:: https://img.shields.io/badge/License-Apache2-green.svg :target: http://www.apache.org/licenses/LICENSE-2.0