# online-softmax

**Repository Path**: mirrors_NVIDIA/online-softmax

## Basic Information

- **Project Name**: online-softmax
- **Description**: Benchmark code for the "Online normalizer calculation for softmax" paper
- **Primary Language**: Unknown
- **License**: BSD-3-Clause
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-08-18
- **Last Updated**: 2026-03-21

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Benchmark

This is a benchmark to explore performance of Softmax and Softmax+TopK functions with online calculation of softmax normalization term. Please see ["Online normalizer calculation for softmax"](https://arxiv.org/abs/1805.02867) paper.

# Build

You will need [CUB](https://nvlabs.github.io/cub/) v1.8.0 (or newer) and CUDA 9.1 (or newer) to build the benchmark. Set CUB variable in Makefile to the correct location of CUB library. Build the sample:
    make

# Run
Run the sample:
    ./online_softmax_benchmark