# attention

**Repository Path**: mirrors_fbcotter/attention

## Basic Information

- **Project Name**: attention
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-10-29
- **Last Updated**: 2026-10-21

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

Attention Examples
==================

This repo contains code examples that build up modern attention layers from the fundamentals.

I wanted to understand how self-attention blocks worked, particularly for images, so have tried 
to write them myself.