# ctx-sparsity

**Repository Path**: tth37/ctx-sparsity

## Basic Information

- **Project Name**: ctx-sparsity
- **Description**: Contextual Sparsity
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-12-08
- **Last Updated**: 2024-12-16

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## Download Models

```bash
export HF_ENDPOINT=https://hf-mirror.com
export HF_TOKEN=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
pip install huggingface_hub
huggingface-cli download --token $HF_TOKEN meta-llama/Meta-Llama-3-8B --local-dir models/Meta-Llama-3-8B
huggingface-cli download --token $HF_TOKEN meta-llama/Llama-2-7b-hf --local-dir models/Llama-2-7b-hf
huggingface-cli download --repo-type dataset PowerInfer/Predictor-dataset --local-dir datasets/Predictor-dataset
```

```bash
pip install transformers k_means_constrained pyarrow
```