# collama

**Repository Path**: ling-java/collama

## Basic Information

- **Project Name**: collama
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: copilot
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-07-31
- **Last Updated**: 2024-07-31

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

<div align=center>

# <img src="https://storage.googleapis.com/sourcegraph-assets/cody/20230417/logomark-default.svg" width="26"> Cody with [LLaMA.cpp](https://github.com/ggerganov/llama.cpp)

"VSCode AI coding assistant powered by self-hosted llama.cpp endpoint."

</div>

## Get started

- Install coLLaMa from VSCode marketplace.
- Set your llama.cpp server's address like http://192.168.0.101:8080 in the Cody>llama Server Endpoint configure.
- Now enjoy coding with your localized deploy models.

 ### chat 

<img src="examples/chat_demo.gif" alt="chat with llama.cpp server"/>

### code generate

<img src="examples/code_generate_demo1.gif" alt="code generate"/>

### code explain

<img src="examples/explain_code_demo1.gif" alt="explain code"/>


## Quick start your model service

### Windows
>
1. Download llama.cpp binary release [archive](https://github.com/ggerganov/llama.cpp/releases)

2. Unzip `llama-bxxx-bin-win-cublas-cuxx.x.x-x64.zip` to folder

3. Download GGUF model file, for example: [wizardcoder-python-13b-v1.0.Q4_K_M.gguf](https://huggingface.co/TheBloke/WizardCoder-Python-13B-V1.0-GGUF/resolve/main/wizardcoder-python-13b-v1.0.Q4_K_M.gguf?download=true)

4. Execute `server.exe` startup command.

```sh
# only use cpu
D:\path_to_unzip_files\server.exe -m D:\path_to_model\wizardcoder-python-13b-v1.0.Q4_K_M.gguf -t 8 -c 1024
# use gpu
D:\path_to_unzip_files\server.exe -m D:\path_to_model\wizardcoder-python-13b-v1.0.Q4_K_M.gguf -t 8 -ngl 81 -c 1024
```


### Linux or MacOS

`Please compile the llama.cpp project by yourself, and follow the same startup steps.`

## What is Cody?

Cody is a free, open-source AI coding assistant that can write and fix code, provide AI-generated autocomplete, and answer your coding.

## Contributing

All code in this repository is open source (Apache 2).

Quickstart: `pnpm install && cd vscode && pnpm run dev` to run a local build of the Cody VS Code extension.