# chatglm3-finetune

**Repository Path**: chenmin_study/chatglm3-finetune

## Basic Information

- **Project Name**: chatglm3-finetune
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 1
- **Created**: 2023-10-30
- **Last Updated**: 2023-12-29

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# chatglm3-finetune
最容易上手的0门槛chatglm3项目  

## 安装依赖
pip3 install -r requirements.txt  

## 下载模型
python download_model.py 

## 处理数据
python cover_alpaca2jsonl.py  --data_path ./alpaca_data.json  --save_path ./alpaca_data.jsonl  
python tokenize_dataset_rows.py  --jsonl_path ./alpaca_data.jsonl --save_path ./alpaca  --max_seq_length 200  

## Finetune
python finetune.py --dataset_path ./alpaca --lora_rank 8 --per_device_train_batch_size 1 --gradient_accumulation_steps 1 --max_steps 52000 --save_steps 1000 --save_total_limit 20 --learning_rate 1e-4 --remove_unused_columns false --logging_steps 50 --output_dir output  

## Inference
python infer.py output/checkpoint-1000 ./alpaca_data.json 100 


## 感谢
inspired by https://github.com/mymusise/ChatGLM-Tuning  
inspired by https://github.com/THUDM/ChatGLM3