# struxgpt

**Repository Path**: alibaba/struxgpt

## Basic Information

- **Project Name**: struxgpt
- **Description**: [NeurIPS 2024] Official implementation of the paper "Enhancing LLM’s Cognition via Structurization"
- **Primary Language**: Unknown
- **License**: MIT
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-11-01
- **Last Updated**: 2025-05-26

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Enhancing Large Language Models via Structurization

This repo integrates a series of research projects focused on enhancing cognition abilities or injecting domain knowledge for LLMs via *structurization*:

* [Enhancing LLM’s Cognition via Structurization](https://arxiv.org/abs/2407.16434), NeurIPS-24.
* [Structure-aware Domain Knowledge Injection for Large Language Models](https://arxiv.org/abs/2407.16724), ArXiv'24.

## Updates

- **30.03.2025**: Released pretrained [StruXGPT-v1-Qwen-7B](https://huggingface.co/StruXGPT/StruXGPT-v1-Qwen-7B) and [StruXGPT-v2-Llama2-7B](https://huggingface.co/StruXGPT/StruXGPT-v2-Llama2-7B) at huggingface. Have fun with them!
- **27.08.2024**: Upload the codebase. Data and weights are coming.


## How to Run
Install the dependencies:

```
pip install -r requirements.txt
```

Click a paper below to see the detailed instructions on how to run the code in `examples/*` to reproduce the results.

* [Enhancing LLM’s Cognition via Structurization](examples/StruXGPT/README.md)
* [Structure-aware Domain Knowledge Injection for Large Language Models](examples/StructTuning/README.md)


## Citation
If you use this code in your research, please kindly cite the following papers

```
@article{liu2024enhancing,
      title={Enhancing LLM's Cognition via Structurization}, 
      author={Liu, Kai and Fu, Zhihang and Chen, Chao and Zhang, Wei and Jiang, Rongxin and Zhou, Fan and Chen, Yaowu and Wu, Yue and Ye, Jieping},
      journal={Advances in Neural Information Processing Systems},
      volume={38},
      year={2024}
}

@article{liu2024educating,
      title={Structure-aware Domain Knowledge Injection for Large Language Models}, 
      author={Liu, Kai and Chen, Ze and Fu, Zhihang and Jiang, Rongxin and Zhou, Fan and Chen, Yaowu and Wu, Yue and Ye, Jieping},
      year={2024},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
}
```