# youtu-parsing **Repository Path**: xiang1/youtu-parsing ## Basic Information - **Project Name**: youtu-parsing - **Description**: youtu-parsing - **Primary Language**: Unknown - **License**: BSD-3-Clause - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2026-10-28 - **Last Updated**: 2026-10-28 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README

Youtu-Parsing Logo

📄 License • 🖥️ Demo • 📑 Technical Report • 🚀 Quick Start • 📊 Performance • 🤗 Models • 📚 Citation

> **🆕 Youtu-Parsing-Omni**: an omni-modal parsing model for documents, images, charts, geometry, audio and video. See [`youtu_parsing_omni`](youtu_parsing_omni/) and the [technical report](youtu_parsing_omni/paper/Youtu_Parsing_Omni.pdf).
Youtu-Parsing-Omni: one encoder, one schema, every modality
## 🎯 Introduction **Youtu-Parsing** is a specialized document parsing model built upon the open-source Youtu-LLM 2B foundation. By extending the capabilities of the base model with a prompt-guided framework and NaViT-style dynamic visual encoder, Youtu-Parsing offers enhanced parsing capabilities for diverse document elements including text, tables, formulas, and charts. The model incorporates an efficient parallel decoding mechanism that significantly accelerates inference, making it practical for real-world document analysis applications. We share Youtu-Parsing with the community to facilitate research and development in document understanding. --- ## ✨ Key Features ### 📄 **Document Structure Preservation** - **Text Localization**: Accurately detects and localizes text regions with pixel-level precision, ensuring no content is missed or misplaced across diverse document layouts. - **Reading Order Restoration**: Intelligently reconstructs the logical reading sequence of document content, maintaining proper flow across columns, sections, and pages for coherent understanding. ### 🔍 **Advanced Content Recognition** - **Text Recognition**: Provides precise text recognition across diverse scenarios. - **Formula Recognition**: Automatically converts mathematical expressions to LaTeX format. - **Table Recognition**: Automatically detects tables and converts them to HTML format. - **Chart Recognition**: Converts charts to markdown tables, mind maps and flow charts to mermaid format. ### ⚡ **High-Performance Inference** - **Token Parallelism**: Enables simultaneous inference of multiple tokens for accelerated processing, achieving 5-11x speedup. - **Query Parallelism**: Combines multiple queries together to maximize Token Parallelism benefits, providing an additional 2x speedup on top of Token Parallelism acceleration.
--- ## 🚀 Quick Start The following guide demonstrates how to use Youtu-Parsing with Hugging Face integration for local deployment. ### 📦 Installation **Option 1: Install from Git Repository** ```bash conda create -n youtu_parsing python=3.10 conda activate youtu_parsing pip install git+https://github.com/TencentCloudADP/youtu-parsing.git#subdirectory=youtu_hf_parser ``` **Option 2: Local Development Installation** ```bash git clone https://github.com/TencentCloudADP/youtu-parsing.git cd youtu-parsing/youtu_hf_parser pip install -e . ``` ### ⚡ Flash Attention Setup Flash Attention is **required** for optimal performance. Choose the installation method that works best for your environment: ```bash # 🎯 For CUDA 12.x + PyTorch 2.6 + Python 3.10 + Linux x86_64: pip install https://github.com/Dao-AILab/flash-attention/releases/download/v2.7.4.post1/flash_attn-2.7.4.post1+cu12torch2.6cxx11abiFALSE-cp310-cp310-linux_x86_64.whl # 🔄 Alternative: Install from PyPI (may require compilation) pip install flash-attn>=2.7.0 ``` > **💡 Note**: Flash Attention installation is platform-specific. If you encounter issues, please refer to the [official installation guide](https://github.com/Dao-AILab/flash-attention). ### 📥 Model Weights Download Download the pre-trained model weights from our official repository: 🔗 **[Youtu-Parsing Model Hub](https://huggingface.co/collections/tencent/youtu)** ### 💻 Usage Example ```python from youtu_hf_parser import YoutuOCRParserHF # Initialize the parser with model configuration parser = YoutuOCRParserHF( model_path=model_path, # Path to downloaded model weights enable_angle_correct=True, # Set to False to disable angle correction angle_correct_model_path=angle_correct_model_path # If None, model will auto-download to default path; if custom path, manually download https://github.com/TencentCloudADP/youtu-parsing/releases/download/v1.0.0/model.pth to specified location ) # Parse a document (supports images, PDFs, and more) parser.parse_file( input_path=image_path, # Input document path output_dir=output_dir # Output directory for results ) print("✅ Document parsing completed!") print(f"📄 Results saved to: {output_dir}") ``` --- ## 📊 Performance Our comprehensive evaluation demonstrates Youtu-Parsing's superior performance across multiple benchmarks and real-world scenarios. ### OminiDocBench v1.5 Benchmark
OminiDocBench v1.5 Performance Results
### olmOCR Benchmark
olmOCR Benchmark Performance
## 🎨 Visualization & Examples ### Text Recognition
### Formula & Mathematical Expression
### Table Recognition
### Chart Recognition
--- ## 🤝 Acknowledgments We extend our gratitude to the following projects and communities that made Youtu-Parsing possible: - [Youtu-LLM](https://github.com/TencentCloudADP/youtu-tip/tree/master/youtu-llm) - [PDF-Extract-Kit](https://github.com/opendatalab/PDF-Extract-Kit) - [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR) - [MinerU](https://github.com/opendatalab/MinerU) - [dots.ocr](https://github.com/rednote-hilab/dots.ocr) - [PSENet](https://github.com/whai362/PSENet) --- ## 📚 Citation If you find Youtu-Parsing useful in your research or applications, please consider citing our work: ```bibtex @article{youtu-parsing, title={Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding}, author={Tencent Youtu Lab}, year={2026}, eprint={2601.20430}, archivePrefix={arXiv}, primaryClass={cs.CV}, url={https://arxiv.org/abs/2601.20430}, } @article{youtu-vl, title={Youtu-VL: Unleashing Visual Potential via Unified Vision-Language Supervision}, author={Tencent Youtu Lab}, year={2026}, eprint={2601.19798}, archivePrefix={arXiv}, primaryClass={cs.CV}, url={https://arxiv.org/abs/2601.19798}, } @article{youtu-llm, title={Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models}, author={Tencent Youtu Lab}, year={2025}, eprint={2512.24618}, archivePrefix={arXiv}, primaryClass={cs.CL}, url={https://arxiv.org/abs/2512.24618}, } ```