# paper_downloader

**Repository Path**: silenceagle/paper_downloader

## Basic Information

- **Project Name**: paper_downloader
- **Description**: Download papers and supplemental materials from paper website, such as AAAI, AISTATS, COLT, CVPR, ECCV, ICCV, ICLR, ICML, IJCAI, JMLR, NIPS.
- **Primary Language**: Python
- **License**: MIT
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 1
- **Created**: 2020-10-31
- **Last Updated**: 2024-02-22

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# paper_downloader

Download papers and supplemental materials only from **OPEN ACCESS** paper website, such as **AAAI**, **AISTATS**, **COLT**, **CVPR**, **ECCV**, **ICCV**, **ICLR**, **ICML**, **IJCAI**, **JMLR**, **NIPS**, **WACV**.   

---

The number of papers that could be downloaded using this repo (with Aliyundrive share link and `access code`):



<sub>
<sup>

|  year\conf   | [AAAI](https://www.aaai.org/Library/AAAI/aaai-library.php) |                                [ACCV](https://openaccess.thecvf.com/ACCV2020)                                |          [AISTATS](https://www.aistats.org/)           |      [COLT](http://learningtheory.org/colt2020/)       |                                  [CVPR](http://openaccess.thecvf.com/menu.py)                                  |         [ECCV](https://www.ecva.net/papers.php)         |                                  [ICCV](http://openaccess.thecvf.com/menu.py)                                  |                    [ICLR](https://iclr.cc/)                    |                [ICML](https://icml.cc/)                 |            [IJCAI](https://www.ijcai.org/)             | [JMLR](http://www.jmlr.org/) |                [NIPS ](https://nips.cc/)                |                                     [WACV](http://wacv2021.thecvf.com/)                                      |
|:------------:|:----------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------:|:------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------:|:-------------------------------------------------------:|:------------------------------------------------------:|:----------------------------:|:-------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------:|
|   **1969**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           64                           |              --              |                           --                            |                                                      --                                                      |
|   **1971**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           66                           |              --              |                           --                            |                                                      --                                                      |
|   **1973**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           85                           |              --              |                           --                            |                                                      --                                                      |
|   **1975**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          146                           |              --              |                           --                            |                                                      --                                                      |
|   **1977**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          251                           |              --              |                           --                            |                                                      --                                                      |
|   **1979**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           12                           |              --              |                           --                            |                                                      --                                                      |
|   **1980**   |   [95](https://www.aliyundrive.com/s/ucngMrKSTmi)`96eg`    |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           --                            |                                                      --                                                      |
|   **1981**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          108                           |              --              |                           --                            |                                                      --                                                      |
|   **1982**   |                            104                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           --                            |                                                      --                                                      |
|   **1983**   |   [92](https://www.aliyundrive.com/s/L3GfxhEqyWg)`09jo`    |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          237                           |              --              |                           --                            |                                                      --                                                      |
|   **1984**   |                             69                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           --                            |                                                      --                                                      |
|   **1985**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          259                           |              --              |                           --                            |                                                      --                                                      |
|   **1986**   |                            194                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           --                            |                                                      --                                                      |
|   **1987**   |                            149                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          246                           |              --              |                           90                            |                                                      --                                                      |
|   **1988**   |                            159                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           94                            |                                                      --                                                      |
|   **1989**   |                             --                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          269                           |              --              |                           101                           |                                                      --                                                      |
|   **1990**   |                            173                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           49                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           143                           |                                                      --                                                      |
|   **1991**   |                            144                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          192                           |              --              |                           144                           |                                                      --                                                      |
|   **1992**   |                            134                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           49                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           127                           |                                                      --                                                      |
|   **1993**   |                            135                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          138                           |              --              |                           158                           |                                                      --                                                      |
|   **1994**   |                            302                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           98                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           140                           |                                                      --                                                      |
|   **1995**   |                             --                             |                                                      --                                                      |                           64                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          282                           |              --              |                           152                           |                                                      --                                                      |
|   **1996**   |                            275                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           98                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           152                           |                                                      --                                                      |
|   **1997**   |                            186                             |                                                      --                                                      |                           57                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          180                           |              --              |                           150                           |                                                      --                                                      |
|   **1998**   |                            187                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           98                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              --              |                           151                           |                                                      --                                                      |
|   **1999**   |                            182                             |                                                      --                                                      |                           17                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                          204                           |              --              |                           150                           |                                                      --                                                      |
| **2000/v1**  |                            221                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           98                            |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              11              |                           152                           |                                                      --                                                      |
| **2001/v2**  |                             --                             |                                                      --                                                      |                           46                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           --                            |                           17                           |              31              |                           197                           |                                                      --                                                      |
| **2002/v3**  |                            187                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           196                           |                                                       --                                                       |                               --                               |                           --                            |                           --                           |              59              |                           207                           |                                                      --                                                      |
| **2003/v4**  |                            ---                             |                                                      --                                                      |                           44                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           121                           |                          297                           |              59              |                           198                           |                                                      --                                                      |
| **2004/v5**  |                            177                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           190                           |                                                       --                                                       |                               --                               |                           118                           |                           --                           |              56              |                           207                           |                                                      --                                                      |
| **2005/v6**  |                            328                             |                                                      --                                                      |                           56                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           133                           |                          350                           |              73              |                           207                           |                                                      --                                                      |
| **2006/v7**  |                            393                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                         192+11                          |                                                       --                                                       |                               --                               |                           --                            |                           --                           |             100              |                           204                           |                                                      --                                                      |
| **2007/v8**  |                            375                             |                                                      --                                                      |                           86                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           150                           |                          478                           |              91              |                           217                           |                                                      --                                                      |
| **2008/v9**  |                            355                             |                                                      --                                                      |                           --                           |                           --                           |                                                       --                                                       |                           196                           |                                                       --                                                       |                               --                               |                           158                           |                           --                           |              97              |                           250                           |                                                      --                                                      |
| **2009/v10** |                             --                             |                                                      --                                                      |                           84                           |                           --                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           160                           |                          342                           |             100              |                           262                           |                                                      --                                                      |
| **2010/v11** |                            300                             |                                                      --                                                      |                          126                           |                           --                           |                                                       --                                                       |                         286+63                          |                                                       --                                                       |                               --                               |                           159                           |                           --                           |             118              |                           292                           |                                                      --                                                      |
| **2011/v12** |                            302                             |                                                      --                                                      |                          108                           |                           43                           |                                                       --                                                       |                           --                            |                                                       --                                                       |                               --                               |                           153                           |                          490                           |             105              |                           306                           |                                                      --                                                      |
| **2012/v13** |                            353                             |                                                      --                                                      |                          160                           |                           46                           |                                                       --                                                       |                         329+147                         |                                                       --                                                       |                               --                               |                           243                           |                           --                           |             119              |                           368                           |                                                      --                                                      |
| **2013/v14** |                            251                             |                                                      --                                                      |                           72                           |                           50                           |                           [471](https://www.aliyundrive.com/s/ZFvga9JZ5aY)`5p0q`+156                           |                           --                            |                                                    455+142                                                     |                              14+9                              |                           283                           |                          496                           |              84              |                           360                           |                                                      --                                                      |
| **2014/v15** |                            447                             |                                                      --                                                      |                          124                           |                           61                           |                                                    545+125                                                     |                         334+158                         |                                                       --                                                       |                               35                               |                           310                           |                           --                           |             120              |                           411                           |                                                      --                                                      |
| **2015/v16** |                            455                             |                                                      --                                                      |                          134                           |                           77                           |                                                    602+133                                                     |                           --                            |                                                    526+133                                                     |                               42                               |                           270                           |                          656                           |             118              |                           403                           |                                                      --                                                      |
| **2016/v17** |                            676                             |                                                      --                                                      |                          168                           |                           70                           |                                                    643+194                                                     |                         372+132                         |                                                       --                                                       |                               80                               |                           322                           |                          658                           |             236              |                           568                           |                                                      --                                                      |
| **2017/v18** |                            765                             |                                                      --                                                      |                          175                           |                           75                           |                                                    783+281                                                     |                           --                            |                                                    621+353                                                     |                              198                               |                           434                           |                          781                           |             234              |                           679                           |                                                      --                                                      |
| **2018/v19** |                            1102                            |                                                      --                                                      |                          230                           |                           94                           |                                                    979+346                                                     |                         732+262                         |                                                       --                                                       |                              336                               |                           466                           |                          870                           |              84              |                          1009                           |                                                      --                                                      |
| **2019/v20** |                            1343                            |                                                      --                                                      |                          403                           |                          127                           |                                                    1294+612                                                    |                           --                            |                                                    1075+498                                                    |                              502                               |                           773                           |                          964                           |             184              |                          1428                           |                                                      --                                                      |
| **2020/v21** |  [1864](https://www.aliyundrive.com/s/kbWKUpHGR3k)`5ls6`   | [254](https://www.aliyundrive.com/s/Dt2ErKCmePQ)`dn93`+[13](https://www.aliyundrive.com/s/AhGvgotrMUv)`d9o6` | [796](https://www.aliyundrive.com/s/iQ4AWTHG4bk)`61yu` | [126](https://www.aliyundrive.com/s/apP8KUFLPe4)`3mv9` | [1467](https://www.aliyundrive.com/s/eJF4BTFzFJq)`y89b`+[517](https://www.aliyundrive.com/s/5wk7Mjo9XyU)`0fz9` | [1358](https://www.aliyundrive.com/s/EYyjxRmmg8d)`a5i0` |                                                       --                                                       |     [687](https://www.aliyundrive.com/s/cVRD5Bu2SgN)`4x1c`     | [1084](https://www.aliyundrive.com/s/BHqtEbi6Dix)`5yw0` | [776](https://www.aliyundrive.com/s/vMZpsjCbWMV)`4xq3` |             254              | [1899](https://www.aliyundrive.com/s/GEMFqxKeHWu)`3g3d` | [378](https://www.aliyundrive.com/s/gfFKwcKrCP1)`l1m8`+[24](https://www.aliyundrive.com/s/2uCW6cq9WHk)`me08` |
| **2021/v22** |  [1961](https://www.aliyundrive.com/s/cdeGciNZch8)`b69m`   |                                                      --                                                      | [845](https://www.aliyundrive.com/s/3hbAhxYFHER)`93ig` | [140](https://www.aliyundrive.com/s/gwhdNT1vGDD)`96ln` |                          1660+[517](https://www.aliyundrive.com/s/ziBfXVKPXSY)`le14`                           |                           --                            | [1612](https://www.aliyundrive.com/s/ME21PfkyAec)`99uu`+[465](https://www.aliyundrive.com/s/ZahPmXSn9an)`16es` |     [860](https://www.aliyundrive.com/s/wGos6n5R93v)`ef43`     | [1183](https://www.aliyundrive.com/s/SYTtH38GiVS)`g8b1` | [723](https://www.aliyundrive.com/s/io3sAjsN5pw)`40is` |             290              | [2334](https://www.aliyundrive.com/s/13sHmhuEdxA)`v6g1` | [406](https://www.aliyundrive.com/s/kTwfaX9tren)`1id9`+[23](https://www.aliyundrive.com/s/7Joy4svvUfy)`90rl` |
| **2022/v23** |  [1624](https://www.aliyundrive.com/s/ePXvUw4VFdQ)`fp76`   | [279](https://www.aliyundrive.com/s/zCCTJMPrfSr)`47jy`+[25](https://www.aliyundrive.com/s/f4kdMXixwJL)`s7a9` | [492](https://www.aliyundrive.com/s/xj2fRMwZxfC)`f16o` |                          155                           | [2077](https://www.aliyundrive.com/s/Q8DG9dKbx6S)`i16a`+[562](https://www.aliyundrive.com/s/f9Zx3hFFyq4)`11kj` | [1645](https://www.aliyundrive.com/s/dv4fhuueRHs)`6d7j` |                                                       --                                                       | [54+176+865](https://www.aliyundrive.com/s/gfANcdbM9TC)`b1l3`  | [1234](https://www.aliyundrive.com/s/eopQ5H8Hz2a)`81ov` | [862](https://www.aliyundrive.com/s/DBVKNsqN2UZ)`ea46` |             351              | [2673](https://www.aliyundrive.com/s/VFLmfnzSAsA)`eh49` | [406](https://www.aliyundrive.com/s/xRhdpencLQU)`ab53`+[80](https://www.aliyundrive.com/s/JCCcQXij7WX)`q6d2` |
| **2023/v24** |                            2021                            |                                                      --                                                      | [496](https://www.aliyundrive.com/s/CD3Kz9cxu1U)`l5m9` |                          170                           |                                          [2358+698](./sharelinks.md)                                           |                           --                            |                                                    2161+491                                                    | [90+284+1205](https://www.aliyundrive.com/s/PZ1Wann4B8A)`29sf` |                          1805                           |                          846                           |             395              |                       67+378+2773                       | [639](https://www.aliyundrive.com/s/fP52KxJEUE5)`mo78`+[74](https://www.aliyundrive.com/s/XZG992JqQfn)`nj80` |
| **2024/v25** |                                                            |                                                                                                              |                                                        |                                                        |                                                                                                                |                                                         |                                                                                                                |                          86+369+1810                           |                                                         |                                                        |                              |                                                         |                                                                                                              |

</sup>
</sub>


<!--| **2023/v24** |                                                              |                                                                                                                   |                                                             |                                                             |                                                                                                                     |                                                                                                                    |                                                                                                                     |                                                                    |                                                              |                                                             |                              |                                                              |                                                                                                                   |-->

[Download from 123pan.com](https://www.123pan.com/s/PwXljv-QErwd.html)
(ACCESS CODE: `FdX2`)

 (May miss some papers due to the 123pan's limitation on the length of filename)

NOTE: all the shared papers' pdf files are collected from network, and the original authors/providers hold the copyrights.
****
## Usage
**For example: download AAAI-2022 papers**
1. Change the code block at the end of [code/paper_downloader_AAAI.py](https://github.com/SilenceEagle/paper_downloader/blob/2dbe66d645dcde89fbad5a1423c270f9f47b4528/code/paper_downloader_AAAI.py#L247)
```python
if __name__ == '__main__':
    year = 2022
    total_paper_number = save_csv(year)  # save papers urls to csv/AAAI_2022.csv
    download_from_csv(
        year, 
        save_dir=f'..\\AAAI_{year}', # change to your save location
        time_step_in_seconds=5,  # time step (seconds) between two downloading requests
        total_paper_number=total_paper_number,
        downloader=None # use python "requests" package to download papers
        # downloader='IDM'  # use Internet Download Manager software to 
                           # download papers
    )
```

2. Then run the code:
```python
python code/paper_downloader_AAAI.py  # download AAAI papers
```

****

**This repo also provides the function to process supplemental material:**
1. Merge the main supplemental material pdf file and the main paper into one single pdf file;
2. Move the supplemental material pdf files (extracted from the downloaded zip files if presented) into the main papers' folder.