# AugLy **Repository Path**: forfreedom1029/AugLy ## Basic Information - **Project Name**: AugLy - **Description**: No description available - **Primary Language**: Python - **License**: Not specified - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2022-01-06 - **Last Updated**: 2024-11-27 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README

logo

Github Actions PyPI downloads per month PyPI Version Image Colab notebook DOI PRs Welcome
---------------------- AugLy is a data augmentations library that currently supports four modalities ([audio](augly/audio), [image](augly/image), [text](augly/text) & [video](augly/video)) and over 100 augmentations. Each modality’s augmentations are contained within its own sub-library. These sub-libraries include both function-based and class-based transforms, composition operators, and have the option to provide metadata about the transform applied, including its intensity. AugLy is a great library to utilize for augmenting your data in model training, or to evaluate the robustness gaps of your model! We designed AugLy to include many specific data augmentations that users perform in real life on internet platforms like Facebook's -- for example making an image into a meme, overlaying text/emojis on images/videos, reposting a screenshot from social media. While AugLy contains more generic data augmentations as well, it will be particularly useful to you if you're working on a problem like copy detection, hate speech detection, or copyright infringement where these "internet user" types of data augmentations are prevalent. ![Visual](https://raw.githubusercontent.com/facebookresearch/AugLy/main/image_visual.png) To see more examples of augmentations, open the Colab notebooks in the README for each modality! (e.g. image [README](augly/image) & [Colab](https://colab.research.google.com/github/facebookresearch/AugLy/blob/main/examples/AugLy_image.ipynb)) The library is Python-based and requires at least Python 3.6, as we use dataclasses. ## Authors [**Joanna Bitton**](https://www.linkedin.com/in/joanna-bitton/) — Software Engineer at Facebook AI [**Zoe Papakipos**](https://www.linkedin.com/in/zoe-papakipos-8637155b/) — Research Engineer at FAIR ## Installation `AugLy` is a Python 3.6+ library. It can be installed with: ```bash pip install augly ``` Or clone AugLy if you want to be able to run our unit tests, contribute a pull request, etc: ```bash git clone git@github.com:facebookresearch/AugLy.git && cd AugLy [Optional, but recommended] conda create -n augly && conda activate augly && conda install pip pip install -e . ``` **Note**: If you want to use the audio or video modalities in AugLy, you can install the extra dependencies required with `pip install augly[av]`. Otherwise, installing with `pip install augly` will only install the base requirements and is sufficient to use the image & text modalities, since the audio & video dependencies are unnecessarily heavy if you won't be using them. In some environments, `pip` doesn't install `python-magic` as expected. In that case, you will need to additionally run: ```bash conda install -c conda-forge python-magic ``` Or if you aren't using conda: ```bash sudo apt-get install python3-magic ``` ## Documentation To find documentation about each sub-library, please see the READMEs in the respective directories. ## Assets We provide various media assets to use with some of our augmentations. These assets include: 1. [Emojis](augly/assets/twemojis/) ([Twemoji](https://twemoji.twitter.com/)) - Copyright 2020 Twitter, Inc and other contributors. Code licensed under the MIT License. Graphics licensed under CC-BY 4.0. 2. [Fonts](augly/assets/fonts/) ([Noto fonts](https://www.google.com/get/noto/)) - Noto is a trademark of Google Inc. Noto fonts are open source. All Noto fonts are published under the SIL Open Font License, Version 1.1. 3. [Screenshot Templates](augly/assets/screenshot_templates/) - Images created by a designer at Facebook specifically to use with AugLy. You can use these with the `overlay_onto_screenshot` augmentation in both the image and video libraries to make it look like your source image/video was screenshotted in a social media feed similar to Facebook or Instagram. ## Links 1. Facebook AI blog post: https://ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models/ 2. PyPi package: https://pypi.org/project/augly/ 3. Examples: https://github.com/facebookresearch/AugLy/tree/main/examples ## Uses of AugLy in the wild 1. [Image Similarity Challenge](https://ai.facebook.com/blog/the-image-similarity-challenge-and-data-set-for-detecting-image-manipulation) - a NeurIPS 2021 competition run by Facebook AI with $200k in prizes, currently open for sign ups; also produced the DISC21 dataset, which will be made publicly available after the challenge concludes! 2. [DeepFake Detection Challenge](https://ai.facebook.com/datasets/dfdc/) - a Kaggle competition run by Facebook AI in 2020 with $1 million in prizes; also produced the [DFDC dataset](https://dfdc.ai) 3. [SimSearchNet](https://ai.facebook.com/blog/using-ai-to-detect-covid-19-misinformation-and-exploitative-content/) - a near-duplicate detection model developed at Facebook AI to identify infringing content on our platforms ## Citation If you use AugLy in your work, please cite: ```bibtex @misc{bitton2021augly, author = {Joanna Bitton and Zoe Papakipos}, title = {AugLy: A data augmentations library for audio, image, text, and video.}, year = {2021}, howpublished = {\url{https://github.com/facebookresearch/AugLy}}, doi = {10.5281/zenodo.5014032} } ``` ## License AugLy is MIT licensed, as found in the [LICENSE](LICENSE) file. Please note that some of the dependencies AugLy uses may be licensed under different terms.