{"release":{"tag":{"name":"0.1.7","path":"/open-compass/opencompass/tags/0.1.7","tree_path":"/open-compass/opencompass/tree/0.1.7","message":"","commit":{"id":"6a398d171cc68f601346ba15427a8c7c67541538","short_id":"6a398d1","title":"Bump version to 0.1.7 (#518)","title_markdown":"Bump version to 0.1.7 (#518)","description":"","description_markdown":"","message":"Bump version to 0.1.7 (#518)\n\n","message_markdown":"Bump version to 0.1.7 (#518)","detail_path":"/open-compass/opencompass/commit/6a398d171cc68f601346ba15427a8c7c67541538","commits_path":"/open-compass/opencompass/commits/6a398d171cc68f601346ba15427a8c7c67541538","tree_path":"/open-compass/opencompass/tree/6a398d171cc68f601346ba15427a8c7c67541538","author":{"name":"Fengzhe Zhou","email":"zfz-960727@163.com","username":null,"user_path":null,"enterprise_user_path":null,"image_path":"no_portrait.png#Fengzhe Zhou-","is_gitee_user":false,"is_enterprise_user":null,"widget_url":null},"committer":{"name":"GitHub GPG Bot","email":"noreply@github.com","username":"github-bot","user_path":"/github-bot","enterprise_user_path":null,"image_path":"https://foruda.gitee.com/avatar/1677201096080835335/10181580_github-bot_1639517195.png!avatar30","is_gitee_user":true,"is_enterprise_user":null,"widget_url":""},"authored_date":"2023-10-27T20:32:27+08:00","committed_date":"2023-10-27T20:32:27+08:00","signature":null,"build_state":null},"archive_path":"/open-compass/opencompass/repository/archive/0.1.7","signature":null},"operating":{"edit":false,"download":true,"destroy":false,"enterprise_forbid_zip":false},"release":{"title":"0.1.7","path":"/open-compass/opencompass/releases/tag/0.1.7","tag_path":"/open-compass/opencompass/tree/0.1.7","project_id":31791757,"created_at":"2023-10-31T19:52:06+08:00","is_prerelease":false,"description":"# OpenCompass v0.1.7 Release Notes 🎉\r\n\r\n## 🌟 Highlights\r\n- **Sampling Control:** Enforce `do_sample=False` for precise control over sampling behavior in HF model.\r\n- **Subjective Evaluation Guidance:** Enhanced evaluation mechanisms for a more comprehensive understanding and analysis of models.\r\n- **Eval Details Dump:** Now, evaluation details for certain datasets are available for a deeper insight and analysis.\r\n\r\n## 🚀 New Features\r\n- **Eval Details Dump** for a deeper insight on each test cases. ([#517](https://github.com/open-compass/opencompass/pull/517) by @Leymore).\r\n- **MathBench Dataset and Circular Evaluator** to bolster mathematical benchmarking capabilities ([#408](https://github.com/open-compass/opencompass/pull/408) by @liushz).\r\n- **Support for Math/GMS8k Agent Config** providing new avenues for configuration ([#494](https://github.com/open-compass/opencompass/pull/494) by @yingfhu).\r\n- **Default Example Summarizer** making summarization tasks more accessible ([#508](https://github.com/open-compass/opencompass/pull/508) by @Leymore).\r\n- **Model Keyword Arguments Setting for HF Model** enhancing customization ([#507](https://github.com/open-compass/opencompass/pull/507) by @Leymore).\r\n\r\n## 🛠 Improvements \u0026 Refactorings\r\n- **Local API Speed Up** with fixed concurrent users for better performance ([#497](https://github.com/open-compass/opencompass/pull/497) by @yingfhu).\r\n- **Local Runner Support for Windows** expanding the platform support ([#515](https://github.com/open-compass/opencompass/pull/515) by @yingfhu).\r\n- **Sync with Internal Implements** for updated and refined functionalities ([#488](https://github.com/open-compass/opencompass/pull/488) by @Leymore).\r\n\r\n## 🐛 Bug Fixes\r\n- **Summary Default Fix** for accurate summarization ([#483](https://github.com/open-compass/opencompass/pull/483) by @Leymore).\r\n- **Enforce `do_sample=False` in HF Model** for correct sampling behavior ([#506](https://github.com/open-compass/opencompass/pull/506) by @Leymore).\r\n- **Invalid Link Fix** in documentation for better navigation ([#499](https://github.com/open-compass/opencompass/pull/499) by @yingfhu).\r\n\r\n## 📚 Documentation \u0026 Maintenance\r\n- **Subjective Comparison Introduction** for organized documentation ([#510](https://github.com/open-compass/opencompass/pull/510) by @frankweijue).\r\n- **README Update** for better project understanding ([#496](https://github.com/open-compass/opencompass/pull/496) by @saakshii12).\r\n- **Owner Update** for correct ownership information ([#504](https://github.com/open-compass/opencompass/pull/504) by @Leymore).\r\n\r\n## 🎊 New Contributors\r\nWe're delighted to welcome new contributors to the OpenCompass community!\r\n- **@saakshii12** made their first contribution in [#496](https://github.com/open-compass/opencompass/pull/496).\r\n- **@frankweijue** stepped in with their first contribution in [#510](https://github.com/open-compass/opencompass/pull/510).\r\n\r\n## Changelog\r\n\r\n* [Fix] Fix summary default by @Leymore in https://github.com/open-compass/opencompass/pull/483\r\n* [Feature] Add mathbench dataset and circular evaluator by @liushz in https://github.com/open-compass/opencompass/pull/408\r\n* [Sync] sync with internal implements by @Leymore in https://github.com/open-compass/opencompass/pull/488\r\n* Update README.md by @saakshii12 in https://github.com/open-compass/opencompass/pull/496\r\n* [Docs] update invalid link in docs by @yingfhu in https://github.com/open-compass/opencompass/pull/499\r\n* [Feat] local api speed up with fixed concurrent users by @yingfhu in https://github.com/open-compass/opencompass/pull/497\r\n* [Feat] support math/gms8k agent config by @yingfhu in https://github.com/open-compass/opencompass/pull/494\r\n* [Feature] update .owner by @Leymore in https://github.com/open-compass/opencompass/pull/504\r\n* [Feat] use example summarizer by default by @Leymore in https://github.com/open-compass/opencompass/pull/508\r\n* [Feat] Add _set_model_kwargs_torch_dtype for HF model by @Leymore in https://github.com/open-compass/opencompass/pull/507\r\n* Subdocs by @frankweijue in https://github.com/open-compass/opencompass/pull/510\r\n* [Fix] enforce `do_sample=False` in HF model by @Leymore in https://github.com/open-compass/opencompass/pull/506\r\n* [Feat] support local runner for windows by @yingfhu in https://github.com/open-compass/opencompass/pull/515\r\n* [Sync] Sync with internal codes 2023.10.27 by @Leymore in https://github.com/open-compass/opencompass/pull/517\r\n* Bump version to 0.1.7 by @Leymore in https://github.com/open-compass/opencompass/pull/518\r\n\r\nThe full list of changes is available in the [changelog](https://github.com/open-compass/opencompass/compare/0.1.6...0.1.7). A massive thank you to all the community members who contributed to this release. Your efforts are propelling OpenCompass further! 🙌\r\n\r\nEmbark on new explorations with OpenCompass v0.1.7!","author":{"name":"syzhang","username":"syzhangbuaa","path":"/syzhangbuaa","avatar_url":"no_portrait.png#syzhang-syzhangbuaa"},"attach_files":[],"zip_download_url":"/open-compass/opencompass/releases/tag/0.1.7.zip","tar_download_url":"/open-compass/opencompass/releases/tag/0.1.7.tar.gz"}}}