当前仓库属于关闭状态,部分功能使用受限,详情请查阅 仓库状态说明
6 Star 3 Fork 67

OpenHarmony-SIG/ostest_integration_test
关闭

加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
贡献代码
同步代码
取消
提示: 由于 Git 不支持空文件夾,创建文件夹后会生成空的 .keep 文件
4个月前
Loading...
README
Apache-2.0

🚨 重要提示 | IMPORTANT

⚠️ 此代码仓已归档。新地址请访问 ostest_integration_test。| ⚠️ This repository has been archived. For the new address, please visit ostest_integration_test.


集成测试仓 ostest_integration_test

介绍

集成测试仓用于统一规划、开发、管理操作系统产品化的场景、功能、性能、稳定性、安全性等测试用例。

集成测试仓在整体目录结构中的位置如下图:

test_dir

集成测试在测试内容组成中的位置如下图所示:

test_content

测试目标

  • 通过功能和场景测试,保障OpenHarmony作为操作系统底座,基本功能可用,流程完善,并且可以覆盖主流的应用场景。

  • 通过性能测试,标定系统基本性能指标,支持能力范围,为基于OpenHarmony的产品研发提供参考。

  • 为基于OpenHarmony的产品研发提供基础测试方法、框架、用例,本测试仓的测试内容可以直接应用于二次开发的产品。

测试策略建议

  • 子系统/模块进行新增、修改、重构,开发完成后,建议进行相关功能和场景测试。
  • 对外发布的各个Beta版本、Release版本建议进行功能测试和场景测试。
  • 主干或重要分支建议定期(周/月)进行全量功能和场景测试。
  • Release版本建议结合硬件平台进行性能测试。

用例目录结构

├── function                //功能测试目录
│       └── communication	         //子系统
│               └── wifi	                //Wi-Fi模块功能测试
│               └── bluetooth	            //蓝牙模块功能测试
│               └── connectivity	        //网络连接功能测试
│       └── multimedia               //子系统
│               └── audio	                //音频模块功能测试
│               └── camera	                //相机功能测试
│               └── video	                //视频功能测试
│               └── image	                //图片功能测试
│       └── device_manager           //子系统
│               └── device_manager	        //设备管理功能测试
│       └── file_manager             //子系统
│               └── file_io	                //文件读写功能测试
├── performance	            //性能测试目录
│       └── arkts	                 //子系统
│               └── benchmark_arkts_compiler	 //编译器语言Benchmark用例 
│       └── arkui	                 //子系统
│               └── benchmark_component	         //组件创建、布局 BenchMark测试
│               └── benchmark_pipeline	         //组件管线 BenchMark测试
│       └── communication	         //子系统
│               └── wifi_perf	                //Wi-Fi模块性能测试
│               └── bluetooth_perf	            //蓝牙模块性能测试
│       └── multimedia               //子系统
│               └── audio_perf	            //音频模块性能测试
│               └── camera_perf	            //相机性能测试
│               └── video_perf	            //视频性能测试
├── scenario               //场景测试应用
│       └── MusicPlayerOnline   //在线音乐场景
│       └── MyMap	            //地图场景测试
│       └── MyMusic	            //音乐场景测试
│       └── MyNews	            //新闻场景测试
│       └── MyShopping          //购物场景测试
│       └── MyDoc	            //办公场景测试
│       └── MyChat	            //社交场景测试
│       └── MyGame	            //游戏场景测试
└── figures		           //readme 图片资源
└── docs		           //readme 二级文档
└── readme.md              //说明文档

测试内容

集成测试仓规划的测试内容如下(持续更新):

  • 功能测试
编号 子系统 测试模块
1 设备管理 系统信息
2 多模输入 触摸/手势
3 通信 Wi-Fi
4 通信 蓝牙
5 通信 网络传输
6 媒体 音频
7 媒体 相机
8 媒体 视频
9 媒体 图片
10 文件 文件读写
11 分布式 分布式设备
  • 场景测试
编号 场景
1 音乐播放
2 社交软件
3 办公软件
4 电商购物
5 新闻资讯
6 游戏
7 视频直播
8 智能设备控制
  • 性能测试
编号 子系统 测试项
1 应用程序框架 应用启动、切换
2 文件 文件IO性能
3 通信 网络传输性能(Wi-Fi)
4 图形 图形显示性能
5 多媒体 音频性能
6 多媒体 视频性能
7 多媒体 相机性能
8 电源管理 功耗
9 ArkUI ArkUI组件benchmark
10 ArkTS ArkTS语言benchmark
11 <综合> 性能(CPU,GPU,IO)

详细测试项参考各模块说明。

测试应用示例

  • 功能测试
Wi-Fi功能测试 音频功能测试 相机功能测试
image image image
  • 场景测试
在线音乐场景测试应用 音乐UX场景测试应用 新闻UX场景测试应用
image image image
  • 性能测试
Wi-Fi性能测试 音频性能测试 相机性能测试 ArkTS benchmark测试
image image image image

使用说明

测试执行步骤:

  1. 下载代码

从代码仓同步代码。

  1. 编译构建

【手动测试】在DevEco中运行test工程测试用例即可。

  • 使用DevEco编译、运行测试:

image

  • 查看测试结果:

image

【自动化测试】使用xDevice框架,环境搭建执行按后续步骤 3~5 操作:

  • 当前使用DevEco手工构建,批量构建可以通过脚本,使用类似XTS的gn方式(后续将替换成hivigor)
  1. 环境准备
  • 测试环境创建四个目录和一个执行脚本:

    • config//json配置文件

    • tools//执行所需的工具:xdevice安装包

    • testcases//测试应用hap

    • report//报告输出目录

    • run.bat//执行脚本

  • 将编译好的hap文件拷贝到testcases目录。

  • 配置文件预置模板:

    • myShopping.json
{
  "description": "Configuration for myshopping Tests",
  "level": ["0","1","2"],
  "type": "function",
  "component": "player_framework",
  "syscap": [
        "SystemCapability.Multimedia.Media.AudioPlayer",
        "SystemCapability.Multimedia.Media.VideoPlayer",
        "SystemCapability.Multimedia.Media.AudioRecorder",
        "SystemCapability.Multimedia.Media.VideoRecorder",
        "SystemCapability.Multimedia.Media.AVPlayer",
        "SystemCapability.Multimedia.Media.AVRecorder"
      ],
  "driver": {
      "type": "OHJSUnitTest",
      "test-timeout": "180000",
      "bundle-name": "ohos.samples.myShopping",
      "module-name": "entry_test",
      "shell-timeout": "60000",
      "testcase-timeout": 30000
  },
  "kits": [
  {
      "test-file-name": [
          "myShopping.hap"
      ],
      "type": "AppInstallKit",
      "cleanup-apps": true
  }, {
      "type": "ShellKit",
      "run-command": [
          "power-shell wakeup",
          "power-shell setmode 602"
      ]
  }]
}

参考这个模板,给其他应用的测试hap创建json文件,创建后修改bundle-name,module-name,test-file-name ,这里注意应用的bundle-name的这个名称最好和hap的文件名一致,方便检索修改。

例如,修改后的myMusic.json如下:

{
  "description": "Configuration for myMusic Tests",
  {
  "description": "Configuration for myshopping Tests",
  "level": ["0","1","2"],
  "type": "function",
  "component": "player_framework",
  "syscap": [
        "SystemCapability.Multimedia.Media.AudioPlayer",
        "SystemCapability.Multimedia.Media.VideoPlayer",
        "SystemCapability.Multimedia.Media.AudioRecorder",
        "SystemCapability.Multimedia.Media.VideoRecorder",
        "SystemCapability.Multimedia.Media.AVPlayer",
        "SystemCapability.Multimedia.Media.AVRecorder"
      ],
  "driver": {
      "type": "OHJSUnitTest",
      "test-timeout": "180000",
      "bundle-name": "ohos.samples.myMusic",
      "module-name": "entry_test",
      "shell-timeout": "60000",
      "testcase-timeout": 30000
  },
  "kits": [
  {
      "test-file-name": [
          "myMusic.hap"
      ],
      "type": "AppInstallKit",
      "cleanup-apps": true
  }, {
      "type": "ShellKit",
      "run-command": [
          "power-shell wakeup",
          "power-shell setmode 602"
      ]
  }]
}
  1. 执行用例

    脚本参考:run.bat

    run -l 包名
    

    不同环境下,可以自行修改自动化执行的脚本。

  2. 查看报告

    查看report输出的报告。 image

其他细节参考各测试应用使用说明。

系统功能和测试执行

通过功能和用例映射规则定义”功能和用例的映射关系“和”支持执行方式“,体现在用例设计规范中。

规范

  1. 代码规范

    查看代码规范

  2. 工程结构规范

    查看工程结构规范

  3. README编写规范

    查看README编写规范

  4. 用例设计规范

    查看用例设计规范

  5. 应用质量规范

    查看OpenHarmony应用质量要求

参与贡献

上述规划中的测试内容,包括不限于:

  1. 功能测试:Wi-Fi、蓝牙、音频、视频等;
  2. 场景测试:办公、媒体、游戏等;
  3. 专项工具:应用性能、安全性、稳定性等;

有任何关于本仓的想法和问题请联系管理员或者提issue问题单。

共建操作步骤:

  1. Fork 本仓库
  2. 新建 Feat_xxx 分支
  3. 提交代码
  4. 新建 Pull Request
License Notice Copyright 2021 Huawei Device Co., Ltd. Testing Materials under this file are licensed under License Agreement for Testing Materials. All other materials under this file, including codes are licensed under Apache License V 2.O -------------------------------------------------------------------------------- License Agreement for Testing Materials THIS LICENSE AGREEMENT FOR TESTING MATERIALS (“AGREEMENT”) IS A LEGAL AGREEMENT BETWEEN YOU (EITHER A SINGLE INDIVIDUAL, OR SINGLE LEGAL ENTITY) AND LICENSORS FOR THE USE OF THE TESTING MATERIALS ACCOMPANYING THIS AGREEMENT FOR TESTING PURPOSE. BY DOWNLOADING, REPRODUCING OR OTHERWISE USING THE TESTING MATERIALS YOU INDICATE THAT YOU AGREE TO BE BOUND BY ALL OF THE TERMS OF THIS AGREEMENT. IF YOU DO NOT AGREE TO THE TERMS OF THIS AGREEMENT, YOU MAY NOT DOWNLOAD, REPRODUCE OR OTHERWISE USING THE TESTING MATERIALS, AND YOU SHALL PROMPTLY DESTROY AND DELETE ALL THE TESTING MATERIALS. 1. Definition "Testing Materials" shall mean the materials provided by licensors under this agreement for testing the function of OpenHarmony Operating System,an open source project governed under OpenAtom Foundation. The Testing Materials include but not limited to photos, pictures, graphics, videos and audios. "Licensors" shall mean the copyright holders or their licensees who have the right to license the Testing Materials under this Agreement. "YOU" shall mean an individual or legal entity exercising permissions granted by this Agreement. 2. GRANT OF LICENSE Subject to the terms and conditions of this Agreement, Licensors hereby grant YOU, a non-transferable, non-exclusive, royalty-free, revocable, worldwide copyright license (without the right to sublicense) to reproduce and use Testing Materials internally solely for the purpose of testing the function of OpenHarmony Operating System. YOU agree not to use the TESTING MATERIALS for any other purposes. Except as expressly licensed in Section 2, in no event shall the license granted in this Section 2 be construed as granting YOU expressly or by implication, estoppels or otherwise, licenses to any intellectual property rights, including but not limited to patent rights, copyrights, trademark or trade secret in the TESTING MATERIALS. Any use beyond the internal testing purpose as stated in Section 2 is prohibited. No right is granted to YOU under this Agreement to distribute the Testing Materials or any part of them or their derivative works independently or accompany with your products or services. 3. NO WARRANTY YOU AGREE THAT THE TESTING MATERIALS IS PROVIDED BY LICENSORS ON AN "AS IS" BASIS. LICENSORS MAKES NO WARRANTY, EXPRESSED OR IMPLIED OR STATUTORY, WITH RESPECT TO ANY OF THE TESTING MATERIALS, INCLUDING WITHOUT LIMITATION, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, SATISFACTORY QUALITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT. YOU EXPRESSLY ASSUME ALL LIABILITIES AND RISKS FOR USE OF THE TESTING MATERIALS. SHOULD THE TESTING MATERIALS PROVE DEFECTIVE, YOU ASSUME THE ENTIRE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION. 4. NO LIABILITY PLEASE NOTE THAT YOU SHOULD USE THE TESTING MATERIALS AT YOUR OWN RISK. IN NO EVENT SHALL LICENSORS BE LIABLE FOR ANY DIRECT OR INDIRECT, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES (INCLUDING WITHOUT LIMITATION, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) ARISING IN ANY WAY OUT OF THE USE OF OR INABILITY TO USE THE TESTING MATERIALS, WHETHER UNDER THEORY OF CONTRACT, TORT (INCLUDING NEGLIGENCE), STRICT LIABILITY OR OTHER LEGAL THEORY, EVEN IF LICENSORS HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. -------------------------------------------------------------------------------- Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 1. Definitions. "License" shall mean the terms and conditions for use, reproduction, and distribution as defined by Sections 1 through 9 of this document. "Licensor" shall mean the copyright owner or entity authorized by the copyright owner that is granting the License. "Legal Entity" shall mean the union of the acting entity and all other entities that control, are controlled by, or are under common control with that entity. For the purposes of this definition, "control" means (i) the power, direct or indirect, to cause the direction or management of such entity, whether by contract or otherwise, or (ii) ownership of fifty percent (50%) or more of the outstanding shares, or (iii) beneficial ownership of such entity. "You" (or "Your") shall mean an individual or Legal Entity exercising permissions granted by this License. "Source" form shall mean the preferred form for making modifications, including but not limited to software source code, documentation source, and configuration files. "Object" form shall mean any form resulting from mechanical transformation or translation of a Source form, including but not limited to compiled object code, generated documentation, and conversions to other media types. "Work" shall mean the work of authorship, whether in Source or Object form, made available under the License, as indicated by a copyright notice that is included in or attached to the work (an example is provided in the Appendix below). "Derivative Works" shall mean any work, whether in Source or Object form, that is based on (or derived from) the Work and for which the editorial revisions, annotations, elaborations, or other modifications represent, as a whole, an original work of authorship. For the purposes of this License, Derivative Works shall not include works that remain separable from, or merely link (or bind by name) to the interfaces of, the Work and Derivative Works thereof. "Contribution" shall mean any work of authorship, including the original version of the Work and any modifications or additions to that Work or Derivative Works thereof, that is intentionally submitted to Licensor for inclusion in the Work by the copyright owner or by an individual or Legal Entity authorized to submit on behalf of the copyright owner. For the purposes of this definition, "submitted" means any form of electronic, verbal, or written communication sent to the Licensor or its representatives, including but not limited to communication on electronic mailing lists, source code control systems, and issue tracking systems that are managed by, or on behalf of, the Licensor for the purpose of discussing and improving the Work, but excluding communication that is conspicuously marked or otherwise designated in writing by the copyright owner as "Not a Contribution." "Contributor" shall mean Licensor and any individual or Legal Entity on behalf of whom a Contribution has been received by Licensor and subsequently incorporated within the Work. 2. Grant of Copyright License. Subject to the terms and conditions of this License, each Contributor hereby grants to You a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable copyright license to reproduce, prepare Derivative Works of, publicly display, publicly perform, sublicense, and distribute the Work and such Derivative Works in Source or Object form. 3. Grant of Patent License. Subject to the terms and conditions of this License, each Contributor hereby grants to You a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable (except as stated in this section) patent license to make, have made, use, offer to sell, sell, import, and otherwise transfer the Work, where such license applies only to those patent claims licensable by such Contributor that are necessarily infringed by their Contribution(s) alone or by combination of their Contribution(s) with the Work to which such Contribution(s) was submitted. If You institute patent litigation against any entity (including a cross-claim or counterclaim in a lawsuit) alleging that the Work or a Contribution incorporated within the Work constitutes direct or contributory patent infringement, then any patent licenses granted to You under this License for that Work shall terminate as of the date such litigation is filed. 4. Redistribution. You may reproduce and distribute copies of the Work or Derivative Works thereof in any medium, with or without modifications, and in Source or Object form, provided that You meet the following conditions: (a) You must give any other recipients of the Work or Derivative Works a copy of this License; and (b) You must cause any modified files to carry prominent notices stating that You changed the files; and (c) You must retain, in the Source form of any Derivative Works that You distribute, all copyright, patent, trademark, and attribution notices from the Source form of the Work, excluding those notices that do not pertain to any part of the Derivative Works; and (d) If the Work includes a "NOTICE" text file as part of its distribution, then any Derivative Works that You distribute must include a readable copy of the attribution notices contained within such NOTICE file, excluding those notices that do not pertain to any part of the Derivative Works, in at least one of the following places: within a NOTICE text file distributed as part of the Derivative Works; within the Source form or documentation, if provided along with the Derivative Works; or, within a display generated by the Derivative Works, if and wherever such third-party notices normally appear. The contents of the NOTICE file are for informational purposes only and do not modify the License. You may add Your own attribution notices within Derivative Works that You distribute, alongside or as an addendum to the NOTICE text from the Work, provided that such additional attribution notices cannot be construed as modifying the License. You may add Your own copyright statement to Your modifications and may provide additional or different license terms and conditions for use, reproduction, or distribution of Your modifications, or for any such Derivative Works as a whole, provided Your use, reproduction, and distribution of the Work otherwise complies with the conditions stated in this License. 5. Submission of Contributions. Unless You explicitly state otherwise, any Contribution intentionally submitted for inclusion in the Work by You to the Licensor shall be under the terms and conditions of this License, without any additional terms or conditions. Notwithstanding the above, nothing herein shall supersede or modify the terms of any separate license agreement you may have executed with Licensor regarding such Contributions. 6. Trademarks. This License does not grant permission to use the trade names, trademarks, service marks, or product names of the Licensor, except as required for reasonable and customary use in describing the origin of the Work and reproducing the content of the NOTICE file. 7. Disclaimer of Warranty. Unless required by applicable law or agreed to in writing, Licensor provides the Work (and each Contributor provides its Contributions) on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied, including, without limitation, any warranties or conditions of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. You are solely responsible for determining the appropriateness of using or redistributing the Work and assume any risks associated with Your exercise of permissions under this License. 8. Limitation of Liability. In no event and under no legal theory, whether in tort (including negligence), contract, or otherwise, unless required by applicable law (such as deliberate and grossly negligent acts) or agreed to in writing, shall any Contributor be liable to You for damages, including any direct, indirect, special, incidental, or consequential damages of any character arising as a result of this License or out of the use or inability to use the Work (including but not limited to damages for loss of goodwill, work stoppage, computer failure or malfunction, or any and all other commercial damages or losses), even if such Contributor has been advised of the possibility of such damages. 9. Accepting Warranty or Additional Liability. While redistributing the Work or Derivative Works thereof, You may choose to offer, and charge a fee for, acceptance of support, warranty, indemnity, or other liability obligations and/or rights consistent with this License. However, in accepting such obligations, You may act only on Your own behalf and on Your sole responsibility, not on behalf of any other Contributor, and only if You agree to indemnify, defend, and hold each Contributor harmless for any liability incurred by, or claims asserted against, such Contributor by reason of your accepting any such warranty or additional liability. END OF TERMS AND CONDITIONS

简介

集成测试仓 展开 收起
README
Apache-2.0
取消

发行版

暂无发行版

近期动态

29天前推送了新的提交到 master 分支,cd65c2e...54de0a5
4个月前通过合并 Pull request OHBM性能测试应用:增加cube 3d用例 将 Issue #IBLTBN 状态从 待办的 更改为 已完成
4个月前推送了新的提交到 master 分支,100c4b5...cd65c2e
4个月前合并了 PR #247 OHBM性能测试应用:增加cube 3d用例
4个月前评论了 PR !247 OHBM性能测试应用:增加cube 3d用例
加载更多
不能加载更多了
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/openharmony-sig/ostest_integration_test.git
git@gitee.com:openharmony-sig/ostest_integration_test.git
openharmony-sig
ostest_integration_test
ostest_integration_test
master

搜索帮助