gala-spider：手动构造tcpline.txt格式异常数据，get_entities接口会有Traceback打印

【标题描述】手动构造tcpline.txt格式异常数据，get_entities接口会有Traceback打印
【环境信息】
[root@openEuler spider]# uname -r
5.10.0-5.8.0.22.oe1.x86_64
[root@openEuler spider]# rpm -qa | grep gala-spider
python3-gala-spider-v1.0.2-2.oe1.x86_64
gala-spider-v1.0.2-2.oe1.x86_64
【问题复现步骤】
1，手动构造tcpline.txt数据，且数据错误非jason格式，使用curl -X 'GET' 'http://0.0.0.0:11115/gala-spider/api/v1/get_entities' -H 'accept: application/json' 获取实信息
【预期结果】
数据异常应该增加可靠性，不能导致接口500
【实际结果】
![输入图片说明](https://images.gitee.com/uploads/images/2021/0915/141607_5662dc42_5201072.png "屏幕截图.png")
Sep 15 14:00:29 openEuler spider[4635]: [2021-09-15 14:00:28,847] ERROR in app: Exception on /gala-spider/api/v1/get_entities [GET]
Sep 15 14:00:29 openEuler spider[4635]: Traceback (most recent call last):
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/flask/app.py", line 2447, in wsgi_app
Sep 15 14:00:29 openEuler spider[4635]:     response = self.full_dispatch_request()
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/flask/app.py", line 1952, in full_dispatch_request
Sep 15 14:00:29 openEuler spider[4635]:     rv = self.handle_user_exception(e)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/flask/app.py", line 1821, in handle_user_exception
Sep 15 14:00:29 openEuler spider[4635]:     reraise(exc_type, exc_value, tb)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise
Sep 15 14:00:29 openEuler spider[4635]:     raise value
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/flask/app.py", line 1950, in full_dispatch_request
Sep 15 14:00:29 openEuler spider[4635]:     rv = self.dispatch_request()
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/flask/app.py", line 1936, in dispatch_request
Sep 15 14:00:29 openEuler spider[4635]:     return self.view_functions[rule.endpoint](**req.view_args)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/connexion/decorators/decorator.py", line 68, in wrapper
Sep 15 14:00:29 openEuler spider[4635]:     response = function(request)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/connexion/decorators/uri_parsing.py", line 149, in wrapper
Sep 15 14:00:29 openEuler spider[4635]:     response = function(request)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/connexion/decorators/validation.py", line 396, in wrapper
Sep 15 14:00:29 openEuler spider[4635]:     return function(request)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/connexion/decorators/parameter.py", line 115, in wrapper
Sep 15 14:00:29 openEuler spider[4635]:     return function(**kwargs)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/spider/controllers/gala_spider.py", line 27, in get_observed_entity_list
Sep 15 14:00:29 openEuler spider[4635]:     edges_table, edges_infos, nodes_table, lb_tables = node_entity_process()
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/spider/data_process/data_to_entity.py", line 111, in node_entity_process
Sep 15 14:00:29 openEuler spider[4635]:     edges_table, edges_infos = tcp_entity_process()
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib/python3.8/site-packages/spider/data_process/data_to_entity.py", line 24, in tcp_entity_process
Sep 15 14:00:29 openEuler spider[4635]:     line_json = json.loads(lines)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib64/python3.8/json/__init__.py", line 357, in loads
Sep 15 14:00:29 openEuler spider[4635]:     return _default_decoder.decode(s)
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib64/python3.8/json/decoder.py", line 337, in decode
Sep 15 14:00:29 openEuler spider[4635]:     obj, end = self.raw_decode(s, idx=_w(s, 0).end())
Sep 15 14:00:29 openEuler spider[4635]:   File "/usr/lib64/python3.8/json/decoder.py", line 353, in raw_decode
Sep 15 14:00:29 openEuler spider[4635]:     obj, end = self.scan_once(s, idx)
Sep 15 14:00:29 openEuler spider[4635]: json.decoder.JSONDecodeError: Expecting ',' delimiter: line 1 column 206 (char 205)

openEuler/A-Ops
关闭

内容风险标识

评论 (2)

openEuler/A-Ops关闭 .gitee-modal { width: 500px !important; }

内容风险标识