2 Star 2 Fork 0

HuaweiCloudDeveloper/huaweicloud-analytics-reference-architecture

加入 Gitee
与超过 1400万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
文件
克隆/下载
obs_hive_ods.sh 1.92 KB
一键复制 编辑 原始数据 按行查看 历史
zhanghaopeng 提交于 2022-05-20 23:32 +08:00 . analytics
#!/bin/bash
tenant_id=$1
do_date=$2
domain=$3
obs_path='obs://obs-east-bkt001/origin_data/db'
ods_user="
load data inpath '${obs_path}/user_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_user partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
ods_t_order="
load data inpath '${obs_path}/t_order_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_t_order partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
ods_t_service_sku="
load data inpath '${obs_path}/t_service_sku_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_t_service_sku partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
ods_t_task="
load data inpath '${obs_path}/t_task_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_t_task partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
ods_message="
load data inpath '${obs_path}/message_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_message partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
ods_t_housekeeper_service="
load data inpath '${obs_path}/t_housekeeper_service_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_t_housekeeper_service partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
ods_t_service_option="
load data inpath '${obs_path}/t_service_option_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_t_service_option partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
ods_t_service_specification="
load data inpath '${obs_path}/t_service_specification_full/${do_date}/${domain}/${tenant_id}' OVERWRITE into table ods_t_service_specification partition(dt='${do_date}',domain='${domain}',tenant_id='${tenant_id}');"
hive -e "$ods_user$ods_t_service_sku$ods_t_order$ods_t_task$ods_message$ods_t_housekeeper_service$ods_t_service_option$ods_t_service_specification"
Loading...
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/HuaweiCloudDeveloper/huaweicloud-analytics-reference-architecture.git
git@gitee.com:HuaweiCloudDeveloper/huaweicloud-analytics-reference-architecture.git
HuaweiCloudDeveloper
huaweicloud-analytics-reference-architecture
huaweicloud-analytics-reference-architecture
master-dev

搜索帮助