Big Data - Scala - 大数据 - Gitee open source code management software

极客青年/SZT-bigdata

深圳地铁大数据客流分析系统🚇🚄🌟

Scala

Big Data

1 month ago

科学大数据开源社区/PiFlow

混合型科学大数据流水线系统，包含丰富的处理器组件，提供Shell、DSL、Web配置界面、任务调度、任务监控等功能

Scala

Big Data

2 months ago

wux-labs/DataService-Framework

大数据平台数据服务框架。实现了Kafka实时数据过滤、清洗、转换、消费，实现了Spark SQL对Redis、MongoDB等非关系型数据库的数据的读写；集成了规则引擎，可基于规则引擎实现客户标签、画像等相关功能。

Scala

Big Data

over 1 year ago

Fire Framework/fire

Fire框架是由中通大数据自主研发并开源的、专门用于进行Spark和Flink任务开发的大数据框架，可节约70%以上的代码量。首创基于注解进行Spark和Flink任务开发，具备实时血缘、根因诊断、动态调优、参数热调整等众多平台化功能。Fire框架在中通内部每天处理数据量高达数千亿，在外部已被数十家公司所使用。

Scala

8 days ago

supermy/kafka-spark-redis

大数据实时流的计算框架

Scala

Big Data

6 years ago

白乔/πFlow

可配置图形化大数据流水线系统，包含丰富的处理器组件，提供Shell、DSL、Web配置界面、任务调度、任务监控等功能

Scala

Big Data

6 years ago

meta-soul/LakeSoul

LakeSoul 端到端实时湖仓框架 Github 官方镜像

Scala

Big Data

22 days ago

Qinx/setl

A simple Spark-powered ETL framework that just works 🍺

Scala

Big Data

almost 3 years ago

Gitee 极速下载/stream-dm

streamDM，是由华为诺亚方舟实验室开源的使用 Spark Streaming 挖掘大数据的开源软件

Scala

Big Data

3 years ago

Hardware	IoT/Edge Computing
Car Application	Smart Home
Autopilot	Robots
5G	低代码
科研论文	quantum
chips	Web 3.0
Privacy Computing	Cloud Native

HarmonyOS Button	HarmonyOS EditText	HarmonyOS Layout	HarmonyOS Image
HarmonyOS Progress	HarmonyOS Menu	HarmonyOS Popup	HarmonyOS Selector
HarmonyOS TextView	HarmonyOS ListView	HarmonyOS Loading	HarmonyOS Notification
HarmonyOS View Transition	HarmonyOS Slider	HarmonyOS Chart	HarmonyOS Draw
HarmonyOS Counter	HarmonyOS Animate	HarmonyOS Captcha	HarmonyOS Multimedia
HarmonyOS Barcode	HarmonyOS Advanced	HarmonyOS Map	OpenHarmony Games
HarmonyOS Networking	HarmonyOS Communication	HarmonyOS Payment	HarmonyOS Database
HarmonyOS Drivers	OpenHarmony Guide	OpenHarmony DevTools	OpenHarmony App
HMS	HarmonyOS Permission	HarmonyOS Toolkit	OpenHarmony Components
Gesture

Chinese/English Segmenter	Payment Dev	Security Dev	Common Toolkit
Excel Toolkit	Barcode/QRCode	Template Engine	Desktop UI
Network Development Package	Audio Process	Network Tool	Network Service
Data Mining	Job/Task Scheduling	Programming Language/Scripting Language	Cache
Markdown Tools	Search Engine	Microservice	Workflow
Chart/Diagram Component	Authority Management	Reporting Tool	Code Generator
IoC/AOP Framework	Image Library	Rule Engine	JSON Toolkit
Log Toolkit	Spring Boot Extension	Verification Code	Algorithm/Mathematical Calculation
Node Extension	Process Engine	Animation Development	3G/4G/5G

Artificial Intelligence	VR/AR
Machine Learning/Deep Learning	Computer Vision/Face Recognition
Natural Language Processing	LLM

Wechat Development Package	WeChat Applet/Game
WeChat Application	WeChat Game

Search