# Framework-Of-BigData

**Repository Path**: guoguoq/Framework-Of-BigData

## Basic Information

- **Project Name**: Framework-Of-BigData
- **Description**: 大数据面试题，从0到1走向架构师之路。Flink、Spark、Hive、HBase、Hadoop、Kettle、Kafka... 每周日更新
- **Primary Language**: Scala
- **License**: Not specified
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 15
- **Created**: 2023-07-21
- **Last Updated**: 2023-07-21

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Framework-Of-BigData
大数据面试题，从0到1走向架构师之路。Flink、Spark、Hive、HBase、Hadoop、Kettle、Kafka...
每周日更新

<p align="center">
    <a href="#微信" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/WeChat-%E5%85%AC%E4%BC%97%E5%8F%B7-green" alt="公众号" />
    </a>
    <a href="https://www.toutiao.com/c/user/token/MS4wLjABAAAA1ddQa0qBdony54kzsuJEh4SofJyzbv-u_uIXh4EMf4EIlPILAOy4YrRpoeGXYMkJ/" target="_blank" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/toutiao-%E5%A4%B4%E6%9D%A1-red" alt="头条" />
    </a>
    <a href="https://www.zhihu.com/people/ting-feng-92-52-29" target="_blank" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/zhihu-%E7%9F%A5%E4%B9%8E-blue" alt="知乎" />
    </a>
    <a href="https://my.oschina.net/u/4917371" target="_blank" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/oschina-%E5%BC%80%E6%BA%90%E4%B8%AD%E5%9B%BD-green" alt="开源中国" />
    </a>
    <a href="https://juejin.cn/user/369051370796478" target="_blank" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/juejin-%E6%8E%98%E9%87%91-blue" alt="掘金" />
    </a>
    <a href="https://blog.csdn.net/qq_43791724?spm=1000.2115.3001.5343" target="_blank" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/csdn-CSDN-red" alt="CSDN" />
    </a>
    <a href="https://blog.51cto.com/14417862" target="_blank" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/51cto-51CT0%E5%8D%9A%E5%AE%A2-orange" alt="51CT0博客" />
    </a>
        <a href="https://www.infoq.cn/profile/098EDD008A05B1/publish" target="_blank" style="text-decoration:none;">
        <img src="https://img.shields.io/badge/infoq-INFOQ-Chartreuse" alt="INFOQ" />
    </a>
</p>

## 项目系列
### 一、大数据项目
1. [如何在面试中介绍自己的项目经验(经验分享)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247485734&idx=1&sn=c117995c9a2ad924233c22a2264903a1&chksm=9f1f5d2ea868d4389735d86adeaa70052bb964b3a8bf11be06267d24c6dbdc17f9b975f993e4&token=1524063186&lang=zh_CN#rd)
2. [kettle生成节假日数据原来还可以这样操作？(数仓面试题、数仓项目)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487190&idx=1&sn=6afdb1e98e5eae583898af61b18bf931&chksm=9f1f5adea868d3c81483106af308cc4ffd574c4f33a61dfb368312003a6790d2ff8cb6c3d22e&token=1524063186&lang=zh_CN#rd)
3. [数仓模型设计详细讲解(数仓面试题、数仓项目)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487538&idx=1&sn=c06b6ce73f25593eb25f516b4cb9db82&chksm=9f1f443aa868cd2c3b014cdb40ebda1e4bd67054ebb15b647b7a862e93a37ad2256520f02328&token=1524063186&lang=zh_CN#rd)
4. [数据仓库分层架构深度讲解(数仓面试题、数仓项目)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487563&idx=1&sn=c5e72c68bdef10186f36d8531a7fea6b&chksm=9f1f4443a868cd55738d75fc850a9cc3e31ca6e162b36cb45f9de26ed1e9a79e20f233c10ae8&token=1524063186&lang=zh_CN#rd)
5. [数仓缓慢变化维深度讲解](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487646&idx=1&sn=cfac74b61dd95172d02ac3254b4014af&chksm=9f1f4496a868cd800ecd883d423b0116e46c3b2a009341e2c83b0b587f83c2b8dc9953c8fd35&token=754054769&lang=zh_CN#rd)
6. [深入讲解拉链表，还怕面试官问？](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487688&idx=1&sn=c7afa24770ae54528fd433546076f808&chksm=9f1f44c0a868cdd67d88e7c7305bcfb896ba7aa295c594cd526db44deca4d1804082683071c5&token=754054769&lang=zh_CN#rd) 
7. [企业是如何选择技术栈来做离线数仓](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488274&idx=1&sn=6dc1f5123a8d3fe41a9b96e2286275cf&chksm=9f1f471aa868ce0cd8e06702f9e72dd47bc620290b42096a39ae29bd8155b9c7b1d754b470d4&token=1486904052&lang=zh_CN#rd)

## 面试系列 
1. [分布式计算—MapReduce、Spark、Storm、Flink分别适用什么场景](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488872&idx=1&sn=0ecde481d758d115537091a37694aaa5&chksm=9f1f4160a868c8769e698ed7578b66e5bd1a5252e1e2e1fa39b8dbe5c10482debfde594a7ef5&token=1486904052&lang=zh_CN#rd)
2. [13道Flink企业级高频面试题](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488936&idx=1&sn=84b8ef3c460683de4209ceab2f80b09a&chksm=9f1f41a0a868c8b6b73aa2ffd750eb64d6f9556c4e49082be529c6e1b6d31db1825fbe95e540&token=1486904052&lang=zh_CN#rd)
3. [关于构建数据仓库的几个问题](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488965&idx=1&sn=79a104b491c94c04a18483e777a11081&chksm=9f1f41cda868c8db75a976d46b8930f9fd0a59801704ea230c36cab1342d8966c03ff6831733&token=1486904052&lang=zh_CN#rd)
## 优秀文章目录
### 一、Hadoop
 1. [HDFS是如何设计架构的](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488297&idx=1&sn=07f936434302975c23bd31b6c4c1dc0f&chksm=9f1f4721a868ce3703bce8a8e517d2d5d4524ef74938d149db979e885e35d115b04222d566f2&token=1486904052&lang=zh_CN#rd)
 2. [最新Hadoop的面试题总结](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488759&idx=1&sn=d4ff86a44eacf18e1f1b9282babf2e10&chksm=9f1f40ffa868c9e9c1bd4ca1877d69a43b6222c2e6e62cf7acecc7249723f6342902bdb95512&token=1486904052&lang=zh_CN#rd)
### 二、Flink
1. [十分钟入门Fink SQL](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247486726&idx=1&sn=f7320bf30a52c737ba22d781dc5b483e&chksm=9f1f590ea868d018703b577f96e24db78413d838723285b41e07ac581ea69e0504d132251477&token=1524063186&lang=zh_CN#rd)
2. [Flink SQL——Table与DataStream之间的互转(超详细)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247486862&idx=1&sn=0bcc6da90bd74a48d783ff11b87c6e97&chksm=9f1f5986a868d090c6694b4e9df0fc882eb11e9ffe533d49ed6a2126919a564799fdf6c09f9a&token=1524063186&lang=zh_CN#rd)
3. [Flink SQL Sink(文件、kafka、Stream)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247486899&idx=1&sn=d3ecd628f72ce2d0f1d9ddc91454014a&chksm=9f1f59bba868d0ad3ccb25562315ed204f3129bf2e0fda01b3c8bb0fcfcaea6aff7cfe53e207&token=1524063186&lang=zh_CN#rd)
4. [一文章带你深入了解Flink SQL流处理中的特殊概念(超详细)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247486995&idx=1&sn=ffd7eb859788b4de02c7a7b5268f56a7&chksm=9f1f5a1ba868d30d72abe43568a877599b368a18905b37cf9826e024656683ac398e35835d4f&token=1524063186&lang=zh_CN#rd)
5. [一文章让深入理解Flink SQL 时间特性(超详细)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487143&idx=1&sn=5cbddcadd401d50b30a94b768f9bdd0c&chksm=9f1f5aafa868d3b9e9128db4f5c39fb95d7864a8b28236c08bde9f324a4033ebeca3dad28e30&token=1524063186&lang=zh_CN#rd)
6. [一文章带你深入理解FlinkSQL中的窗口(三种模式)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487436&idx=1&sn=98e6f8081ee7fba9c74277c06bc19112&chksm=9f1f5bc4a868d2d29110ab5d398416bde510e2835733aef25924eb44a6b1349476d0a03742a8&token=1524063186&lang=zh_CN#rd)
7. [Flink系统自带函数与自定义UDF(超详细)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487501&idx=1&sn=43db346ef4e4f0c021f923ef62d851c1&chksm=9f1f4405a868cd13b24dd0a5f9bbcae3a6a647a1d61cf07c953170ffdc9ca97be92a62b62ab1&token=1524063186&lang=zh_CN#rd)
8. [那些被问懵的Flink面试题(Flink面试急需)](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487518&idx=1&sn=75853b3620e4de74df91694c441670ff&chksm=9f1f4416a868cd00f44d39fa23752ffe7a33398157afd64fdf02ff00620bc0674dcd0cfcdc7c&token=1524063186&lang=zh_CN#rd)
9. [Flink 自定义Avro序列化(Source/Sink)到kafka中](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487893&idx=1&sn=01a04af2c007b6fd32ad09eb286da907&chksm=9f1f459da868cc8b6a0daabb213b93d4c560fa3631dd9aa153760b85be9ae2256a4a8f0c14e3&token=754054769&lang=zh_CN#rd)
10. [Flink 资源分配和并行度深度剖析](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488786&idx=1&sn=118c92aadd0cedc8a80d671ac86d566a&chksm=9f1f411aa868c80ce2e20838c95d7b5cb673689fac521da1511a696275750d6c9ac27ea375ce&token=1486904052&lang=zh_CN#rd)
11. [13道Flink企业级高频面试题](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488936&idx=1&sn=84b8ef3c460683de4209ceab2f80b09a&chksm=9f1f41a0a868c8b6b73aa2ffd750eb64d6f9556c4e49082be529c6e1b6d31db1825fbe95e540&token=1486904052&lang=zh_CN#rd)



### 三、Spark

1. [Spark企业级面试题【上】](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247485925&idx=1&sn=844453cb86043889510d299ff4bc2507&chksm=9f1f5deda868d4fb6d9cd99a76082ef985f2920f259cba726e6ad4301d3a1705ce2bc43936f6&token=1524063186&lang=zh_CN#rd)
2. [Spark企业级面试题【下】](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247485976&idx=1&sn=bcc97f542e08e9b98385cca82d426e06&chksm=9f1f5e10a868d706306c536552f7b679d71cb18f683f305b254fb1704f7eb990c4fe7cef7851&token=1524063186&lang=zh_CN#rd)
3. [如何管理Spark的分区](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488918&idx=1&sn=40f9055b9174f2719bc1d8214c5a0dd0&chksm=9f1f419ea868c888231c9da47e35171120fe7e48a53e86c3dbccd0faaf36300e00a4bb350f07&token=1486904052&lang=zh_CN#rd)
### 四、kettle

1. [kettle生成节假日数据原来还可以这样操作？](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487190&idx=1&sn=6afdb1e98e5eae583898af61b18bf931&chksm=9f1f5adea868d3c81483106af308cc4ffd574c4f33a61dfb368312003a6790d2ff8cb6c3d22e&token=1524063186&lang=zh_CN#rd)

### 五、Hive
1. [一文教你学会Hive视图和索引](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247487767&idx=1&sn=18be996ccba71ae0ad102c657453cd64&chksm=9f1f451fa868cc09e48b7bbce87d3e77fe9c5cafc62d94f0b635918ece974d567b26430684c6&token=754054769&lang=zh_CN#rd)
2. [Hive的调优你都知道那些？](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488141&idx=1&sn=7bc1dc36a6aaa7302855b815f8a74ed3&chksm=9f1f4685a868cf933cb857c129132c72575e2bb7968b574457835360180ad51e03d2cc343143&token=427252031&lang=zh_CN#rd)
3. [最新Hive的高频面试题新鲜出炉了！](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488831&idx=1&sn=fcce86a8b167902b24f6474e1113f12a&chksm=9f1f4137a868c821344a3d7bd7df582fc9ab014c9df7a7c7ea2acbae1f101465cd417cb25d15&token=1486904052&lang=zh_CN#rd)
4. [Hive查询的18种方式，你都学会了吗？](9f1f4187a868c891729fb9fdebaa33c37ecdee5e4bdbb29374b6838a2661baee151d18e2c6bd)
### 六、kafka
 1. [使用 Kafka，如何成功迁移 SQL 数据库中超过 20 亿条记录？](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488086&idx=1&sn=5fb64e80d2422286bcc130f51673435d&chksm=9f1f465ea868cf487052139e261aed95982b182eb2f442da8b7db3a33572a52c5997765bf5ca&token=427252031&lang=zh_CN#rd)
 2. [你都知道那些Kafka副本机制？](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488336&idx=1&sn=15320eb438d265528c0cde36f52d7a7c&chksm=9f1f4758a868ce4e025de6fbeda33f91e566a386421a735395570238aa4e30bb6cd33d3e0d19&token=1486904052&lang=zh_CN#rd)
 3. [都说Kafka牛3万字带你全面掌握kafka](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247489011&idx=1&sn=27e1a887e85e4a097ee43fe94c9de27b&chksm=9f1f41fba868c8ed5cfafc8124c5a052cbdb9e93b45bc9451013d4def1da144e1832a2394836&token=1486904052&lang=zh_CN#rd)
### 七、zookeeper
1. [讲解 Zookeeper 的五个核心知识点](https://mp.weixin.qq.com/s?__biz=MzA3MjQ1MTQzMQ==&mid=2247488692&idx=1&sn=ae9a5602614c6e6a7b0c7e1f6acd21d4&chksm=9f1f40bca868c9aa6d50af0f06d307af6c9cc4ccf17f2fb8d043b397a7bd5210700810b7cda1&token=1486904052&lang=zh_CN#rd)
## 联系号主

<p>
    <a name="微信"></a>
</p>
<p align="center">
    <img src="https://img-blog.csdnimg.cn/20210121141636866.png?"/>
   <img src="https://img-blog.csdnimg.cn/20210121141718609.png?"/>
</p>