init
BIN
document/source/wiki/evolution/Business.png
Normal file
|
After Width: | Height: | Size: 107 KiB |
BIN
document/source/wiki/evolution/BusinessProcess.png
Normal file
|
After Width: | Height: | Size: 202 KiB |
48
document/source/wiki/evolution/CHANGELOG
Normal file
@@ -0,0 +1,48 @@
|
||||
# PLATFORM FOR BDP 科学护城河
|
||||
|
||||
# Version1
|
||||
|
||||
```markdown
|
||||
|
||||
1、美团Logan埋点
|
||||
|
||||
2、采集中心代码编写
|
||||
|
||||
3、维护kafka集群
|
||||
|
||||
4、日志消费系统
|
||||
|
||||
5、爬虫采集系统
|
||||
|
||||
6、ETL清洗入ES, HBase
|
||||
|
||||
7、电商分析
|
||||
|
||||
8、上线demo
|
||||
```
|
||||
|
||||
# Version2
|
||||
|
||||
```markdown
|
||||
|
||||
1、BUSINESS FOR ALL DATA PLATFORM 商业项目
|
||||
|
||||
2、BUSINESS FOR ALL DATA PLATFORM 计算引擎
|
||||
|
||||
3、DEVOPS FOR ALL DATA PLATFORM 运维引擎
|
||||
|
||||
4、DATA GOVERN FOR ALL DATA PLATFORM 数据治理引擎
|
||||
|
||||
5、DATA Integrate FOR ALL DATA PLATFORM 数据集成引擎
|
||||
|
||||
6、AI FOR ALL DATA PLATFORM 人工智能引擎
|
||||
|
||||
7、DATA ODS FOR ALL DATA PLATFORM 数据采集引擎
|
||||
|
||||
8、OLAP FOR ALL DATA PLATFORM OLAP查询引擎
|
||||
|
||||
9、OPTIMIZE FOR ALL DATA PLATFORM 性能优化引擎
|
||||
|
||||
10、DATABASES FOR ALL DATA PLATFORM 分布式存储引擎
|
||||
|
||||
```
|
||||
BIN
document/source/wiki/evolution/CommunityEdition.png
Normal file
|
After Width: | Height: | Size: 95 KiB |
BIN
document/source/wiki/evolution/CustomScene.png
Normal file
|
After Width: | Height: | Size: 202 KiB |
BIN
document/source/wiki/evolution/Doris.png
Normal file
|
After Width: | Height: | Size: 138 KiB |
BIN
document/source/wiki/evolution/Overview.png
Normal file
|
After Width: | Height: | Size: 475 KiB |
59
document/source/wiki/evolution/README.md
Normal file
@@ -0,0 +1,59 @@
|
||||
# 未来规划
|
||||
|
||||
## 1、 AllData总述
|
||||
>
|
||||
> 一个基础平台基于Docker拉起20+种开源组件的启停,第二个是数据平台的产品
|
||||
>
|
||||
## 2、组件维护与升级
|
||||
>
|
||||
> 由于Apache很多开源项目发展节奏较快,目前暂时没有很好的版本切换的能力,维护不同组件的版本比较困难
|
||||
>
|
||||
## 3、定期升级维护最新的组件版本
|
||||
>
|
||||
> 并对已进行二次开发的组件进行适配升级到组件新版本,保证平滑兼容升级
|
||||
>
|
||||
## 4、apache社区组件版本
|
||||
>
|
||||
> DataSphereStudio: 1.1.0
|
||||
>
|
||||
> docker: 3.0.0.0-SNAPSHOT
|
||||
>
|
||||
> Dolphinscheduler: 3.0.0
|
||||
>
|
||||
> Atlas: 3.0.0-SNAPSHOT
|
||||
>
|
||||
> Griffin: 0.7.0-SNAPSHOT
|
||||
>
|
||||
> Kong: 3.0.0
|
||||
>
|
||||
> Flinkcdc: 2.3 RELEASE
|
||||
>
|
||||
> Flinkx: 1.12-SNAPSHOT
|
||||
>
|
||||
> Kylin: 4.0.2
|
||||
>
|
||||
> Presto: 0.276.2
|
||||
>
|
||||
> Hudi: v0.12.0
|
||||
>
|
||||
> Iceberg: v0.13.1
|
||||
>
|
||||
> Dlink: 0.6.7
|
||||
>
|
||||
> Linkis: 1.2.0
|
||||
>
|
||||
> Streamis: 0.2.0
|
||||
>
|
||||
> Doris: 1.0-SNAPSHOT
|
||||
>
|
||||
> DataX: X-version
|
||||
>
|
||||
> Backend: v1.2-SNAPSHOT
|
||||
>
|
||||
> Rancher: 2.6.7
|
||||
>
|
||||
> SREWorks: X-version
|
||||
>
|
||||
> Cube-Studio: X-version
|
||||
>
|
||||
> GraphScope: 0.17.0
|
||||
BIN
document/source/wiki/evolution/RecommendSystem.png
Normal file
|
After Width: | Height: | Size: 389 KiB |
BIN
document/source/wiki/evolution/RoadMap.png
Normal file
|
After Width: | Height: | Size: 278 KiB |
BIN
document/source/wiki/evolution/TimeTravel.png
Normal file
|
After Width: | Height: | Size: 87 KiB |
BIN
document/source/wiki/evolution/TreeMap.png
Normal file
|
After Width: | Height: | Size: 230 KiB |
BIN
document/source/wiki/evolution/ai-studio.png
Normal file
|
After Width: | Height: | Size: 63 KiB |
7
document/source/wiki/evolution/index.rst
Normal file
@@ -0,0 +1,7 @@
|
||||
evolution
|
||||
=================================
|
||||
|
||||
.. toctree::
|
||||
:maxdepth: 2
|
||||
|
||||
README
|
||||