337 lines
15 KiB
Markdown
337 lines
15 KiB
Markdown
# 可定义数据中台
|
||
|
||
## [官方文档](https://alldata.readthedocs.io/) ｜ [安装文档](https://github.com/alldatacenter/alldata/blob/master/install.md)
|
||
|
||
## 一、AllData体验版
|
||
|
||
> 体验版地址：Test账号只有数据质量，体验更多功能可选参加会员通道
|
||
>
|
||
> 成为会员：享受会员权益，详情查看Github主页文档
|
||
>
|
||
> 地址：http://122.51.43.143/dashboard
|
||
>
|
||
> 账号：test/123456
|
||
|
||
## 二、 官方网站
|
||
> 官方文档：https://alldata.readthedocs.io
|
||
>
|
||
> 部署教程：https://github.com/alldatacenter/alldata/blob/master/install.md
|
||
>
|
||
> 教程文档：https://github.com/alldatacenter/alldata/blob/master/dts_quickstart.md
|
||
> 教程文档2: https://github.com/alldatacenter/alldata/blob/master/bi_quickstart.md
|
||
|
||
## 三、会员通道-商业版【可选参加】
|
||
> 【腾讯文档】2023-大数据中台AllData会员通道
|
||
>
|
||
> https://docs.qq.com/sheet/DVFd6WXJLUHJ3eEZ1
|
||
|
||
## github
|
||
|
||
[](https://starchart.cc/alldatacenter/alldata)
|
||
|
||
<br/>
|
||
<a href="https://github.com/alldatacenter/github-readme-stats">
|
||
<img width="1215" align="center" src="https://github-readme-stats.vercel.app/api/pin/?username=alldatacenter&repo=alldata" />
|
||
</a>
|
||
|
||
## 体验版
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/204965509-fc13050b-ebe8-4bd5-8882-69e1af0a8367.png">
|
||
<br/>
|
||
|
||
|
||
## 可定义数据中台
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/235920344-fbf3c9d2-6239-4c73-aa9c-77a72773780e.png">
|
||
<br/>
|
||
|
||
## 首页
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456470-6fd4e3c8-e5b7-48f9-bf3a-83975f78654c.png">
|
||
<br/>
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456480-d23d6df9-65f0-45f8-8d02-b1a448fcf0cc.png">
|
||
<br/>
|
||
|
||
## 数据集成
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071504-c0e2b3ca-e3c2-4d70-8213-55c7316465ff.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071513-61997f31-12c4-464b-897d-bb60f0095ee9.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071519-35651c39-38c9-4746-ba18-c110a672e48f.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071527-d2af118c-ea4e-49f7-8435-c2b9ab8039cc.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071530-408d3001-0596-440c-93da-60d50aaacebe.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071537-4c0c2b38-dbfa-46a1-850e-4b73d5ca4236.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071539-f6b95712-4a32-481c-b719-f56c7542888c.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071544-43c5136d-091d-4602-b6de-ef528f39095c.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071554-1bc698f3-41d4-4fc5-ac74-a419ffede30e.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/206071565-1634a747-0f60-4dcd-a294-90d80d59cdc7.png">
|
||
<br/>
|
||
|
||
## 数据质量
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457313-aac5a92e-3780-4b81-99f3-de6ea1b32f79.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457303-9272dd14-6602-4f32-ab26-ea2c4b9e7c55.png">
|
||
<br/>
|
||
|
||
## 数据标准
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457469-8183b633-ace2-48ed-91ac-9d1c114e7e67.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457478-8ddf5083-5bad-4b27-90b9-14bebf7615f6.png">
|
||
<br/>
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457492-9c90f9a6-2a56-47ce-9042-00e2c5c662ec.png">
|
||
<br/>
|
||
|
||
## 元数据管理
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456662-be27764e-f2a1-46a1-97fb-4689a93a42a9.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456676-9c66e22b-393c-4757-a22f-2aa1604bef51.png">
|
||
<br/>
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456683-36436d97-76fc-4a0d-b4b7-e0090a6a2575.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456694-06a042cf-cad6-4bf5-ae41-8f1fad46c642.png">
|
||
<br/>
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456700-76a54b9f-e806-4ca7-b1d3-d0a9fa383de1.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456710-c004ac4a-5f67-45f2-9cbf-67b855a55c34.png">
|
||
<br/>
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456722-4f468872-2ada-4ad8-a56e-69c63f9b7e31.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227456740-12c5298d-c72f-46ec-88ec-c680efbb592f.png">
|
||
<br/>
|
||
|
||
## 数据资产
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457692-c9c1a763-b0e5-4afe-abe7-623203ab6231.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457706-872b49b5-9ec5-4ad3-beb1-535fbd88dde3.png">
|
||
<br/>
|
||
|
||
|
||
## 数据市场
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457844-e1a3ebbe-5a7c-43c4-8317-2bf066c5deed.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457858-37307d6b-41a1-4475-8d69-d7bcc38f6f10.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457862-415bdb7f-784e-4db9-9e54-eb83ea7a581f.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457872-6cbb24e0-82e1-47de-b3f8-200cdb47b90f.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227457882-77fc873b-c340-47f1-b41c-9b2d5e73ff4d.png">
|
||
<br/>
|
||
|
||
## 数据比对
|
||
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/234816803-ca89bdd2-bce6-499d-8dbf-0522ed07ba86.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/234816815-89864618-f786-47ff-ae31-4fd8c662130b.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/234816833-7bf1202b-9a9a-48cd-9523-d329ad92cf69.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/234816849-5563f3c1-32f3-4ab8-ae1a-7919c65fd656.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/234816860-72f06760-94cd-497f-a623-7bb378d8077f.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/234816915-d45771bb-de17-4e3c-88ae-183d1aa28a1b.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/234817116-dc4bca8e-e8ac-4efa-a2a0-d91ce9eb56e8.png">
|
||
<br/>
|
||
|
||
## BI报表
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458114-48ab43b4-437d-4b7e-9eb3-d49b1da1b762.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458126-d5367210-fd82-4190-bf71-b99c6fc3176e.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458133-39ad2515-4447-4f6d-a9c7-e353d70c628d.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458143-5c771b96-6888-48e1-9e1c-265efee62b30.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458149-b658b9ea-c6df-4a7d-884c-d02f42aadb3e.png">
|
||
<br/>
|
||
|
||
## 流程编排
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458401-9244442e-c66d-4ebe-8a81-e989bedb1415.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458415-ec02039f-73d0-4513-b613-5aa931c9b294.png">
|
||
<br/>
|
||
|
||
|
||
## 系统监控
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458501-7493df22-026b-402d-80dd-03c4b9bd8224.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458517-45eb4fd4-ccc1-4a37-8a0d-4403301bbc55.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458525-639b90bf-ffc3-439e-ba74-b9e9ce2f1323.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458535-2fea5b2c-b478-4192-a303-f377de0cd9b1.png">
|
||
<br/>
|
||
|
||
|
||
## 运维管理
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458729-f6517a7e-ad37-4ce1-94d8-e2a2b41de7b9.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458745-5455a74e-706a-4498-af4a-39454f743cd6.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458756-9db88ca2-848d-4461-a4da-5ca149288779.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458765-f6be2c35-d870-4952-a79c-bb26ebaac6e7.png">
|
||
<br/>
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/227458778-4f2e1b46-d532-4411-b104-8288fcb97ad7.png">
|
||
<br/>
|
||
|
||
## AllData AI Studio 社区版
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/211255550-2d58eb94-42ce-411c-9487-9f2e499e565a.png">
|
||
<br/>
|
||
|
||
## AllData Studio 社区版
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/210299541-b9f4d344-30ba-4fc9-a083-390129f7da1e.png">
|
||
<br/>
|
||
|
||
## AllData社区商业计划图
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/188898972-d78bcbb6-eb30-420d-b5e1-7168aa340555.png">
|
||
<br/>
|
||
|
||
## AllData社区项目业务流程图
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/188899006-aba25703-f8fa-42b6-b59f-2573ee2b27fc.png">
|
||
<br/>
|
||
|
||
## AllData社区项目树状图
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/188898939-bfba6cbc-c7b0-40c4-becd-27152d5daa90.png">
|
||
<br/>
|
||
|
||
## 全站式AllData产品路线图
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/179927878-ff9c487e-0d30-49d5-bc88-6482646d90a8.png">
|
||
<br/>
|
||
|
||
|
||
## AllData社区开发规划
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/188899033-948583a4-841b-4233-ad61-bbc45c936ca1.png">
|
||
<br/>
|
||
|
||
### 数据中台建设方法论
|
||
|
||
> 确定数据中台的目标和范围: 在开始构建数据中台之前, 需要明确数据中台的目标和范围, 例如数据中台的主要功能, 应用场景, 覆盖范围等
|
||
>
|
||
> 收集数据源: 根据定义的目标和范围, 收集相关的数据源这些数据源可以包括内部和外部的结构化和非结构化数据, 实时数据, 历史数据等
|
||
>
|
||
> 数据预处理: 对收集到的数据进行预处理, 包括数据清洗, 归一化, 去重, 脱敏等操作, 以确保数据的准确性, 一致性和安全性
|
||
>
|
||
> 数据建模和集成: 对预处理的数据进行建模和集成, 包括定义数据模型, 设计数据流程, 数据映射和转换等操作, 以确保数据的结构和语义一致性
|
||
>
|
||
> 数据存储和管理: 将集成的数据存储在数据仓库或数据湖中, 并实现数据的管理, 备份和恢复
|
||
>
|
||
> 数据治理和质量管理: 实现数据质量监控, 数据血缘追溯, 数据安全保障, 合规性检查等数据治理和质量管理功能, 以保证数据的高质量和可信性
|
||
>
|
||
> 数据分析和应用: 基于数据中台, 实现数据分析和应用, 如数据挖掘, 数据可视化, 机器学习等, 以提高数据的价值和应用效果
|
||
>
|
||
> 持续优化和创新: 数据中台的建设是一个持续迭代的过程, 需要不断进行优化和创新, 以适应不断变化的数据需求和业务场景
|
||
>
|
||
> 需要注意的是, 数据中台建设需要依赖于先进的技术和方法, 如云计算, 大数据, 人工智能, 数据湖等
|
||
>
|
||
> 同时, 数据中台建设还需要依赖于跨部门的协同和配合, 以确保数据的一致性和可用性
|
||
|
||
|
||
## 数字化转型
|
||
>
|
||
> 数字化转型是指将传统企业在信息化, 网络化, 智能化, 数据化等技术的支撑下, 对业务, 组织, 文化, 价值创造, 利益分配等方面进行全面的革新和升级,
|
||
>
|
||
> 以适应市场, 技术, 用户等环境的变化数字化转型的目标是实现企业从传统生产经营方式向数字化经营模式的转变, 提高企业的效率, 创新能力, 市场竞争力和盈利能力
|
||
>
|
||
> 数字化转型方法论可以概括为以下几个方面:
|
||
>
|
||
> 确定数字化转型的战略目标和方向, 明确数字化转型的意义和价值, 为数字化转型的实施提供方向和支撑
|
||
>
|
||
> 分析业务过程, 识别业务痛点和机会, 确定数字化转型的重点领域和项目, 以提高效率, 创新能力和用户体验为导向
|
||
>
|
||
> 优化组织结构和流程, 建立数字化组织架构和工作流程, 激发组织创新和员工动力, 提高业务效率和创新能力
|
||
>
|
||
> 采用先进的信息技术和数据技术, 例如云计算, 大数据, 人工智能, 物联网等, 为数字化转型提供技术支持
|
||
>
|
||
> 建立数字化文化, 通过数字化营销, 数字化服务, 数字化协同等方式, 提升品牌价值, 用户满意度和市场影响力
|
||
>
|
||
> 实施数字化监管, 建立数字化安全, 合规和风险控制体系, 确保数字化转型的合法性, 合规性和可持续性
|
||
>
|
||
> 数字化转型是一个复杂的过程, 需要综合运用战略, 组织, 技术, 文化, 监管等多方面的手段和方法, 才能取得成功
|
||
|
||
## Architecture
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/171598215-0914f665-9950-476c-97ff-e7e07aa10eaf.png">
|
||
<br/>
|
||
<img width="1215" alt="image" src="https://user-images.githubusercontent.com/20246692/171598333-d14ff53f-3af3-481c-9f60-4f891a535b5c.png">
|
||
<br/>
|
||
|
||
## Community
|
||
|
||
> 加入微信群: https://docs.qq.com/doc/DVHlkSEtvVXVCdEFo
|