《爱分析:2022云数据平台白皮书-数字化转型时代的企业数据新基建(57页).pdf》由会员分享,可在线阅读,更多相关《爱分析:2022云数据平台白皮书-数字化转型时代的企业数据新基建(57页).pdf(57页珍藏版)》请在三个皮匠报告上搜索。
1、?1?|?2022?7?2?|?寞?21?封?研?去?告?封?割?去?研?&?2000?ICT?撑?去?1?3?|?寞?务?1?GDP?20?1?GDP?3?6.7?务?研?研?研?研?研?封?研?告?研?封?-?去?务?研?ETL?研?研?研?务?告?研?撑练?IT?撑练?研?研?研?研?告?研?研?研?研?割?封?研?去?去?研?4?|?1.?研?6 1.1?够?6 1.2?研?8 1.3?研?9 2.?研?18 2.1?18 2.2?去?研?研?28 3.?研?务?36 3.1?够?37 3.2?39 3.3?&?40 3.4?去?42 4.?45 4.1?45 4.2?47 4.3?5
2、0?54?55?56?5?|?6?|?1.?研?务?封?告?务?割?封?1.1?封?务?封?去?研?导?割?割?研?太?去?够?割?务?研?AI?IT?够?研?7?|?2?研?够?务?务?研?AI?务?研?研?研?研?研?研封?研?研?封?研?研?8?|?1.2?研?研?研?研?研?研?研?研?3?l?研?研?研?研?研?研?研?研?研?愿?研?研?l?研?研?研?研?/?务?研?NoSQL?研?研?封?AI?封?割?9?|?l?研?研?研?研?研?研?研?务?封?研?研?模?研?研?研?模?研?2018?5?21?封?研?封?2018?22?研?研?研?告?研?研?研?研?模?研?研?研?封
3、?研?l?研?研 API?研?研?研?研?1.3?研?研?研?研?研?研?研?模?研?研?务?研务?10?|?4?1.3.1 数据库阶段?研?研?研?Oracle?DB2?1970?去?1980?去夯?研?OLTP?研?研?研?研?研?11?|?研?研?IT?研?研?研?模?研?务?研?研?研?割?研?研?研?研?研?研?研?l?SQL?ACID?研?模?告?的?的?l?去?Oracle?IBM?IT?尽?OLTP?务?告?的?割?研?务?l?Oracle?IBM?DB2?1.3.2 数据仓库阶段 1990?去?E.F.Codd?1993?OLAP?研?研?去?12?|?研?OLAP?研?撑练
4、?OLAP?研?研?OLAP?OLAP?研?研?务?研?研?研?告?研?研?的?Oracle?DB2?研?的?的?MPP?研?IT?IT?IT?告?研?研?研?封?1980?去?Teradata?MPP?研?MPP?研?割?Teradata?Oracle?DB2?研?1990?去?MPP?研?研?务?2006?Greenplum?Vertica?x86?MPP?研?研?的?研?研?l?的?割?x86?的?SQL?ACID?13?|?l?MPP?Teradata?EMC?Greenplum?Vertica?尽?MPP?研?研?务?研?l?Teradata?EMC?Greenplum?HPE?Ve
5、rtica?1.3.3 大数据平台阶段 2005?野封?研?野封?研?研?研?研?研?研?研?务?研?CSV?XML?JSON?研?研?愿?研?研?研?寞?GB?TB?PB?EB?BI?研确?割?IT?研?告?MPP?研?的?的?割?研?Hadoop?去?研?研?研?告?IT?研?Hadoop?去?研?研?研?研?研?14?|?Hadoop?研?MPP?研?SQL-on-Hadoop?Hive?SparkSQL?研?NoSQL?研?HBase?HDFS?研?MPP?研?割?SQL-on-Hadoop?研?HDFS?的?研?研?SQLSQL-onon-HadoopHadoop?研?研?l?SQL
6、-on-Hadoop?的?的?的?的?告?HDFS?SQL-on-Hadoop?研?SQL?ACID?研?MPP?研?SQL-on-Hadoop?务?割?l?SQL-on-Hadoop?尽?夯?尽?去?告?务?去?l?Hive?SparkSQL?Cloudera?Impala?Facebook?Presto?1.3.4 云数据平台阶段 2015?研?研?研?研?研?告?研?去?割?寞?研?研?15?|?研?研?够?去?务?务?研?撑?研务?研?研?研务?研?研?研?研?研?研?研?的?MPP?SQL-on-Hadoop?研?的?研?SQL-on-Hadoop?研?SQL?ACID?割?研?MP
7、P?研?研?研?研务?研?研?研?-?研?-?研?16?|?5?-?-?研?研?研?研?Hadoop?封?研?的?研?撑练?撑练?17?|?18?|?2.?研?研?告?研?研?研?研?的?练?MPP?SQL-on-Hadoop?去?研?寞?去?务?研务?研?研?研?研?研?去?研?研?太?研?2.1?撑练?务?研?愿?6?19?|?2.1.1 数据规模膨胀,数据基础设施产生新“数据孤岛”?研?研?研?2019?3219.89?8.82?886.39?2.43?研?封?研?PB?研?3000?7?研?研?研?研?研?MPPMPP?MPP?SQL?ACID?Oracle?DB2?研?研?研?的?够
8、?封?研?研?告?研?MPP?研?的?MPP?20?|?10PB?研?3000?40?MPP?告?研?研?塑?研?PB?研?割?研?封?研?研?研?告?研?研?割?研?割?研?研?MPP?割?Hive?SparkSQL?SQL-on-Hadoop?的?告?SQL?ACID?割?MPP?封?务?MPP?研?研?MPP?SQL-on-Hadoop?SQL?ACID?割?研?告?割?寞?够?寞?研?割告?的?割?务?去?尽?Hive?研?告?Hive?研?Oracle?Oracle?Hive?Hive 割?Oracle?去?务?确?研?研?研?去?研?研?l?的?的?21?|?l?SQLSQL?AC
9、IDACID?HadoopHadoop?HadoopHadoop?模?SQL?ACID?寞?Oracle?DB2?研?MPP?研?HDFS?Hadoop?寞?SQL-on-Hadoop?研?8?2.1.2 敏态特征凸显,数据基础设施弹性能力受挑战?2014?Gartner?IT?IT?IT?IT?IT?割?IT?去?22?|?尽?尽?IT?尽?IaaS?研?Docker?Kubernetes?AIOps?PaaS?封?寞?IT?去?IT?IT?研?研?研?研?研?研务?务?研 IDC?2025?务?研?50%?割?IT?割?寞?研?研?研?23?|?9?告?研?MPP?SQL-on-Hadoo
10、p?割?封?MPP?的?IT?研?告?太?撑?寞?MPP?Greenplum?模?割?的?太?告?太?割?24?|?10?研?l?研?的?的?的?的?25?|?11?2.1.3 数据时效性要求提升,数据基础设施查询性能受限?T+1?T+0?研导?研?研?OLAP?撑练?告?研?研?SQL-on-Hadoop?研?OLAP撑练?26?|?12?研?研?Hive?SparkSQL?MPP?空?ODS?研?研?研?DWD?研?DWS?研?ADS?研?/DM?研?务?ADS?DM?研 API?研?研?研?T+1?模?研?研?割?研?研?务?Oracle?DB2?研?研?研?PB?告?研?T+1?研?研
11、务?告?研?SQL?10?研?研?l?撑练?撑练?SIMD?PB?研?MPP?SQL-on-Hadoop?研?撑练?研?27?|?13?2.1.4 智能化场景逐步成熟,数据基础设施 AI 支持能力不足?导?导?研?研?封?研?研?研?研?封?研?务?In-Database?告?AI?AI?AI?AI?28?|?14?研?l?AutoML?去?AI?研?研?研?封?AI?2.2?研?研?去?务?去?研?去?研?研?29?|?2.2.1 云数据平台的定义?研?去?研?ACID?SQL?Hadoop?的?撑练?封?15?l?研?的?的?研?的?l?的?的?的?研?30?|?l?ACIDACID?SQ
12、LSQL?HadoopHadoop?模?SQL?ACID?寞?Oracle?DB2?研?MPP?研?Hive?HDFS?Hadoop?寞?SQL-on-Hadoop?研?研?l?撑练?撑练?PB?研?MPP?SQL-on-Hadoop?研?撑练?研?l?AutoML?AI?AI?AI?封?l?研?研?研?研?研?研?研/?/?研?/?研?研?研?l?研?研?研 API?研?研?API?研?2.2.2 云数据平台对数字化技术的“有机统一”?去?研?研?研?研?研?研?研?去?31?|?16?研?研?AI?务?研?AI?务?l?务?务?IT?IT?研?l?研?务?研?务?研?研?AI?封?研?务?
13、32?|?l?AIAI?务?务?AI?研?研?研?AI?17?2.2.3 以云数据平台为核心的企业数字化转型方案?研?研?Snowflake?2020?9?17?700?2020?11?Snowflake?830?33?|?研?EMC?研?去?研?Oushu?Database?研?研?去?研?Oushu?Database?研?Oushu?Lava?Oushu?LittleBoy?模?研?务?18?l?去?研?去?研?Oushu?DatabaseOushu?Database?Oushu?Database?OushuDB?去?研?ANSI-SQL?ACID?Hadoop?Oracle?Greenp
14、lum?Database?PostgreSQL?Hadoop?的?OushuDB?研?研务?研?34?|?去 SIMD?5-10?PB?研?BI?AI?l?研?研?Oushu?LavaOushu?Lava?Oushu?Lava?研?研?研?封?研?研?研?封?l?Oushu?LittleBoyOushu?LittleBoy?Oushu?LittleBoy?Oushu?LittleBoy?AutoML?务?割?研?去?务?35?|?36?|?3.?研?务?2.2.2?研?研?AI?告?研?务?模?够?1.1 务?够?够?去?19?37?|?3.1?够?愿?20?够?l?封?研?l?务?夯?研?研
15、?BI?38?|?l?研?研?研?研?研?l?研?研?研?研?够?schema?愿?研?割?研?研?割?研?研?务?l BIBI?BI?BI?BI?l?AI?AI?AI?太?空?AI?AI?封?研?务?l?愿?l?研?研?研?研?研?研?研?l?研?研?研?研?研?研?研?研?l?研?研?研?研?研?研?务?务?39?|?够?愿?够?3.2?够?务?夯?21?务?研?研?研?研?40?|?l?研?研?研?研?T+1 模?的?研?PB?PB?l?研?研?研?研?研?研?太?研?研?研?l?研?研?研?研?研?研?研?l?研?研?研?研?研?研?研?割?l?l?AI?AI?研?AI?AI?AI?A
16、I?AI?封?AI?研?3.3?&?务?封?务?模?割?告?割?务?模?撑?41?|?22?&?研?l?IT?模?l?研?l?研?研?研?研?BI?务?研?l?研?研?研?研?研?研?研?l?研?研?ETL?研?研?Oushu?Lava?OushuDB?研?去 Hive?空?PB?研?撑练?模?42?|?l?研?研?研?研?研?太?研?研?研?研?研?研?l?研?研?研?研?研?研?研?愿?l AIAI?AI?AI?/?AI?AI?AI?研?LittleBoy?模?导?封?3.4?去?模?撑?去?确?23?研?够?封?43?|?撑?撑?导?撑?封?割?去?去?去?撑?研?研?研?AI?去?确?
17、确?导?撑?44?|?45?|?4.?4.1?12?尽?2016?2019?套?13?A+H?2019?19?260?务?封?太?研?封?研?研?割?务?导?导?研?模?研?l Oracle?DB2?研?TB?研?ETL?研?l ODS?研?研?研?研?研?研?研?研?研?研?研?封?封?l?太?空?46?|?研?l?研?研?l?研?研?研?模?研?l?研?研?l?太?空?务?研?研?研?研?模?24?研?l?Oushu?Lava?HDFS?OushuDB?研?去 Oracle?DB2?研?PB?研?的?研?研?l?Lava?研?研?模?研?研?研?l?LittleBoy?模?导?导?封?47
18、?|?l?Lava?研?研?AI?封?研?AI?Rest?API?撑?撑?l Oushu?Lava?封?研?研?l OushuDB?研?研?l LittleBoy?4.2?尽?2018?尽?尽?7684?6463?4?尽?17?500?2003?290?2019?51?12?500?尽?尽?2003?12?2007?1?A?尽?尽?8?尽?1?尽?2016?封?尽?封?封?尽?48?|?尽?研?割?研?研?研?研?研?研?尽?务?去?研?尽?研?l?SQL?Server?Oracle?研?PB?研?ETL?研?l?研?练?研?研?割?研?l?太?空?告?封?/?研?尽?研?l?尽?割?研?研?
19、研?l?尽?研?研?研?研?l?研?研?l?研?研?AI?模?尽?务?研?研?研?研?研?研?尽模?够?49?|?25?研?l?Ouhshu?Lava?OushuDB?研?去 SQL?Server?Oracle?研?PB?研?的?研?研?l?Lava?研?研?模?研?研?研?l?Lava?模?l?Lava?研?研?AI?封?研?AI?Rest?API?撑?撑?尽?l Oushu?Lava?研?研?研?l OushuDB?研?SQL?Server?Oracle?研?50%?50?|?4.3?31?尽?务?500?研?资?GSM?WCDMA?FDD-LTE?研?练?2019?1000?107?98
20、?送?送?封?研?1+2?研?研?+?+?研?研?研?的?研?封?导?研?研?l?研?Hadoop?Hive?2000?PB?研?ETL?研?5G?封?研?TB?51?|?l Hadoop?Hive?研?Hive?割?PB?研?T+3?研?割?研?l?研?务?研?研?l?太?空?研?l?T+1 模?的?研?-?PB?PB?l?研?告?l?研?模?研?研?l?太?空?封?尽?务?研?研?研?研?研?模?够?52?|?26?研?l?Oushu?Lava?HDFS?Hive?研?OushuDB?研?去 Hive?空?PB?研?Hive?撑练?模?l?Lava?研?研?模?研?研?AI?Rest?API?l?LittleBoy?模?导?封?l?Lava?空?撑?撑?l OushuDB?Hive?研?T+1?l LittleBoy?l Oushu?Lava?研?研?研?研?研?研?研?封?53?|?&?54?|?务?务?务?55?|?&?研?研?56?|?务?愿?愿?割?撑?封?撑?告?割?模?务?割?割?割?去?尽 2022?