1、SelectDB 基于 Apache Doris 的现代化实时数据仓库马如悦轮科技 CEO&Apache Doris PMCDoris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia

2、2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB：基于 Apache Doris的现代化实时数据仓库数据的实时导入与实时存储实时数据多种查询负载上都拥有极速性能极速性能弹性架构实现资源灵活扩展弹性架构开放设计支撑高效系统集成开放集成Doris Summit Asia 2023Doris Summit Asia 20

3、23Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit

4、 Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB 提供两种产品形态管理的 Apache Doris 企业分发版。部署在物理机/虚拟机、K8s 或者公有云/私有云上。SelectDB Enterprise全托管的 Apache Doris 公有云服务。已经上线阿云、AWS、华为云和腾讯云。SelectDB CloudDoris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asi

5、a 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB

6、 发展历程2022年H22022年H22023年H12023年H2SelectDB Enterprise V3企业版SelectDB CloudV1SAAS 版本上线邀测存算分离架构阿里云、AWS、腾讯云、华为云SelectDB CloudV2增加可视化开发工具 WebUI配置无套餐化，改为仅需要指定vCPU数即可支持手动弹性伸缩、定时弹性伸缩和自动启停。无感升级、缓存预热SelectDB Cloud V3全面开放，达到GA内核更新至基于 Apache Doris 2.0BYOC产品形态Saving Plan上线GCP、亚马逊云科技企业级内核：内核更新至 Doris 2.x企业级特性：跨集群复

7、制（CCR）可视化管控：Profile优化、Agent改造、日志查看、导入与集成、K8s部署支持数据迁移工具SelectDB Enterprise V2企业级内核：内核基于 Doris 1.2内置可视化开发 WebUI可视化管控：集群管理、监控报警、巡检等SelectDB Enterprise V1企业级内核：内核基于 Doris 1.1命令行管控：集群创建、删除、升级、扩缩容云服务Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2

8、023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB云服务

9、SelectDB CloudDoris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023

10、Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB Cloud 存算分离架构带来极致性价比共享对象存储与本地高速缓存多计算集群，实现负载隔离集群计算节点弹性扩缩容（手动、分时、自动启停）云服务层应用系统/客户端读写读写仓库1（Warehouse 1）仓库2（Warehouse 2）对象存储（S3/OSS/COS/OBS）对象存储（S3/OSS/COS/OBS）读写读写读写读写读写读写集群2（Cluster 2）

11、计算缓存（vCPU，RAM）（Cache）集群1（Cluster 1）计算缓存（vCPU，RAM）（Cache）集群3（Cluster 3）计算缓存（vCPU，RAM）（Cache）集群4（Cluster 4）计算缓存（vCPU，RAM）（Cache）集群5（Cluster 5）计算缓存（vCPU，RAM）（Cache）集群6（Cluster 6）计算缓存（vCPU，RAM）（Cache）计算集群层共享存储层存算分离与弹性计算存储冷热分离，冷数据使用低成本可靠对象存储，平均带来 5x 左右存储成本节省计算节点通过弹性扩缩容，减少计算资源浪费，平均带来 5x 左右计算成本节省极致性价比Doris

12、 Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2

13、023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023无套餐 Serverless化Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia

14、2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023弹性扩缩容：手动、定时、自动启停Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asi

15、a 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Su

16、mmit Asia 2023SelectDB Cloud 降低运维复杂度，提升开发效率多云统一管理组织管理、计费管理、云市场打通集群管理：Serverless化配置，无需配置节点套餐与数量安全连接：支持公网连接及 IP 白名单设定；支持私网连接监控与报警可视化篇理控制台，隆低运维复杂度数据查询数据管理可视化开发 WebUI，提升开发效率数据集成权限管理Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit

17、Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB Cloud 两种部署形态全托管控制面

18、和数据面在 SelectDB 账户最小管理更加 Serverless 化SelectDB Cloud SaaS全托管控制面在 SelectDB 账户，数据面在客户账户数据合规要求比较高拥有较高云资源折扣和自己账户的其他系统方便的打通SelectDB Cloud BYOCDoris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summi

19、t Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB Cloud 全面开放，免费试用国际站已经上线：即将上线：中国站已经上线：即将上线：Doris Summit Asia 2

20、023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summi

21、t Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023阿里云 SelectDB 版本邀测版上线Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris

22、 Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB企业版SelectDB EnterpriseDoris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summi

23、t Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Dor

24、is Summit Asia 2023Enterprise Core：与 Apache Doris 100%兼容的企业版内核飞轮科技严格测试的稳定内核比社区更快速的缺陷修复 提供对大版本的长周期支持 长周期支持的稳定内核数据查询数据管理数据集成权限管理内置可视化开发 WebUIDoris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris S

25、ummit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Enterprise Manager:可视化集群篇控工具可以管理开源 Doris 内核和企业版内核支持托管已部署集群支持多集群的创

26、建、配置变更、升级、扩缩容等功能提供监控、报警、巡检、审计等功能支持在物理机/虚拟机、K8S 部署(开发中）和公有云部署(开发中）支持对接客户的私有云降低运维复杂度，提升运维效率Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit

27、Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Enterprise Support：飞轮科技的专家技术服务月 Top 15 贡献者，12 名在飞轮科技消除风险：提供例行巡检，及时消除系统可能的隐患。专业团队，断绝一切后顾之忧解决问题：严格的服务SLA，确保 7*24小时及时获

28、得专属支持；对紧急Bug提供天级别的专属修复版本更新。咨询培训：提供对业内最佳实践的咨询、产品的系统培训。优化系统：通过对产品的使用培训，业内最佳应用实践的分享，与客户一起优化系统性能和成本。5 名 PMC 成员，21 名 Committer主导发布了 Apache Doris V1.0 V1.1 V1.2 V2.0 等一系列版本Apache Doris 社区用户群 95%的问题由飞轮科技同学响应最近两年，Apache Doris 90%的新增代码由飞轮科技同学贡献Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 202

29、3Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit

30、Asia 2023Doris Summit Asia 2023自主可控、安全可靠多项国产化信创兼容认证公安部等保三级，6 项 ISO 安全管理体系认证，2022 信创产业实者Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit As

31、ia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023SelectDB解决方案SelectDB SolutionsDoris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 202

32、3Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit

33、Asia 2023SelectDB 的主要应用场景构建用户数据平台，进行用户参与、留存和转化等行为分析，及人群洞察和人群圈选等画像分析 用户行为与画像分析构建统一的日志管理与分析平台，在极低成本存储的基础上提供高性能的日志检索与分析日志管理与分析面向内部和外部的实时报表与仪表盘，面向自动化程序的实时决策实时报表与实时决策对 TB和PB 数据进行快速的即席查询(Ad-hoc Queries)交互式探索分析无论是混合部署(公有云、私有化部署)还是在多个公共云上部署，统一体验，一切可简化混合云和多云部署Doris Summit Asia 2023Doris Summit Asia 2023Doris

34、 Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2

35、023Doris Summit Asia 2023Doris Summit Asia 2023混合云和多云正在成为用云主流趋势开源开放，与 Apache Doris 100%兼容。提供可以在 IDC、私有云部署的 SelectDB 企业版。提供在全球七个主流云上云原生的 SelectDB 云服务。所有形态都拥有一致的使用体验。灵活的产品使用和部署形态SelectDB Cloud 提供可视化管控，对多云上的仓库和集群进行统一纳管。SelectDB Enterprise 提供可以私有化部署的 Enterprise Manager，可以对部署在物理机/虚拟机、K8s 容器和公有云/私有云上的集群进行

36、统一纳管。统一的可视化管控工具提供跨集群复制能力，可以在多云上进行集群异步复制。提供数据迁移工具，方便从私有化部署迁移到云上，方便在云与云之间迁移。数据贯通和迁移Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 202

37、3Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023实时报表与实时决策支持 100 万行/秒的实时写入，也支持流式的从 OLTP 数据库和 Kafka 同步数据。支持数据更新，关系数据库中某些数据，例如订单状态等，可以实时地反映到数仓中，及时生成有关订单状态等信息的分析报告。实时数据写入存储和计算

38、引擎全链路向量化，实现数量级的查询加速。强一致聚合物化视图，自动使用预聚合结果，满足亚秒级聚合统计查询。亚秒级查询响应采用分区分桶将单个查询分发到单台机器处理，使用跳数索引(Zonemap,Bloomfilter)和点查索引(主键、倒排)减少读取数据量，提升并发查询能力。通过点查行存，减少 IOPS 压力，支撑单机上万 QPS 的高并发点查。高并发的解决方案无单点故障，在线扩容、升级自动副本均衡，实现单集群高可用。跨集群实时数据同步，实现跨集群高可用。稳定、高可用的服务Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2

39、023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summi

40、t Asia 2023Doris Summit Asia 2023从固定报表到交互式即席分析SelectDB 支持通过 multi-catalog 的机制将外部的数据库、数据湖映射为 SelectDB的库表外表和内表可以联邦查询分析。做到了无需移动数据，即可使用 SelectDB 完成多各种数据源的即席查询分析。联邦查询极速查询性能：基于成本的优化器，MPP的分布式执行框架，向量化的计算引擎等对多种查询负载提供极速查询性能：不论是简单的大宽表查询，还是复杂的多表 JOIN 查询，都拥有极速性能。多种查询负裁上的极速性能SelectDB Cloud 提供多计算集群能力，Ad-hoc 分析集群和在

41、线服务查询集群共享一份存储数据的同时，做到了集群隔离。计算集群内，可以划分不同的查询资源组，来隔离不同用户的查询。异常 SQL 的捕获：及时发现并 Kill 可能会造成节点内存 OOM 的查询。内存消耗较大的 SQL，会对中间结果进行落盘，减少对内存的消耗。多计算集群与集群内的负载隔离Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Dor

42、is Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023用户画像与行为分析支持行为分析业务属性频繁变动，支持画像场景的宽表列实时更新。毫秒级加列、部分列更新丰富的行为分析函数，带

43、来开发简化和效率提升，比如 rentention、window_funnel、sequence_match 等。函数持，业务场景秒级响应表正交位图实现画像场景的秒级圈用户画像千亿数据，秒级人群预估，秒级别 10 标签圈人，10 秒级别 100 标签人群圈选。基于 SelectDB 建设的 CDP 平台Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia

44、 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023日志管理与分析为日志场景优化的高性能倒排索引，写入速度是 ES 倒排索引的 4 倍。服务端 group c

45、ommit 机制，保证秒级实时可见前提下写入吞吐到 GB/s。海量数据实时写入采用列式存储、精简倒排索引、高压缩比压缩，存储空间占用仅需 ES 的 1/5。采用冷热分离，单位存储空间成本仅需 ES 的 1/3，整体成本 1/15。高性价比存储高效处理业务场景通过分区分桶、时间段筛选，大幅缩小查询的数据范围。通过倒排索引，按检索词快速定位到匹配的日志行，避免大批量扫描，达到秒级响应。Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 20

46、23Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023谢 谢 观 看Thank

47、 Youhttps:/ Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Do

48、ris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023获取更多社区动态与最佳实践Doris Summit 峰会官网：doris- Doris Summit 峰会回放：https:/ Doris 官网：doris.apache.orgApache Doris GitHub： Doris 官方平台：Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris

49、 Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023Doris Summit Asia 2023