《阿里云流计算专场(17页).pdf》由会员分享,可在线阅读,更多相关《阿里云流计算专场(17页).pdf(17页珍藏版)》请在三个皮匠报告上搜索。
1、Stratify Inc.2000-2002 Member of Technical Staff2002Microsoft2002-2010 Principal Software EngineerFacebook2010-2014 Software EngineerAlibaba Group2014-Now Senior Director20102014NowAbout MeAbout AlibabaAbout Alibaba Data EB TotalPB Everyday100M Events/secT Events/DayWeb TierDB TierMQDataHubData Pipe
2、lineHBaseDashboard Exactly-OnceLots of EventsSub second latencyWhy Streaming?Highly AvailableChallenges of Data Infra at AlibabaLots of JobsTons of DataExactly-OnceComplex LogicThousands of MachinesStrict SLALow LatencyHigh ThroughputImprovements in Blink RuntimeAsync IOIncrement CPProcess&Deploymen
3、tMetric2016 Scalability&Reliability2017 ProductivityDeclarativeOptimizableUnderstandableWhy SQL?StableUnifyDynamic TableStream DataBlinkBatch DataDynamic TableContinuous QueryDynamic TableStream DataBatch DataStream JobBatch JobSQL ImprovementsUDF/UDTF/UDAFStream JOIN,etc.RetractionWindow AGGDML:INS
4、ERT etc.DDLStreamCompute PlatformSQL Only Solves Part of the ProblemEcosystem Metadata Management Data Quality We Provide More!Just SQL?StreamCompute Development Debugging Deployment WebConsole DevelopDebugDeployMonitorStreamCompute 2.0 ExperienceRedesigned UIUltimate ExperienceEasy Migration TakeawayMassive DataLarge ClustersMany ProductsMass Adoption