1、使使用用 O Op pe er ra at to or r 实实现现 K K8 8s s 上上的的P Po os st tg gr re eS SQ QL L（半半）自自动动运运维维南京富士通南大软件技术有限公司庾乐2022年1月关关于于我我们们 植根基础软件研发领域20余年 自2005年开始参与富士通数据库产品开发/维护/测试/支持 活跃于PostgreSQL开源社区，数名成员参与了内核及周边组件的开发/维护/测试A Ab bo ou ut t F FN NS ST T南南京京富富士士通通南南大大软软件件技技术术有有限限公公司司 fnstml-内内容容n 为什么把PG部署到K8s上n Pos

2、tgreSQL on Kubernetesn 关于Kubernetes Operatorn 常见开源/商业PostgreSQL Operator为为什什么么把把P PG G部部署署到到K K8 8s s上上Cloud-Native is Eating the WorldSoftwareOpenSourceCloudCloud-Native没有找到“大鱼吃小鱼”的出处，只好自己动手将将要要/已已经经面面临临的的云云环环境境基基于于容容器器编编排排技技术术的的K K8 8s s可可以以提提供供更更加加灵灵活活且且易易于于伸伸缩缩和和隔隔离离的的运运行行环环境境，对对于于D De ev vO Op

3、ps s和和跨跨云云运运维维更更加加友友好好虚拟机+PG容器+PG多云混合云公有云RDS（PG）公有云私有云上上云云之之后后的的新新挑挑战战 数据容量规划 数据架构设计 软件安装部署 可用性维护 容灾备份/恢复 扩容/缩容 访问速度优化（Both Query&Inserting）故障修复D DB BA A的的职职责责不不变变，但但方方法法和和工工具具将将大大不不相相同同P Po os st tg gr re eS SQ QL L o on n K Ku ub be er rn ne et te es sK Ku ub be er rn ne et te es s简简介介Kubernetes C

4、lusterControl PlaneAPI ServerControllerEtcdkubeletkube-proxyNodesUsersVolumesServiceDeploymentReplicaSetDaemonSetResourcePodsYAMLDefinitionsP Po os st tg gr re eS SQ QL L部部署署方方案案示示例例PodPostgreSQLPatroni AgentPVPodPostgreSQLPatroni AgentPVLoad Balancer/ProxyExporterExporterPodpgBackRestPVPodPrometheu

5、sGrafanaControl PlaneEtcdPodPostgreSQLPatroni AgentPVExporter还还是是会会有有问问题题安装配置麻烦扩容麻烦升级麻烦克隆测试环境麻烦组件多，关系杂“有状态”应用事务一致性需求似似乎乎并并没没有有享享受受到到K Ku ub be er rn ne et te es s带带来来的的灵灵活活和和便便利利！遇到的问题面临的挑战K Ku ub be er rn ne et te es s O Op pe er ra at to or r什什么么是是O Op pe er ra at to or r K8s上操作自定义资源（CRD）的自定义Contr

6、oller原生自定义期待状态控制循环Kubernetes Controller ManagerKubernetesControllersOperators原生资源自定义资源当前状态R Re ec co on nc ci il le eServiceDeploymentJobhttps:/kubernetes.io/zh/docs/concepts/extend-kubernetes/operator/O Op pe er ra at to or r能能做做什什么么Level 1Level 2Level 3Level 4Level 5安装无缝升级https:/sdk.operatorframew

7、ork.io/docs/overview/operator-capabilities/全生命周期管理深度洞察自动运维自动完成软件安装及基本配置打补丁小版本升级应用生命周期管理存储生命周期管理（备份、恢复）指标采集日志告警负载分析纵向/水平伸缩自动参数优化故障检测调度优化P PG G O Op pe er ra at to or r能能做做什什么么软件/组件安装高可用集群配置安全认证配置环境克隆PG实例/组件升级PITR日志归档定期备份纵向/横向扩容指标采集系统日志采集安装部署日常维护监控辅助常常见见开开源源/商商业业P Po os st tg gr re eS SQ QL L O Op pe

8、er ra at to or rZ Za al la an nd do o P Po os st tg gr re eS SQ QL L O Op pe er ra at to or rRolling updates on Postgres cluster changes,incl.quick minor version updatesDatabaseLive volume resize without pod restarts(AWS EBS,PVC)connection pooling with PGBouncerSupport fast in place major version up

9、grade to PG13.Supports global upgrade of all clusters.Restore and cloning Postgres clusters(incl.major version upgrade)Additionally logical backups to S3 bucket can be configuredStandby cluster from S3 WAL archiveConfigurable for non-cloud environmentsBasic credential and user management on K8s,ease

10、s application deploymentsSupport for custom TLS certificatesUI to create and edit Postgres cluster manifestsWorks well on Amazon AWS,Google Cloud,OpenShift and locally on KindSupport for AWS EBS gp2 to gp3 migration,supporting iops and throughput configurationMain FeaturesSummary 能够比较容易的完成PG集群的创建及高可

11、用/容灾环境部署 和Patroni师出同门，基于Zalando长期的线上服务的实践积累 自带WEB UIhttps:/ PG GO O(The Postgres Operator from Crunchy Data)PostgreSQL Cluster ProvisioningHigh AvailabilityDisaster RecoverySecurity and TLSMonitoringUpgrade ManagementAdvanced Replication SupportCloneConnection PoolingPod Anti-Affinity,Node Affinity,

12、Pod TolerationsScheduled BackupsBackup to Local Storage,S3,GCS,Azure,or a Combo!Full CustomizabilityNamespacesMain FeaturesSummary Crunchy Data是PG内核的主要贡献者之一，技术实力很强 集成大量第三方开源组件，功能强大 pgBackRest PostGIS/pgRouting Prometheus/Grafanahttps:/ PG GO O简简单单使使用用例例$kubectl create namespace pgo$kubectl apply-f h

13、ttps:/ apply f./postgres-operator.yml安装（另外还需要安装PGO CLI，此处不赘述）创建PG集群$pgo create cluster example-replica-count=1-metrics修改集群配置$pgo update cluster example cpu=2.0 cpu-limit=4.0-memory=4Gi-memory-limit=6Gi简简单单对对比比S St to ol lo on nZ Za al la an nd do oP PG GO OGitHub Stars3.5k2.2k2.2kOSS LicenseApache 2

14、.0MITApache 2.0UICLIGUICLIHA Cluster&FailoverScaling&ResizingCause DowntimeWAL ArchivingScheduled BackupMetricsBuilt-in Prometheus SupportSummaryLong history,but not active recentlyWith GUIFriendly to newerPowerful L4 OperatorSS So om me e C Co om mm me er rc ci ia al l O Op pe er ra at to or rs s Fujitsu Enterprise PostgresIncludes security features enhanced by FEPPerformance optimized for IBM LinuxONEhttps:/ EDBhttps:/ To Find Morehttps:/operatorhub.io/?category=Database&view=cardTHANKS谢谢观看