《【李晨】向量数据库:大模型的海量记忆体.pdf》由会员分享,可在线阅读,更多相关《【李晨】向量数据库:大模型的海量记忆体.pdf(25页珍藏版)》请在三个皮匠报告上搜索。
1、向向量量数数据据库库:面面向向 A AI IG GC C 的的海海量量记记忆忆体体李李晨晨Zilliz 开发者关系及市场运营负责人,客户成功与生态发展负责人。Linux Foundation APAC Evangelist。曾任开源中国社区负责人,Linux Foundation 开源软件学园运营负责人。多年来从事开源项目和社区的组织、管理工作,有着丰富的市场和运营经验,策划及参与执行多个国内外顶级基金会在国内的落地和生态拓展工作。李晨A Ab bo ou ut t MMe E Emmb be ed dd di in ng g a an nd d V Ve ec ct to or r S Se
2、 ea ar rc ch L LL LMM L Li immi it ta at ti io on ns sD Do omma ai in n-s sp pe ec ci if fi ic c k kn no owwl le ed dg ge eR Re ea al l-t ti imme e i in nf fo or rmma at ti io on K Kn no owwl le ed dg ge e R Re et tr ri ie ev va al l f fo or r L LL LMMs C CV VP P f fr ra amme ewwo or rk k:L LL LMM +
3、V Ve ec ct to or rD DB B +P Pr ro ommp pt tL LL LMMAnalysis and reasoning unit&natural language adapterV Ve ec ct to or rD DB BLong-term memory&knowledgebaseP Pr ro ommp pt tBusiness MMi il lv vu us s:为为云云而而生生的的向向量量数数据据库库 分布式云原生,基于 K8s 进行微服务化设计 存储计算分离,弹性扩缩容 高可用,故障分钟级恢复 百亿级向量的扩展能力 基于消息队列实现数据的实时增删 集成
4、OpenAl,Langchain,Huggingface,Pytorch等AI生态 强大的生态工具 GUI,CLl,监控,备份Pipeline&Ecosystem IntegrationLLM+VectorDB+Prompt chained togetherhttps:/towhee.io/OperatorsPipelinesT To owwh he ee e O Op pe er ra at to or rs s&P Pi ip pe el li in ne es Z Zi il ll li iz z -构构建建开开源源+云云的的非非结结构构化化数数据据处处理理方方案案围绕 LLM 的开源非
5、结化数据解决方案 ZilliZ Cloud 开箱即用的全托管向量检索服务Z Zi il ll li iz z C Cl lo ou ud d:企企业业级级特特性性O Ou ur r P Pa ar rt tn ne er rs s:Z Zi il ll li iz z x x A AI I x x C Cl lo ou ud dMilvus 被全球超过 1 10 00 00 0家家 企业用户所信赖,超过 3 35 50 0万万次次 下载和安装Milvus Github Star 数目超过 2 2万万,贡献者人数超过 3 30 00 0Milvus DB-Engine引擎排名 2 22 23 3
6、,并且在SIGMOD和VLDB等数据库顶会上发表了论文,奠定了向量数据库的基础V Ve ec ct to or rD DB B x x 异异构构并并行行计计算算A An ns swwe er r f fr ro omm C Ch ha at tG GP PT TA An ns swwe er r f fr ro omm O OS SS SC Ch ha at h ht tt tp ps s:/o os ss sc ch ha at t.i io o/G GP PT TC Ca ac ch he e :A A L Li ib br ra ar ry y f fo or r C Cr re ea
7、at ti in ng g S Se emma an nt ti ic c C Ca ac ch he e f fo or r L LL LMM Q Qu ue er ri ie es sSlash Your LLM API Costs by 10 x Boost Speed by 100 x A Ar rc ch hi it te ec ct tu ur re eR Re et tr ri ie ev va al l-A Au ug gmme en nt te ed d G Ge en ne er ra at ti io on L LL LMM-p po owwe er re ed d a
8、au ut to on no ommo ou us s a ag ge en nt t s sy ys st te F Fe ea at tu ur re es s D De es si ig gn ne ed d f fo or r A AI IG GC C D De ev ve el lo op pe er rs sP Pa ar rt ti it ti io on n K Ke ey yidvectoruser_nameABABAC0214350.13,.0.21,0.05,0.09,0.01,0.13,A:B:C:PartitionsCF Fe ea at tu ur re es s
9、D De es si ig gn ne ed d f fo or r A AI IG GC C D De ev ve el lo op pe er rs sS Sp pa ar rs se e V Ve ec ct to or riddense vector0214350.13,.0.21,0.05,0.09,0.01,0.13,sparse vector0,0,0,0,0.35,0,0,0,0,0,0,0,0,0,0,0,0,0.63,0,0,1.0,0,0.28,0,0,0,0,0,0,0,0,0,0,1.0,0,0,0,0,1.0,0,0,0,0,0,0,0.69,0,0,0,0,0,0
10、,0,0,F Fe ea at tu ur re es s D De es si ig gn ne ed d f fo or r A AI IG GC C D De ev ve el lo op pe er rs sMMu ul lt ti i V Ve ec ct to or rs sidVector from text0214350.13,.0.21,0.05,0.09,0.01,0.13,Vector from front image0.07,.0.1,0.05,0.03,0.05,0.19,Vector from side image0.15,.0.25,0.01,0.08,0.01,0.03,“Tesla Model S”F Fe ea at tu ur re es s D De es si ig gn ne ed d f fo or r A AI IG GC C D De ev ve el lo op pe er rs sV Ve ec ct to or r L Li is st tidVector from sampled T TH HA AN NK KS S