报告预览

GPU 在向量搜索中的应用.pdf

编号：29528

PDF 25页 2.55MB 下载积分：VIP专享

下载报告请您先登录！

GPU 在向量搜索中的应用.pdf

1、GPU在向量搜索中的应用金海ZillizZILLI2820207#page#Speaker bio金海ZILLI2R&D DirectorProject LeaderCareer historyEducation2020 Milvus.All righhts reserved#page#Unlock the treasure of unstructured dataAlalgorithms transform image，video，voice，naturallanguageinto vectors，and enable understandingandutilization ofunstru

2、ctured data at scale.mUnstructured dataDeep learning modelsEmbedding vectorsKnowledge，insight，$#page#The flow-based Al applicationsVideoThe most popularwayVoiceExtractExtractFlexibleframcsmodeltagsEasytocomposeweb-based UISample pipelinesImageThe challengeData fragmentationVsual modelVGG.gEmbeddings

3、EmbeddingsAttributesVisualVoice2020 Milvus.All righhts reserved#page#The unstructured data service (UDS) for AlUnstructured Dataimage，video，voice，naturallanguageSearchInsertModel Inference RuntimeInference LayerStoreTensorRT.ONNX RT.TFRT.ctc.InsertSearchMilvusObject URIObjectVectorsAttributesData Se

4、rvice LayerStorageHigh dense +SparsexperimentalVector IDMultimodalScoringon roadmapon roadmapOutputResult Setimage，video，voice，natural language#page#Milvus:The big pictureQueryProcessing EngineBuffer PoolSchedulerANNSCollaborative QuenIndexM-FAISS,Mi-Annoytag/structureddataSDK/ Web APIResultFiestop-

5、K resultReducerScoringMultimodalapp specificSegmentSegmentMetadataquery objSelectioninsert objX86:supporisSSE4.2，AVX2,AVX512GPU:Pareorlaler.CUDA10.0imieroarehlX86ArmrlateNewIndexArm:requirosaarch64IndexFilesFileGPUOtherVarious ProcessorsStorage Tier#page#Vectors are differentNumbersVectorsArithmetic

6、 operationSimilarity(cg.Euclidcan distance）-+d（4B）=a-a）OperatiSimilaritycomparisonNumber comparisonTopK（A）=argmin（d（AB）91-106-672020 Milvus.All rights reserve#page#Faiss-GPUTraining data0.32,0.21.0.510.52,0.11.0.60IVF Flatf.0.91,0.33.0.13CentroidsClustersGPUVector data0.32,0.21.0.510.5

7、2,0.11.0.60有0.91,0.33.0.132020Milvus.Allrighsreserved#page#Faiss - Multiple GPUs supportFaiss-IndexShardsFaiss- IndexReplicasGPUOGPU1GPUOGPU1#page#Other LimitationsThroughputSM-0SM-1SM-（N-1）HighTopK = 2048L2 CacheGlobal MemoryLOWGPUPCIE2048Thread queueWarp queueInsertDDW。W2TooTo.Tom-1Merging Network

8、Lane0W.WLane1T:T；CheckLane31WT31oT31To1 m-1WWaD.RegisterRegisterGlobal Memory2020 Miivus.All rights reserved#page#Challenges - CPU-GPU co-processingFaiss-IVFQueryIndex0.32,0.21,0.23.0.51）Step1CentroidsQuery0.32,0.21,0.23，.0.51Step2Clusters2020 Milvus.All righhts reserved#page#Challenges - CPU-GPU co

9、-processingFaiss-IVF Indexnlist2x-5x speed up!nlist* dimension*4GPUCentroidsbytesCPUClusters#page#Performance ComparisonCPUvS CPU+GPUOS:Centos Linux release 7.6.1810（Core）CPU:Intel(R）Xeon(R）CPUE5-2678v32.50GGPU:Tesla P100*2Memory:503GBDataset:sift1B（http:/corpus-texmex.irisa.fr）metric_type:L2nlist:1

10、6384nprobe:32200吉NuberO QueriesOCPU+GPLOCPU2020 Milvus.All righhts reserved#page#Our Journey2018.102019.042019.06MivsThe most activeAl projects in1st5eedLinux foundationMis.1The deaUse8Joine年A2020.102019.102020.032020 Milvus.All righhts reserved#page#Community ConferenceMilvusmmunityonf2020#page#Cur

11、rent Process452CommitsGitHub starsForksContributors16190K70+400+UsersReleasesDockerHub downloadsMeetupsandevents2020 Milvus.All rights reserve#page#lmage search for companytrademarkImages55millionimagesCompany TrademarkSearchelapsedtime商标查询20ms on cloud GPUserverEncoderVGG (fine tuned）Obj

12、ectURIObjectSearchMilvusStorageVector IDTrademarklmageCompany Info2020 Milvus.All righhts reserved#page#Intelligent writing assistantCorpus Datanatural languageWriting IntentonData CleansingEncoderTextCNNResultExAnauto-generatedEncoderessayInferSentObjectURObjectMilvusStorageVectorID#page#Pharmaceut

13、ical molecule analysisMolecular Formula800millionmoleculesCC(=O)Nclccc(S(=O）（=ONCC(=ON2CCS(=0)CC2)cc1Searchelapsedtime:Encoder500 ms on single serverRDKitMolecular fingerprint1024bits00001100.10000000MilvusTanimotosimilarityMolecularSubstructureCandidate ListsimilaritySuperstructure2020 Milvus.All r

14、ighhts reserved#page#Users400+users in 10months贝壳P再来能t99mWMPS七中国电信X服Q系M科技6微博等节额动平安科技魔快手0IY爱奇艺A然物不接母苏宁易购M二湖起科技4399BEsTmnnSBESNEA治明Ultrapouer08捷信图微拍堂HaG中用研学院新华智春沿科技店中千O汇D银加水箱0！Galiboo焦点科技2望石智慧Microsofttokopedic金VC5GtwwFleneKUANG-CHI光启拍云SlprivatBankST88.851日东学甲WISE GBITS6ssyasteroxylonURANMINNOGiENiden

15、tvNCECuniviewJSCCEIECe.5om深度行G恒科技流喜回奇安信企意意稀定科技阿里云Flat面将石动SENSOROFINNOS荔校平安人寿X3TRANSSIONG京东A7DHgccAEEBOSS直聘途虎养车#page#Zilliz:WhoweareOpen-source software company basedin ShanghaiSoftwareewelopmenMain contributor of Milvus projectScene风山MachineMotndLeaming2020 Milvus.All righhts reserved#page#We are hi

16、ringFind our positions in ChinaC+backenddeveloperAl algorithm engineerFrontend developerProduct managerProject managerFind our positions in USCloud infrastructure engineer/developerOpen-source evangelist（US）Developeradvocate（US）Community manager(US）Anda lot more.You may also contact 2020Mivus.Allrighsreserved#page#Thanks口 Speaker Contact口WeChat:Mail:

友情提示

1、下载报告失败解决办法
2、PDF文件下载后，可能会被浏览器默认打开，此种情况可以点击浏览器菜单，保存网页到桌面，就可以正常下载了。
3、本站不支持迅雷下载，请使用电脑自带的IE浏览器，或者360浏览器、谷歌浏览器下载即可。
4、本站报告下载后的文档和图纸-无水印,预览文档经过压缩，下载后原文更清晰。

本文（GPU 在向量搜索中的应用.pdf）为本站（X-iao）主动上传，三个皮匠报告文库仅提供信息存储空间，仅对用户上传内容的表现方式做保护处理，对上载内容本身不做任何修改或编辑。若此文所含内容侵犯了您的版权或隐私，请立即通知三个皮匠报告文库（点击联系客服），我们立即给予删除！

温馨提示：如果因为网速或其他原因下载失败请重新下载，重复下载不扣分。

上海品茶

GPU 在向量搜索中的应用.pdf

GPU 在向量搜索中的应用.pdf