《青源会:2022年人工智能重要方向进展与未来展望报告(82页).pdf》由会员分享,可在线阅读,更多相关《青源会:2022年人工智能重要方向进展与未来展望报告(82页).pdf(82页珍藏版)》请在三个皮匠报告上搜索。
1、 1?1?.9?挖?意?.10?意?.10 1.?.10 2.?续?.12 3.?.13 4.?.14 5.?.14?热?.16?.16?意?.18?.18?意?.19 1.?.19 2.?.19 3.?续?CTR?.20 4.?.20?.20?.21 2?意?.21?.21?.21?意?.22 1.?意?.22 2.?意?.22 3.?.23 4.?.23 5.?.23 6.?.23?.23?.24?意?.24 1.?.24 2.?.24 3.?.25?.25 1.?.25 2.?.25?.26?.26?意?.26 3?.27?.28?意?.30?意?.30 1.?.30 2.?.31 3.
2、?.31 4.?.32 5.?.32?.33 1.?.33 2.?.33 3.?.34?.34?意?.36?意?.36?.37 1.?Transformer?全?.37 2.?.38 3.?MIM?.39?.40 4?1.?.40 2.?.41?意?.41 1.?续?.41 2.?续?.42 3.?GAN?.42?.43 1.?NeRF?.43 2.?.44?.45 1.?.45 2.?.45 3.?3D?.46 4.?.46 5.?.47?意?.49?.49 1.?.49 2.Serverless?.50 3.?.51?.52 5?1.?.52 2.?.53 3.DPU.54 4.?.54
3、5.?.55 6.CPU?.55 7.?.56?EDA?.56?.57 1.?续?.58 2.?.58 3.?.59 4.?.60?AI+SCIENCE?意?.61?AI+?.61?意?.61?.62 1.?.62 2.?.62 3.?.62 4.?.63?.63 6?AI+?.63?AI+?.64?意?.65?.65?.66 1.?.66 2.?.66 3.?.66 4.?.67?AI+?.67?意?.67?.68?.68?AI+?/?.68?意?.69?.69?.70?AI?意?.70 1.AI+?.70 2.AI+?.70?AI?.71 7?意?.71?.72?意?.74?意?.74 1
4、.?.74 2.?.75 3.?.75 4.?预?.75 5.?预?.76 6.?.76 7.?.77 8.?.77?.77 1.?预?.78 2.?.78 3.?.78 4.?.78?.78 1.?.78 2.?.79 3.?全?.79 8?4.?.79 5.?.80 9?劲?2021?6?纳?缺?劲?AI?续?2022?5?6?劲公?劲?挖?AI+?意?缺?续?劲?劲2022?缺?绍?意?劲 2022?7?10?挖?挖?挖?意?Transformer?挖?意?全?缺?续?意?缺?意?挖?意?意?全?劲?续?劲?挖?意?缺?1.?挖?NLU?NLG?克?7?全?11?https:/arxiv
5、.org/pdf/2109.12575.pdf?挖?挖?缺挖?缺?Paradigm Shift?MRC?挖?挖?Prompt?续?12?https:/arxiv.org/pdf/2109.12575.pdf?劲?点?劲全?挖?热?NLP?2.?续?续?续?缺?续?Prompt Tuning?Fine Tuning?缺?续?碎?续?13?3.?全?GPT?劲?劲?Lets Think Step by Step?14?4.?热?缺?续?纳?Language Model As A Service?LMAAS?纳?热?纳?Black-box Tuning?糊?续?碎?5.?15?LMs-as-KBs?
6、缺?缺?受?热?缺?续?续?续?点?意?16?挖?意?热?全?BERT?T5?热?受?缺?缺?劲?缺?意?法?17?挖?纳?续?预?续?热?劲?挖?意?/?续?-?续?NLP?18?意?劲?缺?意?缺?续?劲?意?装?意?缺?绍?Query?Document?Q&A?-?缺?Query?Document?硬?克?Web Data?Query?Document?Document?硬?19?意?意?全?1.?2019?意?Query?Document?缺?2021?Transformer Memory as a Differentiable Search Index?意?硬?克?碎?2.?意?续?
7、缺?CLIP?DALLE?DALLE2?20?3.?续?CTR?CTR?全?2015?2020?挖?缺?缺?UBR?DIEN?缺?4.?绍?受?意全?克?全?受?全?绍?绍?缺?意?劲?硬?克?续?受?21?意?全?绍?劲?热?全?全?预?点?预?Cross Domain?Large Scale?Long Tail?挖?续?22?1.?意?意?意?意?缺?2.?意?分?潜劲分?意?23?3.?法?4.?5.?垂?垂?垂?垂?挖?6.?点?热?缺?克?意?缺?Drug Discovery?续?热?24?1.?全?法?法?法?热?点?法?缺?全?Prompt-based?Case-based?2.
8、?点?25?劲?Transformer?意?3.?热?意?全?1.?意?意?2.?热?糊?26?缺?意?糊?意?潜?缺?CPU?分?27?意?1.?2.?分?分?3.?糊?劲?缺?全?4.?挖?续?换然?缺?意?GPU?FPGA?GPU?糊?续?FPGA?缺?缺?28?缺?意?1.?2.?3.?4.?29?续?劲 2022?5?10?6?1?劲?劲?布?节?划?30?热?续?预?续?劲?意?缺?绍?1.?30?Universal Approximation?/?克?劲?意?全?碎?31?2.?全?意?缺?续?缺?Benign Overfitting?意?意?公克?纳?NeRF?劲?Dropou
9、t?劲?热?3.?受?受?法?缺?32?劲?缺?意?劲?劲?热?糊?Kernel?性?性?缺?热?糊?缺?性?克?糊?意?意?预?意?性?意?意?块?意?4.?缺?性?挖?劲?5.?意?劲?碎?续?33?点?点?点?AI for Science?缺?全?纳?分?1.?热?糊?续?内?0?劲?2.?热?Trade-off?受?34?3.?续?意?缺?意?劲?1.?全?2.?3.?4.?5.?意?装?35?续?劲 2022?5?16?6?1?劲?劲?布?36?挖?缺?糊挖?克?3D?续?劲?意?缺?2021?缺?全?意?2021?内?意?全?37?1.?Transformer?全?Transfor
10、mer?续?NLP?缺?Transformer?意全?2020?ViT?2021?Transformer?SETR?Swin Transformer?ADE20K?COCO?CNN?缺?Transformer?DeiT?PVT?T2T?CvT?TNT?Focal-Transformer?Transformer?ViViT?Point Transformer?潜?Image Processing Transformer?38?意?Transformer?2021?TransGAN?Transformer?潜?StyleSwin?CNN?Transformer?2022?Nvidia?GPU H1
11、00?Transformer?6?Transformer?MobileFormer?Transformer?MLP-Mixer?MLP?RepMLP?CylelMLP?PoolFormer?Transformer?缺?D-DW Conv?ConvNeXt?RepLKNet?2.?2020?DETR?DETR?Transformer?DETR?意?Deformable DETR?DETR?DETR?39?Mask Former?Mask2Former?3D?意?DETR3D?group-free-3D?DETR?YOLOS?2022?3?DINO?Swin-L?COCO?63.3 mAP?DET
12、R?绍?3.?MIM?挖?意?GPT?BERT?克?意?BERT?意?OpenAI?2020?ImageGPT?全?2021?6?BEiT?VQ-VAE?挖?Patch?Token?BERT?MAE?SimMIM?MAE?SimMIM?MIM?意?意?data2vec?PeCo?CAE?意?MaskFeat?BEVT?Video?ViTDet?MIMDet?40?热?MIM?MIM?Feature Distillation?1.?AI?全?全?挖?意?意?2021?缺?ViT?18?30?ImageNet?90.45%?意?Scaling Law?41?Swin V2?30?性?SoTA?Si
13、mMIM?Swin V2?40?7000?2.?MoE?意?150?ViT-MoE?Swin Transformer?MoE?1.?续?缺?续?2021?OpenAI?DALLE?续?意?2022?DALLE?续?Imagen?CogView?VQ-Diffusion?NUWA-infinity?42?2.?续?2021?OpenAI?CLIP?ImageNet?续?Florence?CoCa?DeepMind?Gato?Flamingo?3.?GAN?DPM?GAN?OpenAI?ADM?SDE?DPM?GAN?VAE?FLOW?43?DPM?Analytic-DPM?DPM?SDE?Ana
14、lytic-DPM?克?ICLR2021?2022?Outstanding Paper Award?意?1.?NeRF?缺?UCB?UCSD?2020?模?NeRF?缺?模?NeRF?44?NeRF?3D?NeRF?PixelNeRF?NeRF?NeRF?模?3D?2D?NeuralBody?2.?意?意?全?缺?DBNet?热?劲?劲?Transformer?意?WebFace260M?42M?意?VSPW?VIPSeg?意?45?1.?全?缺?EventZoom?Time Lens?Time Lens?2.?-?AWS?2022?X-DETR?绍?-?AI2?UIUC?GPV?潜?意?46
15、?3.?3D?3D?全?克?3D?3D?3D?CLEVR 3D?ScanQA?4.?点?点?MIT?2?意?缺?FAIR?AI2?Google?Rearrangement?AI2THOR?47?5.?续?Transformer?热?48?续?劲 5?13?6?1?公?劲?劲?布?偲?类?49?AI?缺?续?劲?意?EDA?潜?意?1.?纳?纳?全?纳?挖?纳?模?纳?模?潜?分?分?劲?50?2.Serverless?Serverless?IoT?挖?意分?点?Serverless?克?噪?GB?纳?Serverless?纳?缺?Web?AI?Serverless?51?热?意?Serverl
16、ess?Serverless?3.?缺?意?GraphScope?绍?缺?意?52?1.?TensorFlow?PyTorch?PaddlePaddle?MindSpore?OneFlow?AI?TensorRT?TensorFlow?CNNL?FastMoE?NVIDIA NCCL?53?PET?EinNet 克?PET?碎?EinNet?缺?模?受?PET?EinNet?3?2.?纳?性?60%?纳?RDMA?CPU 糊?CXL?load?store?54?3.DPU?DPU?挖?CPU/GPU?续?SSD?挖?劲?4.?挖?55?AI?24%?CPU?GPU?54%?挖?缺?GNN?GN
17、N?GNN?5.?碎挖?缺?碎挖?糊?碎?挖?GPU?碎?6.CPU?CPU?缺?CPU?克?CPU?GPU?点?56?7.?缺?缺DPU?缺?挖?缺?ATP?DPU?纳?纳?CPU?缺?CPU?挖?挖?热?全?点?EDA?意?EDA?RTL?糊?意?糊?意?EDA 糊?挖?意?57?意?意?EDA?意?意?潜?克?潜?克?EDA?劲?纳?意?缺?挖?58?1.?续?续?Chiplet?Hub+Side Die?Hub Die?碎?全?CPU?Side Die?AI?Die to Die 碎?Chiplet?Hub Die?IP?Hub+Side Die?全?续?全?NoC?DFT?Chipl
18、et?Die to Die?碎?碎?分?UCIE?分续?MCM?2.5D?2.?Chiplet?Hub+Side Die?全?SoC?HPC?意?Chiplet?Chiplet?NoC?缺?59?3.?克?Chips for AI?AI?AI?碎?缺?AI?潜?缺?点?缺?意?AI for Chips?缺?60?续?40?缺?缺?续?绍?Nature?点?缺?6?TPU?4.?挖?缺?挖?CPU?CPU?缺?CPU?SoC?61?AI+Science?AI+Science?意?缺?AI?全?AI for Science?意?意?续?劲?AI+Science?全?AI+?AI+?AI+?AI+?
19、AI+?/?AI+?意?劲?AI?意?缺?AI+?哈?缺?哈?AI+?缺?2020?DeepMind?AlphaFold?2021?AlphaFlod2?RoseTTAFold?AI?RNA?62?意性?意?2021?DeepMind?Science?DM21?AI?绍?意?缺?AI+?意?1.?AlphaFold?分?2.?Baker?意?Nature?挖?缺?AI?劲?分?3.?AI?缺?AI?63?4.?AI?意?AI+?AI?AI?AlphaFold?AI?意?AI?缺?AI+?AI+?AI?AI+?AI+?2016?5?Nature?缺?Nature?Science?意?AI+?克?
20、64?2021?5?4?Nature?换?AI?AI?2021?1?6?Nature?10?缺?10?AI+?缺?典?2006?缺?AI?意?缺?65?AI+?全?2021?DeepMind?碎?意?挖?缺 AI+?66?1.?挖?2.AI?3.?AI?全?AI?AI+?全?1.?全?全?然?AI?挖?2.?挖?TB?性?AI?挖?3.?受?67?4.?AI+?AI+?碎?2016?AI+?分?Nature?2016?MIT?CNN?碎?碎?68?AI+?碎?碎?AI+?意?AI+?AI+?/?AI?69?意?AI?法?AI?续?AI?AI+?/?意?全?+?组?缺?DeepMind?点?热?
21、AI+?/?法?法?碎全?全?+?70?AI+?/?法?AI?1.AI+?全?缺?DeepMind?Nature?克?意?预分?2.AI+?2022?DeepMind?Nature?Ithaca?换?缺?AI?71?AI?AI+Science?意?分?AI?AI?Lime?Efficiency?Symmetry?Linearity?72?克?Local Accuracy?Missingness?Consistency?Shapley Value?Sensitivity?Implementation Invariance?全?Sensitivity?Implementation Invarian
22、ce?缺?Integrated Gradients?缺?AI?缺?AI?绍?AI+Science?意?意?AI?AI+Science?AI+Science?73?续?劲 2022?5?9?6?1?劲?劲?布?观?节?74?热?劲?意?劲?内?续?劲?意?缺?缺?劲?缺?缺?全?克?劲?全?续?劲?分?劲?1.?AI?劲?2021?11?25?2021?9?25?75?2.?1-2?2021?9?17?点?纳?哈?克?纳?纳?纳?意?克?类?3.?AI?意?缺?2022?克?2.8?2.19?AI?意?4.?预?热?2020?1?2?3?76?4?纳?5.?预?预?全?预?预?碎?AI?意?热?6.?AI?意?受?77?7.?热?劲?Learning to Unlearn?意全?克?挖?8.?热?纳?劲?热?受?点?糊?缺?热?AI?意?78?1.?预?续?预?热?糊?预?2.?劲?受?糊?绍?克?劲分?缺?3.?续?模?4.?缺?预?缺?分?1.?点?79?2.?缺?3.?全?热?续?4.?性?劲?预?AI?劲?AI?全?AI?80?5.?AI?意?Debug?AI?AI?81?续?劲 5?16?6?1?公?劲?劲?布?