《3- Track 1_Arm_Liming Li.pdf》由会员分享,可在线阅读,更多相关《3- Track 1_Arm_Liming Li.pdf(17页珍藏版)》请在三个皮匠报告上搜索。
1、Public 2023 Arm Technology(China)Co.,Ltd.Embedded World China 2023Liming Li|Senior Marketing Manager,Arm ChinaSparking the Next Generation of Arm-based Cloud-native Smart Camera Designs2Public 2023 Arm Technology(China)Co.,Ltd.Introduction to the Future of Smart CameraWhere are the changes happening
2、?Local NVRCashierless smart retailCloudFuture deploymentsObject detection on smart cameras Human presence detection and express authenticationSmart city(urban mobility,public safety,etc.)and much more.Current deployment is single function camera with limited cloud service3Public 2023 Arm Technology(
3、China)Co.,Ltd.Why Are the Changes Happening?Machine learning(ML)is everywhere Need an efficient way to make it easier to support multiple platforms with varying ML capabilities Security CamerasSmart HomeOccupancy and People Counting Consumer AppliancesIndustrial Vision(Quality Inspection etc.)Smart
4、DoorbellsMachine Learning4Public 2023 Arm Technology(China)Co.,Ltd.Review of Typical Native Only Development Flow Time-consuming to develop solutions including hardware,software and integrate cloud service provider(CSP)servicesRigid machine learning(ML)use case due to single ML-model deployment Lack
5、 of software ecosystem to deploy multiple ML applicationsOSCPUNPUISPML ApplicationTraining Data StoreTrain ModelModel OptimizationDeployment5Public 2023 Arm Technology(China)Co.,Ltd.Building an Arm-based Cloud-native Smart CameraPackage ModelCollaborateApp developer using DevOpsData scientist using
6、Machine LearningIoT EngineerModel Zoo(per target hardware)Arm Optimization ToolsArm Virtual HardwareRetrain model&Debug64Deploy multiple container images to support various machine learning workloads/servicesTarget platformCloudPublic 2023 Arm Technology(China)Co.,Ltd.Arm Vision Solution Makes it Ea
7、sier than Ever to Design a Cloud-native Smart Camera7Public 2023 Arm Technology(China)Co.,Ltd.Overview of Arm Vision SolutionAccelerate time to market by building on Arms proven technologyPower multiple ML use cases and new application developmentEnable software developers to easily access Arms stro
8、ng software ecosystemReference systemarchitectureOpen source reference software stackArm Virtual Hardware/FPGAPower/PerfReportsDemonstrator and Documentation8Public 2023 Arm Technology(China)Co.,Ltd.BSP and Software EcosystemThe software ecosystem of Arm Vision solution8UEFI/uBoot(SystemReady-IR)EWA
9、OL(Edge Workload Abstraction and Orchestration Layer)*Cloud Service Provider IntegrationVideo Capture ContainerApplication ContainerML Inference ContainerLinux-kernel v5.10(upstream)*EWAOL project provides users with a standards-based framework using containers.See https:/ 2023 Arm Technology(China)
10、Co.,Ltd.Software in Arm Vision SolutionBSP,includes U-Boot,Linux-Yocto Hardknott 5.1 and EWAOLIntegrated drivers cover:Cortex-A,Cortex-M communicationISP VPU and NPUModel ZooExample applicationObject recognition example with Yolov310Public 2023 Arm Technology(China)Co.,Ltd.Block Diagram of Arm Visio
11、n SolutionAXI interconnectCortex-A35/Cortex-A53System controlPower controlSecureDebugExpansionsMemoriesSecure enclaveRoot of TrustMessageUnitPeripheralsFirewallFirewallFirewallExpansion SystemMachine learning AcceleratorImage Signal Processor Video Encoder11Public 2023 Arm Technology(China)Co.,Ltd.H
12、ardware in Arm Vision SolutionCPUUp to four cores of Cortex-A35 or Cortex-A53Always-on Cortex-M55 with Helium supportISP(Mali-C55)Up to 4K 30 fps with IMX415Neural Processing Engine-up to 4 TOPSVideo Encoder H.265/H.264&JPEG multi-streaming channel128 bits Interconnect NIC-450Integrated interrupt co
13、ntroller,power management,Coresight secure debug Clock domain controlInter-processor communication MHUPublic 2023 Arm Technology(China)Co.,Ltd.Deployment Examples13Public 2023 Arm Technology(China)Co.,Ltd.Smart Retail Arm Vision SolutionArm Hardware PlatformCSP DashboardSmart RetailCashierless check
14、 outStore maintenance,shelf management or safetyCustomer flow,store occupancyCustomer sentimentBase Yocto based OS(SmartCamera Reference Software Stack)Docker Container RuntimeCSP Integration ContainerInference ContainerCloud Service ProviderVideo CaptureML ModelPreprocessing+Web-UI Container14Publi
15、c 2023 Arm Technology(China)Co.,Ltd.Smart City Arm Vision Solution Vehicle detectionVehicle trackingPedestrian detectionSocial distancingAnd much more15Public 2023 Arm Technology(China)Co.,Ltd.SummaryIn typical native-only development,it is time-consuming to integrate CSP services,theres too little
16、flexibility to deploy varying ML functionality,and there is an insufficient software ecosystemArm is enabling the next generation cloud-native smart camera by providing a reference design to:Accelerate time to market by building a solution on Arms proven technologyPower multiple ML use cases and new
17、 application developmentEnable software developers to easily access Arms strong software ecosystem16Public 2023 Arm Technology(China)Co.,Ltd.ResourcesArm Solutions for IoT:https:/ Developer Tools and Software for IoT:https:/ Virtual Hardware:https:/ Demos at Embedded World China:Arm IoT Solution for Smart Vision Demo.A Reference hardware platform and software stack for Open-Source Cloud-Native solutionsTHANKS