Efficient AI is more than algorithms. This hands-on course shows you how to optimize GenAI workloads on real-world systems using techniques such as SIMD (SVE, Neon), low-bit quantization, and the optimized KleidiAI library. You will develop essential strategies and skills to build scalable, high-performance AI on edge and cloud-based platforms based on the most widespread processor architecture.
What you'll learn
optimization techniques for generative AI
using SIMD for performance enhancement
implementing low-bit quantization
leveraging the KleidiAI library for AI workloads
Course objectives
provide practical skills for optimizing AI on Arm processors
understand deployment strategies for edge and cloud platforms