(Boursier.com) — Qualcomm Technologies Inc and Meta announced a collaboration to optimize the execution of Meta Llama 3 large language models (LLM) directly on smartphones, PCs, VR/AR headsets, vehicles, etc.
The ability to run Llama 3 on devices provides significant benefits, including greater responsiveness, better privacy, increased reliability, and more personalized experiences for users.
“We welcome Meta’s open approach with Meta Llama 3 and share its commitment to empowering developers and driving innovation in AI,” said Durga Malladi, Vice President senior and general manager of technology, planning and edge solutions at Qualcomm Technologies, Inc. “Our leadership in on-device AI, coupled with our broad reach across different edge devices, allows us to “expand the benefits of the Llama ecosystem worldwide and enable customers, partners and developers to create a new generation of revolutionary AI experiences.”
This collaboration aims to democratize access to generative AI capabilities by enabling OEMs and developers to make Llama 3 accessible on devices powered by the upcoming flagship Snapdragon(R) platforms. Utilizing Qualcomm Technologies’ powerful heterogeneous computing architecture, which seamlessly leverages our industry-leading CPUs, GPUs and NPUs, in conjunction with cutting-edge memory architecture, enables customers, partners and developers to optimize application performance, thermal efficiency and battery life.
Developers will be able to access the resources and tools needed to run Llama 3 optimally on Snapdragon platforms through the Qualcomm(R) AI Hub, which currently offers around 100 optimized AI models. The Qualcomm AI Hub reduces time to market for developers and enables them to realize the benefits of on-device AI for their applications. To get updates, sign up for our monthly developer newsletter.
Qualcomm Technologies and Meta are committed to driving innovation and delivering the next generation of AI experiences. This commitment represents an important step in their collaboration and demonstrates their desire to offer developers and users powerful AI capabilities.
©2024 Boursier.com