Qualcomm Technologies and Meta Platforms today announced a collaboration to bring on-device AI to smartphones and other devices. The collaboration will leverage Meta’s LLaMA 2 large language model (LLM) and Qualcomm’s Snapdragon AI Engine to deliver more personalized, immersive, and secure experiences on a wider range of devices.
LlaMA 2 is a powerful LLM that can be used for a variety of tasks, including generating text, translating languages, and writing different kinds of creative content. By bringing Llama 2 to devices, Qualcomm and Meta aim to improve the performance, privacy, and security of AI applications.
“We applaud Meta’s approach to open and responsible AI and are committed to driving innovation and reducing barriers-to-entry for developers of any size by bringing generative AI on-device,” says Durga Malladi, senior vice president and general manager of technology, planning and edge solutions businesses, Qualcomm Technologies, Inc. “To effectively scale generative AI into the mainstream, AI will need to run on both the cloud and devices at the edge, such as smartphones, laptops, vehicles, and IoT devices.”
The partnership aims to enable developers to create innovative AI applications using the AI capabilities of Snapdragon platforms, which power billions of devices such as smartphones, PCs, VR/AR headsets, and vehicles. By running LLaMA 2 models on-device, developers can offer users more private, reliable, and personalized experiences while saving on cloud costs. On-device AI can also function in areas with no connectivity or even in airplane mode.
LLaMA to integrate with Snapdragon in 2024
Meta CEO Mark Zuckerberg said the company will place AI models into all of its products. Speaking to AI research and podcaster Lex Fridman, Zuckerberg offered a wide-ranging state of play for Meta overall. Across the all-encompassing 3 hour+ interview, he also discussed the company’s wide-ranging plans for AI.
Zuckerberg announced that Meta has achieved “amazing advances” in generative AI lately, and that the company is eager to offer this technology to its users. He said that generative AI can “change how we make, distribute, and enjoy content.”
Qualcomm Technologies is scheduled to make available LLaMA 2-based AI implementations on devices powered by Snapdragon starting from 2024 onwards. Developers can get started today by optimizing their applications for on-device AI using the Qualcomm AI Stack, a dedicated set of tools enabling more efficient AI processing on Snapdragon. This breakthrough technology makes on-device AI possible even in small, thin, and light devices.
Last Updated on November 8, 2024 12:22 pm CET
