May 17, 2023
1 min read

Qualcomm bets big on Hybrid AI

In a white paper, the company said that hybrid processing is more important than ever…reports Asian Lite News

As generative artificial intelligence (AI) and chatbots like Microsoft-backed OpenAIs ChatGPT and Google Bard take the world by storm, Hybrid AI will allow generative AI developers and providers to take advantage of the compute capabilities available in edge devices to reduce costs, chip maker Qualcomm has said.

In a white paper, the company said that hybrid processing is more important than ever.

“A hybrid AI architecture distributes and coordinates AI workloads among cloud and edge devices, rather than processing in the cloud alone,” said the chip maker.

The cloud and edge devices — smartphones, cars, personal computers, and Internet of Things (IoT) devices — work together to deliver more powerful, efficient and highly optimised AI.

“The main motivation is cost savings. For instance, generative AI-based search cost per query is estimated to increase by 10 times compared to traditional search methods — and this is just one of many generative AI applications,” Qualcomm stressed.

Hybrid AI even allows for devices and cloud to run models concurrently — with devices running light versions of the model while the cloud processes multiple tokens of the full model in parallel and corrects the device answers if needed.

AI models with more than 1 billion parameters are already running on phones with performance and accuracy levels similar to those of the cloud, and models with 10 billion parameters or more are slated to run on devices in the near future.

“The hybrid AI approach is applicable to virtually all generative AI applications and device segments — including phones, laptops, extended reality headsets, cars and IoT,” according to Qualcomm.

ALSO READ: Binance exits Canada market

Previous Story

Experion Technologies widens global footprint

Next Story

MakeMyTrip logs highest-ever profit in its history

Latest from Business

RBI Holds Rates, Boosts Outlook

One of the most significant announcements was the upward revision of India’s GDP growth forecast for FY 2025–26—from 6.5% to 6.8% In a move reflecting cautious optimism, the Reserve Bank of India

Nykaa Expands Global Footprint with UK Debut

To commemorate this significant global debut, Nykaa’s leadership hosted an exclusive soiree at the George Club in Mayfair, London Nykaa, India’s leading beauty and lifestyle destination, is set to make a grand

Nothing’s CMF Goes Indian with $100M JV

Company has announced a $100 million joint venture with Indian electronics manufacturer Optiemus Infracom Limited….reports Asian Lite News Smartphone maker Nothing has spun off its budget sub-brand CMF into an independent subsidiary,

Airbnb Boosts India Economy

Among international guests, the largest inbound sources were the United States, United Kingdom, Canada, and Australia Hospitality giant Airbnb made a significant impact on India’s economy in 2024, contributing Rs 113 billion

Rupee, Markets Gain Amid Trade Optimism

Emerging market currencies, including the rupee, have gained support amid softening in the dollar. Reports suggesting that the US economy is on the verge of a recession have contributed to the greenback’s
Go toTop

Don't Miss

G42, Qualcomm partner to boost AI inference performance

Core42’s Condor AI is a cutting-edge cloud computing platform delivering

Qualcomm unveils innovator kit to empower developers

It offers a hardware development kit based on the Snapdragon