There’s every chance IBM has just unveiled the blueprint for the future of AI development with an analog AI chip that’s said to be up to 14 times more energy efficient than current industry-leading components.

One of the major problems with generative AI is how power-hungry the technology currently is – and may one day become. 

The costs involved in training models and running the infrastructure will only skyrocket as the space matures. ChatGPT, for example, costs more than $700,000 per day to run, according to Insider.

IBM progress

IBM’s prototype chip, which the firm revealed in Nature, aims to ease the pressure on enterprises that build and operate generative AI platforms like Midjourney or GPT-4 by slashing energy consumption. 

This is due to the way the analog chip is built; these components differ from digital chips in that can manipulate analog signals and understand gradations between 0 and 1. Digital chips are the most widespread in today’s age, but they only work with distinct binary signals. There are also variations in functionality, signal processing, and application areas.

Nvidia’s chips, including the H100 Tensor Core GPU and A100 Tensor Core GPU, are chiefly the components that power many of today’s generative AI platforms. Should IBM iterate on the prototype and prime it for the mass market, however, it may well one day displace Nvidia as the current mainstay.

IBM claims its 14nm analog AI chip, which can encode 35 million phase-change memory devices per component, can model up to 17 million parameters. The firm has also said its chip mimics the way in which a human brain would operate, with the microchip performing computations directly within memory.

It demonstrated the merits of using such a chip in several experiments, including one in which a system was able to transcribe audio of people speaking with accuracy very close to digital hardware setups. 

The IBM prototype was roughly 14 times more efficient per watt, although simulations have previously shown such hardware might be between 40 and 140 times as energy-efficient as today’s leading GPUs.

Read more

Go to Source

Follow us on FacebookTwitter and InstagramWe are growing. Join our 6,000+ followers and us.

At will strive to help turn Tech Rookies into Pros!

Want more articles click Here!

Deals on Homepage!

M1 Finance is a highly recommended brokerage start investing today here!

WeBull. LIMITED TIME OFFER: Get 3 free stocks valued up to $6300 by opening & funding a #Webull brokerage account! “>Get started >Thanks for visiting!

Subscribe to our newsletters. Here! On the homepage

Tech Rookies Music Here!

Disclaimer: I get commissions for purchases made through links in this post at no charge to you and thanks for supporting Tech Rookies.

Disclosure: Links contain affiliates. When you buy through one of our links we will receive a commission. This is at no cost to you. Thank you for supporting

Disclaimer: This article is for information purposes and should not be considered professional investment advice. It contains some forward-looking statements that should not be taken as indicators of future performance. Every investor has a different risk profile and goals. All investments have risks. Always do your own research or hire an expert before investing and trading.