Reducing Carbon Footprint for Generative AI

The project aims to reduce the energy consumption and carbon footprint of generative AI systems by implementing more efficient matrix multiplication algorithms, potentially saving 40-50% energy while maintaining performance.

Subsidie
€ 150.000
2023

Projectdetails

Executive Summary

Introduction

Generative AI systems, such as chatGPT, recently passed the Turing test, forever transforming human-machine interaction. These systems provide giant productivity leaps across many sectors. However, their energy requirements increase nine-fold annually and their abundance grows at an exponential rate. The resulting carbon footprint becomes significant.

Industry Commitment

IT giants such as Google, Nvidia, Microsoft, and Amazon, as well as many mid-sized companies, have committed to reducing their carbon footprint. The EU is strengthening regulation for emission reductions. But the new generative AI trend jeopardizes emission reduction commitments.

Energy Consumption Challenges

Most power consumption of generative AI is spent on matrix multiplication. Our novel solutions reduce energy consumption and carbon footprint by replacing current matrix multiplication algorithms with more efficient ones. These can be implemented on existing hardware and software stacks.

Potential Savings

  • Potential energy saving predicted at about 40-50%
  • Maintains performance and accuracy

Research and Development

The novel developments of Prof. Oded Schwartz and his strong team are based on years of research and are protected by patents. The funds are requested to pursue business opportunities.

Financiële details & Tijdlijn

Financiële details

Subsidiebedrag€ 150.000
Totale projectbegroting€ 150.000

Tijdlijn

Startdatum1-10-2023
Einddatum31-3-2025
Subsidiejaar2023

Partners & Locaties

Projectpartners

  • THE HEBREW UNIVERSITY OF JERUSALEMpenvoerder

Land(en)

Israel

Vergelijkbare projecten binnen European Research Council

ERC Proof of...

Fast Matrix Multiplication for AI

Developing patented methods for faster and energy-efficient matrix multiplication in software and hardware to enhance AI applications and capitalize on business opportunities.

€ 150.000
ERC Consolid...

Outplaying the hardware lottery for embedded AI

The BINGO project aims to revolutionize embedded AI by enabling rapid customization of heterogeneous compute platforms using prefabricated chiplets, achieving 100x efficiency gains in days.

€ 1.995.750
ERC Consolid...

Educational Inequalities and Generative AI: A Focus on Language Diversity

ChatEQUITY explores the impact of generative AI on educational inequalities by developing a new assessment tool and analyzing access disparities among students and teachers in diverse linguistic contexts.

€ 2.195.500
ERC Consolid...

Growing Machines Capable of Rapid Learning in Unknown Environments

GROW-AI aims to develop machines with general intelligence through genomic bottleneck algorithms and optimized learning environments, enhancing their autonomy and task-solving capabilities.

€ 1.994.225
ERC Consolid...

Thermodynamic-inspired computing with oscillatory neural networks

THERMODON aims to revolutionize energy-efficient computing by integrating thermodynamics with neuromorphic architectures for self-organizing, adaptive AI systems.

€ 2.000.000

Vergelijkbare projecten uit andere regelingen

EIC Accelerator

First automated risk management platform to enable safety, fairness, explainability, and continuous monitoring of generative AI systems

QuantPis offers a comprehensive, model-agnostic platform for generative AI risk management, enabling companies to assess and mitigate risks while ensuring compliance with over 100 standards.

€ 2.498.475
Mkb-innovati...

Digital Business Architecture Assistant

Het project onderzoekt de toepasbaarheid van generatieve AI voor het automatisch genereren van Business Architecture en Business Processes uit natuurlijke taal, om informatiesystemen efficiënter te ontwikkelen.

€ 20.000
Demonstratie...

CO2-reductie in de glastuinbouw door intelligente algoritmen

Het project ontwikkelt AI-gestuurde algoritmen voor het optimaliseren van het binnenklimaat in kassen, met als doel een CO2-reductie van 25% en optimale groeicondities.

€ 341.050
Demonstratie...

Plug & Play Artificial Energy Intelligence

Het project ontwikkelt een plug & play energiebesparingssoftware met kunstmatige intelligentie voor de industrie, gericht op CO2-reductie en kostenbesparing, getest in twee pilotomgevingen.

€ 120.420
EIC Pathfinder

n-ary spintronics-based edge computing co-processor for artificial intelligence

MultiSpin.AI aims to revolutionize edge computing by developing a neuromorphic AI co-processor that enhances energy efficiency and processing speed, enabling transformative applications while reducing CO2 emissions.

€ 3.143.276