Fujitsu unveils AI computing broker to boost GPU efficiency

Fujitsu has announced the launch of an AI computing broker middleware aimed at improving GPU utilisation and addressing global shortages.

The newly developed technology dynamically allocates GPU resources, integrating Fujitsu's adaptive GPU allocator technology with AI processing optimisation techniques. This middleware promises an increase in computational efficiency by up to 2.25 times and enables handling up to 150GB of AI processing, significantly more than typical GPU memory capacities.

Mahesh Krishnan, Chief Technology Officer Oceania at Fujitsu, said, "Organisations are struggling to keep pace with AI demands due to the global GPU shortage. Fujitsu's new AI computing broker middleware provides a powerful solution, allowing businesses to better leverage their existing GPU resources and breakthrough processing constraints." 

Pilot trials with companies such as TRADOM, SAKURA internet, AWL, Xtreme-D, and Morgenrot showed substantial improvements, including a significant increase in the concurrent handling of AI processes across various platforms.

Junichi Kayamoto, Chief Data Science Officer at TRADOM, commented, "Our company delivers cutting-edge AI-powered solutions for managing foreign exchange risk. The trial of Fujitsu's AI computing broker technology proved its ability to significantly streamline GPU resource allocation for AI model generation, enabling the development of substantially more accurate models in significantly less time through AI learning process multiplexing. We are committed to leveraging this technology, in continued collaboration with Fujitsu, to proactively expand our solution offerings, driving both TRADOM's growth and the advancement of the FinTech industry."

Ken Wakishita, Senior Director at SAKURA internet, said, "Our trial of Fujitsu's AI computing broker has proven the technology's ability to significantly enhance the efficiency of GPU resource allocation within our cloud business, expanding GPU access to a broader customer base. We hope to collaborate with Fujitsu to fully integrate this technology and meet the increasing demand for GPUs."

Hiroshi Fujimura, R&D General Manager at AWL, noted, "We are committed to developing and delivering cutting-edge AI camera solutions that solve various problems and maximise the value of all real-world spaces, particularly retail environments. Meeting the high demands of our clients, optimising GPU operating costs during parallel AI model training is paramount. Our trial proved Fujitsu's AI computing broker's ability to significantly enhance GPU utilisation and AI processing efficiency. We are excited to see further advancements in this important technology."

Naoki Shibata, Founder and CEO of Xtreme-D, remarked, "We congratulate Fujitsu on the launch of the AI computing broker. Xtreme-D provides Raplase, a cloud-based service for AI and HPC clients. A critical challenge for our customers is optimising price/performance through efficient utilisation of costly on-premise and bare-metal cloud GPUs. We are confident that Fujitsu's AI computing broker will significantly address this challenge, and we are actively collaborating with Fujitsu to integrate this solution into our customer offerings."

Masamichi Nakamura, COO, and Hisashi Ito, CTO of Morgenrot, expressed, "Our company is revolutionising the cloud computing landscape with its innovative, decentralised approach leveraging container data centres. We're building a cutting-edge sharing economy model for computing power, perfectly poised to meet the increasing demand for advanced computational resources, including GPUs."

"Our recent trial, with a view to collaborating between our HPC management solution (M:Arthur) and cloud service (Cloud Bouquet) and Fujitsu's AI computing broker technology, yielded impressive results. By enabling GPU sharing between multiple jobs, we achieved a remarkable near 10% reduction in overall execution time, compared to running jobs sequentially on two GPUs."

"This parallel processing capability unlocks significant advantages, allowing simultaneous execution of long training sessions for model building and shorter inference/testing tasks, all within constrained resources. We are excited to explore further usage of Fujitsu's AI computing broker to integrate this transformative technology into our product suite," said Nakamura.