Training advanced AI models like OpenAI’s ChatGPT and Google’s Gemini Ultra requires millions of dollars, with costs escalating rapidly. As computational demands increase, the expenses for the computing power necessary to train them are soaring. In response, AI companies are rethinking how they train generative AI systems. In many cases, these include strategies to reduce computational costs given current growth trajectories. As Visual Capitalist’s Dorothy Neufeld shows in the following graphic, based on analysis from Stanford University’s 2024 Artificial Intelligence Index Report, the training costs for advanced AI models has surged. How Training Cost is Determined The AI Index collaborated with research firm Epoch AI to estimate AI model training costs, which were based on cloud compute rental prices. Key factors that were analyzed include the model’s training duration, the hardware’s utilization rate, and the value of the training hardware. While many have speculated that training AI models has become increasingly costly, there is a lack of comprehensive data supporting these claims. The AI Index is one of the rare sources for these estimates. Ballooning Training Costs Below, we show the training cost of major AI models, adjusted for inflation, since 2017: Last year, OpenAI’s GPT-4 cost an estimated $78.4 million to train, a steep rise from Google’s PaLM (540B) model, […]

Google’s long-standing supremacy in the search engine arena may soon be challenged as OpenAI, boosted by its partnership with Microsoft, is reportedly stepping up to launch its own AI-driven search product. According to two sources familiar with the matter who spoke to Reuters, OpenAI is scheduled to unveil its AI-powered search tool on Monday. The introduction of this product coincides closely with the timing of Google’s annual I/O conference, which starts on Tuesday and is anticipated to feature several AI-related announcements. While Google remains a titan in search, it too has been adapting to incorporate AI more deeply into its functionalities. Google began trialing AI-powered search summaries in the US over a year ago and expanded testing to selected, signed-in UK users last month. The potential entry of OpenAI into the search engine market adds a new layer of competition not only for Google, but also for other entities like Perplexity. This week, Perplexity announced a partnership with SoundHound to enhance voice assistants for IoT devices with its AI-powered search capabilities. OpenAI, heavily supported by Microsoft, seems to be banking on the intersection of AI and search engine technology to carve out its niche. Microsoft previously integrated OpenAI’s AI capabilities into its Bing search […]