On October 31, 2024, OpenAI postponed new AI models due to computational issues, but compensated by launching SearchGPT. This AI generative search engine can ingest the latest information from the web.

Search GPT is a new feature in ChatGPT that directly challenges industry giants like Google and Microsoft Bing with real-time search capabilities that merge the conversational AI experience with web browsing.

Our discussion begins with insights from OpenAI’s recent Reddit AMA, which focused on the delays and progress of AI models such as GPT-5, SORA, and other reasoning models. Subsequently, we will analyze the introduction of Search GPT, exploring its main characteristics, its strategic implications for the AI ​​market and the legal challenges it faces.

AMA Session Preview: OpenAI Faces Compute Delays

During a Reddit AMA session on October 31, 2024, OpenAI CEO Sam Altman addressed ongoing challenges and delays in the development of the company’s next-generation AI models. Altman candidly discussed the IT constraints that have slowed the deployment of new technologies, saying, “All of these models have become quite complex,” making it difficult to efficiently distribute IT resources across multiple projects.

Altman revealed that planned launches of major updates, including the next iteration of DALL-E and AI video generation tool Sora, are being postponed without a firm release date. He stressed that DALL-E’s next update “will be worth the wait,” highlighting ongoing efforts to improve AI capabilities despite setbacks.

Further detailing the computational hurdles, Altman noted: “We face many limitations and difficult decisions about how we allocate our compute for many big ideas. » This issue notably affected the advancement of OpenAI’s realistic-sounding conversational feature, Advanced Voice Mode, which lacks the vision capabilities initially announced earlier in the year. Due to the limited capacity, Altman said these vision capabilities, first demonstrated in April when the ChatGPT app responded to visual cues such as clothing in a smartphone’s camera view, do not wouldn’t happen anytime soon. This delay is due to the continued improvements needed in the security and scalability of the technology.

During the session, Kevin Weil, OpenAI’s Chief Product Officer, also commented on the status of Sora, explaining that the tool still needs further refinement, especially regarding security and spoofing issues. , before a broader version can be considered. Sora reportedly suffered from technical issues, as the original system revealed in February that it took over 10 minutes to generate a one-minute video clip. These challenges position it poorly against competing systems from companies like Luma and Runway.

Facing infrastructure challenges, Reuters reports indicate that OpenAI has struggled to secure enough compute infrastructure to support its ambitious plans. The company has been working with Broadcom for months on an AI chip to improve the model’s performance, which is expected to be ready by 2026.

In response to questions about the highly anticipated GPT-5, Altman responded that while there were “some really good releases coming later this year,” he also clarified that “nothing that we’re going to call GPT-5.” 5, however.” For now, OpenAI appears to be focused on improving existing models rather than releasing new model numbers.

Altman also mentioned that OpenAI was considering the possibility of “one day” allowing “NSFW” content in ChatGPT, emphasizing the company’s belief in “treating adult users like adults.” The company’s top priority remains improving its o1 series of “reasoning” models and their successors, with features previewed at OpenAI’s DevDay conference in London, including advances in understanding pictures.

Detailed overview of OpenAI’s SearchGPT functionality

With the Reddit AMA session, OpenAI launched Search GPT, the AI-powered search engine seamlessly integrated with ChatGPT. It allows the chatbot to access and relay information in real time from the Internet, thereby meeting the immediate information needs of its users. Unlike other search engines, Search GPT combines the conversational nature of AI with web browsing to provide a streamlined experience, free of ad clutter.

Functional capabilities and integrations

Search GPT goes beyond a typical update and completely changes the way ChatGPT interacts with data. The feature makes it easy to directly access web content, including weather updates, stock trends, sports scores and breaking news. OpenAI has established partnerships with leading media outlets such as Le Monde in France, Axel Springer in Germany and the Financial Times in the UK, ensuring that the information provided is accurate and relevant.

In a detailed pre-launch demo, Adam Fry, head of OpenAI’s ChatGPT research initiative, demonstrated the new functionality by searching Apple’s stock market information. The chatbot displayed an interactive stock chart, detailed upcoming earnings and relevant news articles with clickable links, showcasing the interactive and detailed nature of Search GPT. Another demo featured a search for local Italian restaurants in San Francisco, which resulted in an interactive map identifying various recommendations, demonstrating the user-friendly and engaging aspect of the search results.

Technical and ethical considerations

This enhanced search capability is powered by a mix of advanced technologies, including Microsoft Bing. The underlying model, a refined version of GPT-4o, was rigorously tested with 10,000 users under the prototype name SearchGPT before full integration.

A notable advancement of Search GPT is its ability to significantly improve factual accuracy by extracting the latest available information, which is crucial especially in the critical period leading up to the US presidential election.

OpenAI CEO Sam Altman expressed his excitement for the new feature on social media platforms, telling X (formerly Twitter) that it was his “favorite feature we’ve launched” since the beginning of ChatGPT in 2022. He highlighted the efficiency and ease of access. information through Search GPT, reflecting on its potential to transform information accessibility.

Content management and legal considerations

The search feature allows users to enable it by default or manually via a web search icon, providing flexibility in how information is accessed. OpenAI also allows any website or publisher to choose to appear in ChatGPT’s search results, actively seeking feedback to further refine the system. This proactive approach to content management is essential as OpenAI navigates a complex legal landscape, where it faces lawsuits from entities such as News Corp and the New York Times for alleged violations of the copyright.

OpenAI is committed to addressing these challenges responsibly, with a focus on media partnerships to ensure content is used ethically. Adam Fry noted that despite the potential for inaccuracies (“hallucinations”), the new search functionality would likely increase overall factual accuracy through its access to up-to-date information.

Financial and operational implications

Despite the absence of advertising, which differentiates Search GPT from competitors like Google Search, maintaining such an AI-powered search tool is inherently more expensive. OpenAI spokesperson Niko Felix said that while they are still trying to figure things out, they will try to balance the costs by imposing some limits on free users.

With the introduction of Search GPT, the field of AI-powered web search is now more competitive than ever. While this new feature puts OpenAI in direct competition with giants like Google, it will also increase the company’s IT needs and expenses. Going forward, it will be essential for OpenAI to respond effectively to these increased demands to ensure the long-term viability of this ambitious project.