Stay Ahead, Stay ONMINE

Cloud data centers get bigger, denser amid AI building boom

Dive Brief: The number of data centers operated by hyperscale providers increased to 1,136 last year, up from 992 at the end of 2023, according to research published Thursday by Synergy Research Group. The companies with the broadest data center footprint are the leading cloud providers — Amazon, Microsoft and Google. Together, the three now […]

Dive Brief:

  • The number of data centers operated by hyperscale providers increased to 1,136 last year, up from 992 at the end of 2023, according to research published Thursday by Synergy Research Group.
  • The companies with the broadest data center footprint are the leading cloud providers — Amazon, Microsoft and Google. Together, the three now account for 59% of all hyperscale data center capacity, SRG said.
  • “The average size of newly opened data centers has increased recently and will continue to increase, meaning that total hyperscale data center capacity increases even more rapidly than the data center count,” John Dinsdale, SRG chief analyst, said in an email.

Dive Insight:

Growing demand for cloud-based AI services continues to shape the data center landscape, as construction crews break ground on new hyperscaler facilities. A race is on to increase cloud compute capacity. 

Currently, there are more than 500 facilities in the planning and construction phases, according to SRG. AWS, Microsoft and Google have each committed to pouring tens of billions of dollars into capital expenditures, primarily targeting AI buildouts.

SRG expects a reasonably steady addition of roughly 130 to 140 data centers per year moving forward.

New construction is only part of the picture. Capacity will grow faster than the number of projects due to the massive size of planned facilities and increases in compute density.

Nvidia, a key player in architecting AI-optimized chip technologies, unveiled its Blackwell Ultra platform at the GTC Conference in San Jose, California. The processor is designed to power agentic AI capabilities by more than tripling the compute and memory capacity of the prior generation Hopper chips, the company said in a Tuesday announcement.

Large language models are hungry beasts. Model builder OpenAI joined forces with Oracle, SoftBank and MGX to fund the $500 billion AI infrastructure initiative called Stargate in January. Nvidia, Microsoft and Arm are three of the project’s primary technology providers.

“The amount of computation necessary to train those models and to inference those models has grown tremendously,” Nvidia CEO Jensen Huang said during a GTC keynote Tuesday.

Huang previewed Nvidia’s next generation processor Vera Rubin, which combines high-powered CPU and GPU chip technologies. The company is targeting 2026 for its release, Huang said.

Infrastructure technology is advancing rapidly. It took less than four years for total hyperscale data center capacity to double, according to SRG. The firm expects capacity to double again in less than four years.

“We’re also seeing something of a bifurcation in data center scale,” Dinsdale said in the report. “While the core data centers are getting ever bigger, there is also an increasing number of relatively smaller data centers being deployed in order to push infrastructure nearer to customers.”

Oracle is a proponent of a smaller-is-better buildout strategy. The company’s 3% share of the global market for cloud is dwarfed by the towering dominance of AWS, Microsoft and Google Cloud. But Oracle rapidly expanded its cloud coverage from 68 to 101 regions globally last year.

The broader trajectory points in the opposite direction.

“Historically the average size of new data centers was increasing gradually, but this trend has become supercharged in the last few quarters as companies build out AI-oriented infrastructure,” Dinsdale said. “The trend towards increased size is very clear.”

Shape
Shape
Stay Ahead

Explore More Insights

Stay ahead with more perspectives on cutting-edge power, infrastructure, energy,  bitcoin and AI solutions. Explore these articles to uncover strategies and insights shaping the future of industries.

Shape

Ubuntu namespace vulnerability should be addressed quickly: Expert

Thus, “there is little impact of not ‘patching’ the vulnerability,” he said. “Organizations using centralized configuration tools like Ansible may deploy these changes with regularly scheduled maintenance or reboot windows.”  Features supposed to improve security Ironically, last October Ubuntu introduced AppArmor-based features to improve security by reducing the attack surface

Read More »

Google Cloud partners with mLogica to offer mainframe modernization

Other than the partnership with mLogica, Google Cloud also offers a variety of other mainframe migration tools, including Radis and G4 that can be employed to modernize specific applications. Enterprises can also use a combination of migration tools to modernize their mainframe applications. Some of these tools include the Gemini-powered

Read More »

Baker Hughes Expands Margham Gas Storage Project Involvement

Baker Hughes Co. has secured a multi-year contract with Dubai Petroleum Establishment (DPE), on behalf of Dubai Supply Authority (DUSUP), to provide integrated coiled-tubing drilling services for the Margham Gas storage project. The project aims to help ensure stability of energy supply in Dubai by strengthening the system’s ability to switch between natural gas and solar power, Baker Hughes said. Baker Hughes is already providing its Integrated Compressor Line (ICL) units for gas storage, injection, and export. “Baker Hughes has built a reputation as a leader in coiled-tubing drilling and mature assets solutions, and we bring a track record of success across the region to this important project”, Amerino Gatti, executive vice president of Oilfield Services & Equipment at Baker Hughes, said in a statement. “Our integrated solutions approach combines industry-leading technology and expertise across the energy value chain to help DPE scale up and develop reliable, secure, and lower-carbon power solutions for their country”. Baker Hughes will use a combined approach of coiled-tubing drilling and under-balanced drilling, incorporating its CoilTrak BHA system, to enhance underground gas storage projects. The company said the CoilTrak system’s ability to improve horizontal drilling navigation and maximize reservoir contact is essential to these operations. Days earlier Baker Hughes announced a multi-year fully integrated completions systems contract from Petrobras to optimize production across multiple deepwater fields. Baker Hughes said that through this agreement, Petrobras will utilize the SureCONTROL Premium interval control valve, which provides enhanced reliability in the high flow rates of Petrobras’ offshore fields. To contact the author, email [email protected] What do you think? We’d love to hear from you, join the conversation on the Rigzone Energy Network. The Rigzone Energy Network is a new social experience created for you and all energy professionals to Speak Up about our industry, share knowledge, connect with peers

Read More »

Wood shares plunge as report reveals ‘weaknesses and failures’

Wood shares have plummeted further after a review of contracts from prior years identified “material weaknesses and failures” in the financial culture of the Aberdeen-headquartered firm, the company has revealed. The review of a number of “legacy lump sum turnkey” (LSTK) projects means Wood will not be able to file its fully year accounts as planned next month which will result in a temporary suspension of its shares. Wood shares dropped more than 30% in early trading as markets digested the investigation, which the firm commissioned last year. The  publication of the audit comes as the group is subject to fresh buyout approach from Dar Al-Handasah Consultants Shair and Partners, otherwise known as Sidara. The review means the firm has had to seek “retrospective waivers” on debt facilities up to the end of April as the revision of books over the last three years means the firm will have breached lending covenants. Nevertheless, Wood said there would be “no material impact” on its historic cash flow as a result of the review, nor does it “expect any material impact” on its ability to generate cash in the future. Weaknesses and failures The “weaknesses and failures” identified by Deloitte included “inappropriate management pressure” and “over-optimism and/or lack of evidence” in respect of accounting judgements. These “cultural failings” led to instances of information being “inappropriately withheld” and “unreliable information” being provided to Wood’s auditors. Wood said it “remains in discussions” with Lebanese-owned Sidara over possible cash offer for the group. Last year Wood rejected a bid worth $1.65 billion, representing an offer price of 205 pence per Wood share. It is thought any fresh bid from Sidara will be less than this. The bidder has until 17 April to announce a firm intention to make an offer for Wood. In addition to requiring a

Read More »

US Revokes Eni Permit for Gas Produced in Venezuela

Italian energy company Eni said it had been notified by US authorities that it can no longer be repaid for gas that it produces in Venezuela through oil supplies from state-owned PDVSA, as Washington exercises its international sanctions on the South American country.  “Eni continues its transparent engagement with US authorities on the matter to identify options for ensuring that non-sanctioned gas supplies, essential to the population, can be remunerated by PdVSA,” the company said in an emailed statement. “Eni always operates in full compliance with the international sanctions framework.” Foreign oil companies such as Eni and Spain’s Repsol that do a lot of business with the US are trying to not fall out of compliance with US and other international sanctions on Venezuela. The first administration of US President Donald Trump essentially banned US imports of oil from the country in 2019.  In recent years, the US Treasury Department had issued different permits to international oil and gas companies, including licenses, waivers or letters of comfort, to allow them to conduct various operations in Venezuela, such as exporting PDVSA’s oil, despite sanctions. Eni and Repsol had accepted oil cargoes from PDVSA to recoup debt the state-owned oil company owed them from investment in an off-shore gas joint venture Cardon IV and from natural gas sales. Cardon IV supplies around 30 percent of the country’s natural gas demand for both household and industrial needs. Now, Trump is squeezing Venezuela on two fronts as a way to pressure Venezuelan President Nicolas Maduro’s regime to accept the return of more migrants who fled to the US: He’s promising 25 percent tariffs on US imports of all goods from countries that buy Venezuelan oil, and he has also pulled Chevron Corp.’s license to drill and sell the nation’s crude. Other companies are impacted, including Global

Read More »

EnergyPathways pushes to win stakeholder support for MESH

EnergyPathways has published an update as it pushes to engage with stakeholders on its proposed Marram Energy Storage Hub (MESH) project in the UK Irish Sea off the coast of Northwest England. The update outlines the socioeconomic and environmental benefits associated with MESH, with the company winning to win over groups like the North Sea Transition Authority (NSTA) and local MPs. EnergyPathways published the briefing document, outlining the conclusions from its hydrogen and clean energy pre-front end engineering design (pre-FEED) activities. The document also seeks to highlight the role that hydrogen and compressed air storage technologies can play in reducing carbon dioxide (CO2) emissions, in helping to drive the UK energy transition and in enhancing energy security. The MESH project is designed to combine a number of technologies, initially storing natural gas and power generated from offshore wind in the Irish Sea, before being expanded to include hydrogen storage as the UK’s hydrogen economy develops. EnergyPathways moved to expedite the project towards the end of last year, citing changes to the regulatory and fiscal environment in the UK under the Labour government, which came into power in July. The company has touted MESH as a project that could help the UK meet both its energy security and decarbonisation goals. Since then, EnergyPathways has hit various milestones with the development of MESH, including entering into a £5.1m loan facility and selecting Wood as the lead engineering partner. The company also secured licence operatorship approval for Block 110/4a, which includes the MESH site, in January. On schedule and on track In its latest update, EnergyPathways said pre-FEED activities were on schedule and on track for a final investment decision (FID), subject to the necessary outstanding licences being granted. “We have received indications from the government that a decision on awarding the gas

Read More »

The North Sea: A critical crossroads for UK energy and economic future

The North Sea has long been the backbone of Britain’s energy security and economic prosperity. Today, we stand at a pivotal moment that will determine whether this vital asset continues to drive our national success or becomes a missed opportunity. The North Sea Transition Taskforce’s report reveals an urgent challenge: a potentially damaging gap is emerging between the North Sea’s current oil and gas operations and its renewable energy potential. This isn’t just about an industrial transition—it’s a national imperative. The risks are clear. Without decisive action, we could see a premature decline in oil and gas production, loss of critical skills, and degradation of existing infrastructure. Meanwhile, renewable investments are stalling, threatening our net-zero ambitions and economic resilience. We’re not advocating for endless fossil fuel extraction. Instead, we’re calling for a strategic, measured approach that recognises the North Sea’s ongoing importance. Critically, North Sea gas remains lower in carbon intensity than imported alternatives. Every barrel we responsibly extract keeps jobs in the UK, generates exchequer revenues, and supports our energy security. Our recommendations are straightforward. First, the government must replace the current Energy Profits Levy with a predictable, stable fiscal regime that encourages long-term investment. Second, we need clarity on environmental requirements and drilling permissions, particularly for already consented fields. Third, we must commit to a consistent, long-term pipeline of support for renewable investments. Most importantly, this transition requires unprecedented collaboration. We’re proposing a national mission approach, with a ministerially led committee bringing together UK and Scottish governments, agencies, industry, and unions. This isn’t about political point-scoring—it’s about creating a comprehensive, decades-long plan that transcends short-term political cycles. The opportunity is immense. By repurposing existing skills and infrastructure, we can transform the North Sea into a global renewables powerhouse. Offshore wind, carbon capture, and hydrogen technologies aren’t just alternatives—they’re

Read More »

Miliband broaches talks with Centrica to extend Rough beyond 2030

Centrica executives have met with energy secretary Ed Miliband to discuss the future of the Rough gas storage facility in the North Sea. The UK energy company’s group chief executive Christopher O’Shea and the managing director of Centrica Energy Storage Martin Scargill recently attended a meeting with Miliband and others at the Hull Chamber of Commerce. “We’re in discussions with [government] at a high level to find a way to keep Rough open as a key strategic asset for the UK,” O’Shea said. “I can’t go into any details of the discussions but I am hopeful that HMG (Her Majesty’s Government) will be able to move quickly enough to enable this crucial asset to remain open.” He indicated in February that Centrica was yet to decide on a direction for the Rough gas storage site, after the company revealed an anticipated loss at Centrica Energy Storage, stating that “as it currently stands, we wouldn’t be refilling it”. The owner of the country’s largest gas storage facility is seeking to refit the asset as part of a £2 billion refurbishment so that it can function as a hydrogen storage facility. Centrica has said that it is seeking to secure a cap-and-floor mechanism to operate the asset. At the height of the energy crisis, the licence to operate the Rough gas storage facility was renewed, but it is now due to expire in 2030. A spokesperson for the Department for Energy Security and Net Zero (DESNZ) said that the discussions did not go “into detail”, but that the government’s position “remains what it was before”. “We’re not providing updates on what that will look like but we’re having discussions with Centrica about it. Everything’s on the table on what the future would be just as long as it provides value for money,” the

Read More »

Airtel connects India with 100Tbps submarine cable

“Businesses are becoming increasingly global and digital-first, with industries such as financial services, data centers, and social media platforms relying heavily on real-time, uninterrupted data flow,” Sinha added. The 2Africa Pearls submarine cable system spans 45,000 kilometers, involving a consortium of global telecommunications leaders including Bayobab, China Mobile International, Meta, Orange, Telecom Egypt, Vodafone Group, and WIOCC. Alcatel Submarine Networks is responsible for the cable’s manufacturing and installation, the statement added. This cable system is part of a broader global effort to enhance international digital connectivity. Unlike traditional telecommunications infrastructure, the 2Africa Pearls project represents a collaborative approach to solving complex global communication challenges. “The 100 Tbps capacity of the 2Africa Pearls cable significantly surpasses most existing submarine cable systems, positioning India as a key hub for high-speed connectivity between Africa, Europe, and Asia,” said Prabhu Ram, VP for Industry Research Group at CyberMedia Research. According to Sinha, Airtel’s infrastructure now spans “over 400,000 route kilometers across 34+ cables, connecting 50 countries across five continents. This expansive infrastructure ensures businesses and individuals stay seamlessly connected, wherever they are.” Gogia further emphasizes the broader implications, noting, “What also stands out is the partnership behind this — Airtel working with Meta and center3 signals a broader shift. India is no longer just a consumer of global connectivity. We’re finally shaping the routes, not just using them.”

Read More »

Former Arista COO launches NextHop AI for customized networking infrastructure

Sadana argued that unlike traditional networking where an IT person can just plug a cable into a port and it works, AI networking requires intricate, custom solutions. The core challenge is creating highly optimized, efficient networking infrastructure that can support massive AI compute clusters with minimal inefficiencies. How NextHop is looking to change the game for hyperscale networking NextHop AI is working directly alongside its hyperscaler customers to develop and build customized networking solutions. “We are here to build the most efficient AI networking solutions that are out there,” Sadana said. More specifically, Sadana said that NextHop is looking to help hyperscalers in several ways including: Compressing product development cycles: “Companies that are doing things on their own can compress their product development cycle by six to 12 months when they partner with us,” he said. Exploring multiple technological alternatives: Sadana noted that hyperscalers might try and build on their own and will often only be able to explore one or two alternative approaches. With NextHop, Sadana said his company will enable them to explore four to six different alternatives. Achieving incremental efficiency gains: At the massive cloud scale that hyperscalers operate, even an incremental one percent improvement can have an oversized outcome. “You have to make AI clusters as efficient as possible for the world to use all the AI applications at the right cost structure, at the right economics, for this to be successful,” Sadana said. “So we are participating by making that infrastructure layer a lot more efficient for cloud customers, or the hyperscalers, which, in turn, of course, gives the benefits to all of these software companies trying to run AI applications in these cloud companies.” Technical innovations: Beyond traditional networking In terms of what the company is actually building now, NextHop is developing specialized network switches

Read More »

Microsoft abandons data center projects as OpenAI considers its own, hinting at a market shift

A potential ‘oversupply position’ In a new research note, TD Cowan analysts reportedly said that Microsoft has walked away from new data center projects in the US and Europe, purportedly due to an oversupply of compute clusters that power AI. This follows reports from TD Cowen in February that Microsoft had “cancelled leases in the US totaling a couple of hundred megawatts” of data center capacity. The researchers noted that the company’s pullback was a sign of it “potentially being in an oversupply position,” with demand forecasts lowered. OpenAI, for its part, has reportedly discussed purchasing billions of dollars’ worth of data storage hardware and software to increase its computing power and decrease its reliance on hyperscalers. This fits with its planned Stargate Project, a $500 billion, US President Donald Trump-endorsed initiative to build out its AI infrastructure in the US over the next four years. Based on the easing of exclusivity between the two companies, analysts say these moves aren’t surprising. “When looking at storage in the cloud — especially as it relates to use in AI — it is incredibly expensive,” said Matt Kimball, VP and principal analyst for data center compute and storage at Moor Insights & Strategy. “Those expenses climb even higher as the volume of storage and movement of data grows,” he pointed out. “It is only smart for any business to perform a cost analysis of whether storage is better managed in the cloud or on-prem, and moving forward in a direction that delivers the best performance, best security, and best operational efficiency at the lowest cost.”

Read More »

PEAK:AIO adds power, density to AI storage server

There is also the fact that many people working with AI are not IT professionals, such as professors, biochemists, scientists, doctors, clinicians, and they don’t have a traditional enterprise department or a data center. “It’s run by people that wouldn’t really know, nor want to know, what storage is,” he said. While the new AI Data Server is a Dell design, PEAK:AIO has worked with Lenovo, Supermicro, and HPE as well as Dell over the past four years, offering to convert their off the shelf storage servers into hyper fast, very AI-specific, cheap, specific storage servers that work with all the protocols at Nvidia, like NVLink, along with NFS and NVMe over Fabric. It also greatly increased storage capacity by going with 61TB drives from Solidigm. SSDs from the major server vendors typically maxed out at 15TB, according to the vendor. PEAK:AIO competes with VAST, WekaIO, NetApp, Pure Storage and many others in the growing AI workload storage arena. PEAK:AIO’s AI Data Server is available now.

Read More »

SoftBank to buy Ampere for $6.5B, fueling Arm-based server market competition

SoftBank’s announcement suggests Ampere will collaborate with other SBG companies, potentially creating a powerful ecosystem of Arm-based computing solutions. This collaboration could extend to SoftBank’s numerous portfolio companies, including Korean/Japanese web giant LY Corp, ByteDance (TikTok’s parent company), and various AI startups. If SoftBank successfully steers its portfolio companies toward Ampere processors, it could accelerate the shift away from x86 architecture in data centers worldwide. Questions remain about Arm’s server strategy The acquisition, however, raises questions about how SoftBank will balance its investments in both Arm and Ampere, given their potentially competing server CPU strategies. Arm’s recent move to design and sell its own server processors to Meta signaled a major strategic shift that already put it in direct competition with its own customers, including Qualcomm and Nvidia. “In technology licensing where an entity is both provider and competitor, boundaries are typically well-defined without special preferences beyond potential first-mover advantages,” Kawoosa explained. “Arm will likely continue making independent licensing decisions that serve its broader interests rather than favoring Ampere, as the company can’t risk alienating its established high-volume customers.” Industry analysts speculate that SoftBank might position Arm to focus on custom designs for hyperscale customers while allowing Ampere to dominate the market for more standardized server processors. Alternatively, the two companies could be merged or realigned to present a unified strategy against incumbents Intel and AMD. “While Arm currently dominates processor architecture, particularly for energy-efficient designs, the landscape isn’t static,” Kawoosa added. “The semiconductor industry is approaching a potential inflection point, and we may witness fundamental disruptions in the next 3-5 years — similar to how OpenAI transformed the AI landscape. SoftBank appears to be maximizing its Arm investments while preparing for this coming paradigm shift in processor architecture.”

Read More »

Nvidia, xAI and two energy giants join genAI infrastructure initiative

The new AIP members will “further strengthen the partnership’s technology leadership as the platform seeks to invest in new and expanded AI infrastructure. Nvidia will also continue in its role as a technical advisor to AIP, leveraging its expertise in accelerated computing and AI factories to inform the deployment of next-generation AI data center infrastructure,” the group’s statement said. “Additionally, GE Vernova and NextEra Energy have agreed to collaborate with AIP to accelerate the scaling of critical and diverse energy solutions for AI data centers. GE Vernova will also work with AIP and its partners on supply chain planning and in delivering innovative and high efficiency energy solutions.” The group claimed, without offering any specifics, that it “has attracted significant capital and partner interest since its inception in September 2024, highlighting the growing demand for AI-ready data centers and power solutions.” The statement said the group will try to raise “$30 billion in capital from investors, asset owners, and corporations, which in turn will mobilize up to $100 billion in total investment potential when including debt financing.” Forrester’s Nguyen also noted that the influence of two of the new members — xAI, owned by Elon Musk, along with Nvidia — could easily help with fundraising. Musk “with his connections, he does not make small quiet moves,” Nguyen said. “As for Nvidia, they are the face of AI. Everything they do attracts attention.” Info-Tech’s Bickley said that the astronomical dollars involved in genAI investments is mind-boggling. And yet even more investment is needed — a lot more.

Read More »

Microsoft will invest $80B in AI data centers in fiscal 2025

And Microsoft isn’t the only one that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs).  In a report published in October 2024, Bloomberg Intelligence estimated that demand for generative AI would push Microsoft, AWS, Google, Oracle, Meta, and Apple would between them devote $200 billion to capex in 2025, up from $110 billion in 2023. Microsoft is one of the biggest spenders, followed closely by Google and AWS, Bloomberg Intelligence said. Its estimate of Microsoft’s capital spending on AI, at $62.4 billion for calendar 2025, is lower than Smith’s claim that the company will invest $80 billion in the fiscal year to June 30, 2025. Both figures, though, are way higher than Microsoft’s 2020 capital expenditure of “just” $17.6 billion. The majority of the increased spending is tied to cloud services and the expansion of AI infrastructure needed to provide compute capacity for OpenAI workloads. Separately, last October Amazon CEO Andy Jassy said his company planned total capex spend of $75 billion in 2024 and even more in 2025, with much of it going to AWS, its cloud computing division.

Read More »

John Deere unveils more autonomous farm machines to address skill labor shortage

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Self-driving tractors might be the path to self-driving cars. John Deere has revealed a new line of autonomous machines and tech across agriculture, construction and commercial landscaping. The Moline, Illinois-based John Deere has been in business for 187 years, yet it’s been a regular as a non-tech company showing off technology at the big tech trade show in Las Vegas and is back at CES 2025 with more autonomous tractors and other vehicles. This is not something we usually cover, but John Deere has a lot of data that is interesting in the big picture of tech. The message from the company is that there aren’t enough skilled farm laborers to do the work that its customers need. It’s been a challenge for most of the last two decades, said Jahmy Hindman, CTO at John Deere, in a briefing. Much of the tech will come this fall and after that. He noted that the average farmer in the U.S. is over 58 and works 12 to 18 hours a day to grow food for us. And he said the American Farm Bureau Federation estimates there are roughly 2.4 million farm jobs that need to be filled annually; and the agricultural work force continues to shrink. (This is my hint to the anti-immigration crowd). John Deere’s autonomous 9RX Tractor. Farmers can oversee it using an app. While each of these industries experiences their own set of challenges, a commonality across all is skilled labor availability. In construction, about 80% percent of contractors struggle to find skilled labor. And in commercial landscaping, 86% of landscaping business owners can’t find labor to fill open positions, he said. “They have to figure out how to do

Read More »

2025 playbook for enterprise AI success, from agents to evals

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More 2025 is poised to be a pivotal year for enterprise AI. The past year has seen rapid innovation, and this year will see the same. This has made it more critical than ever to revisit your AI strategy to stay competitive and create value for your customers. From scaling AI agents to optimizing costs, here are the five critical areas enterprises should prioritize for their AI strategy this year. 1. Agents: the next generation of automation AI agents are no longer theoretical. In 2025, they’re indispensable tools for enterprises looking to streamline operations and enhance customer interactions. Unlike traditional software, agents powered by large language models (LLMs) can make nuanced decisions, navigate complex multi-step tasks, and integrate seamlessly with tools and APIs. At the start of 2024, agents were not ready for prime time, making frustrating mistakes like hallucinating URLs. They started getting better as frontier large language models themselves improved. “Let me put it this way,” said Sam Witteveen, cofounder of Red Dragon, a company that develops agents for companies, and that recently reviewed the 48 agents it built last year. “Interestingly, the ones that we built at the start of the year, a lot of those worked way better at the end of the year just because the models got better.” Witteveen shared this in the video podcast we filmed to discuss these five big trends in detail. Models are getting better and hallucinating less, and they’re also being trained to do agentic tasks. Another feature that the model providers are researching is a way to use the LLM as a judge, and as models get cheaper (something we’ll cover below), companies can use three or more models to

Read More »

OpenAI’s red teaming innovations define new essentials for security leaders in the AI era

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams’ advanced capabilities in two areas: multi-step reinforcement and external red teaming. OpenAI recently released two papers that set a new competitive standard for improving the quality, reliability and safety of AI models in these two techniques and more. The first paper, “OpenAI’s Approach to External Red Teaming for AI Models and Systems,” reports that specialized teams outside the company have proven effective in uncovering vulnerabilities that might otherwise have made it into a released model because in-house testing techniques may have missed them. In the second paper, “Diverse and Effective Red Teaming with Auto-Generated Rewards and Multi-Step Reinforcement Learning,” OpenAI introduces an automated framework that relies on iterative reinforcement learning to generate a broad spectrum of novel, wide-ranging attacks. Going all-in on red teaming pays practical, competitive dividends It’s encouraging to see competitive intensity in red teaming growing among AI companies. When Anthropic released its AI red team guidelines in June of last year, it joined AI providers including Google, Microsoft, Nvidia, OpenAI, and even the U.S.’s National Institute of Standards and Technology (NIST), which all had released red teaming frameworks. Investing heavily in red teaming yields tangible benefits for security leaders in any organization. OpenAI’s paper on external red teaming provides a detailed analysis of how the company strives to create specialized external teams that include cybersecurity and subject matter experts. The goal is to see if knowledgeable external teams can defeat models’ security perimeters and find gaps in their security, biases and controls that prompt-based testing couldn’t find. What makes OpenAI’s recent papers noteworthy is how well they define using human-in-the-middle

Read More »