Stay Ahead, Stay ONMINE

PJM Moves to Redefine Behind-the-Meter Power for AI Data Centers

PJM Interconnection is moving to rewrite how behind-the-meter power is treated across its grid, signaling a major shift as AI-scale data centers push electricity demand into territory the current regulatory framework was never designed to handle. For years, PJM’s retail behind-the-meter generation rules allowed customers with onsite generation to “net” their load, reducing the amount […]

PJM Interconnection is moving to rewrite how behind-the-meter power is treated across its grid, signaling a major shift as AI-scale data centers push electricity demand into territory the current regulatory framework was never designed to handle.

For years, PJM’s retail behind-the-meter generation rules allowed customers with onsite generation to “net” their load, reducing the amount of demand counted for transmission and other grid-related charges. The framework dates back to 2004, when behind-the-meter generation was typically associated with smaller industrial facilities or campus-style energy systems.

PJM now argues that those assumptions no longer hold. The arrival of very large co-located loads, particularly hyperscale and AI data centers seeking hundreds of megawatts of power on accelerated timelines, has exposed gaps in how the system accounts for and plans around those facilities.

In February 2026, PJM asked the Federal Energy Regulatory Commission to approve a tariff rewrite that would sharply limit how new large loads can rely on legacy netting rules. The move reflects a broader challenge facing grid operators as the rapid expansion of AI infrastructure begins to collide with planning frameworks built for a far slower era of demand growth.

The proposal follows directly from a December 18, 2025 order from FERC finding that PJM’s existing tariff was “unjust and unreasonable” because it lacked clear rates, terms, and conditions governing co-location arrangements between large loads and generating facilities.

Rather than prohibiting co-location, the commission directed PJM to create transparent rules allowing data centers and other large consumers to pair with generation while still protecting system reliability and other ratepayers. In essence, FERC told PJM not to shut the door on these arrangements, but to stop improvising and build a formal framework capable of supporting them.

Why Behind-the-Meter Power Matters

Behind-the-meter arrangements have become one of the most attractive strategies for hyperscale and AI data center developers seeking to bypass grid bottlenecks. Across the PJM Interconnection footprint, particularly in Northern Virginia and other Mid-Atlantic markets, the queue for new grid service has become a strategic constraint.

Developers are trying to energize multi-hundred-megawatt campuses on accelerated timelines, while utilities and regional planners face transmission limits, slow generation additions, and growing debate over who should bear the cost of serving massive new loads. Those tensions have increasingly drawn the attention of regulators, policymakers, and consumer advocates.

PJM’s Board acknowledged in January 2026 that data centers account for a substantial share of forecast large-load additions and that their scale and speed are unlike anything the system has previously experienced. At the same time, PJM has made clear it does not intend to slow that growth. Instead, it wants the data center sector to participate more directly in addressing the reliability and affordability challenges its demand is creating.

At the center of the debate is the original purpose of behind-the-meter generation. PJM argues the framework was designed for relatively small industrial or campus-style systems and not for giant single-point loads sitting behind power plants.

Under existing rules, behind-the-meter generation allows a facility to net its load against its generation, which can leave large co-located loads effectively outside PJM’s planning assumptions. In materials presented at the May 2025 PJM Large Load Additions Workshop, PJM stated bluntly that “large load behind generation was not intended” under the current rules. The workshop also warned that such configurations may not be fully captured in forward-looking planning models, and in some cases may not even be fully visible to PJM if the generation is classified as retail rather than a PJM resource.

The concern is not theoretical. In testimony submitted to the Federal Energy Regulatory Commission in late 2024, PJM Chief Operating Officer Stu Bresler argued that co-located behind-the-meter loads are effectively excluded from PJM’s load forecasts. Electrically, they sit behind a generator, but the system’s planning models do not treat them as load the broader grid must ultimately be prepared to serve.

That disconnect creates a potential reliability risk. If a co-located generator fails or retires, the regional grid may suddenly be expected to supply a large load it was never planned to support. Bresler’s argument is not that such arrangements are impossible, but that the current framework creates a mismatch between physical reality, system planning obligations, and the political expectations that emerge once a major facility is operating.

In the era of AI-scale infrastructure, PJM argues, those mismatches become increasingly difficult to manage. For grid planners, the concern is simple. A data center sitting behind a power plant may appear invisible in the planning models … until the day the grid is expected to supply it.

Proposed 50 MW Threshold

PJM Interconnection’s February 2026 filing attempts to resolve the planning mismatch by drawing a clear line between traditional behind-the-meter generation and the new scale of data center demand.

The most consequential element is a proposed 50 MW threshold. Under the filing, new behind-the-meter loads larger than 50 MW would no longer qualify for the legacy netting treatment that allows customers to offset load with onsite generation.

PJM proposes a three-year transition period, and existing behind-the-meter arrangements would be grandfathered for the life of their contracts. Backup generation would not count toward the threshold. In practical terms, the rule is aimed squarely at the emerging class of mega-loads rather than smaller industrial or campus-style systems.

For data center developers, the change is significant. Netting has been attractive because it reduces the amount of load that appears on the transmission system, lowering exposure to certain grid-related charges. PJM now wants to reserve that treatment for smaller facilities while pushing large new loads into explicit transmission-service categories.

Alongside the filing, PJM proposed three new service constructs for co-located loads:

  • Interim Network Integration Transmission Service

  • Firm Contract Demand Transmission Service

  • Non-Firm Contract Demand Transmission Service

The rates and detailed terms for those services will be addressed in a subsequent filing, but the intent is already clear. PJM wants co-located data centers to move out of the gray zone between “on-system” and “off-system” status and instead select a defined service model with corresponding obligations and costs.

The proposal goes well beyond billing mechanics. It is part of PJM’s broader 2026 strategy for managing the surge of large-load development. In January, the PJM Board outlined a six-part framework that includes improved load forecasting, a larger role for state regulators, pathways for large loads to bring their own generation, a “connect-and-manage” model that allows earlier grid access with potential curtailment risk, an accelerated interconnection track for some resources, and a backstop procurement process to address near-term reliability gaps.

The underlying message to the market is plain. The legacy framework cannot accommodate a wave of multi-hundred-megawatt data centers arriving faster than the grid can add generation and transmission. Under PJM’s proposed rules, large loads will increasingly need to bring supply with them, accept operational limits, or pay more directly for the grid services they require.

In effect, PJM is signaling that AI-scale infrastructure can no longer rely on regulatory ambiguity to secure power access. For the next generation of AI campuses, access to power may depend less on proximity to generation and more on how transparently the load participates in the grid.

The Politics of Behind-the-Meter Power

The broader architecture PJM is proposing matters not only for grid planning but also for the politics surrounding large data center development.

For years, behind-the-meter arrangements were often presented as a way for data centers to reduce strain on the grid by supplying some of their own power. PJM’s recent posture is more cautious. While proximity to generation can offer operational benefits, PJM now argues that physical location alone does not resolve the system-level obligations created by very large loads.

A facility may sit next to a power plant, but it can still create planning, reliability, and cost-allocation challenges if the arrangement allows it to avoid paying for transmission infrastructure while remaining dependent on the broader grid when outages or operational disruptions occur.

Those concerns came into sharper focus during the high-profile dispute over a proposed arrangement between Amazon Web Services and Talen Energy involving co-located data center load at the Susquehanna nuclear facility in Pennsylvania. The Federal Energy Regulatory Commission rejected an amended interconnection service agreement that would have expanded behind-the-meter power use for the data center, citing concerns about reliability and potential cost impacts on other customers.

For regulators, the case became a clear illustration of the risks associated with large co-location arrangements. PJM’s latest filing can be interpreted as an effort to prevent future disputes of that kind from being resolved one project at a time.

At the same time, the proposed reforms are generating pushback from other industrial energy users. Trade groups such as the Industrial Energy Consumers of America and the PJM Industrial Customer Coalition argue that the changes could undermine the economics of long-standing behind-the-meter operations at manufacturing facilities.

Industry advocates warn that stricter treatment of co-located loads could make hundreds of megawatts of existing or planned industrial behind-the-meter generation uneconomic, particularly for combined heat and power systems that have historically relied on the netting framework.

That tension helps explain why PJM chose a 50 MW threshold and a transition period rather than eliminating behind-the-meter netting altogether. The filing appears designed to preserve the traditional framework for smaller facilities while separating very large data center loads from a tariff structure PJM believes was never intended to support them.

What This Means for Large-Scale Data Center Development

For developers of AI-scale campuses, the commercial implications are substantial. PJM’s broader large-load strategy effectively pushes the market toward two emerging models.

Bring Your Own Generation (BYOG).
Under this approach, a data center developer or a utility partner arranges new generation to arrive with the load. PJM’s Board explicitly endorsed voluntary BYOG and directed staff to develop an expedited interconnection track for projects that bring new supply online alongside large loads as a way to mitigate curtailment risk.

Connect-and-Manage.
Under this framework, a large load gains grid access more quickly but accepts the possibility of curtailment during stressed system conditions.

Both models are more explicit (and likely more expensive) than relying on legacy behind-the-meter netting rules. Analysts say PJM’s plan could accelerate direct partnerships between data center developers and independent power producers.

According to reporting by Reuters, the package could encourage more private pairings between large loads and new generation because the alternative may involve a more constrained and potentially more costly path through the regional grid framework. In the near term, that dynamic could favor gas-fired generation, which remains one of the few dispatchable resources capable of being deployed quickly at the scale the market is demanding, even as nuclear, storage, and other technologies remain part of the longer-term supply mix.

Redefining Behind-the-Meter Power in the AI Era

At a deeper level, PJM is attempting to redefine what “behind the meter” means in an era of AI-scale infrastructure.

Historically, the term implied a relatively simple arrangement: onsite generation supplying a facility that had limited dependence on the broader grid. PJM now argues those assumptions break down when the load in question is a 200 MW, 500 MW, or even 1 GW data center campus.

At that scale, a facility sitting behind a generator is no longer just a customer with onsite power. It becomes a regional planning issue, a capacity issue, a transmission issue, and potentially a political issue if the arrangement fails and the grid is expected to step in.

Previous tariff structures often obscured that reality. PJM’s new proposal attempts to force it into the open.

When the Federal Energy Regulatory Commission evaluates the filing, it will need to balance three competing priorities:

  1. Enabling faster interconnection for large loads and supporting economic growth.

  2. Protecting existing ratepayers from subsidizing bespoke power arrangements for the largest new customers on the grid.

  3. Preserving legitimate industrial behind-the-meter models that have long supported manufacturing and combined heat-and-power systems.

PJM’s proposal attempts to thread that needle by grandfathering existing arrangements, carving out smaller facilities, and pairing behind-the-meter reforms with new transmission service options and a broader large-load integration strategy.

This is not a minor tariff adjustment. It is one of the clearest signals yet that regional grid operators are moving from reacting to data center growth to structurally redesigning market rules around it.

For developers, the message is increasingly obvious. Securing fast access to power will no longer be as simple as locating next to a generator and labeling the arrangement “behind the meter.”

Large loads will increasingly need to demonstrate how they are supplying power, what level of grid service they expect, what curtailment risk they are willing to accept, and how the costs of those choices will be allocated.

In the PJM region, home to the largest concentration of data center development in the world, that represents a major shift. It may also become a template for how other markets respond as AI infrastructure collides with power systems that were never designed for the speed or scale of this new demand.

In the emerging gigawatt era of digital infrastructure, the question is no longer whether power can be found. The question is how transparently and at what cost the grid is expected to support it.

Shape
Shape
Stay Ahead

Explore More Insights

Stay ahead with more perspectives on cutting-edge power, infrastructure, energy,  bitcoin and AI solutions. Explore these articles to uncover strategies and insights shaping the future of industries.

Shape

FortiBleed campaign exposes 75,000 Fortinet firewalls worldwide

“Attribution is ongoing, but the operational fingerprints are clear,” SOCRadar researchers said in a blog post, adding that the tooling and targeting choices are consistent with Russian-speaking threat actors. According to independent analyses, including by SOCRadar, Hudson Rock, and security researcher Kevin Beaumont, the threat actors systematically collected configuration files from

Read More »

Cisco: AI growth is exposing campus network limits

“Usually, networks are designed for consistent traffic, like SaaS and CRM traffic, and there aren’t a lot of unpredictable traffic patterns,” said the head of AI strategy for global IT and network engineering operations at a large U.S. technology company who participated in the research. “Suddenly, three AI agents are

Read More »

AMD acquires MEXT to add predictive memory optimization to its AI stack

Gogia said predictive memory tiering addresses inefficiencies that often leave expensive DRAM underutilized, but cautioned that optimization should complement, rather than replace, sound infrastructure design. “Predictive tiering attacks the waste inside that reflex,” he said, referring to the tendency to address performance challenges by purchasing more memory instead of improving

Read More »

Trump Administration Keeps Indiana Coal Plants Open to Ensure Grid Reliability and Minimize Electricity Costs

WASHINGTON—U.S. Secretary of Energy Chris Wright today issued emergency orders to keep two Indiana coal plants operational to ensure Americans in the Midwest region of the United States have continued access to affordable, reliable, and secure electricity. The orders direct the Northern Indiana Public Service Company (NIPSCO), CenterPoint Energy, and the Midcontinent Independent System Operator, Inc. (MISO) to take all measures necessary to ensure specified generation units at both the R.M. Schahfer and F.B. Culley generating stations in Indiana are available to operate. Certain generation units at the coal plants were scheduled to shut down at the end of 2025. The orders will minimize electricity costs and the risk of unnecessary blackouts for the American people. Since the Department of Energy’s (DOE) original orders were issued on December 23, 2025, the coal plants have proven critical to MISO’s operations, operating during periods of high energy demand and low levels of intermittent energy production, including during Winter Storm Fern.   “Taking reliable generation off the grid compromises energy reliability and needlessly raises energy costs for Americans,” said Energy Secretary Wright. “During peak summer demand, Midwesterners deserve continued access to affordable, reliable, and secure energy to power and cool their homes.” Thanks to President Trump’s leadership, coal plants across the country are being saved from premature retirement and reversing plans to shut down. In 2025, more than 17 gigawatts of coal-power electricity generation were saved. As outlined in DOE’s Resource Adequacy Report, power outages could increase by 100 times by 2030 if the U.S. continues to take reliable power offline. The emergency conditions that led to the issuance of the original orders persist.   MISO’s service area continues to face emergency conditions both in the near and long term. The North American Electric Reliability Corporation (NERC) cautioned in its 2025 Long-Term Reliability Assessment that, “projected resource additions do not keep

Read More »

The Department of Energy Applauds FERC’s Action on Large Load Interconnection Reform

WASHINGTON—U.S. Secretary of Energy Chris Wright and Deputy Secretary of Energy James P. Danly issued the following statements after the Federal Energy Regulatory Commission’s (FERC or Commission) actions at its open meeting today. The Commission announced parallel show cause orders under section 206 of the Federal Power Act, directing each of the six regional grid operators under its jurisdiction to justify or reform tariffs for data centers and other large energy users. The action aims to deliver the speed-to-power that is critical to supporting American innovation and national security while protecting ratepayers in response to the large load interconnection proceeding initiated at the direction of Secretary Wright. “Thanks to President Trump, America is entering a period of unprecedented electricity demand driven by manufacturing, innovation, and economic growth. Meeting that demand requires building more energy infrastructure and bringing new power online faster,” said Energy Secretary Wright. “This Administration is working to remove barriers, accelerate development, and ensure America has the affordable, reliable, and secure energy needed to power a new era of prosperity while delivering on President Trump’s Ratepayer Protection Pledge.” “FERC’s announcement today demonstrates Chairman Swett’s commitment to addressing Secretary Wright’s directive and delivering on President Trump’s goal of American energy dominance while maintaining affordability, reliability, and flexibility,” said Deputy Secretary Danly. “Today’s action is an important step toward improving interconnection processes, supporting flexible load and generation arrangements, and accelerating the addition of new generation. By increasing transparency and preventing unjust cost shifts onto existing customers, these reforms advance President Trump’s Ratepayer Protection Pledge while ensuring Americans continue to have access to affordable, reliable, and secure electricity.”

Read More »

Department of Energy Celebrates Second Advanced Reactor Achieving Criticality

WASHINGTON—The U.S. Department of Energy (DOE) today celebrated another historic milestone in America’s nuclear renaissance. DOE Reactor Pilot Program participant Valar Atomics’ advanced reactor design, Ward 250, successfully completed a zero-power fueled criticality demonstration. The experiment took place at the Utah San Rafael Energy Lab in Emery County, Utah, and marks the first DOE authorized reactor built outside of a national laboratory. “Today marks another historic moment for America’s nuclear renaissance,” said U.S. Energy Secretary Chris Wright. “From the first-ever airlift of a small reactor aboard a U.S. military C-17 to successful zero-power criticality testing, Valar Atomics is delivering achievements that mark a revolutionary moment for advanced nuclear in this country. The Trump administration is proud to support the rebirth of America’s nuclear industry, ensuring Americans have access to affordable, reliable and secure energy for generations to come.” Ward 250 is the second of multiple advanced reactors anticipated to go critical by the July 4th deadline set by President Trump in his May 2025 executive order. Criticality demonstrates that Ward 250 can sustain a controlled nuclear chain reaction, which must be achieved before the reactor can generate power. Earlier this month, Antares Nuclear’s Mark-0 reactor achieved criticality at Idaho National Laboratory. “Nine months ago, this was an empty site. Today, there’s a critical reactor on it, built and operated by the Valar team,” said Isaiah Taylor, Founder & CEO of Valar Atomics. “We met the milestone the executive order set. This reactor was built to make power, and that’s exactly where we’re headed. I’m grateful to the Department of Energy, the State of Utah, the local community, and the many people who got us here.” The Department’s Reactor Pilot Program has catalyzed rapid innovation and progress in furthering American advanced reactor designs. The Reactor Pilot Program leverages DOE authorization to

Read More »

Save the Date for AFFO’s 2027 Peer Review Meeting

The U.S. Department of Energy’s (DOE’s) Alternative Fuels and Feedstocks Office (AFFO) will hold its 2027 Peer Review Meeting (PRM) the week of April 19, 2027.  The PRM will evaluate office-funded projects for their contributions to DOE’s goals and provide an opportunity for National Lab experts, industry stakeholders, and DOE staff to exchange ideas on cutting-edge technologies to advance key priorities in the production and use of domestic feedstocks, fuels, and chemicals.  The 2027 PRM will be the first such meeting to review AFFO-funded projects since the DOE reorganization earlier this year, which established the Office of Critical Minerals and Energy Innovation (CMEI). That reorganization also established AFFO, within CMEI, bringing together existing portfolios of research, development, and demonstration in hydrogen and bioenergy technologies. This united portfolio aims to mobilize America’s abundant potential for biomass and hydrogen, and provide additional fuels, chemicals, and materials that will enable affordable and reliable energy choices for businesses and consumers.     The event will be hosted in Arlington, Virginia. Additional details and registration information will be posted on the 2027 AFFO PRM webpage.

Read More »

MRV lets EPCIC contract for Coral North FLNG project

Mozambique Rovuma Venture (MRV) SpA  has let an engineering, procurement, construction, installation, and commissioning (EPCIC) contract to Technip Energies, in partnership with JGC and Samsung Heavy Industries, for the Coral North FLNG project offshore Mozambique. Under the contract, JGC France and Technip Energies, through their joint venture, will be primarily responsible for the engineering and procurement of the FLNG topside infrastructure as well as overall project management. Samsung Heavy Industries will undertake the engineering, procurement, and construction of the FLNG hull and the fabrication of the topside modules. The Coral North project includes construction of a new FLNG vessel with a production capacity of about 3.6 million tonnes/year (tpy). The vessel will be installed in Coral gas field, about 50 km offshore northern Mozambique. Coral North is designed as an enhanced replica of Coral Sul, the first development in Mozambique’s Area 4 offshore gas block, and is expected to double Coral hub’s capacity to 7 million tpy.  Coral FLNG SA is a special-purpose entity incorporated by Area 4 partners Eni SPA (operator), China National Petroleum Corp. (CNPC), Empresa Nacional de Hidrocarbonetos (ENH), Galp Energia SGPS SA, and Korea Gas Corp. (KOGAS).

Read More »

EIA forecasts prolonged oil market tightening amid Hormuz shipping disruptions

In its June 2026 Short-Term Energy Outlook (STEO), the US Energy Information Administration (EIA) assumes the Strait of Hormuz will remain effectively closed in the near term, with oil shipments resuming in third–quarter 2026. The agency expects it will take until early 2027 for traffic through the waterway to return to pre-conflict levels. Some Middle East oil production is expected to remain disrupted beyond the forecast period. Global oil producers in the Middle East reduced crude oil production by more than 11 million b/d in May compared with pre-conflict levels because of limited shipping traffic through the strait. EIA estimates production shut-ins averaged 11.3 million b/d in May and forecasts disruptions of 11.34 million b/d in June before easing to 10.11 million b/d in the third quarter and 5.70 million b/d in the fourth quarter. Stay updated on oil price volatility, shipping disruptions, LNG market analysis, and production output at OGJ’s Iran war content hub. As a result, EIA expects global oil inventories to fall by an average of 6.3 million b/d in second-quarter 2026 and 7.6 million b/d in third-quarter 2026. OECD commercial inventories are forecast to fall to just under 2.3 billion bbl by December 2026, the lowest level since 2003. On a days-of-supply basis, OECD inventories are expected to fall to 50 days by yearend 2026. Brent crude oil averaged $107/bbl in May, down $10/bbl from April. EIA forecasts Brent prices will average about $105/bbl in June and July before declining to an average of $89/bbl in fourth-quarter 2026 as oil flows gradually resume. Brent is forecast to average $95/bbl in 2026 and $79/bbl in 2027. High fuel prices, reduced fuel availability, and government initiatives have lowered oil demand, EIA said. The agency now forecasts global oil demand will decline by 1.1 million b/d in 2026 compared

Read More »

Edge networks a particular challenge for summer power, IT staffing needs

Power failures continue to dominate data center outage causes, accounting for 45% of impactful outages in Uptime Institute’s recently released 2026 Annual Outage Analysis report. While that figure declined from the previous year, it remains significantly higher than any other category. Within power-related incidents, UPS failures, transfer switch failures, and generator failures are the leading root causes. Uptime analysts said growing grid instability, power constraints, and high-density compute deployments are creating new pressure points for operators already running closer to capacity limits, according to a recent story on the report in Network World. Beyond power issues, hardware failures—particularly related to storage—also contribute to downtime. He noted that a lack of routine updates, especially to firmware, can make these problems worse, even when the underlying hardware is still functional.

Read More »

Turn enterprise AI into real business value with a secure, scalable factory

Building an enterprise AI factory is a complex endeavor that few organizations can tackle alone. The solution requires infrastructure capable of managing massive compute workloads generated by AI training and inferencing, high-capacity/low-latency networking within data centers and to the edge, and security to mitigate the risks that AI introduces. Abhinav Joshi, leader of AI solutions and product marketing at Cisco, identifies three key challenges inherent in building enterprise AI infrastructure: deployment complexity, security vulnerabilities, and performance bottlenecks. Agentic AI, with its heavy reliance on inferencing, places greater demands on infrastructure across all three dimensions. 3 challenges in building enterprise AI factories The deployment complexity challenge is driven by the need to quickly operationalize an AI infrastructure that fully integrates compute, networking, storage, security, and observability. A Kubernetes-based container management platform and a robust AI software toolchain are likewise essential to ensure the consistent development, testing, and deployment of containerized AI applications, Joshi says. The second challenge is mitigating security vulnerabilities. “Many organizations lack integrated security measures to protect the AI models, frameworks, applications, and the supporting infrastructure throughout the stack,” Joshi says. Attackers can exploit vulnerabilities by manipulating large language models (LLMs) with malicious inputs, which can disrupt operations and extract sensitive information. As AI agents ingest diverse data and act independently, they introduce new attack surfaces, including prompt injection, model poisoning, and data leaks.  Performance, especially around networking, is the third challenge. Tasks such as pre-training, post-training, and fine-tuning AI models, along with retrieval-augmented generation (RAG) pipelines and inferencing (including reasoning and agentic) all generate enormous amounts of network traffic. This creates severe bottlenecks across three critical communication paths: high-speed interconnects between graphics processing unit (GPU) servers, data throughput to storage layers, and real-time response delivery to end users. Without high-performance network connections, GPUs may be underutilized and jobs

Read More »

MSI’s Strategic Shift: From Server Vendor to Full-Spectrum AI Infrastructure Provider

The 100 kW rack figure places MSI’s offering squarely in the world of AI-era rack densities, where conventional air cooling becomes increasingly difficult or inefficient. The announcement also suggests that MSI is aligning with hyperscale and large cloud design principles, particularly through ORv3 and 48V power distribution. The company is moving from the “we have servers that can be liquid cooled” message, to “we can participate in rack-level AI infrastructure design.” The EIA air-cooled architecture, by contrast, is designed for more conventional data center environments. MSI says its 19-inch, 48RU EIA air-cooled rack supports standard deployments and can be configured with 16 2U2N multi-node systems, with AMD EPYC 9005 and Intel Xeon 6 platform options. That split matters because the AI infrastructure market is not moving in one uniform direction. Hyperscalers, neoclouds, and AI factories may move aggressively into ORv3, liquid cooling, busbar power, and rack-scale designs. Enterprise data centers, managed service providers, and colocation customers often need to work within existing 19-inch rack footprints and existing facility constraints. MSI wants to supply both markets. The CG681-S6093: MSI’s Flagship Liquid-Cooled AI Server The centerpiece of MSI’s NVIDIA-based AI server announcement is the CG681-S6093, a 6U liquid-cooled AI server based on NVIDIA MGX architecture. MSI says the system supports dual AMD EPYC processors and up to eight NVIDIA RTX PRO 6000 Blackwell Server Edition Liquid Cooled GPUs. It also supports 32 DDR5 DIMMs and NVIDIA ConnectX-8 SuperNICs with up to 8×400Gbps networking. This system is a direct entry into high-density AI inference, HPC, simulation, graphics, video, and physical AI workloads. The server is not positioned only for frontier model training. Instead, MSI appears to be aiming at the expanding middle of the AI infrastructure market: large inference clusters, visual computing, simulation, industrial AI, scientific computing, and agentic AI workloads. The next

Read More »

Cooling at AI Scale: Inside Motivair’s Blueprint for the Liquid-Cooled Data Center

BUFFALO, N.Y. — In the race to build AI infrastructure, the industry often focuses on GPUs, power availability, and the massive capital investments reshaping the digital infrastructure landscape. But a walk through Motivair’s manufacturing facility in Buffalo, as provided on the eve of the Motivair-Schneider Electric Global Press Event’s tour of the nearby Terawulf Lake Mariner AI campus, offers a reminder that another critical component of the AI boom is being built one coolant distribution unit at a time. During a recent Data Center Frontier Show podcast recorded at Motivair’s Buffalo headquarters, CEO Rich Whitmore described a reality that is becoming bedrock across the industry: Liquid cooling is now very far from being an emerging technology. It is now a prerequisite for deploying the most advanced AI systems. “You cannot deploy AI servers—at least the cutting-edge AI servers—without liquid cooling,” Whitmore said. That observation may be obvious to infrastructure veterans. Yet it points to a larger shift now underway across the data center ecosystem. As AI workloads drive rack densities beyond the practical limits of air cooling, thermal infrastructure has moved from a supporting role to a primary design consideration. For Whitmore and Motivair, that transition did not begin with ChatGPT. From Supercomputing to Commercial AI Long before AI became the defining growth story of the data center sector, Motivair was developing liquid cooling systems for high-performance computing and supercomputing environments. Whitmore describes today’s AI market as less of a technological revolution than a commercialization of capabilities that have existed for years inside elite computing environments. “We cut our teeth in high-performance computing and supercomputing,” Whitmore explained. “What we’re seeing today as we go into the AI era is really a commercialization of traditional supercomputing.” That experience has positioned Motivair differently than many newer entrants rushing into the liquid cooling

Read More »

From Components to AI Factories: Peter Panfil Says the Future of Data Centers Is All About Integration at Scale

ORLANDO, Fla. — For years, the data center industry optimized individual systems: power distribution, cooling, racks, UPS equipment, and mechanical infrastructure. In the AI era, according to Vertiv Distinguished Engineer and Vice President of Technical Business Development Peter Panfil, that approach is no longer sufficient. Speaking during Wednesday morning’s keynote at the 2026 7×24 Exchange Spring Conference, Panfil presented a vision in which the data center itself becomes a single, tightly orchestrated computing appliance—truly an “AI factory” whose success depends less on standalone components than on the seamless interaction between them. Throughout his presentation, titled “Scale at Speed: How Massively Parallel Compute GPUs Are Revolutionizing Data Center Design,” Panfil repeatedly returned to a single imperative: the AI infrastructure race is increasingly defined by execution velocity. “If you think you’re going big enough, go bigger,” he told attendees. “If you think you’re going fast enough, you’re going to have to go faster.” For an industry gathered under the conference’s overarching theme of future-proofing AI infrastructure, Panfil’s message suggested something subtly different. Rather than trying to predict the future, operators should build systems capable of adapting to it. “I would much rather be future ready,” he said, “than future proof.” Speed Becomes the New Competitive Metric One of the keynote’s recurring themes was that deployment speed has become an economic variable in its own right. Panfil argued that hyperscalers and AI providers increasingly view time-to-capacity as directly tied to business value, making delays in construction or commissioning far more expensive than traditional infrastructure inefficiencies. “The cost of speeding up has real benefits right now,” he observed. That urgency is changing the way facilities are assembled. Rather than coordinating numerous independent contractors and subsystem vendors on-site, Panfil described an emerging model built around highly standardized, factory-produced HAC [hot aisle containment] modules—or “hacks”—that arrive

Read More »

Beyond the GPU: Cisco Says AI’s Biggest Challenge May Be the Network That Connects It All

For much of the AI boom, the industry’s attention has centered on GPUs, power availability, and liquid cooling. But according to Cisco Senior Business Development Manager Robin Olds, another critical constraint is rapidly moving to the forefront: the network itself. Speaking with Data Center Frontier on the show floor at Fiber Connect 2026, Olds argued that AI represents a once-in-a-generation shift comparable to the birth of the commercial internet, fundamentally changing traffic patterns and forcing service providers, data center operators, hyperscalers, and emerging neoclouds to rethink infrastructure design. “It’s really like the internet when it was created,” Olds said. “We’re at another intersection in time where we could really see things happening.” AI Is Rewriting the Bandwidth Equation The most significant change may not be compute density alone but the sustained demand AI places on transport networks. According to Olds, service providers are already seeing AI traffic account for roughly 30% of utilization on backbone infrastructure; a dramatic increase from less than 1% only two years ago. As AI workloads continue to proliferate, those utilization levels are expected to rise further. The next wave of agentic AI could amplify that trend. Unlike consumer chatbots, which generate bursty request patterns, autonomous AI agents continuously interact with applications and external services, creating more persistent traffic flows. “Everything’s about chatbots,” Olds observed. “It’s very spiky—up, down. Agentic AI is going to maintain utilization because now I have agents working on my behalf.” For data center developers, network operators, and cloud providers alike, that implies planning not just for peak demand but for elevated baseline utilization across metro and long-haul infrastructure. Compressing the Network Stack Cisco’s response centers on architectural simplification. Olds highlighted the company’s Agile Services Networking framework, which combines router and optical networking technologies with coherent optics to converge functions that historically

Read More »

Microsoft will invest $80B in AI data centers in fiscal 2025

And Microsoft isn’t the only one that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs).  In a report published in October 2024, Bloomberg Intelligence estimated that demand for generative AI would push Microsoft, AWS, Google, Oracle, Meta, and Apple would between them devote $200 billion to capex in 2025, up from $110 billion in 2023. Microsoft is one of the biggest spenders, followed closely by Google and AWS, Bloomberg Intelligence said. Its estimate of Microsoft’s capital spending on AI, at $62.4 billion for calendar 2025, is lower than Smith’s claim that the company will invest $80 billion in the fiscal year to June 30, 2025. Both figures, though, are way higher than Microsoft’s 2020 capital expenditure of “just” $17.6 billion. The majority of the increased spending is tied to cloud services and the expansion of AI infrastructure needed to provide compute capacity for OpenAI workloads. Separately, last October Amazon CEO Andy Jassy said his company planned total capex spend of $75 billion in 2024 and even more in 2025, with much of it going to AWS, its cloud computing division.

Read More »

John Deere unveils more autonomous farm machines to address skill labor shortage

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Self-driving tractors might be the path to self-driving cars. John Deere has revealed a new line of autonomous machines and tech across agriculture, construction and commercial landscaping. The Moline, Illinois-based John Deere has been in business for 187 years, yet it’s been a regular as a non-tech company showing off technology at the big tech trade show in Las Vegas and is back at CES 2025 with more autonomous tractors and other vehicles. This is not something we usually cover, but John Deere has a lot of data that is interesting in the big picture of tech. The message from the company is that there aren’t enough skilled farm laborers to do the work that its customers need. It’s been a challenge for most of the last two decades, said Jahmy Hindman, CTO at John Deere, in a briefing. Much of the tech will come this fall and after that. He noted that the average farmer in the U.S. is over 58 and works 12 to 18 hours a day to grow food for us. And he said the American Farm Bureau Federation estimates there are roughly 2.4 million farm jobs that need to be filled annually; and the agricultural work force continues to shrink. (This is my hint to the anti-immigration crowd). John Deere’s autonomous 9RX Tractor. Farmers can oversee it using an app. While each of these industries experiences their own set of challenges, a commonality across all is skilled labor availability. In construction, about 80% percent of contractors struggle to find skilled labor. And in commercial landscaping, 86% of landscaping business owners can’t find labor to fill open positions, he said. “They have to figure out how to do

Read More »

2025 playbook for enterprise AI success, from agents to evals

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More 2025 is poised to be a pivotal year for enterprise AI. The past year has seen rapid innovation, and this year will see the same. This has made it more critical than ever to revisit your AI strategy to stay competitive and create value for your customers. From scaling AI agents to optimizing costs, here are the five critical areas enterprises should prioritize for their AI strategy this year. 1. Agents: the next generation of automation AI agents are no longer theoretical. In 2025, they’re indispensable tools for enterprises looking to streamline operations and enhance customer interactions. Unlike traditional software, agents powered by large language models (LLMs) can make nuanced decisions, navigate complex multi-step tasks, and integrate seamlessly with tools and APIs. At the start of 2024, agents were not ready for prime time, making frustrating mistakes like hallucinating URLs. They started getting better as frontier large language models themselves improved. “Let me put it this way,” said Sam Witteveen, cofounder of Red Dragon, a company that develops agents for companies, and that recently reviewed the 48 agents it built last year. “Interestingly, the ones that we built at the start of the year, a lot of those worked way better at the end of the year just because the models got better.” Witteveen shared this in the video podcast we filmed to discuss these five big trends in detail. Models are getting better and hallucinating less, and they’re also being trained to do agentic tasks. Another feature that the model providers are researching is a way to use the LLM as a judge, and as models get cheaper (something we’ll cover below), companies can use three or more models to

Read More »

OpenAI’s red teaming innovations define new essentials for security leaders in the AI era

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams’ advanced capabilities in two areas: multi-step reinforcement and external red teaming. OpenAI recently released two papers that set a new competitive standard for improving the quality, reliability and safety of AI models in these two techniques and more. The first paper, “OpenAI’s Approach to External Red Teaming for AI Models and Systems,” reports that specialized teams outside the company have proven effective in uncovering vulnerabilities that might otherwise have made it into a released model because in-house testing techniques may have missed them. In the second paper, “Diverse and Effective Red Teaming with Auto-Generated Rewards and Multi-Step Reinforcement Learning,” OpenAI introduces an automated framework that relies on iterative reinforcement learning to generate a broad spectrum of novel, wide-ranging attacks. Going all-in on red teaming pays practical, competitive dividends It’s encouraging to see competitive intensity in red teaming growing among AI companies. When Anthropic released its AI red team guidelines in June of last year, it joined AI providers including Google, Microsoft, Nvidia, OpenAI, and even the U.S.’s National Institute of Standards and Technology (NIST), which all had released red teaming frameworks. Investing heavily in red teaming yields tangible benefits for security leaders in any organization. OpenAI’s paper on external red teaming provides a detailed analysis of how the company strives to create specialized external teams that include cybersecurity and subject matter experts. The goal is to see if knowledgeable external teams can defeat models’ security perimeters and find gaps in their security, biases and controls that prompt-based testing couldn’t find. What makes OpenAI’s recent papers noteworthy is how well they define using human-in-the-middle

Read More »