Stay Ahead, Stay ONMINE

AI, Data Centers, and the Next Big Correction: Will Growth Outpace Market Reality?

AI is being readily embraced by organizations, government, and individual enthusiasts for data aggregation, pattern recognition, data visualization, and co-creation of content. Given the headlines lately, AI is set to take over the world. And as an emerging, revolutionary technology with large potential impact and newfound user-friendliness, both large tech companies and small startups alike […]

AI is being readily embraced by organizations, government, and individual enthusiasts for data aggregation, pattern recognition, data visualization, and co-creation of content. Given the headlines lately, AI is set to take over the world. And as an emerging, revolutionary technology with large potential impact and newfound user-friendliness, both large tech companies and small startups alike have raced to capitalize on potential growth. Hands down, this transformative technology has caused a wave of adoption, investment, and innovation around the world and across industries.

Naturally, when a technology or application accelerates quickly, the more risk-averse will be cautious and when it accelerates this quickly, a bubble might be forming. Even more bullish investors have ridden through too much tumult in the past few decades for their bank accounts to withstand another cataclysmic loss. More investment is pouring in (including at a federal level), stock valuations are all over the charts and not necessarily true to a ticker’s earnings, and the recent market fluctuations leave the entire ecosystem a little hesitant about buying into the hype too much.

The Nature of Bubbles and Some Potential Signals to Watch For

Economic bubbles occur when asset prices significantly exceed their intrinsic value, often fueled by speculative demand and irrational investment, leading to unsustainable market conditions. A bigger concern than just to digital infrastructure, bubbles can have far-reaching impacts on the entire market, as the initial distorted financial metrics encourage excessive lending and create systemic risk. The collapse of a bubble can trigger a chain reaction of financial distress, causing widespread economic instability and potentially leading to recessions, as seen in historical examples like the dot-com and housing bubbles.

Reasonable bubble indicators that have the market concerned include:

  • Overvaluation and Lack of Profit Generation: Tech giants are heavily invested in AI despite limited returns from the associated products. Likewise, many AI startups have achieved valuations far exceeding their earnings. This discrepancy between valuation and profitability is a classic sign of a bubble.
  • Hype vs. Reality: The AI hype cycle throughout the news has led to significant investments, with society torn about the potential and ethical claims regarding AI capabilities. Overstatements in the media often must be tempered with corrections in later expectation, but when hundreds of billions of dollars are at stake, it’s no small adjustment.
  • Diminishing Returns: Some experts suggest that large language models (LLMs) may not be as scalable as previously thought, leading to diminishing returns on investment in these technologies.

The Dot-Com Burst Saw Precisely This Happen

The dot-com bubble emerged in the late 1990s, fueled by the rapid growth of the internet and the establishment of numerous tech startups. This period saw a surge in demand for internet-based stocks, leading to high valuations that often exceeded the companies’ intrinsic value. The NASDAQ Composite index rose dramatically, increasing by 582% from January 1995 to March 2000, only to fall by 75% from March 2000 to October 2002.

The frenzy of buying internet-based stocks was overwhelming, with many companies lacking viable business models and focusing instead on metrics like website traffic. Venture capitalists and other investors poured money into these startups, often ignoring traditional financial metrics in favor of speculative growth potential. The media played a significant role in fueling this hype, encouraging investors to overlook caution and invest in risky tech stocks.

The bubble burst when capital began to dry up, leading to a market crash. By 2002, investor losses were estimated at around $5 trillion. Many tech companies that conducted IPOs during this era declared bankruptcy or were acquired by other companies. The collapse of the dotcom bubble resulted in massive layoffs in the technology sector and served as a cautionary tale about the dangers of speculative investing and overvaluation.

The aftermath of the dotcom bubble led to a more cautious approach to investing, with a renewed focus on fundamental analysis rather than speculative hype. Despite the devastating impact, it laid the groundwork for the modern tech industry, with companies like Amazon and Google surviving and thriving to become leaders in their fields.

Growth and Profitability

While AI as a technology has been around for decades, the advent of generative AI built on neural networks resulted in the release of ChatGPT. This launched a user-friendly chatbot that could interpret and then generate responses in milli-seconds that were more than just coherent, but informative, insightful, and intuitive. The potential of AI was on display for all the world to see and users of OpenAI’s system grew to 1 million users in five days and 100 million users in 2 months, the fastest adoption of a platform the world has ever seen. They recently have reached 400 million weekly active users.

The societal adoption makes sense, but what about the business application, where there is real money to be made? Other than for the reputed college kids writing term papers, AI’s value to an organization is its ability to analyze vast amounts of disorganized data, aggregate it all, and make complex decisions from it. Key industries like healthcare, computer science, cybersecurity, logistics, manufacturing, and content creation are all leading the shift and embracing the benefits of AI technology and there is no end in sight to the innovation available.

The efficiency gains and reduced operational costs to an organization are limited only by a user’s imagination for what queries to put to the test. But speaking openly, as someone who grew up in the power distribution world, peddling equipment that made utilities and industries more efficient and reduced OpEx as our core product benefits, I can tell you this isn’t an easy value proposition to market your products on, even when it is so tangibly evident as it is with AI, and the enterprise and B2B adoption is rolling out slower than the headlines might have us believing.

Simply stated, this technology is only profitable if there are paying customers and revenue growth that follow. Serious startup capital is being spent on applications of this technology that the market may not be ready to support. This does have the markings of a crash, but whether that crash will be a true bubble will depend on the speed, reach, and broader impact of that decline.

Economic Considerations

Herd mentality plays a significant role in the adoption of AI technologies. This phenomenon involves individuals following the crowd and making decisions based on the actions of others, rather than their own beliefs or analysis. In the context of AI, herd behavior is amplified by the widespread adoption of AI tools and the fear of missing out (FOMO) on potential benefits.

AI algorithms, trained on extensive datasets, can perpetuate this mentality by replicating existing trends and strategies, making them more appealing to a broader audience. As a result, the rapid adoption of AI technologies can lead to inflated expectations and valuations, similar to what was observed during the dotcom bubble, where speculative demand drove prices far beyond their intrinsic value.

The prices of hardware necessary for AI development and deployment are being driven up by several factors, including scarcity and increased demand. The rapid growth of AI applications has led to a surge in demand for GPUs and TPUs necessary for training models. This increased demand, coupled with supply chain constraints and geopolitical tensions affecting semiconductor production, has resulted in higher prices for these critical components.

Additionally, the concentration of manufacturing in a few regions exacerbates these supply chain issues, further contributing to price increases. As AI continues to expand across industries, the strain on hardware resources is likely to persist, maintaining upward pressure on prices.

Right now, investors and data center operators, alike, are attempting to chart the viability of the many parties and the likely winners of the AI arms race, and charting those sort of outcomes always brings different economic tools such as game theory to mind, where we have many players all vying for the same opportunities. The considerations of approaching this like a game are that we can complement our decisions by modeling interdependencies, ensuring strategies that achieve the most desirable outcomes.

This mathematical framework is frequently used for understanding interactions within an ecosystem, but is much more complicated than the well-known Nash equilibrium, whereby each participant strives to maximize their outcome, and equilibrium is achieved only when all players have reached this maximum, which is interdependent on the behaviors and actions of the other players. The Prisoner’s Dilemma is the well-known classic, but as applied in this sense, other studied “games” to consider are more applicable, especially those that result in a “winner takes all” outcome.

One of the challenges, however, is that new neocloud players are joining amidst an ongoing game, making this extremely difficult to mathematically chart. Nevertheless, it can be useful framework for isolated scenario modeling of strategies, predictive analytics, and decision mapping to anticipate outcomes.

For example, many AI startup companies may be bidding for the same hyperscale AI projects. As with a Prisoner’s Dilemma, there may be a first-mover advantage, but this is actually more like a game of Chicken. The first to pull out of the competition loses the crown title, but keeps their life; the one to stay in the match (if the other pulls out) earns both; or they defeat each other through psychological tactics whereby 1) neither succeed or 2) the result is mutually assured destruction when neither gives in.

The resulting sentiment is that in this arms race, one year from now only a handful of companies will have survived.

Therefore, investment is slowing down as investors are digging deeper into the cost of the technology, the feasibility of finding customers, and the timeline to revenue. “Show me the money,” is being heard across digital infrastructure, or rather, show me the path to monetization, the business case for your unique application of the technology and prospective customer. With limited winners and an excess of losers, it is hard to see investors placing financial bets across the board; they will be much more strategically selected than we saw in the dot-com days.

Ripples in the Ecosystem

Countering the bubble fear-mongers, it must be argued that the long-term outlook of AI and the underlying technology that fosters this innovation will have a lasting-impact. From the 40,000-foot view, I can’t imagine a fundamentally revolutionary technology causing a complete market burst, while businesses and individuals have already come to rely on various AI applications as essential tools for business.

Rather than a crash, natural economic adjustment may be more likely, though it must be said that market fluctuations have had greater swings of late and may be established as a norm that day tradesmen have to account for in their strategies, while longer-term investors are willing to ride these waves out. That is, if they ever lock in on a winner they choose to financially back. Readjustments are just part of the game.

As an asset category, we need to consider the full ecosystem and consider the market corrections we’ve begun to see play out:

  • Competitive Market Growth:  An example of this is easily seen when we consider the DeepSeek launch recently, a Chinese product competitive to ChatGPT that supposedly boasted lower costs and energy usage. The U.S. tech index lost $1 trillion in value that day. Much of that was quickly recovered. Additionally, individual stocks may contribute to some fluctuations, but there was some concern about a burst looming, because a single announcement should never have seen the swing that resulted from this announcement. In general, we need to stop letting short-term sentiment and fear impact us to this extent and trust what we know to be true about the technology adoption. The wake-up call was heard nonetheless across the market, and we should expect to see much more reticence to large investments that present a high risk profile.
  • Lease Terms: The data center market has been a bit of a seller’s market for a few years now; those with land and power need simply say the word and they could lock in 15 year lease terms. That’s changing a bit of late and as we’ve seen, some hyperscalers are even pulling back lease terms to under 10 years, some around 7-8 years. AI leases are even less secure with many neocloud startups aiming for 5-7 year lease terms. This doesn’t offer the same confidence to an investor or to a data center provider compared to a longer-term commit and let’s not forget, these cash constrained startups cannot afford to give this perception. As we learned from the real estate bubble, inability to pay the rent quite literally could become a trigger for another burst.
  • Equipment Obsolescence:  Another factor to consider is the high cost of investment in hardware. Ultimately with growth, price per unit will come down. Then as new models are released by the various manufacturers, the previous renditions will become obsolete, and suddenly entire generations of hardware may lose value. As long as the neocloud provider has established a decent customer base to generate revenue, or a hyperscaler has deep enough pockets to fund an equipment refresh, this is no concern. But it’s a bitter pill to swallow when it happens and is not always a blow that can be recovered from, since it hinges on the model already demonstrating success. Some question has arisen whether there will be a second-hand market for GPUs. With the investment that goes into the purchase up front, it would be a struggle to imagine that there won’t be, but a viable use case has yet to emerge; it’s simply too new to discern. It would likely be pennies on the dollar, but better than nothing. Perhaps by being repurposed for smaller outfits that lease  to single-use enterprises will provide a niche market where equipment finds new utility, even if not as lucrative as the initial use.
  • Equipment Failure:  Beginning to be discussed openly, GPUs have a high failure rate due to component failures, memory issues, and driver problems. This unreliability can lead to costly downtime and data loss, impacting the efficiency and reliability of AI operations. As AI applications become more complex and widespread, the need for robust and reliable GPU infrastructure grows. The consequences of these failures ripple through the market, affecting not only the deployment timelines and operational costs but will also make companies more hesitant to adopt and scale their use of the technology. Moreover, the scarcity of GPUs, exacerbated by supply chain disruptions and export restrictions, further complicates the situation, pushing companies to explore alternative solutions like GPU-as-a-Service (GPUaaS) to mitigate these risks.
  • Stock Valuations:  Nvidia, the leading supplier of GPUs essential for training AI models, has become one of the most valuable publicly listed companies, with a valuation exceeding $3 trillion. As the gold standard for GPUs, Nvidia’s stock performance significantly influences the broader market, particularly tech-heavy indices like the S&P 500. Given its substantial market capitalization, Nvidia’s stock makes up a considerable portion of major indexes, meaning that any large market adjustment could have far-reaching effects on the entire tech sector. This concentration of market influence in a few key stocks, including Nvidia, leaves investors vulnerable unless they are well diversified. The valuation of AI-related stocks, such as OpenAI potentially reaching a $300 billion valuation despite never being profitable, raises questions about sustainability. The recent stock market surge has been largely driven by the “Magnificent Seven” companies—Alphabet, Amazon, Apple, Meta, Microsoft, Nvidia, and Tesla—which are heavily invested in AI and have collectively seen significant growth. These companies account for over half of the S&P 500’s total return in 2024, with annualized appreciation rates exceeding 20% over the past five years, and Nvidia leading with over 90% growth. The sustainability of such high valuations and growth rates is uncertain, and any correction could have profound implications for the entire market.
  • Colocation Markets:  The Magnificent Seven mentioned include the hyperscale market, which naturally leads the majority of AI investment, but we must consider impacts to other operators. Over the past two years, many hyperscalers paused to reevaluate their facility designs, then turned to colocation providers for extended support. We have now seen this infrastructure begin to crumble, with Microsoft cancelling leases based on concerns of oversupply and reduced capacity needs for AI. Those contracted deployments will have caused a financial loss for the colocation providers who planned to construct them. This may have been our biggest market test yet, as it eerily echoes the dot-com triggers that began the burst. The market did react and it’s unclear whether we’re out of the woods just yet. Aside from hyperscale AI deployments inside a colocation data center, neocloud companies present another viable AI tenant opportunity, but even they are all bidding for the same hyperscale contracts. When the hyperscalers get nervous, this puts the entire industry at great concern about long-term viability.
Shape
Shape
Stay Ahead

Explore More Insights

Stay ahead with more perspectives on cutting-edge power, infrastructure, energy,  bitcoin and AI solutions. Explore these articles to uncover strategies and insights shaping the future of industries.

Shape

Trump extends tariff pause to all USMCA goods

The White House announced Thursday afternoon that it will suspend tariffs on all imports that are compliant with the United States-Mexico-Canada Agreement until April 2. The pause, which was extended to imports from Mexico that adhered to the USMCA earlier Thursday, will now also cover goods from Canada that meet

Read More »

Raizen Is Said to Hire JPMorgan for Argentina Energy Assets Sale

Brazil’s Raizen SA has begun to explore the sale of its oil refinery and network of gas stations in Argentina, according to people familiar with the matter. Raizen, a joint venture between oil supermajor Shell Plc and Brazilian conglomerate Cosan SA, has hired JPMorgan Chase & Co. to manage the sale, said the people, who asked not to be named discussing private matters. Press offices for Raizen and JPMorgan declined to comment.  The energy firm’s potential departure from Argentina would add to a growing list of multinational firms, including Exxon Mobil, HSBC Holdings Plc and Mercedes-Benz, that have chosen to sell operations in the country during the past year despite more investor optimism about President Javier Milei’s economic overhaul.  Brazil’s largest producer of ethanol fuel, Raizen is mulling divestments and slowing down expansions as higher borrowing costs of late in Brazil rattle its finances. Its Dock Sud oil refinery in Buenos Aires is Argentina’s oldest with a capacity of 100,000 barrels a day that only trails two facilities run by state-run oil company YPF SA. Raizen’s network of around 700 gas stations account for 18% of Argentina’s gasoline and diesel sales, second to YPF, which has more than half of the market. The fuel is branded as Shell. Raizen bought the assets for almost $1 billion in 2018 from Shell, which owned them outright, during Argentina’s last experiment with market-oriented reforms. The country then witnessed a period of big government from 2019 to 2023 before voting in libertarian Milei more than a year ago. He is on a crusade to deregulate the economy, in particular the energy and oil sectors. The divestment comes as Milei rips away controls on crude and fuel prices that were used to stem inflation. That was sometimes bad for refiners or drillers, depending on how

Read More »

Data center supply, construction surged in 2024 amid AI boom

Dive Brief: Data center supply in major “primary” markets like Northern Virginia, Atlanta and Chicago surged 34% year-over-year in 2024 to 6,922.6 MW, with a further 6,350 MW under construction at year-end, CBRE said in a Feb. 26 report. The data center vacancy rate in primary markets fell to 1.9%, driving up the average asking rates for a 250-to-500-kilowatt requirement by 2.6% year-over-year to $184.06/kW, reflecting tight supply and robust demand for AI and cloud services, CBRE said in its North America Data Center Trends H2 2024 report. Volume-based discounts for larger tenants “have been significantly reduced or eliminated” due to rising demand for large, contiguous spaces, while data center operators grapple with elevated construction and equipment costs and “persistent shortages in critical materials like generators, chillers and transformers,” CBRE said. Dive Insight: Surging demand from organizations’ use of AI is driving the record data center development, CBRE says. The demand is giving AI-related occupiers increasing influence over data center development decisions like site selection, design and operational requirements. These occupiers are “prioritizing markets with scalable power capacity and advanced connectivity solutions,” the report says.  Demand is also showing up in pricing trends.  Last year was the third consecutive year of pricing increases for 250-to-500-kW slots in primary markets, CBRE said. Following steady single-digit annual declines from 2015 to 2021, average pricing rose 14.5% in 2022, 18.6% in 2023 and 12.6% in 2024. Robust tenant demand, healthy investor appetite for alternative real estate assets and recent interest rate declines are among the factors fueling an exponential increase in data center investment activity, CBRE said. Annual sales volumes reached $6.5 billion in 2024 as average sale prices increased year-over-year, reflecting “the growing scale of data center campuses,” CBRE said. Five transactions exceeded $400 million last year. Notable capital market developments included

Read More »

Bonneville opts to join SPP’s Markets+ day-ahead market over CAISO alternative

Dive Brief: The Bonneville Power Administration plans to join the Southwest Power Pool’s Markets+ real-time and day-ahead market instead of a market being launched by the California Independent System Operator, BPA said in a draft policy released Wednesday. While the CAISO’s Extended Day-Ahead Market may offer greater financial benefits compared to Markets+, overall the SPP market is a better fit for BPA based on market design elements covering governance, resource adequacy, greenhouse gas accounting and congestion revenue, the federal power marketer said. Bonneville expects to make a final decision in May. The BPA’s draft decision sets the stage for the creation of two intertwined day-ahead markets in the West. “The idea that there’s some West-wide market ideal out there that we can get to today is just not something that is on the table,” Rachel Dibble, BPA power services vice president of bulk marketing, said at a press briefing Thursday. “Maybe someday, in future decades, there may be a point where we could merge into one market, but right now, there are many entities who support Markets+.” Dive Insight: The BPA’s decision will have a major effect on market development in the West. It sells wholesale power from federal hydroelectric dams in the Northwest, totaling about 22.4 GW. The federal power marketer also operates about 15,000 circuit miles of high-voltage transmission across the Northwest. The BPA mainly sells its power to cooperative and municipal utilities, and public power districts. In its draft decision, BPA rejected calls to wait for the West-Wide Governance Pathways Initiative to complete its effort to establish an independent governance framework for EDAM.  While a bill — SB 540 — was introduced in the California Legislature last month to implement the Pathways’ second phase, it “limits the availability of full operational administrative independence by requiring that the

Read More »

USA Won’t Hesitate on Russia and Iran Sanctions, Bessent Says

The US will not hesitate to go “all in” on sanctions on Russian energy if it helps lead to a ceasefire in the Ukraine war, Treasury Secretary Scott Bessent said Thursday. Sanctions on Russia “will be used explicitly and aggressively for immediate maximum impact” at President Donald Trump’s guidance, Bessent told an audience at the Economic Club of New York. The Trump administration is pressing Ukraine to come to the table for a ceasefire deal with Russia, and Bessent said additional sanctions on Russia could help give the US more leverage in the negotiations. Trump is ready to finalize an agreement that would give the US rights to help develop some of Ukraine’s natural resources if Ukrainian President Volodymyr Zelenskiy agrees to a tangible path for a truce and talks with Moscow, according to people familiar with the matter. Bessent criticized the Biden administration for not going harder on Russian energy sanctions for fear of driving up gas prices and asked what the point of “substantial US military and financial support over the past three years” was without matching sanctions. The US has paused military aid and some intelligence sharing with Ukraine in an effort to force the US ally to agree to negotiations with Russia over the end of the war. Bessent also said the US would ramp up sanctions on Iran, adding that the US will “shutdown” the country’s oil sector using “pre-determined benchmarks and timelines” and that “Making Iran broke again will mark the beginning of our updated sanctions policy.” The Treasury chief suggested that the US would work with “regional parties” that help Iran move its oil onto the market. One of those countries is likely to be Russia, which signaled earlier this week that it was willing to assist the US in talks with Iran on ending its nuclear

Read More »

Oil Gains on Truce Hopes but Closes Week Lower

Oil’s one-day advance wasn’t enough to rescue prices from a seventh straight weekly decline as the prospect of a temporary truce in Ukraine capped on-again, off-again tariff news that upended global markets. West Texas Intermediate futures climbed by 0.7% Friday to settle above $67 a barrel after Bloomberg reported that Russia is open to a pause to fighting in Ukraine, raising the prospect of a resumption in Moscow’s crude exports. US President Donald Trump earlier pressured the two warring nations to hasten peace talks and the White House signaled that it may relax sanctions on Russian oil if there’s progress. Crude also found support from a weakening dollar and US plans to refill its strategic oil reserve, but still was down 3.9% on the week. The Biden administration’s farewell sanctions on Russia have snarled the nation’s crude trade in recent months, with total oil and natural gas revenue last month falling almost 19% from a year earlier, Bloomberg calculations showed. Russia’s oil-related taxes are a key source of financing its war against Ukraine. A potential reintroduction of Russian barrels to the market comes amid a gloomy period for the supply outlook, as OPEC+ forges ahead with a plan to start reviving idled output in April. Meanwhile, Trump’s trade policies have fanned concerns about reduced global energy demand. “You’re seeing some volatility as people try to interpret what they think is going to happen and what it’s going to mean, but the bottom line is Russia has been able to sell its oil,” said Amy Jaffe, director of New York University’s Energy, Climate Justice and Sustainability Lab. Trump signed orders on Thursday paring back tariffs on Mexico and Canada until April 2. That timing coincides with a date when the president is expected to start detailing plans for so-called reciprocal duties

Read More »

EVOL X Fugro International Women’s Day special

Join Energy Voice News Editor Erikka Askeland who speaks to two high profile energy industry business leaders for International Women’s Day. We speak to Nicola Welsh, UK Country Director at geo-data specialist Fugro alongsideLinda Stewart, Director Marine Geophysical Europe, also at Fugro. Tune in to hear Nicola discuss her route from mining camps in the Australian outback to a senior leadership role while Linda charts her 19-year career journey to become Fugro’s first female director in her role in Scotland. There’s serious discussion about leaning in, the “double bind” and what the IWD 2025 call to “accelerate action” really means. This special podcast also serves and the opening of Energy Voice’s highly anticipated Women in New Energy Event which takes place in Aberdeen in June. Recommended for you Celebrating International Women’s Day with Axis Network’s Emma Behjat

Read More »

Lenovo introduces entry-level, liquid cooled AI edge server

Lenovo has announced the ThinkEdge SE100, an entry-level AI inferencing server, designed to make edge AI affordable for enterprises as well as small and medium-sized businesses. AI systems are not normally associated with being small and compact; they’re big, decked out servers with lots of memory, GPUs, and CPUs. But the server is for inferencing, which is the less compute intensive portion of AI processing, Lenovo stated.  GPUs are considered overkill for inferencing and there are multiple startups making small PC cards with inferencing chip on them instead of the more power-hungry CPU and GPU. This design brings AI to the data rather than the other way around. Instead of sending the data to the cloud or data center to be processed, edge computing uses devices located at the data source, reducing latency and the amount of data being sent up to the cloud for processing, Lenovo stated. 

Read More »

Seven important trends in the server sphere

The pace of change around server technology is advancing considerably, driven by hyperscalers but spilling over into the on-premises world as well. There are numerous overall trends, experts say, including: AI Everything: AI mania is everywhere and without high power hardware to run it, it’s just vapor. But it’s more than just a buzzword, it is a very real and measurable trend. AI servers are notable because they are decked out with high end CPUs, GPU accelerators, and oftentimes a SmartNIC network controller.  All the major players — Nvidia, Supermicro, Google, Asus, Dell, Intel, HPE — as well as smaller vendors are offering purpose-built AI hardware, according to a recent Network World article. AI edge server growth: There is also a trend towards deploying AI edge servers. The Global Edge AI Servers Market size is expected to be worth around $26.6 Billion by 2034, from $2.7 Billion in 2024, according to a Market.US report. Considerable amounts of data are collected on the edge.  Edge servers do the job of culling the useless data and sending only the necessary data back to data centers for processing. The market is rapidly expanding as industries such as manufacturing, automotive, healthcare, and retail increasingly deploy IoT devices and require immediate data processing for decision-making and operational efficiency, according to the report. Liquid cooling gains ground: Liquid cooling is inching its way in from the fringes into the mainstream of data center infrastructure. What was once a difficult add-on is now becoming a standard feature, says Jeffrey Hewitt, vice president and analyst with Gartner. “Server providers are working on developing the internal chassis plumbing for direct-to-chip cooling with the goal of supporting the next generation of AI CPUs and GPUs that will produce high amounts of heat within their servers,” he said.  New data center structures: Not

Read More »

Data center vacancies hit historic lows despite record construction

The growth comes despite considerable headwinds facing data center operators, including higher construction costs, equipment pricing, and persistent shortages in critical materials like generators, chillers and transformers, CRBE stated. There is a considerable pricing disparity between newly built data centers and legacy facilities, reflecting the premium placed on modern, energy-efficient infrastructure. Specifically, liquid/immersion cooling is preferred over air cooling for modern server requirements, CRBE found. On the networking side of things, major telecom companies made substantial investments in fiber in the second half of 2024, reflecting the growing need for more network infrastructure and capacity to accommodate growing demand from AI and data providers. There have also been many notable deals recently: AT&T’s multi-year, $1 billion agreement with Corning to provide next-generation fiber, cable and connectivity solutions; Comcast’s proposed acquisition of Nitel; Verizon’s agreement to acquire Frontier, the largest pure-play fiber internet provider in the U.S.; and T-Mobile’s entry into the fiber internet market via partnerships with fiber-optic providers. In the quarter, Meta announced plans for a 25,000-mile undersea fiber cable that would connect the U.S. East and West coasts with global markets across the Atlantic, Indian and Pacific oceans. The project would mark the first privately owned and operated global fiber cable network. Data Center Outlook

Read More »

AI driving a 165% rise in data center power demand by 2030

Goldman Sachs Research estimates the power usage by the global data center market to be around 55 gigawatts, which breaks down as 54% for cloud computing workloads, 32% for traditional line of business workloads and 14% for AI. By 2027, that number jumps to 84 GW, with AI growing to 27% of the overall market, cloud dropping to 50%, and traditional workloads falling to 23%, Schneider stated. Goldman Sachs Research estimates that there will be around 122 GW of data center capacity online by the end of 2030, and the density of power use in data centers is likely to grow as well, from 162 kilowatts per square foot to 176 KW per square foot in 2027, thanks to AI, Schneider stated.  “Data center supply — specifically the rate at which incremental supply is built — has been constrained over the past 18 months,” Schneider wrote. These constraints have arisen from the inability of utilities to expand transmission capacity because of permitting delays, supply chain bottlenecks, and infrastructure that is both costly and time-intensive to upgrade. The result is that due to power demand from data centers, there will need to be additional utility investment, to the tune of about $720 billion of grid spending through 2030. And then they are subject to the pace of public utilities, which move much slower than hyperscalers. “These transmission projects can take several years to permit, and then several more to build, creating another potential bottleneck for data center growth if the regions are not proactive about this given the lead time,” Schneider wrote.

Read More »

Top data storage certifications to sharpen your skills

Organization: Hitachi Vantara Skills acquired: Knowledge of data center infrastructure management tasks automation using Hitachi Ops Center Automator. Price: $100 Exam duration: 60 minutes How to prepare: Knowledge of all storage-related operations from an end-user perspective, including planning, allocating, and managing storage and architecting storage layouts. Read more about Hitachi Vantara’s training and certification options here. Certifications that bundle cloud, networking and storage skills AWS Certified Solutions Architect – Professional The AWS Certified Solutions Architect – Professional certification from leading cloud provider Amazon Web Services (AWS) helps individuals showcase advanced knowledge and skills in optimizing security, cost, and performance, and automating manual processes. The certification is a means for organizations to identify and develop talent with these skills for implementing cloud initiatives, according to AWS. The ideal candidate has the ability to evaluate cloud application requirements, make architectural recommendations for deployment of applications on AWS, and provide expert guidance on architectural design across multiple applications and projects within a complex organization, AWS says. Certified individuals report increased credibility with technical colleagues and customers as a result of earning this certification, it says. Organization: Amazon Web Services Skills acquired: Helps individuals showcase skills in optimizing security, cost, and performance, and automating manual processes Price: $300 Exam duration: 180 minutes How to prepare: The recommended experience prior to taking the exam is two or more years of experience in using AWS services to design and implement cloud solutions Cisco Certified Internetwork Expert (CCIE) Data Center The Cisco CCIE Data Center certification enables individuals to demonstrate advanced skills to plan, design, deploy, operate, and optimize complex data center networks. They will gain comprehensive expertise in orchestrating data center infrastructure, focusing on seamless integration of networking, compute, and storage components. Other skills gained include building scalable, low-latency, high-performance networks that are optimized to support artificial intelligence (AI)

Read More »

Netskope expands SASE footprint, bolsters AI and automation

Netskope is expanding its global presence by adding multiple regions to its NewEdge carrier-grade infrastructure, which now includes more than 75 locations to ensure processing remains close to end users. The secure access service edge (SASE) provider also enhanced its digital experience monitoring (DEM) capabilities with AI-powered root-cause analysis and automated network diagnostics. “We are announcing continued expansion of our infrastructure and our continued focus on resilience. I’m a believer that nothing gets adopted if end users don’t have a great experience,” says Netskope CEO Sanjay Beri. “We monitor traffic, we have multiple carriers in every one of our more than 75 regions, and when traffic goes from us to that destination, the path is direct.” Netskope added regions including data centers in Calgary, Helsinki, Lisbon, and Prague as well as expanded existing NewEdge regions including data centers in Bogota, Jeddah, Osaka, and New York City. Each data center offers customers a range of SASE capabilities including cloud firewalls, secure web gateway (SWG), inline cloud access security broker (CASB), zero trust network access (ZTNA), SD-WAN, secure service edge (SSE), and threat protection. The additional locations enable Netskope to provide coverage for more than 220 countries and territories with 200 NewEdge Localization Zones, which deliver a local direct-to-net digital experience for users, the company says.

Read More »

Microsoft will invest $80B in AI data centers in fiscal 2025

And Microsoft isn’t the only one that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs).  In a report published in October 2024, Bloomberg Intelligence estimated that demand for generative AI would push Microsoft, AWS, Google, Oracle, Meta, and Apple would between them devote $200 billion to capex in 2025, up from $110 billion in 2023. Microsoft is one of the biggest spenders, followed closely by Google and AWS, Bloomberg Intelligence said. Its estimate of Microsoft’s capital spending on AI, at $62.4 billion for calendar 2025, is lower than Smith’s claim that the company will invest $80 billion in the fiscal year to June 30, 2025. Both figures, though, are way higher than Microsoft’s 2020 capital expenditure of “just” $17.6 billion. The majority of the increased spending is tied to cloud services and the expansion of AI infrastructure needed to provide compute capacity for OpenAI workloads. Separately, last October Amazon CEO Andy Jassy said his company planned total capex spend of $75 billion in 2024 and even more in 2025, with much of it going to AWS, its cloud computing division.

Read More »

John Deere unveils more autonomous farm machines to address skill labor shortage

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Self-driving tractors might be the path to self-driving cars. John Deere has revealed a new line of autonomous machines and tech across agriculture, construction and commercial landscaping. The Moline, Illinois-based John Deere has been in business for 187 years, yet it’s been a regular as a non-tech company showing off technology at the big tech trade show in Las Vegas and is back at CES 2025 with more autonomous tractors and other vehicles. This is not something we usually cover, but John Deere has a lot of data that is interesting in the big picture of tech. The message from the company is that there aren’t enough skilled farm laborers to do the work that its customers need. It’s been a challenge for most of the last two decades, said Jahmy Hindman, CTO at John Deere, in a briefing. Much of the tech will come this fall and after that. He noted that the average farmer in the U.S. is over 58 and works 12 to 18 hours a day to grow food for us. And he said the American Farm Bureau Federation estimates there are roughly 2.4 million farm jobs that need to be filled annually; and the agricultural work force continues to shrink. (This is my hint to the anti-immigration crowd). John Deere’s autonomous 9RX Tractor. Farmers can oversee it using an app. While each of these industries experiences their own set of challenges, a commonality across all is skilled labor availability. In construction, about 80% percent of contractors struggle to find skilled labor. And in commercial landscaping, 86% of landscaping business owners can’t find labor to fill open positions, he said. “They have to figure out how to do

Read More »

2025 playbook for enterprise AI success, from agents to evals

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More 2025 is poised to be a pivotal year for enterprise AI. The past year has seen rapid innovation, and this year will see the same. This has made it more critical than ever to revisit your AI strategy to stay competitive and create value for your customers. From scaling AI agents to optimizing costs, here are the five critical areas enterprises should prioritize for their AI strategy this year. 1. Agents: the next generation of automation AI agents are no longer theoretical. In 2025, they’re indispensable tools for enterprises looking to streamline operations and enhance customer interactions. Unlike traditional software, agents powered by large language models (LLMs) can make nuanced decisions, navigate complex multi-step tasks, and integrate seamlessly with tools and APIs. At the start of 2024, agents were not ready for prime time, making frustrating mistakes like hallucinating URLs. They started getting better as frontier large language models themselves improved. “Let me put it this way,” said Sam Witteveen, cofounder of Red Dragon, a company that develops agents for companies, and that recently reviewed the 48 agents it built last year. “Interestingly, the ones that we built at the start of the year, a lot of those worked way better at the end of the year just because the models got better.” Witteveen shared this in the video podcast we filmed to discuss these five big trends in detail. Models are getting better and hallucinating less, and they’re also being trained to do agentic tasks. Another feature that the model providers are researching is a way to use the LLM as a judge, and as models get cheaper (something we’ll cover below), companies can use three or more models to

Read More »

OpenAI’s red teaming innovations define new essentials for security leaders in the AI era

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams’ advanced capabilities in two areas: multi-step reinforcement and external red teaming. OpenAI recently released two papers that set a new competitive standard for improving the quality, reliability and safety of AI models in these two techniques and more. The first paper, “OpenAI’s Approach to External Red Teaming for AI Models and Systems,” reports that specialized teams outside the company have proven effective in uncovering vulnerabilities that might otherwise have made it into a released model because in-house testing techniques may have missed them. In the second paper, “Diverse and Effective Red Teaming with Auto-Generated Rewards and Multi-Step Reinforcement Learning,” OpenAI introduces an automated framework that relies on iterative reinforcement learning to generate a broad spectrum of novel, wide-ranging attacks. Going all-in on red teaming pays practical, competitive dividends It’s encouraging to see competitive intensity in red teaming growing among AI companies. When Anthropic released its AI red team guidelines in June of last year, it joined AI providers including Google, Microsoft, Nvidia, OpenAI, and even the U.S.’s National Institute of Standards and Technology (NIST), which all had released red teaming frameworks. Investing heavily in red teaming yields tangible benefits for security leaders in any organization. OpenAI’s paper on external red teaming provides a detailed analysis of how the company strives to create specialized external teams that include cybersecurity and subject matter experts. The goal is to see if knowledgeable external teams can defeat models’ security perimeters and find gaps in their security, biases and controls that prompt-based testing couldn’t find. What makes OpenAI’s recent papers noteworthy is how well they define using human-in-the-middle

Read More »