Get ONMINE

Stay Ahead, Stay ONMINE

Torus, Rocky Mountain Power sign MOU for 70-MW C&I demand response capability

Dive Brief: A memorandum of understanding between PacifiCorp subsidiary Rocky Mountain Power and Utah-based distributed energy solutions provider Torus could deliver 70 MW of commercial and industrial demand response capability to RMP’s Wattsmart Battery program within 12 to 18 months, Torus said on Feb. 7. Torus has already filled about one-third of the project’s expected […]

Dive Brief:

  • A memorandum of understanding between PacifiCorp subsidiary Rocky Mountain Power and Utah-based distributed energy solutions provider Torus could deliver 70 MW of commercial and industrial demand response capability to RMP’s Wattsmart Battery program within 12 to 18 months, Torus said on Feb. 7.
  • Torus has already filled about one-third of the project’s expected capacity and is “in active permitting and approvals for the deployment of those assets today,” Torus founder and CEO Nate Walkingshaw said in an interview.
  • The partnership “is a great example of Utah’s leadership in innovative energy solutions” as the state looks to double its power production capacity over the next 10 years while remaining a net energy exporter, Utah Gov. Spencer Cox, R, said last month.

Dive Insight:

The Wattsmart Battery program is “among the most advanced [virtual power plants] in the U.S. due to its degree of integration into the utility’s overall system operations and the wide array of use cases (grid services) of the battery aggregation,” the U.S. Department of Energy said last month in its updated Pathways to Commercial Liftoff: Virtual Power Plants report.

The program is already in heavy use, with more than 130 response events in 2024, primarily to manage late afternoon and evening loads, Walkingshaw said. Other energy management providers participate in its residential component, but Torus is the only vendor working with C&I customers, he added.

Under the MOU, Torus will deploy its hybrid flywheel battery energy storage systems behind the meter at commercial and industrial facilities across the Wattsmart program territory, which recently expanded from its Utah home base into Wyoming and parts of Idaho, Walkingshaw said. The company is focused on Utah but available to RMP customers in Wyoming and Idaho, a Torus spokesperson said.

Customers can immediately use the storage systems to reduce utility demand charges while allowing RMP to dispatch stored energy during demand response events that typically occur during less than 1% of hours each year, Walkingshaw said.

Wattsmart “lets them have their cake and eat it too,” he said.

Within the system, the Nova Spin flywheel provides near-instantaneous, short-duration discharge to improve customers’ power quality, facilitate black-start capabilities for onsite generation and provide inertial grid support during transmission outages due to wildfires or other events, Walkingshaw said. The Nova Pulse lithium-iron-phosphate battery provides backup power during unplanned outages and grid support during periods of peak demand, he added.

Nova Pulse batteries range in size from 270 kWh to 2.2 MWh and are expandable to 40 MWh, according to Torus’s website. The hybrid storage system as a whole lasts twice as long as chemical batteries alone thanks to Torus Spin’s ability to respond to surges in demand, which reduces wear on the battery component, Torus says.

The complete system comes with secure hardware and firmware developed in the United States, with 24/7 cybersecurity monitoring and threat detection, Torus said. Cybersecurity is a growing but still-underrated consideration for utilities and end users as distributed energy resources proliferate, Walkingshaw said.

“We are saying to [utilities], ‘Please deploy a modern stack of hardware and firmware that protects from nation-state actors,’” he said.

Shape
Shape
Stay Ahead

Explore More Insights

More Articles

Stay ahead with more perspectives on cutting-edge power, infrastructure, energy,  bitcoin and AI solutions. Explore these articles to uncover strategies and insights shaping the future of industries.

Shape

Fortinet speeds threat detection with improved FortiAnalyzer

The package also now integrates with FortiAI, the vendor’s genAI assistant, to better support analytics and telemetry to help security teams speed threat investigation and response, the vendor stated. “FortiAI identifies the threats that need analysis from the data collected by FortiAnalyzer, primarily collected from FortiGates. By automating the collection,

Read More »

Aryaka adds AI-powered observability to SASE platform

Nadkarni explained that Aryaka runs unsupervised machine learning models on the data to identify anomalies and outliers in the data. For example, the models may detect a sudden spike in traffic to a domain that has not been seen before. This unsupervised analysis helps surface potential issues or areas of

Read More »

Exxon Plans to Ramp Up Guyana Gas Output, Sees Potential for Exports

Exxon Mobil Corp. outlined plans to increase natural gas production from oil-focused Guyana and is considering options to export the fuel to global markets, country manager Alistair Routledge said Wednesday.  Exxon’s developments off the coast of Guyana have turned the South American nation into the world’s fastest-growing major oil producer, but the company has faced pressure from the government to do more with the natural gas that’s found alongside its crude.  Routledge today presented a concept called “Wales Gas Vision” that would send gas from Exxon’s Longtail development to the shore for use in producing fertilizer and alumina as well as for powering data centers. Exxon plans to make a final investment decision on Longtail next year with a view to bringing it online by 2029. Gas production from the project could reach 1.2 billion cubic feet per day. Building a pipeline to nearby Trinidad, which has liquefied natural gas export capacity, would be “cost prohibitive,” but Exxon is exploring other ways to sell Guyana’s gas internationally, Routledge said at the Guyana Energy Conference in Georgetown.  “There is still a possibility of using liquefied natural gas technology connectors to global markets,” he said. “That is a further option that is on the table and being investigated.”  The Wales Gas Vision proposal is separate from Guyana’s gas-to-energy project, for which Exxon has already completed an underwater pipeline to supply fuel for power generation. Routledge cautioned the ideas depend on volume uptake, price and timing.  WHAT DO YOU THINK? Generated by readers, the comments included herein do not reflect the views and opinions of Rigzone. All comments are subject to editorial review. Off-topic, inappropriate or insulting comments will be removed. MORE FROM THIS AUTHOR Bloomberg

Read More »

DeepSeek called a net positive for data centers despite overcapacity worries

The global race to develop sophisticated, versatile AI models is driving a surge in development of the physical infrastructure to support them. Microsoft, Amazon, Meta and Google parent Alphabet — four of the AI industry’s biggest players — plan to invest a combined $325 billion in capital expenditures in 2025, much of it for data centers and associated hardware.  The technology giants’ spending plans mark a 46% increase from their combined 2024 capital investments, according to Yahoo! Finance, and track a doubling in proposed data centers’ average size from 150 gigawatts to 300 gigawatts between January 2023 and October 2024. In December, Meta said it would build a $10 billion, 4 million-square-foot data center in Louisiana that could consume the power output equivalent of two large nuclear reactors. The planned spending announcements came after the January release of the highly efficient, open-source AI platform DeepSeek, which led some experts and investors to question just how much infrastructure — from high-performance chips to new power plants and electrical equipment — the AI boom actually requires. But experts interviewed by Facilities Dive see AI efficiency gains as a net positive for data center developers, operators and customers in the long run, despite shorter-term uncertainty that could temporarily create overcapacity in some markets. “Every technology has gotten more efficient” DeepSeek’s late January commercial launch took many Americans by surprise, but the rise of a more efficient and capable AI model follows a well-worn pattern of technology development, said K.R. Sridhar, founder, chairman and CEO of power solutions provider Bloom Energy. “In 2010, it took about 1,500 watt-hours to facilitate the flow of one gigabyte of information,” Sridhar said. “Last year it took about one tenth of that … [but] the total growth of traffic, and therefore the chips and energy, has been twice

Read More »

FERC complies with major portions of Trump order on independent agencies: Christie

A White House executive order setting requirements for the Federal Energy Regulatory Commission and other independent agencies largely covers actions FERC already does, according to FERC Chairman Mark Christie. “A lot of this in the EO is basically putting in one place past practices that have been going on for years,” Christie said Thursday during a media briefing.  FERC, for example, submits its budget and strategic plans to the Office of Management and Budget for review, as required by the executive order, Christie said. The agency sends major rulemakings to the OMB’s Office of Information and Regulatory Affairs for review, FERC chairmen consult with White House officials and the commission has complied with executive orders for decades, according to Christie. Even so, Christie said he needed more information from the White House about certain aspects of the executive order. “Does this contemplate a role in proceedings outside of our ex parte rules?” Christie asked. Also, FERC works on more than 1,000 cases a year and it is unclear if any of them would undergo some sort of review because of the executive order, according to Christie. OMB is likely concerned about large, sweeping regulations issued by agencies, not routine cases that are initiated by third parties, Christie said. “We’re going to ask the appropriate places for more detail and see how this plays out,” Christie said. FERC’s activity is largely governed by the Federal Power Act, the Natural Gas Act, the Administrative Procedure Act, the National Environmental Policy Act and the Sunshine Act, Christie said. “At the end of the day, we follow the law,” he said. The executive order includes a clause stating that nothing in the document affects existing law or the authority of an agency under existing law, Christie noted. FERC was established under the Department of

Read More »

FERC launches colocation review, plus 6 other open meeting takeaways

The Federal Energy Regulatory Commission on Thursday launched a review of issues related to colocating large loads, such as data centers, at power plants in the PJM Interconnection. “There are tremendous implications for reliability and consumers, and we have to be fair,” FERC Chairman Mark Christie said during the agency’s monthly meeting. At the same time, utilities have an obligation to serve new customers, he said. FERC’s effort to clarify rules for colocated load comes amid a surge in data center development across the United States, partly driven by the growth of artificial intelligence. Colocating data centers at existing power plants provides a potential pathway to bringing data centers online quickly and at lower cost compared with “front of meter” options. However, new rules governing colocated resources in PJM likely won’t be approved by FERC until early next year, creating a period of uncertainty for independent power producers such as Talen Energy and Vistra by delaying deal announcements with data center operators, Capstone analysts said Thursday. FERC aims to approve new colocation rules for PJM this year, said Ben Williams, FERC director of the office of external affairs. The agency expects it will vote on a PJM proposal within three months of one being filed at the commission, he noted. The lack of near-term clarity on colocation is another negative development for IPPs and raises the potential that data center developers will prefer to work with regulated utilities instead of in competitive markets, Jeffries analysts said. Issues surrounding siting data centers at large power plants in PJM came to a head late last year. The agency in November rejected an amended interconnection service agreement that would have facilitated expanded power sales to a colocated Amazon data center from the Susquehanna nuclear power plant in Pennsylvania that is majority owned by

Read More »

Torus, Rocky Mountain Power sign MOU for 70-MW C&I demand response capability

Dive Brief: A memorandum of understanding between PacifiCorp subsidiary Rocky Mountain Power and Utah-based distributed energy solutions provider Torus could deliver 70 MW of commercial and industrial demand response capability to RMP’s Wattsmart Battery program within 12 to 18 months, Torus said on Feb. 7. Torus has already filled about one-third of the project’s expected capacity and is “in active permitting and approvals for the deployment of those assets today,” Torus founder and CEO Nate Walkingshaw said in an interview. The partnership “is a great example of Utah’s leadership in innovative energy solutions” as the state looks to double its power production capacity over the next 10 years while remaining a net energy exporter, Utah Gov. Spencer Cox, R, said last month. Dive Insight: The Wattsmart Battery program is “among the most advanced [virtual power plants] in the U.S. due to its degree of integration into the utility’s overall system operations and the wide array of use cases (grid services) of the battery aggregation,” the U.S. Department of Energy said last month in its updated Pathways to Commercial Liftoff: Virtual Power Plants report. The program is already in heavy use, with more than 130 response events in 2024, primarily to manage late afternoon and evening loads, Walkingshaw said. Other energy management providers participate in its residential component, but Torus is the only vendor working with C&I customers, he added. Under the MOU, Torus will deploy its hybrid flywheel battery energy storage systems behind the meter at commercial and industrial facilities across the Wattsmart program territory, which recently expanded from its Utah home base into Wyoming and parts of Idaho, Walkingshaw said. The company is focused on Utah but available to RMP customers in Wyoming and Idaho, a Torus spokesperson said. Customers can immediately use the storage systems to reduce utility

Read More »

U.S. Department of Energy Recognizes National Black History Month, 2025

WASHINGTON— U.S. Secretary of Energy Chris Wright released the following statement in recognition of National Black History Month – February 2025:  “Today, I am honored to join President Trump in recognizing February 2025 as National Black History Month. Throughout our history, Black Americans have strengthened our nation’s position as a global leader in energy production, science, and technology. Lewis Latimer’s contributions to electric lighting, Dr. George Washington Carver’s advancements in biofuels, and Dr. William Knox and Dr. Blanche Lawrence’s critical work on the Manhattan Project are just a few examples of the innovation and dedication to excellence that embody the American spirit—one of hard work, determination, and a relentless drive to achieve greatness.  “The Department of Energy remains committed to advancing bold, America-first energy policies that empower our workforce, fuel economic growth, and solidify our nation’s leadership on the world stage. This Black History Month, join us as we celebrate the patriots and pioneers who have contributed to America’s energy success and look forward to a future where we continue to lead the world in energy production, innovation, and strength.” ###

Read More »

Do data centers threaten the water supply?

In a new report, the Royal Academy of Engineering called upon the government to ensure tech companies accurately report how much energy and water their data centers are using and reducing the use of drinking water for cooling. Without such action, warns one of the report’s authors, Professor Tom Rodden, “we face a real risk that our development, deployment and use of AI could do irreparable damage to the environment.” The situation is a little different for the US as the country has large bodies of water offering a  water supply that the UK just does not have. It’s not an accident that there are many data centers around the Chicago area: they’ve also got the Great Lakes to draw upon. Likewise, the Columbia and Klamath Rivers have become magnets for data centers for both water supply and hydroelectric power. Other than the Thames River, the UK doesn’t have these massive bodies of water. Still, the problem is not unique to the UK, says Alan Howard, senior analyst with Omdia. He notes that Microsoft took heat last year because it was draining the water supply of a small Arizona town of Goodyear with a new AI-oriented data center.  The city of Chandler, Arizona passed an ordinance in 2015 that restricted new water-intensive businesses from setting up shop which slowed data center development.   “I believe some data center operators just bowed out,” said Howard.

Read More »

Ireland says there will be no computation without generation

Stanish said that, in 2023, she wrote a paper that predicted “by 2028, more than 70% of multinational enterprises will alter their data center strategies due to limited energy supplies and data center moratoriums, up from only about 5% in 2023. It has been interesting watching this trend evolve as expected, with Ireland being a major force in this conversation since the boycotts against data center growth started a few years ago.” Fair, equitable, and stable electricity allocation, she said, “means that the availability of electricity for digital services is not guaranteed in the future, and I expect these policies, data center moratoriums, and regional rejections will only continue and expand moving forward.” Stanish pointed out that this trend is not just occurring in Ireland. “Many studies show that, globally, enterprises’ digital technologies are consuming energy at a faster rate than overall growth in energy supply (though, to be clear, these studies mostly assume a static position on energy efficiency of current technologies, and don’t take into account potential for nuclear or hydrogen to assuage some of these supply issues).” If taken at face value, she said, this means that a lack of resources could cause widespread electricity shortages in data centers over the next several years. To mitigate this, Stanish said, “so far, data center moratoriums and related constraints (including reduced tax incentives) have been enacted in the US (specifically Virginia and Georgia), Denmark, Singapore, and other countries, in response to concerns about the excessive energy consumption of IT, particularly regarding compute-intense AI workloads and concerns regarding an IT energy monopoly in certain regions. As a result, governments (federal, state, county, etc.) are working to ensure that consumption does not outpace capacity.” Changes needed In its report, the CRU stated, “a safe and secure supply of energy is essential

Read More »

Perspective: Can We Solve the AI Data Center Power Crisis with Microgrids?

President Trump announced a$500 billion private sector investment in the nation’s Artificial Intelligence (AI) infrastructure last month. The investment will come from The Stargate Project, a joint venture between OpenAI, SoftBank, Oracle and MGX, which intends to build 20 new AI data centers in the U.S in the next four to five years. The Stargate Project committed$100 billion for immediate deployment and construction has already begun on its first data center in Texas. At approximately a half a million square feet each, the partners say these new facilities will cement America’s leadership in AI, create jobs and stimulate economic growth. Stargate is not the only game in town, either. Microsoft is expected to invest$80 billion in AI data center development in 2025, with Google, AWS and Meta also spending big. While all this investment in AI infrastructure is certainly exciting, experts say there’s one lingering question that’s yet to be answered and it’s a big one: How are we going to power all these AI data centers? This will be one of the many questions tackled duringMicrogrid Knowledge’s annual conference, which will be held in Texas April 15-17 at the Sheraton Dallas. “Powering Data Centers: Collaborative Microgrid Solutions for a Growing Market” will be one of the key sessions on April 16. Industry experts will gather to discuss how private entities, developers and utilities can work together to deploy microgrids and distributed energy technologies that address the data center industry’s power needs. The panel will share solutions, technologies and strategies that will favorably position data centers in the energy queue. In advance of this session, we sat down with two microgrid experts to learn more about the challenges facing the data center industry and how microgrids can address the sector’s growing energy needs. We spoke with Michael Stadler, co-founder and

Read More »

Data Center Tours: Iron Mountain VA-1, Manassas, Virginia

Iron Mountain Northern Virginia Overview Iron Mountain’s Northern Virginia data centers VA-1 through VA-7 are situated on a 142-acre highly secure campus in Prince William County, Virginia. Located at 11680 Hayden Road in Manassas, Iron Mountain VA-1 spans 167,958 sq. ft. and harbors 12.4 MW of total capacity to meet colocation needs. The 36 MW VA-2 facility stands nearby. The total campus features a mixture of single and multi-tenant facilities which together provide more than 2,000,000 SF of highly efficient green colocation space for enterprises, federal agencies, service providers and hyperscale clouds.  The company notes that its Manassas campus offers tax savings compared to Ashburn and exceptional levels of energy-efficiency as well as a diverse and accessible ecosystem of cloud, network and other service providers.  Iron Mountain’s Virginia campus has 9 total planned data centers, with 5 operational facilities to date and two more data centers coming soon. VA-2 recently became the first data center in the United States to achieve DCOS Maturity Level 3.    As we continued the tour, Kinra led the way toward the break room, an area where customers can grab coffee or catch up on work. Unlike the high-end aesthetic of some other colocation providers, Iron Mountain’s approach is more practical and focused on functionality. At the secure shipping and receiving area, Kinra explained the process for handling customer equipment. “This is where our customers ship their equipment into,” he said. “They submit a ticket, send their shipments in, and we’ll take it, put it aside for them, and let them know when it’s here. Sometimes they ask us to take it to their environment, which we’ll do for them via a smart hands ticket.” Power Infrastructure and Security Measures The VA-1 campus is supported by a single substation, providing the necessary power for its growing

Read More »

Land and Expand: DPO, Microsoft, JLL and BlackChamber, Prologis, Core Scientific, Overwatch Capital

Land and Expand is a periodic feature at Data Center Frontier highlighting the latest data center development news, including new sites, land acquisitions and campus expansions. Here are some of the new and notable developments from hyperscale and colocation data center developers and operators about which we’ve been reading lately. DPO to Develop $200 Million AI Data Center in Wisconsin Rapids; Strategic Partnership with Billerud’s CWPCo Unlocks Hydroelectric Power for High-Density AI Compute Digital Power Optimization (DPO) is moving forward with plans to build a $200 million high-performance computing (HPC) data center in Wisconsin Rapids, Wisconsin. The project, designed to support up to 20 megawatts (MW) of artificial intelligence (AI) computing, leverages an innovative partnership with Consolidated Water Power Company (CWPCo), a subsidiary of global packaging leader Billerud. DPO specializes in developing and operating data centers optimized for power-dense computing. By partnering with utilities and independent power producers, DPO colocates its facilities at energy generation sites, ensuring direct access to sustainable power for AI, HPC, and blockchain computing. The company is privately held. Leveraging Power Infrastructure for Speed-to-Energization CWPCo, a regulated utility subsidiary, has operated hydroelectric generation assets since 1894, reliably serving industrial and commercial customers in Wisconsin Rapids, Biron, and Stevens Point. Parent company Billerud is a global leader in high-performance packaging materials, committed to sustainability and innovation. The company operates nine production facilities across Sweden, the USA, and Finland, employing 5,800 people in over 19 countries.  The data center will be powered by CWPCo’s renewable hydroelectric assets, tapping into the utility’s existing 32 megawatts of generation capacity. The partnership grants DPO a long-term land lease—extending up to 50 years—alongside interconnection rights to an already-energized substation and a firm, reliable power supply. “AI infrastructure is evolving at an unprecedented pace, and access to power-dense sites is critical,” said Andrew

Read More »

Data center spending to top $1 trillion by 2029 as AI transforms infrastructure

His projections account for recent advances in AI and data center efficiency, he says. For example, the open-source AI model from Chinese company DeepSeek seems to have shown that an LLM can produce very high-quality results at a very low cost with some clever architectural changes to how the models work. These improvements are likely to be quickly replicated by other AI companies. “A lot of these companies are trying to push out more efficient models,” says Fung. “There’s a lot of effort to reduce costs and to make it more efficient.” In addition, hyperscalers are designing and building their own chips, optimized for their AI workloads. Just the accelerator market alone is projected to reach $392 billion by 2029, Dell’Oro predicts. By that time, custom accelerators will outpace commercially available accelerators such as GPUs. The deployment of dedicated AI servers also has an impact on networking, power and cooling. As a result, spending on data center physical infrastructure (DCPI) will also increase, though at a more moderate pace, growing by 14% annually to $61 billion in 2029.  “DCPI deployments are a prerequisite to support AI workloads,” says Tam Dell’Oro, founder of Dell’Oro Group, in the report. The research firm raised its outlook in this area due to the fact that actual 2024 results exceeded its expectations, and demand is spreading from tier one to tier two cloud service providers. In addition, governments and tier one telecom operators are getting involved in data center expansion, making it a long-term trend.

Read More »

Microsoft will invest $80B in AI data centers in fiscal 2025

And Microsoft isn’t the only one that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs).  In a report published in October 2024, Bloomberg Intelligence estimated that demand for generative AI would push Microsoft, AWS, Google, Oracle, Meta, and Apple would between them devote $200 billion to capex in 2025, up from $110 billion in 2023. Microsoft is one of the biggest spenders, followed closely by Google and AWS, Bloomberg Intelligence said. Its estimate of Microsoft’s capital spending on AI, at $62.4 billion for calendar 2025, is lower than Smith’s claim that the company will invest $80 billion in the fiscal year to June 30, 2025. Both figures, though, are way higher than Microsoft’s 2020 capital expenditure of “just” $17.6 billion. The majority of the increased spending is tied to cloud services and the expansion of AI infrastructure needed to provide compute capacity for OpenAI workloads. Separately, last October Amazon CEO Andy Jassy said his company planned total capex spend of $75 billion in 2024 and even more in 2025, with much of it going to AWS, its cloud computing division.

Read More »

John Deere unveils more autonomous farm machines to address skill labor shortage

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Self-driving tractors might be the path to self-driving cars. John Deere has revealed a new line of autonomous machines and tech across agriculture, construction and commercial landscaping. The Moline, Illinois-based John Deere has been in business for 187 years, yet it’s been a regular as a non-tech company showing off technology at the big tech trade show in Las Vegas and is back at CES 2025 with more autonomous tractors and other vehicles. This is not something we usually cover, but John Deere has a lot of data that is interesting in the big picture of tech. The message from the company is that there aren’t enough skilled farm laborers to do the work that its customers need. It’s been a challenge for most of the last two decades, said Jahmy Hindman, CTO at John Deere, in a briefing. Much of the tech will come this fall and after that. He noted that the average farmer in the U.S. is over 58 and works 12 to 18 hours a day to grow food for us. And he said the American Farm Bureau Federation estimates there are roughly 2.4 million farm jobs that need to be filled annually; and the agricultural work force continues to shrink. (This is my hint to the anti-immigration crowd). John Deere’s autonomous 9RX Tractor. Farmers can oversee it using an app. While each of these industries experiences their own set of challenges, a commonality across all is skilled labor availability. In construction, about 80% percent of contractors struggle to find skilled labor. And in commercial landscaping, 86% of landscaping business owners can’t find labor to fill open positions, he said. “They have to figure out how to do

Read More »

2025 playbook for enterprise AI success, from agents to evals

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More 2025 is poised to be a pivotal year for enterprise AI. The past year has seen rapid innovation, and this year will see the same. This has made it more critical than ever to revisit your AI strategy to stay competitive and create value for your customers. From scaling AI agents to optimizing costs, here are the five critical areas enterprises should prioritize for their AI strategy this year. 1. Agents: the next generation of automation AI agents are no longer theoretical. In 2025, they’re indispensable tools for enterprises looking to streamline operations and enhance customer interactions. Unlike traditional software, agents powered by large language models (LLMs) can make nuanced decisions, navigate complex multi-step tasks, and integrate seamlessly with tools and APIs. At the start of 2024, agents were not ready for prime time, making frustrating mistakes like hallucinating URLs. They started getting better as frontier large language models themselves improved. “Let me put it this way,” said Sam Witteveen, cofounder of Red Dragon, a company that develops agents for companies, and that recently reviewed the 48 agents it built last year. “Interestingly, the ones that we built at the start of the year, a lot of those worked way better at the end of the year just because the models got better.” Witteveen shared this in the video podcast we filmed to discuss these five big trends in detail. Models are getting better and hallucinating less, and they’re also being trained to do agentic tasks. Another feature that the model providers are researching is a way to use the LLM as a judge, and as models get cheaper (something we’ll cover below), companies can use three or more models to

Read More »

OpenAI’s red teaming innovations define new essentials for security leaders in the AI era

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams’ advanced capabilities in two areas: multi-step reinforcement and external red teaming. OpenAI recently released two papers that set a new competitive standard for improving the quality, reliability and safety of AI models in these two techniques and more. The first paper, “OpenAI’s Approach to External Red Teaming for AI Models and Systems,” reports that specialized teams outside the company have proven effective in uncovering vulnerabilities that might otherwise have made it into a released model because in-house testing techniques may have missed them. In the second paper, “Diverse and Effective Red Teaming with Auto-Generated Rewards and Multi-Step Reinforcement Learning,” OpenAI introduces an automated framework that relies on iterative reinforcement learning to generate a broad spectrum of novel, wide-ranging attacks. Going all-in on red teaming pays practical, competitive dividends It’s encouraging to see competitive intensity in red teaming growing among AI companies. When Anthropic released its AI red team guidelines in June of last year, it joined AI providers including Google, Microsoft, Nvidia, OpenAI, and even the U.S.’s National Institute of Standards and Technology (NIST), which all had released red teaming frameworks. Investing heavily in red teaming yields tangible benefits for security leaders in any organization. OpenAI’s paper on external red teaming provides a detailed analysis of how the company strives to create specialized external teams that include cybersecurity and subject matter experts. The goal is to see if knowledgeable external teams can defeat models’ security perimeters and find gaps in their security, biases and controls that prompt-based testing couldn’t find. What makes OpenAI’s recent papers noteworthy is how well they define using human-in-the-middle

Read More »
More Articles