Stay Ahead, Stay ONMINE

Introducing MASK: A Benchmark for Measuring Honesty in AI Systems

This is a linkpost for https://www.mask-benchmark.ai/
This is a linkpost for https://www.mask-benchmark.ai/
Shape
Shape
Stay Ahead

Explore More Insights

Stay ahead with more perspectives on cutting-edge power, infrastructure, energy,  bitcoin and AI solutions. Explore these articles to uncover strategies and insights shaping the future of industries.

Shape

SolarWinds buys Squadcast to speed incident response

Squadcast customers shared their experiences with the technology. “Since implementing Squadcast, we’ve reduced incoming alerts from tens of thousands to hundreds, thanks to flexible deduplication. It has a direct impact on reducing alert fatigue and increasing awareness,” said Avner Yaacov, Senior Manager at Redis, in a statement. According to SolarWinds,

Read More »

Tariffs won’t impact IT organizations, for now anyway

The idea behind tariffs is to increase domestic manufacturing, but Almassy notes the United Stated doesn’t have the manufacturing capacity or capability that Taiwan does. TSMC, Samsung, and GlobalFoundries have some fabs here but they are not building the most leading edge technologies. “Those are all in Taiwan at the

Read More »

EIR Downgrades Brent Price Forecast

In a statement sent to Rigzone late Wednesday by the Enverus team, Enverus Intelligence Research (EIR), a subsidiary of Enverus, said it has downgraded its Brent price forecast “due to recent events including OPEC+ production cuts and President Trump’s tariffs”.  EIR revealed in the statement that it now sees the Brent price averaging $70 per barrel this year and $65 per barrel next year. “The unwinding of OPEC cuts was a counter-consensus decision, especially with Brent trading in the low $70s,” EIR Director Al Salazar said in the statement. “This is an indication to EIR that OPEC+ is willing to risk lower pricing levels to recapture market share,” Salazar added. “There are no more delays or speculation. Trump’s tariffs have been implemented, and the retaliation has begun. Should tariffs stick, global economic growth in 2025 will be lower than 2024 and oil demand will suffer,” Salazar went on to state. In a BMI report sent to Rigzone by the Fitch Group late Monday, BMI, a unit of Fitch Solutions, projected that the Brent price will average $76 per barrel in 2025, $75 per barrel in 2026, and $75 per barrel across 2027, 2028, and 2029. A Bloomberg consensus included in that report projected that Brent will come in at $73 per barrel this year, $71 per barrel in 2026, $73 per barrel in 2027, $71 per barrel in 2028, and $69 per barrel in 2029. BMI is a contributor to the Bloomberg consensus, BMI noted in the report. “This month we are holding to our forecast for Brent crude to average $76 per barrel, down from $80 per barrel,” BMI analysts said in the BMI report. “Prices have trended lower under U.S. President Donald Trump’s first few weeks in office, with the front-month contract falling from its year to date

Read More »

Valeura Boosts Manora Field Production Capacity

Valeura Energy Inc. has completed an infill drilling campaign at the Manora field in Licence G1/48 (70 percent operated working interest) offshore the Gulf of Thailand. The company said in a press release it drilled a five-well program comprising three production-oriented development wells and two appraisal wells. In aggregate, the company said its Manora field working-interest oil production before royalties has increased from 2,144 barrels per day (bpd) in December 2024 to 2,866 bpd.  Additionally, the appraisal wells yielded between three and five potential future drilling targets, which will be further evaluated for inclusion in a future drilling program, the company said. “Our most recent drilling at Manora has both increased oil production rates and successfully appraised additional targets which will form the basis of future infill development drilling. While the Manora field accounts for only about 10 percent of our year-to-date production, it is an excellent example of the potential for Gulf of Thailand fields to add many years of economic field life through targeted ongoing activity”, Sean Guest, President and CEO of Valeura, said. “In 2025, we intend to pursue a full year of drilling operations across our portfolio, aimed at continuing our proven track record of adding reserves year on year to support continued cash flow generation.” The A34 well was drilled into the deep 600-series sands of the eastern fault block and completed as a multi-zone producer. The horizontal A38 well targeted shallower 300-series sands, also completed as a producer incorporating an innovative downhole autonomous inflow control device (ICD) to manage water and oil production. The company said it is monitoring the impact of this and other ICDs for optimization. The A36 well focused on multiple known producing intervals in the main fault block and was also completed as a multi-zone infill development well, with production

Read More »

Accelera, GAIL Partner on Green Hydrogen Development in India

Cummins’ zero-emission business Accelera has signed a memorandum of understanding with GAIL (India) Ltd., a major natural gas player in the country, on green hydrogen and zero-emissions technologies in India. In a media release, Accelera said the collaboration will leverage its expertise in hydrogen generation technology and GAIL’s established natural gas infrastructure to explore opportunities in hydrogen production, blending, transportation, and storage. The partnership will also evaluate and develop projects for hydrogen applications across multiple sectors, including transport, power, and steel, Accelera said. “Accelera’s collaboration with a partner like GAIL demonstrates the potential of green hydrogen and the capability of large-scale electrolysis for diverse applications”, Alex Savelli, Global Commercial Leader for Electrolyzers at Accelera, said. “By combining our advanced electrolyzer technology with GAIL’s extensive energy infrastructure and leading market presence, we are well positioned to accelerate the adoption of green hydrogen across India”. Accelera had helped with GAIL’s green hydrogen facility in Vijaipur, Madhya Pradesh, commissioned 2024.  Accelera provided a 10-megawatt PEM electrolyzer system, consisting of two HyLYZER-1000 units, capable of producing 4.3 tons of green hydrogen daily. This hydrogen is blended into GAIL’s natural gas supply, Accelera said. “Building upon the successful implementation of our Vijaipur project, this partnership with Accelera strengthens our commitment to India’s National Green Hydrogen Mission”, Rajeev Kumar Singhal, Director of Business Development at GAIL, said. “Together, we will work towards developing a robust hydrogen value chain that supports India’s ambitious goal of producing 5 million tons of green hydrogen annually by 2030”. The collaboration will share knowledge on hydrogen blending with natural gas, develop industry standards, and explore new green hydrogen applications, Accelera said. Accelera is a major player in large-scale hydrogen production using PEM electrolysis, with over 600 electrolyzer units deployed globally. These include a 20 MW facility in Quebec, Canada, and a

Read More »

Habour Energy pays 108% UK tax

The North Sea’s largest independent operator said it is paying more to the UK tax man than it earns as it revealed its latest accounts for 2024. Harbour Energy (LON: HBR) said its annual report revealed pre-tax profits had doubled to $1.2 billion (£920 million) although this was $800,000 lower due to “non-cash accounting charges” driven by “adverse changes to the UK fiscal regime”. After paying tax, the firm said it actually made a loss of $93 million, compared to a $45m post-tax profit the year before. This was due to a “108% effective tax rate”. The firm has since changed tack. Last year it acquired German rival Wintershall DEA in a deal worth $11.2bn, mostly in an effort to pivot away from its reliance on the UK North Sea. The deal has proved positive as revenues rose 65% to $6.2billion and oil and gas production rose 40% to  258 kboepd. Safety However the widening of its portfolio to across the world has brought with it safety issues. The firm admitted it hosted its “first-ever tier 1 process safety event” in Indonesia – which describes the most serious consequences due to an accidental spill of hazardous materials. The company added it had three slightly less serious tier 2 events, highlighting that its total recordable injury rate (TRIR) has increased to 1 per million hours worked compared to 0.7 in 2023. The firm said this reflected higher injury rates “from the newly acquired assets for the last four months of 2024”. Following the acquisition of Wintershall, the firm has significant assets in Norway and the UK, 30% of its assets in conventional offshore growth projects in Mexico and Indonesia, with the remaining 30% in the onshore Vaca Muerta shale play in Argentina. Ahead of its capital markets event on Thursday, it

Read More »

Equinor Makes Gas Discovery in Halten Area of Norwegian Sea

Equinor ASA and its partners have proven natural gas and condensate in production license 1119 in the Halten area of the Norwegian Sea. Preliminary estimates from the drilling of the Mistral Sør exploration well, or well 6406/6-7 S, indicate 3-7 million standard cubic meters of oil equivalent in recoverable resources, corresponding to 19-44 million barrels of oil equivalent, according to the Norwegian majority state-owned company. “The licensees’ assessment is that this is a commercial discovery, and they will consider tie-back to existing infrastructure or development together with other discoveries in the area”, Equinor said in an online statement. “Mistral Sør is situated just a short distance north of Linnorm, the largest gas discovery on the Norwegian continental shelf that has yet to be developed”, Equinor noted. It has raised its stake in Linnorm to 50 percent after acquiring Shell PLC’s operating 30 percent interest, in a transaction completed April 2024. Linnorm is estimated to hold about 25-30 billion cubic meters (882.87 billion-1.06 trillion cubic feet) of recoverable gas, according to Equinor. The Norwegian Offshore Directorate said separately, “Wildcat well 6406/6-7 S is the first well drilled by the licensees in production license 1119, but the fifth within the license area as a whole”. Grete B. Haaland, Equinor senior vice president for Exploration & Production North, commented, “Norwegian gas is in high demand and is crucial to Europe’s energy security”. “That’s why it’s important for us to continue exploring and making new discoveries so we can maintain a high level of deliveries”, Haaland added. “This discovery was made in an area where gas infrastructure is already in place, and which we’re also continuing to develop. We have active exploration efforts underway in this area, which have resulted in several discoveries in recent years”. The drilling of Mistral Sør, conducted by Odfjell Drilling Ltd.’s Deepsea Atlantic,

Read More »

Unlocking the huge potential of people working in energy

Attracting and retaining the talented people we need to seize the opportunities ahead is a serious challenge as we transition to a low-carbon economy. The people across our industry have an invaluable part to play in decarbonising our economy as this is quite simply one of the biggest engineering projects this country has ever faced. As OEUK’s head of the energy services agreement, skills and employment, I work on many projects focusing on the thousands of skilled people who work in offshore energy. Over the past year, we’ve seen significant progress on several fronts. Milestones include the energy skills passport we launched jointly with RenewablesUK and with support from the UK and Scottish governments. This industry-led project provides people with a practical online tool that enables them to build new careers across energy sectors, enabling them to make informed decisions about their jobs and future. Although we are in the first phase of this project, it’s already helping us develop a more flexible, multi-skilled and technology enabled workforce. We expect the passport to evolve as the UK’s energy production profile changes from oil and gas to a broader low-carbon energy mix in years to come. However, while we still have significant oil and gas reserves in the North Sea, we should use them responsibly alongside the emerging renewable energies. © Supplied by OEUKIrene Bruce, Head of Energy Services Agreement, Employment and Skills, OEUK. In 2024 I was delighted to see the Energy Industries Council present the Collaboration award to the contractor-led Connected Competence programme, enabled by the Engineering Construction Industry Training Board (ECITB). This recognises how operators, contractors, training providers and industry partners are working together, each committed to standardising base technical competence. Mutual recognition of key skills in various energy sectors gives us a competitive international advantage because it

Read More »

AI driving a 165% rise in data center power demand by 2030

Goldman Sachs Research estimates the power usage by the global data center market to be around 55 gigawatts, which breaks down as 54% for cloud computing workloads, 32% for traditional line of business workloads and 14% for AI. By 2027, that number jumps to 84 GW, with AI growing to 27% of the overall market, cloud dropping to 50%, and traditional workloads falling to 23%, Schneider stated. Goldman Sachs Research estimates that there will be around 122 GW of data center capacity online by the end of 2030, and the density of power use in data centers is likely to grow as well, from 162 kilowatts per square foot to 176 KW per square foot in 2027, thanks to AI, Schneider stated.  “Data center supply — specifically the rate at which incremental supply is built — has been constrained over the past 18 months,” Schneider wrote. These constraints have arisen from the inability of utilities to expand transmission capacity because of permitting delays, supply chain bottlenecks, and infrastructure that is both costly and time-intensive to upgrade. The result is that due to power demand from data centers, there will need to be additional utility investment, to the tune of about $720 billion of grid spending through 2030. And then they are subject to the pace of public utilities, which move much slower than hyperscalers. “These transmission projects can take several years to permit, and then several more to build, creating another potential bottleneck for data center growth if the regions are not proactive about this given the lead time,” Schneider wrote.

Read More »

Top data storage certifications to sharpen your skills

Organization: Hitachi Vantara Skills acquired: Knowledge of data center infrastructure management tasks automation using Hitachi Ops Center Automator. Price: $100 Exam duration: 60 minutes How to prepare: Knowledge of all storage-related operations from an end-user perspective, including planning, allocating, and managing storage and architecting storage layouts. Read more about Hitachi Vantara’s training and certification options here. Certifications that bundle cloud, networking and storage skills AWS Certified Solutions Architect – Professional The AWS Certified Solutions Architect – Professional certification from leading cloud provider Amazon Web Services (AWS) helps individuals showcase advanced knowledge and skills in optimizing security, cost, and performance, and automating manual processes. The certification is a means for organizations to identify and develop talent with these skills for implementing cloud initiatives, according to AWS. The ideal candidate has the ability to evaluate cloud application requirements, make architectural recommendations for deployment of applications on AWS, and provide expert guidance on architectural design across multiple applications and projects within a complex organization, AWS says. Certified individuals report increased credibility with technical colleagues and customers as a result of earning this certification, it says. Organization: Amazon Web Services Skills acquired: Helps individuals showcase skills in optimizing security, cost, and performance, and automating manual processes Price: $300 Exam duration: 180 minutes How to prepare: The recommended experience prior to taking the exam is two or more years of experience in using AWS services to design and implement cloud solutions Cisco Certified Internetwork Expert (CCIE) Data Center The Cisco CCIE Data Center certification enables individuals to demonstrate advanced skills to plan, design, deploy, operate, and optimize complex data center networks. They will gain comprehensive expertise in orchestrating data center infrastructure, focusing on seamless integration of networking, compute, and storage components. Other skills gained include building scalable, low-latency, high-performance networks that are optimized to support artificial intelligence (AI)

Read More »

Netskope expands SASE footprint, bolsters AI and automation

Netskope is expanding its global presence by adding multiple regions to its NewEdge carrier-grade infrastructure, which now includes more than 75 locations to ensure processing remains close to end users. The secure access service edge (SASE) provider also enhanced its digital experience monitoring (DEM) capabilities with AI-powered root-cause analysis and automated network diagnostics. “We are announcing continued expansion of our infrastructure and our continued focus on resilience. I’m a believer that nothing gets adopted if end users don’t have a great experience,” says Netskope CEO Sanjay Beri. “We monitor traffic, we have multiple carriers in every one of our more than 75 regions, and when traffic goes from us to that destination, the path is direct.” Netskope added regions including data centers in Calgary, Helsinki, Lisbon, and Prague as well as expanded existing NewEdge regions including data centers in Bogota, Jeddah, Osaka, and New York City. Each data center offers customers a range of SASE capabilities including cloud firewalls, secure web gateway (SWG), inline cloud access security broker (CASB), zero trust network access (ZTNA), SD-WAN, secure service edge (SSE), and threat protection. The additional locations enable Netskope to provide coverage for more than 220 countries and territories with 200 NewEdge Localization Zones, which deliver a local direct-to-net digital experience for users, the company says.

Read More »

Inside the Nuclear Race for Data Center Energy with Aalo Atomics CEO Matt Loszak

The latest episode of the DCF Show podcast delves into one of the most pressing challenges facing the data center industry today: the search for sustainable, high-density power solutions. And how, as hyperscale operators like Google and Meta contend with growing energy demands—and, in some cases, resistance from utilities unwilling or unable to support their expanding footprints—the conversation around nuclear energy has intensified.  Both legacy nuclear providers and innovative startups are racing to secure the future business of data center giants, each bringing unique approaches to the table. Our guest for this podcast episode is Matt Loszak, co-founder and CEO of Aalo Atomics, an Austin-based company that’s taking a fresh approach to nuclear energy. Aalo, which secured a $29.5 million Series A funding round in 2024, stands out in the nuclear sector with its 10-megawatt sodium-cooled reactor design—eliminating the need for water, a critical advantage for siting flexibility. Inspired by the Department of Energy’s MARVEL microreactor, Aalo’s technology benefits from direct expertise, as the company’s CTO was the chief architect behind MARVEL. Beyond reactor design, Aalo’s vision extends to full-scale modular plant production. Instead of just building reactors, the company aims to manufacture entire nuclear plants using prefabricated, LEGO-style components. The fully modular plants, shipped in standard containers, are designed to match the footprint of a data center while requiring no onsite water—features that could make them particularly attractive to hyperscale operators seeking localized, high-density power.  Aalo has already made significant strides, with the Department of Energy identifying land at Idaho National Laboratory (INL) as a potential site for its first nuclear facility. The company is on an accelerated timeline, expecting to complete a non-nuclear prototype within three months and break ground on its first nuclear reactor in about a year—remarkably fast progress for the nuclear industry. In our discussion,

Read More »

Does It Matter If Microsoft Is Cancelling AI Data Center Leases?

Strategic Reallocation: Microsoft is a major owner and operator of data centers and might be reallocating resources to in-house infrastructure rather than leased spaces. Supply Chain Delays: TD Cowen noted that Microsoft used power and facility delays as justifications for voiding agreements, a tactic previously employed by Meta. Oversupply Issues: Analysts at TD Cowen speculate that Microsoft may have overestimated AI demand, leading to an excess in capacity. As it is all speculation, it could simply be that the latest information has driven Microsoft to reevaluate demand and move to more closely align projected supply with projected demand. Microsoft has reiterated their commitment to spend $80 billion on AI in the coming year. Reallocating this spending internally or wit a different set of partners remains on the table. And when you put the TD Cowen report that Microsoft has cancelled leases for “a couple hundred megawatts” into context with Microsoft’s overall leased power, which is estimated at around 20 GW, you see that more than 98% of their energy commitment remains unchanged. Investment Markets Might See the Biggest Hits Microsoft’s retreat has had ripple effects on the stock market, particularly among energy and infrastructure companies. European firms like Schneider Electric and Siemens Energy experienced a decline in stock value, indicating fears that major AI companies might scale back energy-intensive data center investments. However, at press time we have not seen any other indicators that this is an issue as despite these concerns about potential AI overcapacity, major tech firms continue to invest heavily in AI infrastructure:         Amazon: Pledged $100 billion towards AI data centers.         Alphabet (Google): Committed $75 billion.         Meta (Facebook): Planning to spend up to $65 billion.         Alibaba: Announced a $53 billion investment over the next three years. If we see a rush of announcements

Read More »

Dual Feed: Vantage Data Centers, VoltaGrid, Equinix, Bloom Energy, Constellation, Calpine

Nuclear Giant Constellation Acquires Natural Gas Stalwart Calpine, Creating the Largest U.S. Clean Energy Provider On January 10, 2025, Constellation (Nasdaq: CEG) announced a definitive agreement to acquire Calpine Corp. in a $16.4 billion cash-and-stock transaction, including the assumption of $12.7 billion in net debt.  A landmark transaction, the acquisition positions Constellation as the largest clean energy provider in the United States, significantly enhancing its generation portfolio with natural gas and geothermal assets. With an expanded coast-to-coast footprint, the combined company will provide 60 GW of power, reinforcing grid reliability and offering businesses and consumers a broader array of sustainability solutions. The move strengthens Constellation’s competitive retail electricity presence, serving 2.5 million customers across key U.S. markets, including Texas, California, and the Northeast. “This acquisition will help us better serve our customers across America, from families to businesses and utilities,” said Joe Dominguez, president and CEO of Constellation. “By combining Constellation’s unmatched expertise in zero-emission nuclear energy with Calpine’s industry-leading, low-carbon natural gas and geothermal generation, we can deliver the most comprehensive clean energy portfolio in the industry.” A Strategic Move for the Data Center Industry With skyrocketing demand for AI and cloud services, data centers are under increasing pressure to secure reliable, low-carbon energy sources. The Constellation-Calpine combination is particularly relevant for large-scale hyperscale operators and colocation providers seeking flexible energy solutions.  For the data center industry, this consolidation offers several advantages: Diverse Energy Mix: The integration of nuclear, geothermal, and low-emission natural gas provides data centers with flexible and reliable energy options. Grid Stability: Calpine’s extensive natural gas fleet enhances grid reliability, crucial for data centers operating in high-demand regions. Sustainability Initiatives: The combined entity is well-positioned to invest in clean energy infrastructure, including battery storage and carbon sequestration, aligning with the sustainability goals of hyperscale operators. The

Read More »

Microsoft will invest $80B in AI data centers in fiscal 2025

And Microsoft isn’t the only one that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs).  In a report published in October 2024, Bloomberg Intelligence estimated that demand for generative AI would push Microsoft, AWS, Google, Oracle, Meta, and Apple would between them devote $200 billion to capex in 2025, up from $110 billion in 2023. Microsoft is one of the biggest spenders, followed closely by Google and AWS, Bloomberg Intelligence said. Its estimate of Microsoft’s capital spending on AI, at $62.4 billion for calendar 2025, is lower than Smith’s claim that the company will invest $80 billion in the fiscal year to June 30, 2025. Both figures, though, are way higher than Microsoft’s 2020 capital expenditure of “just” $17.6 billion. The majority of the increased spending is tied to cloud services and the expansion of AI infrastructure needed to provide compute capacity for OpenAI workloads. Separately, last October Amazon CEO Andy Jassy said his company planned total capex spend of $75 billion in 2024 and even more in 2025, with much of it going to AWS, its cloud computing division.

Read More »

John Deere unveils more autonomous farm machines to address skill labor shortage

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Self-driving tractors might be the path to self-driving cars. John Deere has revealed a new line of autonomous machines and tech across agriculture, construction and commercial landscaping. The Moline, Illinois-based John Deere has been in business for 187 years, yet it’s been a regular as a non-tech company showing off technology at the big tech trade show in Las Vegas and is back at CES 2025 with more autonomous tractors and other vehicles. This is not something we usually cover, but John Deere has a lot of data that is interesting in the big picture of tech. The message from the company is that there aren’t enough skilled farm laborers to do the work that its customers need. It’s been a challenge for most of the last two decades, said Jahmy Hindman, CTO at John Deere, in a briefing. Much of the tech will come this fall and after that. He noted that the average farmer in the U.S. is over 58 and works 12 to 18 hours a day to grow food for us. And he said the American Farm Bureau Federation estimates there are roughly 2.4 million farm jobs that need to be filled annually; and the agricultural work force continues to shrink. (This is my hint to the anti-immigration crowd). John Deere’s autonomous 9RX Tractor. Farmers can oversee it using an app. While each of these industries experiences their own set of challenges, a commonality across all is skilled labor availability. In construction, about 80% percent of contractors struggle to find skilled labor. And in commercial landscaping, 86% of landscaping business owners can’t find labor to fill open positions, he said. “They have to figure out how to do

Read More »

2025 playbook for enterprise AI success, from agents to evals

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More 2025 is poised to be a pivotal year for enterprise AI. The past year has seen rapid innovation, and this year will see the same. This has made it more critical than ever to revisit your AI strategy to stay competitive and create value for your customers. From scaling AI agents to optimizing costs, here are the five critical areas enterprises should prioritize for their AI strategy this year. 1. Agents: the next generation of automation AI agents are no longer theoretical. In 2025, they’re indispensable tools for enterprises looking to streamline operations and enhance customer interactions. Unlike traditional software, agents powered by large language models (LLMs) can make nuanced decisions, navigate complex multi-step tasks, and integrate seamlessly with tools and APIs. At the start of 2024, agents were not ready for prime time, making frustrating mistakes like hallucinating URLs. They started getting better as frontier large language models themselves improved. “Let me put it this way,” said Sam Witteveen, cofounder of Red Dragon, a company that develops agents for companies, and that recently reviewed the 48 agents it built last year. “Interestingly, the ones that we built at the start of the year, a lot of those worked way better at the end of the year just because the models got better.” Witteveen shared this in the video podcast we filmed to discuss these five big trends in detail. Models are getting better and hallucinating less, and they’re also being trained to do agentic tasks. Another feature that the model providers are researching is a way to use the LLM as a judge, and as models get cheaper (something we’ll cover below), companies can use three or more models to

Read More »

OpenAI’s red teaming innovations define new essentials for security leaders in the AI era

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams’ advanced capabilities in two areas: multi-step reinforcement and external red teaming. OpenAI recently released two papers that set a new competitive standard for improving the quality, reliability and safety of AI models in these two techniques and more. The first paper, “OpenAI’s Approach to External Red Teaming for AI Models and Systems,” reports that specialized teams outside the company have proven effective in uncovering vulnerabilities that might otherwise have made it into a released model because in-house testing techniques may have missed them. In the second paper, “Diverse and Effective Red Teaming with Auto-Generated Rewards and Multi-Step Reinforcement Learning,” OpenAI introduces an automated framework that relies on iterative reinforcement learning to generate a broad spectrum of novel, wide-ranging attacks. Going all-in on red teaming pays practical, competitive dividends It’s encouraging to see competitive intensity in red teaming growing among AI companies. When Anthropic released its AI red team guidelines in June of last year, it joined AI providers including Google, Microsoft, Nvidia, OpenAI, and even the U.S.’s National Institute of Standards and Technology (NIST), which all had released red teaming frameworks. Investing heavily in red teaming yields tangible benefits for security leaders in any organization. OpenAI’s paper on external red teaming provides a detailed analysis of how the company strives to create specialized external teams that include cybersecurity and subject matter experts. The goal is to see if knowledgeable external teams can defeat models’ security perimeters and find gaps in their security, biases and controls that prompt-based testing couldn’t find. What makes OpenAI’s recent papers noteworthy is how well they define using human-in-the-middle

Read More »