Stay Ahead, Stay ONMINE

Anthropic CEO Dario Amodei warns: AI will match ‘country of geniuses’ by 2026

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Artificial intelligence will match the collective intelligence of “a country of geniuses” within two years, Anthropic CEO Dario Amodei warned today in a sharp critique of this week’s AI Action Summit in Paris. His timeline — […]

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Artificial intelligence will match the collective intelligence of “a country of geniuses” within two years, Anthropic CEO Dario Amodei warned today in a sharp critique of this week’s AI Action Summit in Paris. His timeline — targeting 2026 or 2027 — marks one of the most specific predictions yet from a major AI leader about the technology’s advancement toward superintelligence.

Amodei labeled the Paris summit a “missed opportunity,” challenging the international community’s leisurely pace toward AI governance. His warning arrives at a pivotal moment, as democratic and authoritarian nations compete for dominance in AI development.

“We must ensure democratic societies lead in AI, and that authoritarian countries do not use it to establish global military dominance,” Amodei wrote in Anthropic’s official statement. His concerns extend beyond geopolitical competition to encompass supply chain vulnerabilities in chips, semiconductor manufacturing, and cybersecurity.

The summit exposed deepening fractures in the international approach to AI regulation. U.S. Vice President JD Vance rejected European regulatory proposals, dismissing them as “massive” and stifling. The U.S. and U.K. notably refused to sign the summit’s commitments, highlighting the growing challenge of achieving consensus on AI governance.

Anthropic has positioned itself as an advocate for transparency in AI development. The company launched its Economic Index this week to track AI’s impact on labor markets — a move that contrasts with its more secretive competitors. This initiative addresses mounting concerns about AI’s potential to reshape global employment patterns.

Three critical issues dominated Amodei’s message: maintaining democratic leadership in AI development, managing security risks, and preparing for economic disruption. His emphasis on security focuses particularly on preventing AI misuse by non-state actors and managing the autonomous risks of advanced systems.

Race against time: The two-year window to control Superintelligent AI

The urgency of Amodei’s timeline challenges current regulatory frameworks. His prediction that AI will achieve genius-level capabilities by 2027 — with 2030 as the latest estimate — suggests current governance structures may prove inadequate for managing next-generation AI systems.

For technology leaders and policymakers, Amodei’s warning frames AI governance as a race against time. The international community faces mounting pressure to establish effective controls before AI capabilities surpass our ability to govern them. The question now becomes whether governments can match the accelerating pace of AI development with equally swift regulatory responses.

The Paris summit’s aftermath leaves the tech industry and governments wrestling with a fundamental challenge: how to balance AI’s unprecedented economic and scientific opportunities against its equally unprecedented risks. As Amodei suggests, the window for establishing effective international governance is rapidly closing.

Shape
Shape
Stay Ahead

Explore More Insights

Stay ahead with more perspectives on cutting-edge power, infrastructure, energy,  bitcoin and AI solutions. Explore these articles to uncover strategies and insights shaping the future of industries.

Shape

Nvidia partners with cybersecurity vendors for real-time monitoring

Unlike conventional offerings that rely on intrusive methods or software agents, BlueField-3 DPUs function as a virtual security overlay. They inspect network traffic and safeguard host integrity without disrupting operations. Other packages rely on tapping devices to access network data, which helps create a map of interconnected devices. But these

Read More »

Showing memory usage in Linux by process and user

top – 14:22:38 up 12 min, 3 users, load average: 0.02, 0.22, 0.32MiB Mem : 3784.7 total, 967.8 free, 1249.0 used, 1567.9 buff/cacheMiB Swap: 3784.0 total, 3737.2 free, 46.8 used. 2170.7 avail MemPID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND3953 fedora 20 0 1785992 537936 76568

Read More »

SC Analysts Say Recent Oil Price Action Has Been Extremely Cautious

It may be that oil markets have not yet made up their mind whether the new U.S. administration is inherently bullish or bearish for oil prices. That’s what analysts at Standard Chartered Bank, including the company’s Commodities Research Head Paul Horsnell, said in a report sent to Rigzone late Tuesday by Horsnell, adding that recent price action has been extremely cautious. “Brent stands almost on the origin in our summary of week on week changes, with two successive weeks of only limited price changes,” the analysts stated in the report. “April Brent settled at $75.87 per barrel on 10 February, a week on week fall of $0.09 per barrel; in the previous week the April contract also trod water, falling by just $0.22 per barrel,” they added. The analysts noted in the report that volatility has also moved sideways. “The 30-day realized annualized Brent measure has spent the past three weeks within in a narrow 21.2-22.8 percent range,” they said in the report. “However, underneath these signs of tranquility we think there is a bullish market trying to get out,” they added. In the report, the Standard Chartered Bank analysts said they think the oil market will move higher for three main reasons. “First, we think the market narrative of an impending imminent supply glut that dominated sentiment in the latter half of last year is showing signs of weakening,” they said. “The glut narrative is still very easy to find in analyst and media reports; however, it appears to us that the surpluses being predicted are both getting smaller and moving further back in time,” they added. “Our own model continues to show no surplus this year, even if OPEC+ increases output according to the current schedule,” they continued. “Second, we think last year’s steady erosion of demand growth

Read More »

Energy apprenticeships on offer to coincide with National Apprenticeship Week

Various energy industry apprenticeship programmes have been announced to coincide with National Apprenticeship Week, taking place from February 10-16. These include the APTUS programme, which is now open for applications for 2025, as well as a new apprenticeship programme launched by John Crane and the 400 apprenticeship roles available this year announced by British Gas. APTUS was formerly known as the Oil and Gas Technical Apprenticeship Programme (OGTAP) and has been running since 1999. The programme is managed by OPITO and the Engineering Construction Industry Training Board (ECITB). Under the programme, technical apprenticeships are offered across four disciplines – electrical maintenance, instrument and control maintenance, mechanical maintenance and process operations. Apprentices are taught how to operate, maintain and repair critical infrastructure required for energy production. APTUS is open to all British residents over the age of 16 with four National 5s or GCSEs, including Maths and English. The four-year programme comprises 20 months in further education, followed by two years on a work experience placement. Applications are open until March 16, with successful applicants beginning the programme in September this year. There are 17 energy industry employers participating in the programme – including BP, Shell, Petrofac, Semco Maritime and Bilfinger – offering 300 apprenticeship places per year. In their announcement about the opening of applications for 2025, OPITO and ECITB said that 95% of APTUS apprentices go on to secure employment with their sponsor company following completion of the programme. The two organisations pointed to growing demand for skilled workers across both existing and emerging energy industries, saying that education and upskilling must be scaled up. OPITO’s director of products and services, Ewen Hay, said there had been £140m invested in APTUS to date and more than 2,000 apprenticeships completed since the programme’s inception. John Crane launches five-year programme Meanwhile,

Read More »

DESNZ Says Details of GB Energy CEO Role ‘Will be Published in Due Course’

A spokesperson for the UK’s Department for Energy Security and Net Zero (DESNZ) told Rigzone that details of the Great British (GB) Energy CEO role “will be published in due course”. “Details of the role will be published in due course, and we will update when the job advert is live,” the spokesperson told Rigzone when asked if DESNZ had an update on when GB Energy will appoint a CEO. The UK government website notes that GB Energy “will be a new, publicly owned, clean energy company”, adding that it “works with the Department for Energy Security and Net Zero”. “Great British Energy’s mission will be to drive clean energy deployment to create jobs, boost energy independence, and ensure UK taxpayers, billpayers and communities reap the benefits of clean, secure, home-grown energy,” the UK government site states. “This mission will be delivered through the following five functions: Project investment and ownership; Project development; Local Power Plan; Supply chain; Great British Nuclear,” it adds. A statement posted on the UK government’s website on January 17 announced that five non-executive directors had been appointed to GB Energy’s start-up board, “in another step forward for the new, publicly owned energy company that will own and invest in clean energy projects across the UK”.     The statement revealed that the five new start-up non-executive directors joined GB Energy’s board on initial contracts of between 18 months and two years. The directors comprise Frances O’Grady, Frank Mitchell, Kate Gilmartin, Nina Skorupska, and Valerie Todd, the statement showed. O’Grady was general secretary for the TUC between 2013 and 2022, as well as former deputy general secretary from 2003, a bio section included in the statement noted, adding that O’Grady is a member of the House of Lords and has previously held positions at the Transport and General Workers Union. Mitchell is the

Read More »

Commodity Traders Can’t Ignore India’s Growth, Oil Minister Says

Commodity traders should start paying more attention to India, according to the country’s oil and gas minister, as the world’s most populous nation moves into a new phase of growth that will require increased raw material consumption. “No matter which angle you look at India from, it’s a growing economy,” Hardeep Singh Puri said in an interview, predicting it would become the world’s third-largest economy — overtaking Germany and Japan — within a couple of years. His message for commodity traders, he added, was simple: “It’s good to start looking at India.” Though vast, and one of the top food exporters in the world, India has long been overshadowed as a commodity consumer by China, the world’s largest buyer of everything from copper to soybeans. Still, thanks to growth in the years after the coronavirus pandemic and hefty government investment in infrastructure, overall demand expanded — even if the economy has cooled a little since. Puri said that an anticipated surplus of global gas in the next few years should result in lower prices that would increase demand in India and bring the country closer to a government goal of lifting the fuel’s share in the energy mix from about 6% to 15%.  He was speaking on the sidelines of the India Energy Week conference, where companies from Abu Dhabi National Oil Co. to TotalEnergies SE struck deals to supply liquefied natural gas to India. His comments come as India’s Prime Minister Narendra Modi visits the US, with Indian companies discussing additional purchases of US LNG. Puri’s optimism on India was echoed by international commodity executives. “We see massive growth, particularly in India” for gas and LNG over the next 25 years, said Andrew Barry, vice president for LNG marketing at Exxon Mobil Corp. “There’s quite a juxtaposition between India and Europe,” said Russell Hardy, chief executive officer

Read More »

Chevron looking to cut up to 20% of workforce

US oil major Chevron (NYSE: CVX) has announced that it will cut 15-20% of its workforce as it looks to make $3 billion worth of savings by 2026. With a global workforce of around 40,000 people across all its operations, this could potentially mean 8,000 people will lose their jobs. The company was hit by weak margins at its refining and gasoline sectors, while its operations in Kazakhstan have been fit by cost overruns and delays. In addition, it has struggled to close a $53b deal to acquire oil producer Hess and enter the growing Guyanese oil industry, adding to its woes. Chevron vice chairman Mark Nelson said in a statement: “Chevron is taking action to simplify our organisational structure, execute faster and more effectively, and position the company for stronger long-term competitiveness. “We do not take these actions lightly and will support our employees through the transition.” Industry sources have added that Chevron will reorganise its business as part of the cost-cutting measures, including announcing a new leadership structure in the next two weeks. The company will also hold an internal town hall meeting for employees where they can begin opting for buyouts now through April or May. Chevron has a limited presence in the UK, including a 19.4% non-operated stake in the Clair Field. However, it has already floated plans to sell this, marking an end to company’s presence in the North Sea after more than 55 years. Chevron would also sell its interests in the Sullom Voe oil terminal, along with stakes in the Ninian and SIRGE pipeline systems. The potential asset sale spread rumours that it may affect up to a dozen of the company’s workers in the UK. Chevron is the latest oil and gas company looking to make job cuts. BP announced plans this year

Read More »

Government pledges extra £200m for offshore wind in oil and gas communities

The UK government has announced an initiative to deliver up to £200 million of investment to offshore wind developers in this year’s bidding round for renewable energy. The Labour premiership has opened applications for its “clean industry bonus” which will support offshore wind developers, on the condition they prioritise their investment in places “that need it most”. The government said areas that would attract extra investment include “traditional oil and gas communities”, as it looks to back “good jobs” under its plan for change. The cash will be available to all offshore wind projects that come through the next auction, this year is allocation round 7 (AR7). This offers successful bidders a contract a for difference (CfD), a fixed contract price on the energy produced. In prior allocation rounds, the government has chosen the lowest bids. But this year’s clean industry bonus is designed to encourage investment in the supply chain most deem necessary for the industry to flourish. © Supplied by Neart na GoitheTurbines blades at Siemens Gamesa in Hull. The bonus will come with an initial £27 million per gigawatt (GW) of offshore wind projects. “That means if developers commit to 7-8GW of offshore wind, up to £200m of funding could be made available,” the government announcement explained. The government funding will support developers who build sustainable low-carbon factories, offshore wind blades, cables and ports, and reduce industrial emissions across the energy supply chain. This comes as part of a move to drive investment in the UK’s manufacturing capabilities. © Supplied by Ross Creative CommunA floating offshore wind turbine at the Port of Nigg. On Wednesday HMRC granted the Port of Nigg in the north-east of Scotland customs site status to incentivise suppliers to set up shop in the region. The awarded status allows the port to sit

Read More »

Cisco doubles down on AI with new, updated certifications

Essentials is geared toward data center network engineers, data center system engineers, IT infrastructure architects, and IT operations engineers. The training focuses on professionals working on a multi-vendor approach to building AI infrastructure. In addition to adding AI infrastructure skills to its data center certification track from CCNP to CCIE, Cisco is also working to add relevant AI and machine learning skills to its existing certifications. The focus on AI in training is important now, according to Cisco, as business and technology leaders work to keep pace with technology advances and stay ahead of their competitors. “In a dynamic landscape where competition is fierce, speed decides the winders. Leaders who act decisively today to build resilient, future-proofed networks will be the AI-forward leaders driving real value for their business,” said Jeetu Patel, Cisco’s Chief Product Officer, in a statement. “Eventually, there will be only two kinds of companies: those that are AI companies, and those that are irrelevant.” Also at Cisco Live EMEA in Amsterdam, the company released the results of its CEO study, which was conducted by Opinion Matters between December 24, 2024 and January 2, 2025 and surveyed some 2,503 CEOs from companies with more than 250 employees worldwide. The research shows that the majority of CEOs polled recognize AI’s potential benefits and plan to integrate AI into their operations, 74% fear that gaps in knowledge will hinder decisions in the boardroom and 58% worry it will stifle growth. More than 70% of the CEOs worry about losing ground to competitors and missing out on opportunities because of IT and infrastructure gaps. The study shows that 61% of CEOs are improving AI education to address their concerns. “CEOs are turning to AI for its transformative potential: driving efficiency (69%), spurring innovation (68%), and outpacing competitors (54%). But fulfilling

Read More »

Cisco data center switches feature baked-in security for AI, networking duties

The N9324C, available soon, is positioned as an edge device where customers can inspect and protect traffic and access as users come in and out of the network, Wollenweber said. The second model, which will be released towards the middle of the year, is a top-of-rack switch with 25G ports as well as 100/400G uplinks for server connectivity. “We have some customers that are going to deploy these when they do their next network refresh. When they start to look at new switches, they’ll deploy these smart switches today and deploy it with Hypershield. Or, they’ll even add these network services over time, because they now have a more intelligent device that can take on new personas or new features and functions,” Wollenweber said.  Integrated security with Cisco Hypershield a draw for enterprises The range of networking and security services the new N9300s support will make them attractive to data center customers, experts said.  “While AI applications have brought the bandwidth and latency concerns back to the top of the networking requirements, additional capabilities are also top-of-mind. Security, especially in hybrid and multi-cloud networks, requires segmentation and enforcement, and the Cisco N9300 can be hooked into Cisco Hypershield to be a network-based enforcement node for certain policies,” said Paul Nicholson, research vice president, cloud and datacenter networks, with IDC.  “Also, the digital twin capabilities, where upgrades and changes can be tested on a shadow data plane before going into production, will be attractive to IT operations, especially if they do not have the capability today,” Nicholson said.  Additional hardware capabilities can offer multiple benefits – accelerating security policies, offloading other processors to concentrate on their core tasks for better networking performance, and adding capabilities at scale that would not be practical before, Nicholson said. 

Read More »

FPGAs lose their luster in the GenAI era

Part of the problem is that they are one trick pony. Both Intel and AMD use their FPGAs for high-end networking cards. “I see these things are basically really powerful networking cards and nothing more or very little beyond that,” said Alvin Nguyen, senior analyst with Forrester Research. “I think AI and GenAI helped kind of push away focus from leveraging [FPGA]. And I think there were already moves away from it prior to [the GenAI revolution], that put the pedal to the metal in terms of not looking at the FPGAs at the high end. I think now it’s [all about] DeepSeek and is kind of a nice reset moment,” he added. One of the things about the recent news around DeepSeek AI that rattled Wall Street so hard is the Chinese company achieved performance comparable to ChatGPT and Google Gemini but without the billions of dollars’ worth of Nvidia chips. It was done using commercial, consumer grade cards that were considerably cheaper than their data center counterparts. That means all might not be lost when it comes to FPGA. “After DeepSeek showing that you could use lower power devices were more commonly available, [FPGA] might be valuable again,” said Nguyen. But he adds “It’s not going to be valuable for all AI workloads like the LLMs,  where you need as much memory, as much network bandwidth, as much compute, in terms of GPU as possible.” So Nguyen feels that DeepSeek show you don’t necessarily need billions of dollars of cutting-edge Nvidia GPUs, you can get away with an FPGA, a CPU, or use consumer grade GPUs. “I think that’s kind of a nice ‘aha’ moment from an AI perspective, to show there’s a new low bar that’s being set. If you can throw CPUs with a bunch of

Read More »

Your ‘new’ Seagate data center hard drive is likely a used one

The cryptocurrency connection: how used HDDs entered the market The affected hard drives reportedly stem from cryptocurrency mining farms, particularly those that mined Chia cryptocurrency. Unlike traditional cryptocurrency mining that relies on GPUs, Chia mining is storage-intensive, leading to a surge in HDD demand during its peak. As Chia’s profitability declined, many mining operations shut down, offloading their heavily used HDDs into secondary markets. Some of these drives have had their internal usage logs reset to appear as new, deceiving customers, the report added. The fraudulent sales first came to light in January when buyers began inspecting their newly purchased Seagate Exos data center-grade HDDs. SMART parameters, which track drive usage, had been reset to mask wear. However, deeper analysis using FARM (Field-Accessible Reliability Metrics) values exposed the true operational history of these drives. More than 200 reports have surfaced globally, detailing instances where supposedly new Seagate Exos data center HDDs had been in operation for 15,000 to 50,000 hours. These drives have been sold via third-party marketplaces, including eBay, and have been reported in countries such as Germany, Switzerland, Austria, the UK, Japan, and the US, the report added. A request for comment from Seagate on further actions remains unanswered. Industry implications and next steps The widespread nature of this fraudulent resale practice raises concerns about transparency in the secondary market. System integrators who resell HDDs may not always provide adequate warranties, leaving enterprise customers at risk.

Read More »

Nokia changes CEO; Intel data center chief takes over

Nokia has announced that CEO Pekka Lundmark will step down. He took up the position in 2020. He will be replaced by Justin Hotard, who is currently Intel’s Chief Data Center Officer and has previously held executive positions at technology companies such as Hewlett Packard Enterprise and NCR Corporation. “I am honored to have the opportunity to lead Nokia, a global leader in connectivity with a unique technology heritage. Networks are the backbone that drives society and businesses and enables generational shifts in technology, such as the one we are currently experiencing in AI,” said Justin Hotard in a statement. Lundmark will step down on March 31, 2025 and continue as an advisor to the new CEO for the remainder of the year. Hotard will take office on April 1, 2025. He will be based at Nokia headquarters in Espoo, Finland.

Read More »

AWS plans to outspend Microsoft and Google on on AI infrastructure

AI data centers must support much higher power densities than traditional data centers: Nvidia’s GB200 NVL72 systems are estimated to consume up to 120kW per rack, for instance, with classic computing infrastructure consuming perhaps one-tenth of that. On top of that, the AI-enabled data center will need liquid cooling, advanced networking infrastructure, and advanced infrastructure management software. And AWS isn’t the only cloud service provider that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs). Earlier this year, Microsoft President Brad Smith said the company is on track to invest nearly $80 billion to build out AI-enabled data centers this fiscal year. The majority of the $75 billion in capital expenditure Google will make this year will go toward technical infrastructure including servers and data centers, Google CFO Anat Ashkenazi said in the company’s earnings call this week. Based on the investment numbers provided by the three major cloud service providers over the last week, AWS is leading the pack by around $20 to $25 billion — and is ahead, too, of analysts’ forecasts for cloud infrastructure spending.

Read More »

Microsoft will invest $80B in AI data centers in fiscal 2025

And Microsoft isn’t the only one that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs).  In a report published in October 2024, Bloomberg Intelligence estimated that demand for generative AI would push Microsoft, AWS, Google, Oracle, Meta, and Apple would between them devote $200 billion to capex in 2025, up from $110 billion in 2023. Microsoft is one of the biggest spenders, followed closely by Google and AWS, Bloomberg Intelligence said. Its estimate of Microsoft’s capital spending on AI, at $62.4 billion for calendar 2025, is lower than Smith’s claim that the company will invest $80 billion in the fiscal year to June 30, 2025. Both figures, though, are way higher than Microsoft’s 2020 capital expenditure of “just” $17.6 billion. The majority of the increased spending is tied to cloud services and the expansion of AI infrastructure needed to provide compute capacity for OpenAI workloads. Separately, last October Amazon CEO Andy Jassy said his company planned total capex spend of $75 billion in 2024 and even more in 2025, with much of it going to AWS, its cloud computing division.

Read More »

John Deere unveils more autonomous farm machines to address skill labor shortage

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Self-driving tractors might be the path to self-driving cars. John Deere has revealed a new line of autonomous machines and tech across agriculture, construction and commercial landscaping. The Moline, Illinois-based John Deere has been in business for 187 years, yet it’s been a regular as a non-tech company showing off technology at the big tech trade show in Las Vegas and is back at CES 2025 with more autonomous tractors and other vehicles. This is not something we usually cover, but John Deere has a lot of data that is interesting in the big picture of tech. The message from the company is that there aren’t enough skilled farm laborers to do the work that its customers need. It’s been a challenge for most of the last two decades, said Jahmy Hindman, CTO at John Deere, in a briefing. Much of the tech will come this fall and after that. He noted that the average farmer in the U.S. is over 58 and works 12 to 18 hours a day to grow food for us. And he said the American Farm Bureau Federation estimates there are roughly 2.4 million farm jobs that need to be filled annually; and the agricultural work force continues to shrink. (This is my hint to the anti-immigration crowd). John Deere’s autonomous 9RX Tractor. Farmers can oversee it using an app. While each of these industries experiences their own set of challenges, a commonality across all is skilled labor availability. In construction, about 80% percent of contractors struggle to find skilled labor. And in commercial landscaping, 86% of landscaping business owners can’t find labor to fill open positions, he said. “They have to figure out how to do

Read More »

2025 playbook for enterprise AI success, from agents to evals

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More 2025 is poised to be a pivotal year for enterprise AI. The past year has seen rapid innovation, and this year will see the same. This has made it more critical than ever to revisit your AI strategy to stay competitive and create value for your customers. From scaling AI agents to optimizing costs, here are the five critical areas enterprises should prioritize for their AI strategy this year. 1. Agents: the next generation of automation AI agents are no longer theoretical. In 2025, they’re indispensable tools for enterprises looking to streamline operations and enhance customer interactions. Unlike traditional software, agents powered by large language models (LLMs) can make nuanced decisions, navigate complex multi-step tasks, and integrate seamlessly with tools and APIs. At the start of 2024, agents were not ready for prime time, making frustrating mistakes like hallucinating URLs. They started getting better as frontier large language models themselves improved. “Let me put it this way,” said Sam Witteveen, cofounder of Red Dragon, a company that develops agents for companies, and that recently reviewed the 48 agents it built last year. “Interestingly, the ones that we built at the start of the year, a lot of those worked way better at the end of the year just because the models got better.” Witteveen shared this in the video podcast we filmed to discuss these five big trends in detail. Models are getting better and hallucinating less, and they’re also being trained to do agentic tasks. Another feature that the model providers are researching is a way to use the LLM as a judge, and as models get cheaper (something we’ll cover below), companies can use three or more models to

Read More »

OpenAI’s red teaming innovations define new essentials for security leaders in the AI era

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams’ advanced capabilities in two areas: multi-step reinforcement and external red teaming. OpenAI recently released two papers that set a new competitive standard for improving the quality, reliability and safety of AI models in these two techniques and more. The first paper, “OpenAI’s Approach to External Red Teaming for AI Models and Systems,” reports that specialized teams outside the company have proven effective in uncovering vulnerabilities that might otherwise have made it into a released model because in-house testing techniques may have missed them. In the second paper, “Diverse and Effective Red Teaming with Auto-Generated Rewards and Multi-Step Reinforcement Learning,” OpenAI introduces an automated framework that relies on iterative reinforcement learning to generate a broad spectrum of novel, wide-ranging attacks. Going all-in on red teaming pays practical, competitive dividends It’s encouraging to see competitive intensity in red teaming growing among AI companies. When Anthropic released its AI red team guidelines in June of last year, it joined AI providers including Google, Microsoft, Nvidia, OpenAI, and even the U.S.’s National Institute of Standards and Technology (NIST), which all had released red teaming frameworks. Investing heavily in red teaming yields tangible benefits for security leaders in any organization. OpenAI’s paper on external red teaming provides a detailed analysis of how the company strives to create specialized external teams that include cybersecurity and subject matter experts. The goal is to see if knowledgeable external teams can defeat models’ security perimeters and find gaps in their security, biases and controls that prompt-based testing couldn’t find. What makes OpenAI’s recent papers noteworthy is how well they define using human-in-the-middle

Read More »