Stay Ahead, Stay ONMINE

SOC teams take note: The open-source AI that delivers tier-3 analysis at tier-1 costs

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More With cyberattacks accelerating at machine speed, open-source large language models (LLMs) have quickly become the infrastructure that enables startups and global cybersecurity leaders to develop and deploy adaptive, cost-effective defenses against threats that evolve faster than […]

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


With cyberattacks accelerating at machine speed, open-source large language models (LLMs) have quickly become the infrastructure that enables startups and global cybersecurity leaders to develop and deploy adaptive, cost-effective defenses against threats that evolve faster than human analysts can respond.

Open-source LLMs’ initial advantages of faster time-to-market, greater adaptability and lower cost have created a scalable, secure foundation for delivering infrastructure. At last week’s RSAC 2025 conference, Cisco, Meta and ProjectDiscovery announced new open-source LLMs and a community-driven attack surface innovation that together define the future of open-source in cybersecurity.   

One of the key takeaways from this year’s RSAC is the shift in open-source LLMs to extend and strengthen infrastructure at scale.

Open-source AI is on the verge of delivering what many cybersecurity leaders have called on for years, which is the ability of the many cybersecurity providers to join forces against increasingly complex threats. The vision of being collaborators in creating a unified, open-source LLM and infrastructure is a step closer, given the announcements at RSAC.

Cisco’s Chief Product Officer Jeetu Patel emphasized in his keynote, “The true enemy is not our competitor. It is actually the adversary. And we want to make sure that we can provide all kinds of tools and have the ecosystem band together so that we can actually collectively fight the adversary.”

Patel explained the urgency of taking on such a complex challenge, saying, “AI is fundamentally changing everything, and cybersecurity is at the heart of it all. We’re no longer dealing with human-scale threats; these attacks are occurring at machine scale.”

Cisco’s Foundation-sec-8B LLM defines a new era of open-source AI

Cisco’s newly established Foundation AI group originates from the company’s recent acquisition of Robust Intelligence. Foundation AI’s focus is on delivering domain-specific AI infrastructure tailored explicitly to cybersecurity applications, which are among the most challenging to solve. Built on Meta’s Llama 3.1 architecture, this 8-billion parameter, open-weight Large Language Model isn’t a retrofitted general-purpose AI. It was purpose-built, meticulously trained on a cybersecurity-specific dataset curated in-house by Cisco Foundation AI.

“By their nature, the problems in this charter are some of the most difficult ones in AI today. To make the technology accessible, we decided that most of the work we do in Foundation AI should be open. Open innovation allows for compounding effects across the industry, and it plays a particularly important role in the cybersecurity domain,” writes Yaron Singer, VP of AI and Security at Foundation.

With open-source anchoring Foundation AI, Cisco has designed an efficient architectural approach for cybersecurity providers who typically compete with each other, selling comparable solutions, to become collaborators in creating more unified, hardened defenses.

Singer writes, “Whether you’re embedding it into existing tools or building entirely new workflows, foundation-sec-8b adapts to your organization’s unique needs.” Cisco’s blog post announcing the model recommends that security teams apply foundation-sec-8b across the security lifecycle. Potential use cases Cisco recommends for the model include SOC acceleration, proactive threat defense, engineering enablement, AI-assisted code reviews, validating configurations and custom integration.

Foundation-sec-8B’s weights and tokenizer have been open-sourced under the permissive Apache 2.0 license on Hugging Face, allowing enterprise-level customization and deployment without vendor lock-in, maintaining compliance and privacy controls. Cisco’s blog also notes plans to open-source the training pipeline, further fostering community-driven innovation.

Cybersecurity is in the LLM’s DNA

Cisco chose to create a cybersecurity-specific model optimized for the needs of SOC, DevSecOps and large-scale security teams. Retrofitting an existing, generic AI model wouldn’t get them to their goal, so the Foundation AI team engineered its training using a large-scale, expansive and well-curated cybersecurity-specific dataset.

By taking a more precision-focused approach to building the model, the Foundation AI team was able to ensure that the model deeply understands real-world cyber threats, vulnerabilities and defensive strategies.

Key training datasets included the following:

  • Vulnerability Databases: Including detailed CVEs (Common Vulnerabilities and Exposures) and CWEs (Common Weakness Enumerations) to pinpoint known threats and weaknesses.
  • Threat Behavior Mappings: Structured from proven security frameworks such as MITRE ATT&CK, providing context on attacker methodologies and behaviors.
  • Threat Intelligence Reports: Comprehensive insights derived from global cybersecurity events and emerging threats.
  • Red-Team Playbooks: Tactical plans outlining real-world adversarial techniques and penetration strategies.
  • Real-World Incident Summaries: Documented analyses of cybersecurity breaches, incidents, and their mitigation paths.
  • Compliance and Security Guidelines: Established best practices from leading standards bodies, including the National Institute of Standards and Technology (NIST) frameworks and the Open Worldwide Application Security Project (OWASP) secure coding principles.

This tailored training regimen positions Foundation-sec-8B uniquely to excel at complex cybersecurity tasks, offering significantly enhanced accuracy, deeper contextual understanding and quicker threat response capabilities than general-purpose alternatives.

Benchmarking Foundation-sec-8B LLM

Cisco’s technical benchmarks show Foundation-sec-8B delivers cybersecurity performance comparable to significantly larger models:

BenchmarkFoundation-sec-8BLlama-3.1-8BLlama-3.1-70B
CTI-MCQA67.3964.1468.23
CTI-RCM75.2666.4372.66

By designing the foundation model to be cybersecurity-specific, Cisco is enabling SOC teams to gain greater efficiency with advanced threat analytics without having to pay high infrastructure costs to get it.

Cisco’s broader strategic vision, detailed in its blog, Foundation AI: Robust Intelligence for Cybersecurity, addresses common AI integration challenges, including limited domain alignment of general-purpose models, insufficient datasets and legacy system integration difficulties. Foundation-sec-8B is specifically designed to navigate these barriers, running efficiently on minimal hardware configurations, typically requiring just one or two Nvidia A100 GPUs.

Meta also underscored its open-source strategy at RSAC 2025, expanding its AI Defenders Suite to strengthen security across generative AI infrastructure. Their open-source toolkit now includes Llama Guard 4, a multimodal classifier detecting policy violations across text and images, improving compliance monitoring within AI workflows.

Also introduced is LlamaFirewall, an open-source, real-time security framework integrating modular capabilities that includes PromptGuard 2, which is used to detect prompt injections and jailbreak attempts. Also launched as part of LlamaFirewall are Agent Alignment Checks that monitor and protect AI agent decision-making processes along with CodeShield, which is designed to inspect generated code to identify and mitigate vulnerabilities.

Meta also enhanced Prompt Guard 2, offering two open-source variants that further strengthen the future of open-source AI-based infrastructure. They include a high-accuracy 86M-parameter model and a leaner, lower-latency 22M-parameter alternative optimized for minimal resource use.

Additionally, Meta launched the open-source benchmarking suite CyberSec Eval 4, which was developed in partnership with CrowdStrike. It features CyberSOC Eval, benchmarking AI effectiveness in realistic Security Operations Center (SOC) scenarios and AutoPatchBench, which is used to evaluate autonomous AI capabilities for identifying and fixing software vulnerabilities.

Meta also launched the Llama Defenders Program, which provides early access to open-AI-based security tools, including sensitive-document classifiers and audio threat detection. Private Processing is a privacy-first, on-device AI piloted within WhatsApp.

At RSAC 2025, ProjectDiscovery won the award for the “Most Innovative Startup” in the Innovation Sandbox, highlighting its commitment to open-source cybersecurity. Its flagship tool, Nuclei, is a customizable, open-source vulnerability scanner driven by a global community that rapidly identifies vulnerabilities across APIs, websites, cloud environments and networks.

Nuclei’s extensive YAML-based templating library includes over 11,000 detection patterns, 3,000 directly tied to specific CVEs, enabling real-time threat identification. Andy Cao, COO at ProjectDiscovery, emphasized open-source’s strategic importance, stating: “Winning the 20th annual RSAC Innovation Sandbox proves open-source models can succeed in cybersecurity. It reflects the power of our community-driven approach to democratizing security.”

ProjectDiscovery’s success aligns with Gartner’s 2024 Hype Cycle for Open-Source Software, which positions open-source AI and cybersecurity tools in the “Innovation Trigger” phase. Gartner recommends that organizations establish open-source program offices (OSPOs), adopt software bill-of-materials (SBOM) frameworks, and ensure regulatory compliance through effective governance practices.

Actionable insights for security leaders

Cisco’s Foundation-sec-8B, Meta’s expanded AI Defenders Suite and ProjectDiscovery’s Nuclei together demonstrated that cybersecurity innovation thrives most when openness, collaboration and specialized domain expertise align across company boundaries. These companies and others like them are setting the stage for any cybersecurity provider to be an active collaborator in creating cybersecurity defenses that deliver greater efficacy at lower costs.

As Patel emphasized during his keynote, “These aren’t fantasies. These are real-life examples that will be delivered because we now have bespoke security models that will be affordable for everyone. Better security efficacy is going to come at a fraction of the cost with state-of-the-art reasoning.”

Shape
Shape
Stay Ahead

Explore More Insights

Stay ahead with more perspectives on cutting-edge power, infrastructure, energy,  bitcoin and AI solutions. Explore these articles to uncover strategies and insights shaping the future of industries.

Shape

India takes first big step in Quantum Computing supremacy race

The broader vision is to create high-end jobs, attract global investment, and enable enterprises to solve previously intractable problems — such as drug discovery and real-time logistics optimization — through quantum-powered solutions. The new tech park at Amaravati will host research labs, startup incubators, and training programs to build a

Read More »

Pantheon of college football gets a Wi-Fi upgrade

Notre Dame has fully adopted mobile ticketing and introduced grab-and-go concession stands, with plans to expand them further. Alcohol sales were recently approved, prompting efforts to support new services like mobile carts. In premium areas, fans can stream various games during events. Notre Dame also tested mobile ordering for concessions

Read More »

The U.S. leads the world in AI (job) anxiety

The Americans have the highest search volume with a population-adjusted value of 440,000 search queries on the topic of AI job loss, while their attitude towards AI is moderately positive at 54.5%. The intensity score of 3 for the U.S. shows that the concern of losing jobs to AI is

Read More »

Tigera extends cloud-native networking with Calico 3.30

This logging capability is exposed through two new components: Goldmane: A gRPC-based API endpoint that aggregates flow logs from Calico’s Felix component, which runs on each node. Whisker: A web-based visualization tool built with React and TypeScript that connects to the Goldmane API. The combination of these components provides detailed

Read More »

The opportunity is huge: policy decisions will shape future success of UK carbon capture and storage industry

The UK’s carbon capture and storage (CCS) industry has taken a major step forward with the announcement of government agreement for ENI’s Liverpool Bay project. This welcome development comes in a critical period of ongoing government consultations that will shape the future of the North Sea. The UK has world-leading potential for carbon capture and storage, but achieving our ambitions in this area is directly linked to the future of the domestic oil and gas sector. Supportive government policy that prioritises domestic oil and gas production over imports is vital not just to UK energy security, but also to maintain the skilled workforce and supply chain companies needed for carbon capture and storage in the future. The Liverpool Bay milestone involves the carbon transportation and storage system of the Track-1 HyNet industrial cluster, designed to remove emissions from industries across the north-east of England and North Wales. It also includes three carbon storage permits granted by the North Sea Transition Authority and will bring an estimated 2,000 new jobs. Carbon will be stored in depleted oil and gas reservoirs, with existing infrastructure, including 150km of onshore and offshore pipelines being repurposed. HyNet brings the UK closer to the exciting prospect of developing a world-leading CCS industry. © Supplied by HyNetVisual design of the planned Liverpool Bay by HyNet. The government has pledged £21.7 billion to be spent over the next 25 years across Track-1 clusters, which include HyNet and the East Coast Cluster on Teesside. Reducing emissions from these industrial heartlands will kickstart new growth in manufacturing communities. More than £6bn in contracts will flow to the supply chain across both projects. These clusters will capture carbon from hard-to-abate sectors such as cement manufacture, lime for industrial processes, and energy from waste. The full pipeline of CCS projects must be

Read More »

UK electricity supply ‘more British’? What rubbish!

It is possibly the strangest claim I’ve ever seen made about the UK energy industry, that the rollout of wind and solar power over the last decade has made the electricity supply “more British” as hydrocarbon production/imports continued their long-running decline. As recently reported, last year just under half of Britain’s electricity supply was powered by foreign energy imports, down from 65% in 2014. This was said by the Energy and Climate Intelligence Unit (ECIU), or rather a team at CBI Economic hired to carry out the research and deliver the clunkily-named report: ‘The Future is Green – the economic opportunities brought by the UK’s net zero economy’. When it dropped into my mailbox, I quickly spotted the “more British” claim in the press release that came with it. Simon Cran-McGreehin, ECIU’s head of analysis, literally said that “UK electricity is becoming more British and this is the net zero emissions target in action, decreasing our demand for foreign gas by boosting home-grown renewables. “Gas output from the North Sea has been falling for decades, but British renewables like offshore wind are stepping in to help generate more British electricity.” So I did a quick search of the report itself. No sign of the words ‘more British’ there, however. The claim is fatuous! How can it be “more British” when virtually the entire low-carbon energy industry growing up in the UK has been invested in, built by and operated by foreign companies? Like the water industry and the railways, hardly any part of the green electricity revolution can be honestly described as British. Much onshore power generation, once state-owned, is in foreign hands too. And for the ECIU analyst to table such a claim is, I’m disappointed to have to say, beggars belief. Ownership of UK power generation is in

Read More »

Kabal’s innovative solution eases regulation stress

Leading logistics management solution provider Kabal has taken proactive steps to ease the transition to new UK Offshore supply chain regulations.   About partnership content Some Energy Voice online content is funded by outside parties. The revenue from this helps to sustain our independent news gathering. You will always know if you are reading paid-for material as it will be clearly labelled as “Partnership” on the site and on social media channels, This can take two different forms. “Presented by”This means the content has been paid for and produced by the named advertiser. “In partnership with”This means the content has been paid for and approved by the named advertiser but written and edited by our own commercial content team. The introduction of the regulations created operational concerns for operators and suppliers alike. Compliance, resource allocation and employee stress were pressing issues for businesses operating in the North Sea and beyond. In this interview, Esben Slettebø, sales manager at Kabal, explains how the company has collaborated with major UK operators to enhance its solution by integrating new requirements into Kabal’s customs features. Industry-driven solutions for a changing landscape “We’ve been working with the majority of operators in the Aberdeen area to develop a standardized solution within our existing system,” said Esben. “By working together with industry leaders, we identified the main challenges and adapted our software platform to meet the new customs regulations and compliance requirements.” For over a decade, Kabal has supported major UK offshore operators, including Shell, BP, TotalEnergies, Harbour, Ithaca and Equinor. The company’s deep-rooted industry relationships positioned it to take the lead in addressing these regulatory changes, ensuring that operators and suppliers remain compliant while maintaining efficiency. Esben Slettebø, sales manager at Kabal. Seamless integration of new requirements “The vast amounts of equipment moving offshore demands more

Read More »

Momentum starting to build in North Sea’s energy transition, Aquaterra boss says

After months of uncertainty in 2024, momentum is starting to build in the North Sea’s energy transition in 2025, according to the head of Aquaterra Energy. Throughout 2024, the UK’s offshore oil and gas sector sounded the alarm over Labour’s plans to increase the windfall tax and cut investment allowances. The sector criticised the decision to increase the Energy Profits Levy (EPL) in last year’s October budget, warning it would “hasten the demise” of the industry and put jobs and energy transition targets at risk. But speaking to Energy Voice, Aquaterra chief executive George Morrison said the UK has seen a “quite positive” start to 2025 with several final investment decisions (FIDs). “Beyond just the North Sea, but generally industrially, we’re seeing an awful lot of FIDs that seem to have been delayed for quite some time actually finally getting made,” Morrison said. “A lot of those FIDs are for North Sea projects, and we’re very glad to see it. “People are starting to move ahead with some of the big projects that are essential to the sector’s future.” Morrison said a key area which is beginning to see movement is carbon capture and storage (CCS). The UK government and Italian operator Eni reached a financial agreement for the Liverpool Bay CCS project, part of the HyNet North West industrial cluster. © Supplied by px GroupSaltend Chemicals Park, one of the sites to benefit from the success of the East Coast Cluster CCUS bid. It came after North Sea operators BP, Equinor and TotalEnergies secured approval in December for their £4 billion Northern Endurance Partnership (NEP) in Teesside. With major CCS projects across the UK starting to take shape, Morrison said “momentum has been building for a long period of time” in the North Sea’s energy transition. “An awful lot

Read More »

‘We were shocked’: Aberdeen’s Fennex aims to become a £100m energy tech company after King’s Award win

Aberdeen technology company Fennex has won its first King’s Award for Enterprise and plans to use it to “achieve bigger and greater things faster”. The digital firm, which specialises in developing predictive safety software for the offshore energy industry, was one of 197 organisations across the UK to be recognised for excellence in international trade, one of four categories in the annual scheme now headed by HRH King Charles. Fennex co-founder and strategy director Nassima Brown said advance news of the accolade was emotional for the firm which was established in 2016. “First of all, we were shocked, but then it’s the confidence of knowing this is the highest accolade for business recognition in the UK,” said Brown. “The King’s Award emblem is recognized around the world. I really believe that will transform Fennex in so many ways. It will help us to achieve bigger and greater things faster – our hope and ambitions are already there.” © Supplied by FennexFennex celebrates winning its first King’s Award for enterprise She pointed to Fennex’s doubling of its international sales growth, recognised in the awards’ scheme, and expects the firm to double again in size in the next two years. “Since we started in Aberdeen, the business has rapidly developed: our systems now operate in over 20 countries, with 42,000 end-users, and our safety solutions are actively deployed across more than 70 global operated assets,” she said. She added: “In Aberdeen, we want to be a £100 million company in 10 years, or maybe less than that. We want to employ 300 or 400 people across Scotland. Why not? Why can’t we put out ambitions like that. We have demonstrated a track record.” Fennex was founded by “proud ex-oil and gas” professionals Brown and her husband Adrian and now employs 27 people.

Read More »

WTI Hits 4-Year Low After Supply Surge

Oil dropped after OPEC+ agreed to another large output increase, raising concern that additional supply could lead to a global glut just as the trade war threatens demand. West Texas Intermediate futures fell 2% to settle just above $57 a barrel, a fresh four-year low for the closing price, amid thinner trading due to a UK holiday. OPEC and its allies agreed on Saturday to continue loosening supply constraints as the group’s leaders seek to punish overproducing members and win back market share. The latest hike of more than 400,000 barrels a day starting in June matched a similar increase announced last month, when the group made the shock decision to bring back triple the planned volume for May. The alliance — led by Saudi Arabia and Russia — has been unwinding prolonged output curbs that were meant to support prices but which also cost the group market share. The strategy shift has already collapsed spreads at the front end of the futures curve and forced Wall Street observers to shave price forecasts. “Oil market analysts did not expect the eight OPEC+ countries to accelerate the return of oil volumes for a second consecutive month — especially amid such economic uncertainty,” said Rob Thummel, senior portfolio manager at Tortoise Capital. His firm predicts that global oil markets will be oversupplied by as much as 500,000 barrels a day starting in June, which could push prices to the low $50s. In a move that could put additional pressure on prices, Saudi Arabia signaled further similar-sized output increases could follow, according to delegates. The threat was widely viewed as being aimed at producers like Kazakhstan and Iraq that have pumped beyond their limits. In the background, US President Donald Trump’s tariff war threatens to derail growth, erode investor confidence and undercut energy

Read More »

Zyxel launches 100GbE switch for enterprise networks

Port specifications include: 48 SFP28 ports supporting dual-rate 10GbE/25GbE connectivity 8 QSFP28 ports supporting 100GbE connections Console port for direct management access Layer 3 routing capabilities include static routing with support for access control lists (ACLs) and VLAN segmentation. The switch implements IEEE 802.1Q VLAN tagging, port isolation, and port mirroring for traffic analysis. For link aggregation, the switch supports IEEE 802.3ad for increased throughput and redundancy between switches or servers. Target applications and use cases The CX4800-56F targets multiple deployment scenarios where high-capacity backbone connectivity and flexible port configurations are required. “This will be for service providers initially or large deployments where they need a high capacity backbone to deliver a primarily 10G access layer to the end point,” explains Nguyen. “Now with Wi-Fi 7, more 10G/25G capable POE switches are being powered up and need interconnectivity without the bottleneck. We see this for data centers, campus, MDU (Multi-Dwelling Unit) buildings or community deployments.” Management is handled through Zyxel’s NebulaFlex Pro technology, which supports both standalone configuration and cloud management via the Nebula Control Center (NCC). The switch includes a one-year professional pack license providing IGMP technology and network analytics features. The SFP28 ports maintain backward compatibility between 10G and 25G standards, enabling phased migration paths for organizations transitioning between these speeds.

Read More »

Engineers rush to master new skills for AI-driven data centers

According to the Uptime Institute survey, 57% of data centers are increasing salary spending. Data center job roles that saw the highest increases were in operations management – 49% of data center operators said they saw highest increases in this category – followed by junior and mid-level operations staff at 45%, and senior management and strategy at 35%. Other job categories that saw salary growth were electrical, at 32% and mechanical, at 23%. Organizations are also paying premiums on top of salaries for particular skills and certifications. Foote Partners tracks pay premiums for more than 1,300 certified and non-certified skills for IT jobs in general. The company doesn’t segment the data based on whether the jobs themselves are data center jobs, but it does track 60 skills and certifications related to data center management, including skills such as storage area networking, LAN, and AIOps, and 24 data center-related certificates from Cisco, Juniper, VMware and other organizations. “Five of the eight data center-related skills recording market value gains in cash pay premiums in the last twelve months are all AI-related skills,” says David Foote, chief analyst at Foote Partners. “In fact, they are all among the highest-paying skills for all 723 non-certified skills we report.” These skills bring in 16% to 22% of base salary, he says. AIOps, for example, saw an 11% increase in market value over the past year, now bringing in a premium of 20% over base salary, according to Foote data. MLOps now brings in a 22% premium. “Again, these AI skills have many uses of which the data center is only one,” Foote adds. The percentage increase in the specific subset of these skills in data centers jobs may vary. The Uptime Institute survey suggests that the higher pay is motivating workers to stay in the

Read More »

ExtraHop looks to eliminate ‘extra hops’ in NDR stack

This deep visibility allows ExtraHop to provide insights across the entire network stack, from basic connectivity to application-level transactions. “The benefit of going all the way through Layer 7 is I can actually see a database transaction going through on the wire,” Vasani said. “If you have application teams complaining about database query latency, we can map it to what session was that tied to and what flows was it tied to from a network perspective and is this really an app server issue, or is it a network issue, or is it an endpoint issue?” The new sensor integrates with ExtraHop’s RevealX platform, feeding telemetry into the company’s cloud-scale ML/AI engine that powers its detection and analysis capabilities. “The sensor collects the telemetry, feeds it into an ML/AI engine that sits in the cloud, and then we layer in workflow engines on top to enable the various use cases,” Vasani said. In modern distributed enterprise environments, network visibility must extend beyond traditional data centers. ExtraHop’s all-in-one sensor is designed to address this reality with deployment options that span physical appliances, virtual machines and cloud environments. ExtraHop has both virtual and physical hardware appliances for sensor deployment. ExtraHop sensors can plug into a network through multiple methods including, Network Tap, SPAN (Switched Port Analyzer) port, packet broker or a cloud provider’s vTAP capabilities.

Read More »

AI’s energy appetite drives interest in nuclear power

In its new report, Deloitte said that its analysis of figures from the World Nuclear Association, the American Nuclear Society, the U.S. Department of Energy, and others showed that new nuclear power could potentially meet about 10% of the projected increase in data center demand over the next decade, assuming capacity is also significantly expanded by between 35GW and 62GW, and 30% of the expansion is earmarked for data centers. “Nuclear energy presents a potential solution for meeting some of the growing electricity demands of data centers, with its reliable and clean energy profile,” Deloitte’s report said, noting five key advantages of the technology: Reliable baseload power: Nuclear reactors operate 24/7, regardless of the weather, providing the reliable power so important to data centers. In addition, Deloitte said, “Their capacity factor, exceeding 92.5%, outperforms other sources like natural gas (56%) and renewables like wind (35%) and solar (25%).” High energy density: A small amount of fuel generates a lot of power, which minimizes the need for fuel storage and transportation. “This efficiency can translate to a smaller physical footprint and enhanced sustainability,” Deloitte said. Scalable power output: A full-sized reactor typically generates 800 megawatts (MW) or more of electricity, which accommodates the needs of large data centers. Low carbon emissions: Nuclear power plants produce virtually no greenhouse gas emissions during operation. Enhanced land use efficiency: Compared to other energy sources, nuclear power plants require relatively little land. Gartner’s Johnson echoed these advantages, and also predicted that nuclear energy, and small modular reactors (SMRs) in particular, will “provide a viable answer” to the question of what to do when electricity demand exceeds supply. They can, he said, “ensure independence from grid power fluctuations by providing dedicated on-site power for large data centers.” However, both Gartner and Deloitte also highlighted challenges in

Read More »

Nvidia AI supercluster targets agents, reasoning models on Oracle Cloud

Oracle has previously built an OCI Supercluster with 65,536 Nvidia H200 GPUs using the older Hopper GPU technology and no CPU that offers up to 260 exaflops of peak FP8 performance. According to the blog post announcing the availability, the Blackwell GPUs are available via Oracle’s public, government, and sovereign clouds, as well as in customer-owned data centers through its OCI Dedicated Region and Alloy offerings. Oracle joins a growing list of cloud providers that have made the GB200 NVL72 system available, including Google, CoreWeave and Lambda. In addition, Microsoft offers the GB200 GPUs, though they are not deployed as an NVL72 machine.

Read More »

Deep Data Center: Neoclouds as the ‘Picks and Shovels’ of the AI Gold Rush

In 1849, the discovery of gold in California ignited a frenzy, drawing prospectors from around the world in pursuit of quick fortune. While few struck it rich digging and sifting dirt, a different class of entrepreneurs quietly prospered: those who supplied the miners with the tools of the trade. From picks and shovels to tents and provisions, these providers became indispensable to the gold rush, profiting handsomely regardless of who found gold. Today, a new gold rush is underway, in pursuit of artificial intelligence. And just like the days of yore, the real fortunes may lie not in the gold itself, but in the infrastructure and equipment that enable its extraction. This is where neocloud players and chipmakers are positioned, representing themselves as the fundamental enablers of the AI revolution. Neoclouds: The Essential Tools and Implements of AI Innovation The AI boom has sparked a frenzy of innovation, investment, and competition. From generative AI applications like ChatGPT to autonomous systems and personalized recommendations, AI is rapidly transforming industries. Yet, behind every groundbreaking AI model lies an unsung hero: the infrastructure powering it. Enter neocloud providers—the specialized cloud platforms delivering the GPU horsepower that fuels AI’s meteoric rise. Let’s examine how neoclouds represent the “picks and shovels” of the AI gold rush, used for extracting the essential backbone of AI innovation. Neoclouds are emerging as indispensable players in the AI ecosystem, offering tailored solutions for compute-intensive workloads such as training large language models (LLMs) and performing high-speed inference. Unlike traditional hyperscalers (e.g., AWS, Azure, Google Cloud), which cater to a broad range of use cases, neoclouds focus exclusively on optimizing infrastructure for AI and machine learning applications. This specialization allows them to deliver superior performance at a lower cost, making them the go-to choice for startups, enterprises, and research institutions alike.

Read More »

Microsoft will invest $80B in AI data centers in fiscal 2025

And Microsoft isn’t the only one that is ramping up its investments into AI-enabled data centers. Rival cloud service providers are all investing in either upgrading or opening new data centers to capture a larger chunk of business from developers and users of large language models (LLMs).  In a report published in October 2024, Bloomberg Intelligence estimated that demand for generative AI would push Microsoft, AWS, Google, Oracle, Meta, and Apple would between them devote $200 billion to capex in 2025, up from $110 billion in 2023. Microsoft is one of the biggest spenders, followed closely by Google and AWS, Bloomberg Intelligence said. Its estimate of Microsoft’s capital spending on AI, at $62.4 billion for calendar 2025, is lower than Smith’s claim that the company will invest $80 billion in the fiscal year to June 30, 2025. Both figures, though, are way higher than Microsoft’s 2020 capital expenditure of “just” $17.6 billion. The majority of the increased spending is tied to cloud services and the expansion of AI infrastructure needed to provide compute capacity for OpenAI workloads. Separately, last October Amazon CEO Andy Jassy said his company planned total capex spend of $75 billion in 2024 and even more in 2025, with much of it going to AWS, its cloud computing division.

Read More »

John Deere unveils more autonomous farm machines to address skill labor shortage

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Self-driving tractors might be the path to self-driving cars. John Deere has revealed a new line of autonomous machines and tech across agriculture, construction and commercial landscaping. The Moline, Illinois-based John Deere has been in business for 187 years, yet it’s been a regular as a non-tech company showing off technology at the big tech trade show in Las Vegas and is back at CES 2025 with more autonomous tractors and other vehicles. This is not something we usually cover, but John Deere has a lot of data that is interesting in the big picture of tech. The message from the company is that there aren’t enough skilled farm laborers to do the work that its customers need. It’s been a challenge for most of the last two decades, said Jahmy Hindman, CTO at John Deere, in a briefing. Much of the tech will come this fall and after that. He noted that the average farmer in the U.S. is over 58 and works 12 to 18 hours a day to grow food for us. And he said the American Farm Bureau Federation estimates there are roughly 2.4 million farm jobs that need to be filled annually; and the agricultural work force continues to shrink. (This is my hint to the anti-immigration crowd). John Deere’s autonomous 9RX Tractor. Farmers can oversee it using an app. While each of these industries experiences their own set of challenges, a commonality across all is skilled labor availability. In construction, about 80% percent of contractors struggle to find skilled labor. And in commercial landscaping, 86% of landscaping business owners can’t find labor to fill open positions, he said. “They have to figure out how to do

Read More »

2025 playbook for enterprise AI success, from agents to evals

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More 2025 is poised to be a pivotal year for enterprise AI. The past year has seen rapid innovation, and this year will see the same. This has made it more critical than ever to revisit your AI strategy to stay competitive and create value for your customers. From scaling AI agents to optimizing costs, here are the five critical areas enterprises should prioritize for their AI strategy this year. 1. Agents: the next generation of automation AI agents are no longer theoretical. In 2025, they’re indispensable tools for enterprises looking to streamline operations and enhance customer interactions. Unlike traditional software, agents powered by large language models (LLMs) can make nuanced decisions, navigate complex multi-step tasks, and integrate seamlessly with tools and APIs. At the start of 2024, agents were not ready for prime time, making frustrating mistakes like hallucinating URLs. They started getting better as frontier large language models themselves improved. “Let me put it this way,” said Sam Witteveen, cofounder of Red Dragon, a company that develops agents for companies, and that recently reviewed the 48 agents it built last year. “Interestingly, the ones that we built at the start of the year, a lot of those worked way better at the end of the year just because the models got better.” Witteveen shared this in the video podcast we filmed to discuss these five big trends in detail. Models are getting better and hallucinating less, and they’re also being trained to do agentic tasks. Another feature that the model providers are researching is a way to use the LLM as a judge, and as models get cheaper (something we’ll cover below), companies can use three or more models to

Read More »

OpenAI’s red teaming innovations define new essentials for security leaders in the AI era

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has taken a more aggressive approach to red teaming than its AI competitors, demonstrating its security teams’ advanced capabilities in two areas: multi-step reinforcement and external red teaming. OpenAI recently released two papers that set a new competitive standard for improving the quality, reliability and safety of AI models in these two techniques and more. The first paper, “OpenAI’s Approach to External Red Teaming for AI Models and Systems,” reports that specialized teams outside the company have proven effective in uncovering vulnerabilities that might otherwise have made it into a released model because in-house testing techniques may have missed them. In the second paper, “Diverse and Effective Red Teaming with Auto-Generated Rewards and Multi-Step Reinforcement Learning,” OpenAI introduces an automated framework that relies on iterative reinforcement learning to generate a broad spectrum of novel, wide-ranging attacks. Going all-in on red teaming pays practical, competitive dividends It’s encouraging to see competitive intensity in red teaming growing among AI companies. When Anthropic released its AI red team guidelines in June of last year, it joined AI providers including Google, Microsoft, Nvidia, OpenAI, and even the U.S.’s National Institute of Standards and Technology (NIST), which all had released red teaming frameworks. Investing heavily in red teaming yields tangible benefits for security leaders in any organization. OpenAI’s paper on external red teaming provides a detailed analysis of how the company strives to create specialized external teams that include cybersecurity and subject matter experts. The goal is to see if knowledgeable external teams can defeat models’ security perimeters and find gaps in their security, biases and controls that prompt-based testing couldn’t find. What makes OpenAI’s recent papers noteworthy is how well they define using human-in-the-middle

Read More »