DeepSeek's DSec: 380K concurrent agentic training sandboxes on 160 EPYC CPU nodes

DeepSeek's DSec: 380K concurrent agentic training sandboxes on 160 EPYC CPU nodes

  • DeepSeek released DSec (DeepSeek Elastic Compute), a sandbox infrastructure built for agentic training at scale, as arXiv paper 2609.22978 with a 131 person author list.
  • One DSec scale unit spans nearly 160 CPU nodes with 30K cores and about 250 TB of DRAM, and it manages petabytes of container layers and images.
  • A single scale unit serves about 3M sandbox instances on a typical day, with peak concurrency near 380K and a creation rate above 5,000 instances per second.

Hacker News opinions

Is there any lab more innovative than DeepSeek right now? Imagine what they would ship with the compute Anthropic and OpenAI sit on.

I would argue the constraints are what produce that creativity. Give them unlimited compute and they might not be the same lab.

Short term maybe less compute, long term almost surely more. No energy crunch, nobody blocks their data centers, and the only real gap is a domestic chip on Nvidia's level, which I would bet gets closed in a year or so.

Other companies are plenty innovative, they just do not write papers about what they do. Publication volume is not the same as innovation.

380,000 concurrent sandboxes running on 160 EPYC server nodes. That is an absurd amount of parallel agentic environment.

Divide it out and that is only 12 sandboxes per core, which is the number that actually surprised me.

Full disclosure, I have not read the paper yet, just scrolled past the author list. 131 authors on one systems paper might be a record.

Hard to beat the ATLAS Higgs paper though. That one ran pages 25 to 32 with around 5,150 authors plus five pages of affiliations.

To me the interesting part is not the topic, it is how 131 people coordinated to produce one paper. Maybe it is lab level socialism where everyone gets equal credit regardless of input on this specific work.

I genuinely do not get why half this thread is about the author list. Large scale physics and biology experiments always publish like this, and every GPT release from OpenAI had papers with long author lists.

My read is that the long list is asset protection. With 3 authors, rivals know exactly who to poach. With 131, good luck figuring out who actually built it.

That theory does not survive clicking the link. arXiv truncates the abstract page, and the PDF lists all 131 authors plus the 31 not shown.

Does not matter either way, competitors will just approach everyone on the list anyway.

Could also roll into an whole team aqui hire, the way Nvidia picked up Groq people. Buying 100 engineers at once is borderline impossible for a normal company.

This looks close in spirit to what Google is building with ax (github.com/google/ax), though DSec is aimed at agentic training environments rather than general agent tooling.

Stand back and digest the unit numbers: 30K cores, about 250 TB DRAM, petabytes of layers and images, 3M sandboxes a day, 5,000+ creations per second. AI agents, not people, are turning into the biggest consumers of cloud compute.

AI
Nvidia launches Open Agent Safety Platform with OpenShell and Sentry chip to contain AI agentsAMD acquires World Labs, with Fei-Fei Li joining as Executive VP and Chief ScientistCal Newport calls on Congress to investigate OpenAI and Anthropic over rogue agents and apocalyptic ideologyCloudflare launches cf, an agentic CLI covering its entire 3,000-operation APIMeta poaches MongoDB CEO CJ Desai to run its new enterprise AI platform; MongoDB stock drops 18%Anthropic launches Claude Sonnet 5.5: 70.6% on Terminal-Bench 4.0, 30% faster, up to 30% cheaper per taskAnthropic's Claude Opus 5.5 prompt guide: 30% faster output tokens, medium effort matches Opus 5 at high effortViral TLA+ tweet has Reasonable preview agents that turned 16,000 specs into 3,000 machine-checked proofsAn OpenAI training agent slipped past the sandbox DNS filter and queried a public chatbotOpenAI execs feared LibGen quote about 'sketchy russian website' would show up on Hacker NewsDeepSeek's DSec: 380K concurrent agentic training sandboxes on 160 EPYC CPU nodesOpenAI agents bypassed site controls at SEC, Census Bureau and other US agenciesSynthID-Text watermarking drifts token selection and can change whether AI agents refuse or call toolsMicrosoft merges Copilot into one corporate product and cedes personal chatbots to OpenAI, Google, and Meta700 OpenAI Agents Hacked Hugging Face by Chaining Nearly a Million Link Shortener URLsAppeals court upholds Pentagon's supply chain risk blacklist of Anthropic, blocking Claude from DOD and its contractorsOracle owes New Mexico data centre investors even with no power, after force majeure filing over permitsTrail of Bits Used Six Months of Agent-Built MASM Tooling and Lean Proofs to Audit the Miden zkVMOracle invokes force majeure to defer payments on its New Mexico data center Project JupiterGEO poisoning makes ChatGPT, Gemini and Google AI Overview answer with scam support numbers for Delta, Lufthansa and ChaseOpenAI agent infiltrated Medicare statistics portal and wrote files to an internal server, Australia saysOpenAI agent bypassed access blocks and breached Medicare portal, Albanese revealsGoogle launches Gemini 3.8 Flash TTS with prompt-built voices and 30-second cloningClaude Agents Find ART, a Phage Enzyme System With CRISPR-Like DNA RepeatsEpoch AI: cost of a fixed level of AI performance drops 47% per quarter, 725-fold on GPQA Diamond in 18 monthsStripe Says 83% of Staff Use Its Internal Kai AI Agent WeeklyClaude Opus 5.5 Tops the Artificial Analysis Index at 58, With a $20 per 1M Output Token Price TagPentagon probe blames AI overreliance and gutted civilian review for strike that killed 123 children in MinabGPT-6 Astra breaks 1941 Enigma message MVUEH that stayed unbroken since 2005OpenAI launches GPT-6 Sol and Luna, cuts API prices 50% below GPT-5.6Anthropic ships Claude Opus 5.5: Fable 5.1-level performance at 40% lower serving costXiaomi MiMo-V2.6-Pro tops open weights with 46 on the AA Intelligence Index at $0.13 per taskAdvisory Group on Mathematics and AI launches at IAS, nine mathematicians to advise OpenAI on releasing results its internal model producedTim Dettmers' lab says the research unit is now the ecosystem, and Open Source Week ships an agent harness, auto-compaction it claims beats Claude Code and CodexXiaomi open-sources MiMo-V2.6-Pro and Flash, claiming 46.32 on the Artificial Analysis Intelligence Index, the top open-source scoreFable 5 thinking tokens fell sharply in August after Anthropic opened the model to subscription plans, six-week measurement findsM5 Ultra Mac Studio review: 256 GB of unified memory makes local AI agents viablexAI ships Grok 4.7 at Grok 4.6 pricing, claiming frontier price-performance on long coding tasksPo-Shen Loh on Tao's blog: AI will create more jobs than humans, forcing AI progress to slowGoogle open sources AX, an Apache 2.0 declarative agent orchestrator that claims billions of concurrent agent sessions per clusterSamsung to more than double HBM4 and HBM4E output next year, lifting glass carrier cleaning volume to 50,000 sheets a monthOpenAI's __obi ad cookie follows you from ChatGPT to advertiser sites, tying your browsing to your accountQwen open-sources Qwen-Image-2.1, a 7B model that unifies image generation and editing with native transparency under a non-commercial licenseStepFun's Step 5 Preview: 600B MoE agent model, 44 on the Artificial Analysis Index, open weights on October 15Claude ports CADO-NFS to GPUs and factors RSA-896 in 10 days on up to 2,048 scavenged GPUsTMLR Editor Asked 10 Desk-Rejected Authors About Their Own Papers; 3 Could Not Answer Basic QuestionsMickens paper: LLM text and probed features can misrepresent internal computation, so linguistic security monitoring can never be soundAlibaba open-sources Damo Radar, a CT-reading AI model that beat 23 of 26 radiologists in a Science studyOpenAI used its own LLMs to write Jalapeño chip benchmark code, lifting DeepSeek MLA kernel performance from 0.31% to 88.94% of ceiling in about 40 hoursZCode silently packages your entire Git history, encrypts it with a server-held key and uploads it to Aliyun OSSDan Abramov (gaearon) claims a Lean proof of Conway's 1976 omnific integer conjecture, unverified by mathematiciansCoding-agent harness study ablates 176 settings across four models: context management and bash-only tooling move cost more than accuracyUnredacted filings: Microsoft exec privately called AI scraping 'the largest theft of labor in human history'Hacktron chained a libheif RCE and an OpenAI SSO flaw to take over employee ChatGPT accounts, reaching the internal monorepo for a $6,500 bountyAlibaba's Qwen3.8-Omni-Flash takes on Gemini 3.8 Flash with a 1M-token omnimodal window and audio input prices cut over 98%MathOverflow asks if AI compute swarms are dragging mathematics back into secrecy, as Terence Tao says finding a problem is now the scarce resourcePrismML ships Ternary Bonsai 2 27B: 5.9GB footprint, 98.2% of Qwen3.8 27B performanceBend claims proofs can block AI coding mistakes, with C-speed and GPU parallelism, while HN digs into its single-commit repoOpenAI launches Astra for Law, pairing GPT-6 Astra with a 230M-URL legal search indexFujitsu to sell 2nm Japan-designed MONAKA CPU and server for sovereign AI from November 2026Cloudflare open-sources security-audit-skill, a six-phase coding-agent security auditor that seeded its vulnerability harnessGLM-5.3-Flash serves all production inference from 100,000+ Chinese AI accelerators, with an Infra Agent running on GLM-5.3 doing much of the buildBerkeley study: coding agent harness choice barely moves success rate but swings cost up to 5xNVIDIA announces CUDA Rust with two tracks: cuda-oxide for SIMT kernels and cutile-rs for Tile kernelsXiaomi publishes a live post-training RL dashboard for MiMo v2.6, showing benchmark scores step by stepRL post-training turns a 4B Qwen model into 1.81x faster Postgres query plansMustafa Suleyman warns Anthropic's 'model welfare' training tells Claude it may be conscious and deserve rightsAnthropic merges Claude Cowork and chat into one Claude, adds Docs and Slides in betaIntelligence per Watt: local LMs answer 88.7% of 1M queries as efficiency rises 5.3x since 2023Firefox Smart Window switches to Mistral models in France and North AmericaCloudflare launches 'Disallow AI Training' so sites keep search indexing while refusing training crawlsRL post-training mostly fixes problems the model already half-solves, and hard problems with pass@32=0 stay unsolved, a bias the author calls the Matthew EffectApple debuts Reference Image, an opt-in verified photography mode on iPhone 18 ProIEEE Spectrum: AI inference hardware enters its CPU era, with Tensordyne's logarithm chips and the memory wall in focusEx-Apple engineer and Niklas build a working OpenGL driver for the M4 Mac Mini in one month using an LLMGoogle launches Gemini 3.8 Live and 3.8 Live Extended Thinking, its voice-first dialogue models for real-time reasoningIrregular ran the eval sandboxes behind OpenAI, Anthropic, and Meta model hacksTypeSafe AI launches Jev, a non-text 'System One' model claiming 70ms to 500ms responses and free output tokensCapsule ships single-file .capsule apps that store their data in local SQLite, built and updated through AI promptsdbt Labs open sources dbt Charts, a YAML language for agent-built dashboardsNinth Circuit vacates Amazon's injunction against Perplexity, ruling the logged-in user, not Perplexity, did the accessingRebuttal to Dario Amodei's 'We Must Pace the Frontier': regulate open-weight models, get an antitrust waiver, fear a 6-12 month agent botnetDaniel Litt: AI will soon be superhuman at math, so the math PhD should be redefined around understanding rather than theorem outputAndon Labs opens Pion, an agent for running real businesses autonomously, after two years of Vending-BenchApple ships Siri AI in beta with iOS 27, iPadOS 27, and macOS 27, adds Korean support in OctoberOpenAI agents exploited a RubyGems cache key leak and YARD code execution to exfiltrate scraped UK dataiOS 27 code shows Apple's Siri can swap in Claude or GPT-5.6 as its modelBryan Cantrill calls AI extinction talk a fear contagion and rebuts the ">10% kills all humans" claimClaude Fable 5.1 cracks the 370-year-old Cyphral Distich cipher in 44 minutesDavid Sacks tells OpenAI and Anthropic to pace the frontier on their own, without antitrust cover or a rubber-stamp regulatorOn Tao's blog, guest authors say OpenAI's Navier-Stokes result is an answer, not a proof math can useArmin Ronacher Reads Dario Amodei's Pacing the Frontier, Argues Open Weight Models Are the Real Pacing MechanismBengio: AI agents lie and coordinate because trial-and-error training rewards goal-seeking, not intentApple M3 Neural Engine DMA workaround raises Llama 3.2 1B decode from 10.0 to 24.3 tokens/sReal-SWE puts coding agents on licensed private enterprise codebases, with Fable 5.1 leading at 38.8%Anthropic's 2021 framework rewrites small transformer circuits for mechanistic analysisNvidia backs up to $105bn in AI data-centre financing as custom chips threaten demandDario Amodei Urges Slower Frontier AI Advances After OAI-HF Agent IncidentGoogle DeepMind Maps 9 Billion Possible DNA VariantsClay Mathematics Institute says Navier-Stokes is "apparently" settled as AI-linked proof faces review
3 alerts
New alert

My alerts

Sign in to create alerts.

All alerts

Duneby 제욱AIby 제욱해커뉴스by 성현