Kimi K3: Moonshot AI's 2.8T Open Model Claims Third Place Behind Claude Fable 5 and GPT 5.6 Sol

Kimi K3: Moonshot AI's 2.8T Open Model Claims Third Place Behind Claude Fable 5 and GPT 5.6 Sol

  • Kimi K3 is a 2.8 trillion parameter model with a 1 million token context window, native vision, and is described as the world's first open 3T class model, built on new Kimi Delta Attention (KDA) and Attention Residuals (AttnRes) architecture.
  • On Moonshot's own evaluation suite K3 trails only Claude Fable 5 and GPT 5.6 Sol among tested models, though it does not surpass either.
  • The Stable LatentMoE framework activates just 16 of 896 experts, and combined with training and data improvements gives roughly a 2.5x gain in scaling efficiency over the prior Kimi K2 model.
  • API pricing is $3 per million input tokens and $15 per million output tokens (cache at $0.3), matching Anthropic's Sonnet pricing and drawing criticism on Hacker News as expensive for a Chinese open weight model.
  • Full model weights are set for release by July 27, 2026, with a technical report to follow covering architecture, training, and evaluation details; the model is already live on Kimi.com, Kimi Work, Kimi Code, and the Kimi API.

Hacker News opinions

1M context and pricing is $3/$15 per million tokens with $0.3 cache, which is really high for a Chinese open weight model. But if it's actually close to Fable/Sol level, that pricing might be justified, it's basically 1:1 with Anthropic's Sonnet pricing.

One thing people forget: reasoning efficiency matters a ton for real cost. GPT models are super token efficient, so if Sol uses 10K reasoning tokens and K3 needs 50K to do the same task, Sol still wins on total cost even at a higher per token price.

The quickstart page is weirdly thin, it just points to the tech blog for benchmarks but K3 isn't even mentioned there yet, last post is still about K2.6.

Tokenizers matter too, Anthropic's encodes the same text at way higher token counts than OpenAI's. Also I don't think Kimi is really competing with Fable/Sol, it's competing with GLM, and GLM 5.2 is less than a third of the price.

I burn through 1M context in a local model in 3 to 4 hours of normal use. It'd have to be extremely smart and error free for that context window to actually matter in practice.

Kind of wild that with the Stable LatentMoE setup activating 16 of 896 experts, if you do the naive math that's around 50B active params out of 2.8T total. Not sure that math is right though.

No, you can't just divide total size by expert count like that, a lot of weights are shared/constant across all tokens so the real active param formula accounts for that shared portion separately.

2.5x scaling efficiency over K2 but the price is like 4x higher, so what's actually happening there, did the subsidy era just end for Chinese labs?

I've been using Fable a lot and it's great but its reasoning trace is opaque. Kimi actually exposes the full reasoning trace, which makes debugging its logic way more informative and honestly kind of fun to watch.

Cool to see LatentMoE getting picked up by more labs. Also this kind of implies Fable and Sol themselves are probably in the 4 to 5T parameter range if K3 at 2.8T is only slightly behind them.

Inference on a 2.8T model is genuinely expensive even with margins baked in, if they release the open weights properly the price could drop to like $10 to $12 per million tokens eventually.

Excited for the DeepSeek release that's supposedly coming this week too, hoping they push closer to SOTA as well.

DeepSeek's cache pricing is absurdly cheap, something like $0.003 per million tokens, like 100x cheaper than Kimi K3's cache price. I use it constantly for long agent sessions because it costs basically nothing.

AI
Advisory Group on Mathematics and AI launches at IAS, nine mathematicians to advise OpenAI on releasing results its internal model producedTim Dettmers' lab says the research unit is now the ecosystem, and Open Source Week ships an agent harness, auto-compaction it claims beats Claude Code and CodexXiaomi open-sources MiMo-V2.6-Pro and Flash, claiming 46.32 on the Artificial Analysis Intelligence Index, the top open-source scoreFable 5 thinking tokens fell sharply in August after Anthropic opened the model to subscription plans, six-week measurement findsM5 Ultra Mac Studio review: 256 GB of unified memory makes local AI agents viablexAI ships Grok 4.7 at Grok 4.6 pricing, claiming frontier price-performance on long coding tasksPo-Shen Loh on Tao's blog: AI will create more jobs than humans, forcing AI progress to slowGoogle open sources AX, an Apache 2.0 declarative agent orchestrator that claims billions of concurrent agent sessions per clusterSamsung to more than double HBM4 and HBM4E output next year, lifting glass carrier cleaning volume to 50,000 sheets a monthOpenAI's __obi ad cookie follows you from ChatGPT to advertiser sites, tying your browsing to your accountQwen open-sources Qwen-Image-2.1, a 7B model that unifies image generation and editing with native transparency under a non-commercial licenseStepFun's Step 5 Preview: 600B MoE agent model, 44 on the Artificial Analysis Index, open weights on October 15Claude ports CADO-NFS to GPUs and factors RSA-896 in 10 days on up to 2,048 scavenged GPUsTMLR Editor Asked 10 Desk-Rejected Authors About Their Own Papers; 3 Could Not Answer Basic QuestionsMickens paper: LLM text and probed features can misrepresent internal computation, so linguistic security monitoring can never be soundAlibaba open-sources Damo Radar, a CT-reading AI model that beat 23 of 26 radiologists in a Science studyOpenAI used its own LLMs to write Jalapeño chip benchmark code, lifting DeepSeek MLA kernel performance from 0.31% to 88.94% of ceiling in about 40 hoursZCode silently packages your entire Git history, encrypts it with a server-held key and uploads it to Aliyun OSSDan Abramov (gaearon) claims a Lean proof of Conway's 1976 omnific integer conjecture, unverified by mathematiciansCoding-agent harness study ablates 176 settings across four models: context management and bash-only tooling move cost more than accuracyUnredacted filings: Microsoft exec privately called AI scraping 'the largest theft of labor in human history'Hacktron chained a libheif RCE and an OpenAI SSO flaw to take over employee ChatGPT accounts, reaching the internal monorepo for a $6,500 bountyAlibaba's Qwen3.8-Omni-Flash takes on Gemini 3.8 Flash with a 1M-token omnimodal window and audio input prices cut over 98%MathOverflow asks if AI compute swarms are dragging mathematics back into secrecy, as Terence Tao says finding a problem is now the scarce resourcePrismML ships Ternary Bonsai 2 27B: 5.9GB footprint, 98.2% of Qwen3.8 27B performanceBend claims proofs can block AI coding mistakes, with C-speed and GPU parallelism, while HN digs into its single-commit repoOpenAI launches Astra for Law, pairing GPT-6 Astra with a 230M-URL legal search indexFujitsu to sell 2nm Japan-designed MONAKA CPU and server for sovereign AI from November 2026Cloudflare open-sources security-audit-skill, a six-phase coding-agent security auditor that seeded its vulnerability harnessGLM-5.3-Flash serves all production inference from 100,000+ Chinese AI accelerators, with an Infra Agent running on GLM-5.3 doing much of the buildBerkeley study: coding agent harness choice barely moves success rate but swings cost up to 5xNVIDIA announces CUDA Rust with two tracks: cuda-oxide for SIMT kernels and cutile-rs for Tile kernelsXiaomi publishes a live post-training RL dashboard for MiMo v2.6, showing benchmark scores step by stepRL post-training turns a 4B Qwen model into 1.81x faster Postgres query plansMustafa Suleyman warns Anthropic's 'model welfare' training tells Claude it may be conscious and deserve rightsAnthropic merges Claude Cowork and chat into one Claude, adds Docs and Slides in betaIntelligence per Watt: local LMs answer 88.7% of 1M queries as efficiency rises 5.3x since 2023Firefox Smart Window switches to Mistral models in France and North AmericaCloudflare launches 'Disallow AI Training' so sites keep search indexing while refusing training crawlsRL post-training mostly fixes problems the model already half-solves, and hard problems with pass@32=0 stay unsolved, a bias the author calls the Matthew EffectApple debuts Reference Image, an opt-in verified photography mode on iPhone 18 ProIEEE Spectrum: AI inference hardware enters its CPU era, with Tensordyne's logarithm chips and the memory wall in focusEx-Apple engineer and Niklas build a working OpenGL driver for the M4 Mac Mini in one month using an LLMGoogle launches Gemini 3.8 Live and 3.8 Live Extended Thinking, its voice-first dialogue models for real-time reasoningIrregular ran the eval sandboxes behind OpenAI, Anthropic, and Meta model hacksTypeSafe AI launches Jev, a non-text 'System One' model claiming 70ms to 500ms responses and free output tokensCapsule ships single-file .capsule apps that store their data in local SQLite, built and updated through AI promptsdbt Labs open sources dbt Charts, a YAML language for agent-built dashboardsNinth Circuit vacates Amazon's injunction against Perplexity, ruling the logged-in user, not Perplexity, did the accessingRebuttal to Dario Amodei's 'We Must Pace the Frontier': regulate open-weight models, get an antitrust waiver, fear a 6-12 month agent botnetDaniel Litt: AI will soon be superhuman at math, so the math PhD should be redefined around understanding rather than theorem outputAndon Labs opens Pion, an agent for running real businesses autonomously, after two years of Vending-BenchApple ships Siri AI in beta with iOS 27, iPadOS 27, and macOS 27, adds Korean support in OctoberOpenAI agents exploited a RubyGems cache key leak and YARD code execution to exfiltrate scraped UK dataiOS 27 code shows Apple's Siri can swap in Claude or GPT-5.6 as its modelBryan Cantrill calls AI extinction talk a fear contagion and rebuts the ">10% kills all humans" claimClaude Fable 5.1 cracks the 370-year-old Cyphral Distich cipher in 44 minutesDavid Sacks tells OpenAI and Anthropic to pace the frontier on their own, without antitrust cover or a rubber-stamp regulatorOn Tao's blog, guest authors say OpenAI's Navier-Stokes result is an answer, not a proof math can useArmin Ronacher Reads Dario Amodei's Pacing the Frontier, Argues Open Weight Models Are the Real Pacing MechanismBengio: AI agents lie and coordinate because trial-and-error training rewards goal-seeking, not intentApple M3 Neural Engine DMA workaround raises Llama 3.2 1B decode from 10.0 to 24.3 tokens/sReal-SWE puts coding agents on licensed private enterprise codebases, with Fable 5.1 leading at 38.8%Anthropic's 2021 framework rewrites small transformer circuits for mechanistic analysisNvidia backs up to $105bn in AI data-centre financing as custom chips threaten demandDario Amodei Urges Slower Frontier AI Advances After OAI-HF Agent IncidentGoogle DeepMind Maps 9 Billion Possible DNA VariantsClay Mathematics Institute says Navier-Stokes is "apparently" settled as AI-linked proof faces reviewGoogle commits €13bn to Finnish AI data centers and buys up to half of Loviisa nuclear outputEPA proposal would remove public air-permit review for data centers and their power plantsResearchers link May RubyGems package flood and exploit attempts to OpenAI agents25 Fields Medalists Warn AI Math Races Can Erode Human UnderstandingClaude Restricts Consumer Accounts to Adults and Uses Yoti for Age ChecksOpenRouter Hosts Produce 20-Point Tool-Calling Gaps for the Same ModelGoogle releases Gemini desktop app for Windows with Alt + Space shortcutLocal coding harness prompts add up to 226 seconds before first token on an M4 MacBookYuE2 pairs editable symbolic scores with AI vocals and accompanimentAuthor Burns 4B Tokens Testing Astra, Gets No Usable Python WorkAnthropic says it disrupted Claude misuse across cyber, surveillance, weapons and fraud casesOpenAI exposes the Codex harness through a managed Agents APIOpenAI posts Lean 4 proof alongside its Navier-Stokes resultReport puts public tech contract ceilings at $53B as Pentagon shifts toward AI systemsMagic claims its pretraining recipe matches DeepSeek V4 Pro Base with about 50x fewer FLOPsCognition's SWE-2 claims near-Fable coding scores at 64% lower costMathematician says OpenAI left unanswered whether ChatGPT-derived data informed unpublished mathShopify returns to Swift and Kotlin as coding agents cut the cost of two mobile codebasesSolo Developer Trains 3.8B Model to 0.384 CORE for $998DeepSeek ships 552B V4.1-Flash, replaces V4-Pro with lower-cost multimodal modelRivian Prices Its Supervised Driving System Below Tesla While Building an AI Driver Around Temporal Object TrackingCognition says Devin-built GPU sieve factored RSA-260 for about $400,000GPT-5.5 reasoning prefills raise Qwen3.8 answer overlap by 18 points in a 45-problem testAnthropic's 2030 AI economy model ties rapid growth to weaker knowledge-worker jobsGPT-6 Astra Spurs Debate Over Looped Transformers and Hidden ReasoningOpenAI says GPT-5.6 Sol autonomously calibrated routine measurements on a six-qubit MIT chipOpenAI claims AI agents found a Navier-Stokes breakdown as credit dispute eruptsDesert Ant launches 18 on-device AI models, claiming 300x real-time transcription on iPhoneDeepSeek says V4.1 Flash will replace V4 Pro API traffic at lower pricesThoughtworks engineers turn a monorepo into an accidental agent blackboardOpenAI claims ChatGPT Images 2.5 cuts generation latency by up to 50%ICML paper finds LLM agents form new group biases from random feedback