BREAKING NEWS🚨: NVIDIA has just achieved 423 tok/s/user 🚀 on the 2.8T Parameter Kimi K3 model via a new upstream vLLM optimization. 1.68x Faster on the Same Hardware! This was done by NVIDIA CentML's Benjamin, who wrote NVIDIA's new decode-specialized kernels in Cute DSL via

SemiAnalysis @SemiAnalysis_ ·
BREAKING NEWS🚨: NVIDIA has just achieved 423 tok/s/user 🚀 on the 2.8T Parameter Kimi K3 model via a…

更多来自 @SemiAnalysis_

  1. #1

    Video posted by SemiAnalysis (@SemiAnalysis_)

    SemiAnalysis @SemiAnalysis_ ·
    视频封面
  2. #2

    BREAKING NEWS🚨: @Inferact & Google submit their FIRST preliminary TPUv7 Kimi K3 2.8T Model Submission, and it is already delivering strong perf per TCO against GB200 NVL72, B3…

    SemiAnalysis @SemiAnalysis_ ·
    BREAKING NEWS🚨: @Inferact & Google submit their FIRST preliminary TPUv7 Kim…
  3. #3

    GLM 5.3’s biggest leap came from post-training alone. “GLM 5.3 was built entirely by post-training the previous model. For me, that was a wake-up call.” “Post-training is far more…

    SemiAnalysis @SemiAnalysis_ ·
    视频封面
  4. #4

    TOKENMAXXING: @vllm_project and @inferact achieve 1.3 BILLION tokens per $ of TCO (hyperscaler volume pricing) via disaggregated serving on AgentX. This result is 4x better than t…

    SemiAnalysis @SemiAnalysis_ ·
    TOKENMAXXING: @vllm_project and @inferact achieve 1.3 BILLION tokens per $ of T…
  5. #5

    MEME: If GPT-7 is AGI, OpenAI could potentially ditch Broadcom entirely and bring everything in-house, as GPT-7 could be better than Broadcom at designing 224G SerDes, handling PD…

    SemiAnalysis @SemiAnalysis_ ·
    MEME: If GPT-7 is AGI, OpenAI could potentially ditch Broadcom entirely and bri…
  6. #6

    The agent access war has started！ Meta's Muse recently hit #1 on the App Store. But soon Amazon blocked it. Jefferies then found a third of the US shopping and travel sites it tes…

    SemiAnalysis @SemiAnalysis_ ·
    The agent access war has started！ Meta's Muse recently hit #1 on the App Store.… The agent access war has started！ Meta's Muse recently hit #1 on the App Store.…

查看 @SemiAnalysis_ 的全部帖子