Think @DeepSpeedAI is only good for ZeRO and its usability, not training throughput? At #PyTorchCon North America 2026, Masahiro Tanaka will cover tensor, sequence, and expert parallelism in DeepSpeed and walk through benchmarks. His session, “DeepSpeed Is Not Just ZeRO:

PyTorch @PyTorch ·
视频封面

更多来自 @PyTorch

  1. #1

    Replacing CUDA with FBTriton for Table Batched Embedding (TBE) kernels delivered massive gains for our rec sys models. @Meta contributors achieved up to 1.28x faster forward passe…

    PyTorch @PyTorch ·
    Replacing CUDA with FBTriton for Table Batched Embedding (TBE) kernels delivere…
  2. #2

    October 19: @RedHat, @NVIDIA AI, and @IBM are hosting “PyTorch, Powering the Enterprise,” a #PyTorchCon North America Day 0 event. The in-person event will explore PyTorch and the…

    PyTorch @PyTorch ·
    October 19: @RedHat, @NVIDIA AI, and @IBM are hosting “PyTorch, Powering the En…
  3. #3

    From torch.profiler to Hardware Cycles: A Practical Profiling Playbook AWS Trainium: designed from the ground up for next generation AI training and inference is now a standard Py…

    PyTorch @PyTorch ·
    视频封面
  4. #4

    The #OpenSourceAIWeek lineup is loading. Is your event on it? ⏳ Join the Bay Area celebration, October 16-25, with flagship events #PyTorchCon North America, October 20-21, and #A…

    PyTorch @PyTorch ·
    视频封面
  5. #5

    Over the last two years, @Meta has consolidated PyTorch's media stack across three libraries: TorchCodec, TorchVision, and TorchAudio. TorchCodec serves as the single home for CPU…

    PyTorch @PyTorch ·
    Over the last two years, @Meta has consolidated PyTorch's media stack across th…
  6. #6

    PyTorch Conference is where the open source Al community gathers to talk about what we are all building together. Priya Nagpurkar, VP of AI Native Systems at @IBMResearch will giv…

    PyTorch @PyTorch ·
    视频封面

查看 @PyTorch 的全部帖子