Svelte Hacker News logo
  • top
  • new
  • show
  • ask
  • jobs
  • about

Disaggregated Inference at Scale with PyTorch and VLLM

pytorch.org

2 points by djhu9 9 hours ago