- llm
- training
- communication
- inference
•
•
•
-  Study on BatchingOrca notes 
-  ToolsTools Used Recently 
-  Disaggregated Servingnotes on nvidia dynamo (framework for inference) 
-  Study on vLLMbackground notes on vllm 
-  Inference Simulation NotesQuotes from Papers that Hint at Significance of Communication in Inference 
-  Study on LLM Inference Communicationbackground notes on llm inference communication 
-  Study on LLM Inferencebackground notes on llm inference 
-  NCCL Intra/Inter-Node Communicationunderstanding nccl intra/inter-node communication 
-  LLM Training Optimization: Megatron and Deepspeednotes on megatron and deepspeed 
-  Survey on LLM Training Todaygeneral notes on sota llm infrastructure 
-  Parallelism in Distributed Training