Hi, I'm Shrinav Loka, a Computer Science and Math student at the University of Maryland - College Park. I previously interned at Stripe working on ML Infrastructure for Privacy. I'm super passionate about ML Systems, focusing on LLM inference, speculative decoding, KV cache mechanics, and prefill/decode disaggregation. Let's have fun coding!
Pinned Loading
-
-
-
-
vllm-cold-start
vllm-cold-start PublicCuts ~30s off vLLM cold starts by caching GPU initialization across container boots
Python
-
gpu-snapshot
gpu-snapshot PublicMulti-GPU checkpoint/restore for gVisor — 2 files, verified on 2x H100 with NCCL
Shell
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.


