Skip to content
View rafvasq's full-sized avatar

Organizations

@IBM @kserve @ibm-granite-community

Block or report rafvasq

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
rafvasq/README.md

LinkedIn

I'm an Open Source Software Developer at IBM working in the AI inference space. I've contributed to vLLM and built a vLLM plugin for hardware enablement on the IBM Spyre Accelerator, and before that I maintained KServe/ModelMesh for model serving.

I also do developer advocacy work: 10+ international conference talks on LLM inference and model serving, mentoring new contributors, and writing blogs and tutorials.

My background includes a MASc spanning reinforcement learning, virtual reality, and autonomous vehicle research, and time spent in retail data science.

Projects I've worked on

Project Role What I did
IBM Granite Community Maintainer, 2026–now Workshop recipes per model release, CI build infrastructure, new models on Replicate and Ollama
vLLM-Spyre Maintainer, 2025–2026 FP8 quantization, sliding window attention, tensor-parallel tests, CI/CD with model caching, docs
vLLM Contributor, 2024–2025 Bug fixes, frontend features, CI linting, docs
KServe ModelMesh Maintainer, 2022–2024 Multi-runtime serving (Triton, TorchServe, MLServer), gRPC/dependency updates, Grafana dashboards

I've also contributed to InstructLab, Caikit, and Machine Learning Exchange.

Selected talks

  • Fast Inference, Furious Scaling, Open Source Summit NA 2025
  • Leveraging Open Source AI Securely and Privately, Devopsdays Geneva 2025
  • All talks & workshops →

Pinned Loading

  1. ibm-granite-community/granite-snack-cookbook ibm-granite-community/granite-snack-cookbook Public

    Granite Snack Cookbook -- easily consumable recipes (python notebooks) that showcase the capabilities of the Granite models

    Jupyter Notebook 394 124

  2. torch-spyre/spyre-inference torch-spyre/spyre-inference Public

    vLLM plugin for Spyre based on torch-spyre

    Python 8 67

  3. kserve/kserve kserve/kserve Public

    Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

    Go 6.1k 1.7k

  4. projectionist projectionist Public

    A self-hosted service that manages Plex collections, handles WhatsApp requests, and automates library cleanup.

    Python

  5. payday-planner payday-planner Public

    Local cashflow planner.

    TypeScript