Skip to content

CollectiveX: use NIXL's two-step prepped-list API for kv-transfer - #3540

Open
iyastreb wants to merge 1 commit into
SemiAnalysisAI:collectivex-kv-transferfrom
iyastreb:iyastreb/nixl-2-steps-api
Open

iyastreb wants to merge 1 commit into
SemiAnalysisAI:collectivex-kv-transferfrom
iyastreb:iyastreb/nixl-2-steps-api

Conversation

@iyastreb

Copy link
Copy Markdown

The NIXL kv adapter now preps both sides' pool descriptor lists once at connect (prep_xfer_dlist) and builds each request with make_prepped_xfer over block-table row indices, the shape vLLM's NixlConnector posts, instead of initialize_xfer per request.

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@iyastreb
iyastreb force-pushed the iyastreb/nixl-2-steps-api branch 2 times, most recently from 7b2ac0c to d53b66e Compare September 28, 2026 14:14
@Oseltamivir
Oseltamivir force-pushed the collectivex-kv-transfer branch from dc68d14 to 249ee19 Compare September 28, 2026 14:58
@Oseltamivir
Oseltamivir requested review from a team and functionstackx as code owners September 28, 2026 14:58
@Oseltamivir
Oseltamivir force-pushed the collectivex-kv-transfer branch 3 times, most recently from 60dbf2b to 3b42529 Compare September 28, 2026 16:03
@iyastreb
iyastreb force-pushed the iyastreb/nixl-2-steps-api branch from d53b66e to 025fbd2 Compare September 29, 2026 03:14
@iyastreb
iyastreb force-pushed the iyastreb/nixl-2-steps-api branch from 025fbd2 to c64e221 Compare September 29, 2026 07:02

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant