Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
02a64f2
Admin API: list connected workers and queued demand (#2804)
amankrx Sep 28, 2026
a7cc44d
Placement: least_loaded and best_fit allocation strategies, typed pro…
amankrx Sep 28, 2026
5ef7a83
Redis scheduler store: RESP3 cursor pages, the retention default, an …
amankrx Sep 28, 2026
2762510
Matching pass: room that opens mid-pass goes to the oldest waiting ac…
amankrx Sep 28, 2026
2bfa020
GoingAway with a drain flag, reconnect backoff with jitter, and a shu…
amankrx Sep 28, 2026
a21d82c
Dispatch is acknowledged or declined by the worker (#2808)
amankrx Sep 29, 2026
e6aa38a
Worker: kill the whole process group when an action times out or is c…
amankrx Sep 29, 2026
f10c7b7
Worker: bound output capture, upload fan-out, precondition scripts an…
amankrx Sep 29, 2026
74688d6
docs(llms): regenerate llms.txt, llms-small.txt and llms-full.txt (#2…
github-actions[bot] Sep 29, 2026
fcdccc8
Worker: soft memory enforcement against the reservation, and a disk g…
amankrx Sep 29, 2026
3ff63f1
Give the oversized-upload store tests the 30 s deadline the third alr…
amankrx Sep 29, 2026
d86ff4f
Worker advertises CPU and memory from its own cgroup limits (#2820)
amankrx Sep 29, 2026
de7a540
Worker readiness follows scheduler registration (#2821)
amankrx Sep 29, 2026
9a95e29
Worker: SIGTERM grace before the kill, output kept, a TMPDIR per acti…
amankrx Sep 29, 2026
5aa89ad
docs(llms): regenerate llms.txt, llms-small.txt and llms-full.txt (#2…
github-actions[bot] Sep 29, 2026
4fe0a27
Worker reaps the zombies actions leave behind, and an action's stragg…
amankrx Sep 29, 2026
c79e3bb
Namespaces: each action gets a private /tmp, its own tmp directory bo…
amankrx Sep 30, 2026
7bd3c54
Worker: a disk soft limit, and peak_disk_kb from the files an action …
amankrx Sep 30, 2026
3c52ee1
Scheduler: memory escalation with retry budgets by cause, the whole w…
amankrx Sep 30, 2026
035dd63
Persistent workers: a configurable pool with an idle sweeper, the act…
amankrx Sep 30, 2026
59cbad2
Historical resource scheduler: hints by digest keys, size classes wit…
amankrx Sep 30, 2026
938c56f
docs(llms): regenerate llms.txt, llms-small.txt and llms-full.txt (#2…
github-actions[bot] Sep 30, 2026
9a03932
Worker: build the cleanup mark's guard after the lock is released (#2…
amankrx Sep 30, 2026
fd6530e
Store: a read that stops short of the digest's size is an error, not …
amankrx Sep 30, 2026
b4a5468
Worker: read capacity and free memory from the worker's own cgroup di…
amankrx Sep 30, 2026
82240c6
Worker: bound the input fetch with max_download_timeout and let a kil…
amankrx Sep 30, 2026
181a1d3
Support queueing-service through an opt-in gRPC event sink (#2811)
MarcusSorealheis Sep 30, 2026
514d75e
ci: gate rbe-*/LRE lanes on affected paths, full matrix on main
b7r6 Sep 30, 2026
16442a8
Disable Bazel disk cache when nativelink cloud cache is enabled
palfrey Oct 2, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/actions/setup-nativelink-cloud/action.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ inputs:

outputs:
enabled:
description: "'true' when a user.bazelrc was written, else 'false'."
description: "'true' when remote cache or execution is enabled, else 'false'."
value: ${{ steps.configure.outputs.enabled }}

runs:
Expand Down
34 changes: 34 additions & 0 deletions .github/workflows/lre.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,41 @@ concurrency:
cancel-in-progress: ${{ github.ref != 'refs/heads/main' }}

jobs:
# Compute whether this diff can affect the LRE example builds. These lanes
# build @local-remote-execution//examples, so they are keyed off the LRE
# toolchain inputs. Pushes to main always run the full matrix (backstop).
changes:
name: Compute affected lanes
runs-on: ubuntu-24.04
outputs:
lre: ${{ steps.filter.outputs.lre }}
steps:
- name: Checkout
uses: >- # v6.0.2
actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd

- name: Filter LRE-affecting paths
uses: >- # v3.0.2
dorny/paths-filter@de90cc6fb38fc0963ad72b210f1f284cd68cea36
id: filter
with:
filters: |
lre:
- 'local-remote-execution/**'
- 'MODULE.bazel'
- 'MODULE.bazel.lock'
- '*.bazelrc'
- 'flake.nix'
- 'flake.lock'
- 'tools/**'
- '.github/workflows/lre.yaml'
- '.github/actions/**'

local:
needs: [changes]
if: >-
github.ref == 'refs/heads/main'
|| needs.changes.outputs.lre == 'true'
strategy:
fail-fast: false
matrix:
Expand Down
38 changes: 22 additions & 16 deletions .github/workflows/native-bazel.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -49,15 +49,8 @@ jobs:
- name: Free disk space
uses: ./.github/actions/free-disk

- name: Setup Bazel
uses: >- # v0.19.0
bazel-contrib/setup-bazel@c5acdfb288317d0b5c0bbd7a396a3dc868bb0f86
with:
bazelisk-cache: true
repository-cache: true
disk-cache: ${{ github.workflow }}-${{ matrix.os }}-bazel-${{ matrix.bazel_version }}

- name: Setup NativeLink Cloud
id: setup-nativelink-cloud
uses: ./.github/actions/setup-nativelink-cloud
with:
ci-mode: ${{ vars.NATIVELINK_CI_MODE }}
Expand All @@ -72,6 +65,16 @@ jobs:
# non-Linux runners, so macOS lanes fall back to cache.
exec: ${{ runner.os == 'Linux' && 'on' || 'off' }}

- name: Setup Bazel
uses: >- # v0.19.0
bazel-contrib/setup-bazel@c5acdfb288317d0b5c0bbd7a396a3dc868bb0f86
with:
bazelisk-cache: true
repository-cache: true
# Only enable when we don't have remote cache, otherwise it just gets very slow
# and enormous
disk-cache: ${{ steps.setup-nativelink-cloud.outputs.enabled == 'false'}}

- name: Show Bazel version
run: bazel --version

Expand Down Expand Up @@ -119,15 +122,8 @@ jobs:
with:
compose-file: src/bin/docker-compose.store-tester.yaml

- name: Setup Bazel
uses: >- # v0.19.0
bazel-contrib/setup-bazel@c5acdfb288317d0b5c0bbd7a396a3dc868bb0f86
with:
bazelisk-cache: true
repository-cache: true
disk-cache: ${{ github.workflow }}-ubuntu-24.04

- name: Setup NativeLink Cloud
id: setup-nativelink-cloud
uses: ./.github/actions/setup-nativelink-cloud
with:
ci-mode: ${{ vars.NATIVELINK_CI_MODE }}
Expand All @@ -142,6 +138,16 @@ jobs:
# non-Linux runners, so macOS lanes fall back to cache.
exec: ${{ runner.os == 'Linux' && 'on' || 'off' }}

- name: Setup Bazel
uses: >- # v0.19.0
bazel-contrib/setup-bazel@c5acdfb288317d0b5c0bbd7a396a3dc868bb0f86
with:
bazelisk-cache: true
repository-cache: true
# Only enable when we don't have remote cache, otherwise it just gets very slow
# and enormous
disk-cache: ${{ steps.setup-nativelink-cloud.outputs.enabled == 'false'}}

- name: Run Store tester with sentinel
run: |
bazel run //:redis_store_tester \
Expand Down
37 changes: 37 additions & 0 deletions .github/workflows/nix.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -157,8 +157,45 @@ jobs:
nativelink_attic_token: ${{ secrets.NATIVELINK_ATTIC_TOKEN }}
nix_name: .#${{ matrix.test-name }}-with-nativelink-test

# Compute which lanes this diff can affect. The rbe-* lanes validate
# "does this toolchain still build through NativeLink", so they are keyed
# off the toolchain/LRE configuration inputs they consume. Pushes to main
# always run the full matrix (backstop), so no change can merge without
# the complete matrix running against it.
changes:
name: Compute affected lanes
runs-on: ubuntu-24.04
outputs:
toolchain: ${{ steps.filter.outputs.toolchain }}
steps:
- name: Checkout
uses: >- # v6.0.2
actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd

- name: Filter toolchain-affecting paths
uses: >- # v3.0.2
dorny/paths-filter@de90cc6fb38fc0963ad72b210f1f284cd68cea36
id: filter
with:
filters: |
toolchain:
- 'toolchain-examples/**'
- 'local-remote-execution/**'
- 'MODULE.bazel'
- 'MODULE.bazel.lock'
- '*.bazelrc'
- 'flake.nix'
- 'flake.lock'
- 'tools/**'
- '.github/workflows/nix.yaml'
- '.github/actions/**'

# rbe-toolchain is slow because it has many subcommands, so split it out
generate-rbe-commands:
needs: [changes]
if: >-
github.ref == 'refs/heads/main'
|| needs.changes.outputs.toolchain == 'true'
runs-on: ubuntu-24.04
outputs:
matrix: ${{ steps.set-matrix.outputs.matrix }}
Expand Down
Loading
Loading