BE-942: Report integration progress and workspace metrics

[montekki]

Workspace operations gain counters and timing measurements so an application can report integration activity through its OpenTelemetry setup. Record request outcomes, query and materialized row counts, published snapshot bytes, and disk sizes already measured by disk-limit checks. Operation and outcome labels have fixed values, and metrics aggregate across workspaces.

Add Progress for shared observed-work counts, throttled structured tracing reports, and immediate final observations. It keeps the tracing span in which tracking started. This layer covers progress reporting and the workspace operations implemented in the stack; worker scheduling and storage metrics belong with those components when they are implemented.

Validation: all 36 engine tests passed, including concurrent progress updates, report throttling, and an in-memory exporter test exercising real workspace success, failure, cancellation, row counts, snapshots, and disk measurements. Clippy, rustdoc, doctests, Rust formatting, Oxfmt, and whitespace checks passed. Generated dependency docs were refreshed and remain unchanged.

Stacked on BE-918.

Related: BE-942 (internal).

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
hash	Ready	Preview	Oct 19, 2026 12:50pm UTC
petrinaut	Ready	Preview	Oct 19, 2026 12:50pm UTC
petrinaut-docs	Ready	Preview	Oct 19, 2026 12:50pm UTC

1 Skipped Deployment

Project	Deployment	Actions	Updated
hashdotdesign-tokens	Ignored	Preview	Oct 19, 2026 12:50pm UTC

[semgrep-code-hashintel]

🟠 High severity issue identified in your code:

The application builds a file path from potentially untrusted data, which can lead to a path traversal vulnerability. An attacker can manipulate the path which the application uses to access files. If the application does not validate user input and sanitize file paths, sensitive files such as configuration or user data can be accessed, potentially creating or overwriting files. To prevent this vulnerability, validate and sanitize any input that is used to create references to file paths. Also, enforce strict file access controls. For example, choose privileges allowing public-facing applications to access only the required files.

🌟 Fixed in commit a131dc0 🌟

[montekki]

/fp Workspace::snapshot is a Rust filesystem API whose caller selects a trusted destination. Writing to a caller-chosen path outside the database directory is supported behavior. This library has no HTTP handler or untrusted request-to-path dataflow. Restricting the destination would change the API contract.

[codspeed]

Merging this PR will not alter performance

⚠️ 6 benchmarks measured no execution time

Nothing ran under measurement, usually because the compiler removed the code under test. These results are not comparable, so they count as unchanged.

Preventing compiler optimizations

• as_constant
• constant_equal
• constant_not_equal
• access
• runtime_equal
• runtime_not_equal

✅ 98 untouched benchmarks

---

_{Comparing fs/be-942-report-progress-and-counters-for-running-integrations (13ce75a) with fs/be-918-derive-deterministic-entity-ids-in-the-integrations-engine (df2ecb5)¹}

Footnotes

1. No successful run was found on fs/be-918-derive-deterministic-entity-ids-in-the-integrations-engine (cf28f73) during the generation of this report, so 35cc020 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

[codecov]

Codecov Report

❌ Patch coverage is 92.46575% with 11 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (fs/be-918-derive-deterministic-entity-ids-in-the-integrations-engine@cf28f73). Learn more about missing BASE report.

Files with missing lines	Patch %	Lines
...ibs/@local/integrations/engine/src/progress/mod.rs	74.41%	10 Missing and 1 partial ⚠️

Additional details and impacted files

@@                                           Coverage Diff                                           @@
##             fs/be-918-derive-deterministic-entity-ids-in-the-integrations-engine   #10080   +/-   ##
=======================================================================================================
  Coverage                                                                        ?   68.33%           
=======================================================================================================
  Files                                                                           ?     2007           
  Lines                                                                           ?   206063           
  Branches                                                                        ?     8751           
=======================================================================================================
  Hits                                                                            ?   140807           
  Misses                                                                          ?    63573           
  Partials                                                                        ?     1683           

Flag	Coverage Δ
hash-integrations-engine	91.55% <92.46%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[github-actions]

Benchmark results

hash-graph-benches – Integrations

policy_resolution_large

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 2002	$$17.4 \mathrm{ms} \pm 118 \mathrm{μs}\left({\color{red}10.8 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$2.16 \mathrm{ms} \pm 17.7 \mathrm{μs}\left({\color{gray}2.57 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 1002	$$8.58 \mathrm{ms} \pm 70.9 \mathrm{μs}\left({\color{red}10.9 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: high, policies: 3314	$$29.0 \mathrm{ms} \pm 279 \mathrm{μs}\left({\color{red}11.8 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: low, policies: 1	$$10.2 \mathrm{ms} \pm 84.5 \mathrm{μs}\left({\color{gray}3.51 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: medium, policies: 1527	$$17.1 \mathrm{ms} \pm 126 \mathrm{μs}\left({\color{red}7.58 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 2078	$$18.3 \mathrm{ms} \pm 188 \mathrm{μs}\left({\color{red}6.73 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$2.43 \mathrm{ms} \pm 34.6 \mathrm{μs}\left({\color{gray}4.30 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 1033	$$9.41 \mathrm{ms} \pm 85.8 \mathrm{μs}\left({\color{red}10.7 \mathrm{\%}}\right) $$	Flame Graph

policy_resolution_medium

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 102	$$2.29 \mathrm{ms} \pm 23.4 \mathrm{μs}\left({\color{gray}-0.786 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$1.85 \mathrm{ms} \pm 8.39 \mathrm{μs}\left({\color{gray}-1.601 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 52	$$2.11 \mathrm{ms} \pm 20.5 \mathrm{μs}\left({\color{gray}3.76 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: high, policies: 269	$$3.15 \mathrm{ms} \pm 19.2 \mathrm{μs}\left({\color{gray}0.608 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: low, policies: 1	$$2.25 \mathrm{ms} \pm 17.2 \mathrm{μs}\left({\color{gray}1.11 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: medium, policies: 108	$$2.51 \mathrm{ms} \pm 19.3 \mathrm{μs}\left({\color{lightgreen}-5.892 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 133	$$2.69 \mathrm{ms} \pm 19.7 \mathrm{μs}\left({\color{gray}1.68 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$2.19 \mathrm{ms} \pm 36.4 \mathrm{μs}\left({\color{gray}2.79 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 63	$$2.48 \mathrm{ms} \pm 15.2 \mathrm{μs}\left({\color{gray}-2.246 \mathrm{\%}}\right) $$	Flame Graph

policy_resolution_none

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 2	$$1.77 \mathrm{ms} \pm 11.5 \mathrm{μs}\left({\color{red}7.10 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$1.79 \mathrm{ms} \pm 17.5 \mathrm{μs}\left({\color{red}8.83 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 2	$$1.87 \mathrm{ms} \pm 23.3 \mathrm{μs}\left({\color{gray}4.96 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 8	$$1.96 \mathrm{ms} \pm 13.5 \mathrm{μs}\left({\color{gray}3.19 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$1.90 \mathrm{ms} \pm 21.3 \mathrm{μs}\left({\color{gray}4.30 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 3	$$1.98 \mathrm{ms} \pm 11.6 \mathrm{μs}\left({\color{gray}-1.299 \mathrm{\%}}\right) $$	Flame Graph

policy_resolution_small

Function	Value	Mean	Flame graphs
resolve_policies_for_actor	user: empty, selectivity: high, policies: 52	$$1.99 \mathrm{ms} \pm 18.8 \mathrm{μs}\left({\color{gray}1.26 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: low, policies: 1	$$1.72 \mathrm{ms} \pm 8.38 \mathrm{μs}\left({\color{gray}-2.595 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: empty, selectivity: medium, policies: 26	$$1.86 \mathrm{ms} \pm 13.2 \mathrm{μs}\left({\color{gray}-1.817 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: high, policies: 94	$$2.12 \mathrm{ms} \pm 17.3 \mathrm{μs}\left({\color{gray}-1.351 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: low, policies: 1	$$1.93 \mathrm{ms} \pm 13.4 \mathrm{μs}\left({\color{gray}1.45 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: seeded, selectivity: medium, policies: 27	$$2.10 \mathrm{ms} \pm 14.3 \mathrm{μs}\left({\color{gray}2.58 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: high, policies: 66	$$2.11 \mathrm{ms} \pm 11.5 \mathrm{μs}\left({\color{gray}1.80 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: low, policies: 1	$$1.96 \mathrm{ms} \pm 9.76 \mathrm{μs}\left({\color{gray}2.44 \mathrm{\%}}\right) $$	Flame Graph
resolve_policies_for_actor	user: system, selectivity: medium, policies: 29	$$2.12 \mathrm{ms} \pm 13.8 \mathrm{μs}\left({\color{gray}3.50 \mathrm{\%}}\right) $$	Flame Graph

read_scaling_complete

Function	Value	Mean	Flame graphs
entity_by_id;one_depth	1 entities	$$21.3 \mathrm{ms} \pm 127 \mathrm{μs}\left({\color{gray}-0.605 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	10 entities	$$42.8 \mathrm{ms} \pm 264 \mathrm{μs}\left({\color{gray}-1.299 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	25 entities	$$23.4 \mathrm{ms} \pm 158 \mathrm{μs}\left({\color{gray}-0.878 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	5 entities	$$24.7 \mathrm{ms} \pm 223 \mathrm{μs}\left({\color{gray}-0.370 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;one_depth	50 entities	$$25.8 \mathrm{ms} \pm 208 \mathrm{μs}\left({\color{gray}-2.496 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	1 entities	$$21.3 \mathrm{ms} \pm 245 \mathrm{μs}\left({\color{gray}-4.572 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	10 entities	$$228 \mathrm{ms} \pm 1.11 \mathrm{ms}\left({\color{lightgreen}-7.395 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	25 entities	$$54.7 \mathrm{ms} \pm 436 \mathrm{μs}\left({\color{gray}-2.461 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	5 entities	$$42.1 \mathrm{ms} \pm 298 \mathrm{μs}\left({\color{lightgreen}-6.664 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;two_depth	50 entities	$$181 \mathrm{ms} \pm 829 \mathrm{μs}\left({\color{gray}1.87 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	1 entities	$$6.63 \mathrm{ms} \pm 42.7 \mathrm{μs}\left({\color{gray}-4.096 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	10 entities	$$6.78 \mathrm{ms} \pm 77.7 \mathrm{μs}\left({\color{gray}-3.803 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	25 entities	$$6.83 \mathrm{ms} \pm 54.6 \mathrm{μs}\left({\color{gray}-3.729 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	5 entities	$$6.68 \mathrm{ms} \pm 35.4 \mathrm{μs}\left({\color{lightgreen}-5.254 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id;zero_depth	50 entities	$$6.80 \mathrm{ms} \pm 52.4 \mathrm{μs}\left({\color{gray}-1.604 \mathrm{\%}}\right) $$	Flame Graph

read_scaling_linkless

Function	Value	Mean	Flame graphs
entity_by_id	1 entities	$$6.51 \mathrm{ms} \pm 33.1 \mathrm{μs}\left({\color{gray}-4.419 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	10 entities	$$6.64 \mathrm{ms} \pm 43.8 \mathrm{μs}\left({\color{gray}0.011 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	100 entities	$$6.71 \mathrm{ms} \pm 67.6 \mathrm{μs}\left({\color{gray}-0.190 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	1000 entities	$$6.86 \mathrm{ms} \pm 83.2 \mathrm{μs}\left({\color{gray}2.57 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	10000 entities	$$7.09 \mathrm{ms} \pm 50.8 \mathrm{μs}\left({\color{red}5.63 \mathrm{\%}}\right) $$	Flame Graph

representative_read_entity

Function	Value	Mean	Flame graphs
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/block/v/1	$$7.39 \mathrm{ms} \pm 56.0 \mathrm{μs}\left({\color{red}7.04 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/book/v/1	$$7.39 \mathrm{ms} \pm 42.5 \mathrm{μs}\left({\color{red}5.34 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/building/v/1	$$7.38 \mathrm{ms} \pm 67.1 \mathrm{μs}\left({\color{red}7.62 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/organization/v/1	$$7.42 \mathrm{ms} \pm 51.8 \mathrm{μs}\left({\color{red}6.96 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/page/v/2	$$7.55 \mathrm{ms} \pm 96.8 \mathrm{μs}\left({\color{red}8.50 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/person/v/1	$$7.52 \mathrm{ms} \pm 59.6 \mathrm{μs}\left({\color{red}9.74 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/playlist/v/1	$$7.13 \mathrm{ms} \pm 80.2 \mathrm{μs}\left({\color{gray}0.581 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/song/v/1	$$7.46 \mathrm{ms} \pm 49.7 \mathrm{μs}\left({\color{red}8.90 \mathrm{\%}}\right) $$	Flame Graph
entity_by_id	entity type ID: https://blockprotocol.org/@alice/types/entity-type/uk-address/v/1	$$7.58 \mathrm{ms} \pm 53.9 \mathrm{μs}\left({\color{red}7.64 \mathrm{\%}}\right) $$	Flame Graph

representative_read_entity_type

Function	Value	Mean	Flame graphs
get_entity_type_by_id	Account ID: bf5a9ef5-dc3b-43cf-a291-6210c0321eba	$$5.21 \mathrm{ms} \pm 32.9 \mathrm{μs}\left({\color{gray}-0.238 \mathrm{\%}}\right) $$	Flame Graph

representative_read_multiple_entities

Function	Value	Mean	Flame graphs
entity_by_property	traversal_paths=0	0	$$39.2 \mathrm{ms} \pm 264 \mathrm{μs}\left({\color{lightgreen}-5.734 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=255	1,resolve_depths=inherit:1;values:255;properties:255;links:127;link_dests:126;type:true	$$78.9 \mathrm{ms} \pm 1.41 \mathrm{ms}\left({\color{red}15.5 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:0;link_dests:0;type:false	$$42.2 \mathrm{ms} \pm 305 \mathrm{μs}\left({\color{red}7.58 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:1;link_dests:0;type:true	$$48.5 \mathrm{ms} \pm 495 \mathrm{μs}\left({\color{red}6.74 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:2;links:1;link_dests:0;type:true	$$53.7 \mathrm{ms} \pm 591 \mathrm{μs}\left({\color{gray}4.79 \mathrm{\%}}\right) $$
entity_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:2;properties:2;links:1;link_dests:0;type:true	$$58.3 \mathrm{ms} \pm 460 \mathrm{μs}\left({\color{gray}4.50 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=0	0	$$28.6 \mathrm{ms} \pm 229 \mathrm{μs}\left({\color{gray}3.49 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=255	1,resolve_depths=inherit:1;values:255;properties:255;links:127;link_dests:126;type:true	$$47.5 \mathrm{ms} \pm 350 \mathrm{μs}\left({\color{red}5.55 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:0;link_dests:0;type:false	$$33.1 \mathrm{ms} \pm 387 \mathrm{μs}\left({\color{gray}0.083 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:0;links:1;link_dests:0;type:true	$$38.3 \mathrm{ms} \pm 372 \mathrm{μs}\left({\color{gray}1.57 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:0;properties:2;links:1;link_dests:0;type:true	$$39.7 \mathrm{ms} \pm 246 \mathrm{μs}\left({\color{red}10.7 \mathrm{\%}}\right) $$
link_by_source_by_property	traversal_paths=2	1,resolve_depths=inherit:0;values:2;properties:2;links:1;link_dests:0;type:true	$$39.8 \mathrm{ms} \pm 337 \mathrm{μs}\left({\color{red}10.7 \mathrm{\%}}\right) $$

scenarios

Function	Value	Mean	Flame graphs
full_test	query-limited	$$70.8 \mathrm{ms} \pm 523 \mathrm{μs}\left({\color{gray}3.35 \mathrm{\%}}\right) $$	Flame Graph
full_test	query-unlimited	$$77.5 \mathrm{ms} \pm 387 \mathrm{μs}\left({\color{gray}2.88 \mathrm{\%}}\right) $$	Flame Graph
linked_queries	query-limited	$$14.9 \mathrm{ms} \pm 94.9 \mathrm{μs}\left({\color{red}15.9 \mathrm{\%}}\right) $$	Flame Graph
linked_queries	query-unlimited	$$327 \mathrm{ms} \pm 1.03 \mathrm{ms}\left({\color{red}6.19 \mathrm{\%}}\right) $$	Flame Graph