Skip to content

refactor(query-engine): remove unused DataFusion query engine - #615

Merged
milindsrivastava1997 merged 1 commit into
mainfrom
worktree-remove-unused-datafusion
Aug 26, 2026
Merged

refactor(query-engine): remove unused DataFusion query engine#615
milindsrivastava1997 merged 1 commit into
mainfrom
worktree-remove-unused-datafusion

Conversation

@milindsrivastava1997

Copy link
Copy Markdown
Contributor

Summary

  • Removes the DataFusion-based logical/physical query engine (engines::logical, engines::physical), superseded by a native implementation in asap-query-engine: convert binary PromQL instant queries from DataFusion to native execution #567
  • Its only entry points, SimpleEngine::execute_plan / execute_logical_plan, were both #[allow(dead_code)]: execute_logical_plan had zero callers anywhere, execute_plan was reachable only from DataFusion-path tests
  • Drops the datafusion, arrow, and datafusion_summary_library dependencies from asap-query-engine, along with the demo bin (src/bin/show_logical_plans.rs) and DataFusion-specific tests that exercised the dead path
  • Three test files under tests/datafusion/ that don't actually touch DataFusion (structural_matching_tests.rs, range_query_arithmetic_tests.rs, dispatch_arithmetic_tests.rs) are moved up to tests/ rather than deleted

Test plan

  • cargo build -p query_engine_rust --tests — clean, no warnings
  • cargo test -p query_engine_rust --lib — 466 passed, 0 failed
  • cargo build --workspace — unaffected (other crates still pull in datafusion directly)
  • pre-commit hooks (fmt, clippy, cargo test) passed

The logical/physical DataFusion plan engine (engines::logical,
engines::physical) was superseded by a native implementation in #567.
Its only entry points, execute_plan and execute_logical_plan on
SimpleEngine, were both #[allow(dead_code)]: execute_logical_plan had
zero callers anywhere, and execute_plan was reachable only from tests
exercising the DataFusion path directly.

Drop those modules, the demo bin that used them, and the DataFusion-
specific tests, along with the datafusion/arrow/datafusion_summary_library
dependencies they pulled in. Three test files under tests/datafusion/
that don't touch DataFusion (structural/range/dispatch arithmetic tests)
move up to tests/ instead of being deleted.
@milindsrivastava1997
milindsrivastava1997 force-pushed the worktree-remove-unused-datafusion branch from 48d0079 to c2b63fc Compare August 26, 2026 00:51
@milindsrivastava1997
milindsrivastava1997 merged commit 170c6cc into main Aug 26, 2026
8 checks passed
@milindsrivastava1997
milindsrivastava1997 deleted the worktree-remove-unused-datafusion branch August 26, 2026 01:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant