Repository navigation

Even more lexer improvements - #102508

Merged

bors merged 8 commits into

rust-lang:masterfrom

nnethercote:even-more-lexer-improvements

Oct 3, 2022

Merged

Even more lexer improvements#102508
bors merged 8 commits into
rust-lang:masterfrom
nnethercote:even-more-lexer-improvements

Commits on Oct 3, 2022
- Clarify operator splitting.
  nnethercote
  committed
  3be86e6
- Add comments to `Spacing`.
  nnethercote
  committed
  bbb53bf
- Rewrite `Token::is_op`.
  nnethercote
  committed
  40e4827
- Add comments to `TokenCursor::desugar`.
  nnethercote
  committed
  9de9cf1
- Merge `parse_token_trees_until_close_delim` and `parse_all_token_trees`.
  nnethercote
  committed
  ce76768
- Inline and remove `parse_token_tree_non_delim_non_eof`.
  nnethercote
  committed
  8d0754d
- Remove `TokenStreamBuilder`.
  nnethercote
  committed
  a822d08
- Invert `is_top_level` to avoid negation.
  nnethercote
  committed
  4e5ddf1