-
Notifications
You must be signed in to change notification settings - Fork 659
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
[Bug Report] TransformerBridge ignores attention_mask when deriving position_ids, so left-padded input silently returns wrong logits and loss
bugSomething isn't workingSomething isn't workingcomplexity-moderateModerately complicated issues for people who have intermediate experience with the codeModerately complicated issues for people who have intermediate experience with the codehigh-priorityMaintainers are interested in these issues being solved before othersMaintainers are interested in these issues being solved before othersTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.#1609 In TransformerLensOrg/TransformerLens;[Bug Report] TransformerBridge causal loss ignores attention_mask
bugSomething isn't workingSomething isn't workinghigh-priorityMaintainers are interested in these issues being solved before othersMaintainers are interested in these issues being solved before othersTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.#1607 In TransformerLensOrg/TransformerLens;[Proposal] One-time converter for TL-convention checkpoints (blocks.N.attn.W_Q, embed.W_E) to bridge format
enhancementNew feature or requestNew feature or requestTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.[Bug Report] Native bridge state_dict()/load_state_dict() are not inverses
complexity-moderateModerately complicated issues for people who have intermediate experience with the codeModerately complicated issues for people who have intermediate experience with the codegood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededhigh-priorityMaintainers are interested in these issues being solved before othersMaintainers are interested in these issues being solved before othersTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.[Proposal] Hybrid architectures warn on unresolved optional 'hook_attn' aliases when they are skipped
bugSomething isn't workingSomething isn't workingcomplexity-simpleSimple issues, which may be good for beginnersSimple issues, which may be good for beginnersTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.#1578 In TransformerLensOrg/TransformerLens;[Bug Report] Native init drifts from
HookedTransformer: unresolvedinitializer_rangesentinel and ignored xavier/kaiming gaincomplexity-moderateModerately complicated issues for people who have intermediate experience with the codeModerately complicated issues for people who have intermediate experience with the codegood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.[Proposal] Rewrite executable doctests that construct HookedTransformer onto TransformerBridge
complexity-moderateModerately complicated issues for people who have intermediate experience with the codeModerately complicated issues for people who have intermediate experience with the codeenhancementNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.[Proposal] Migration recipes for the new bridge capabilities in migrating_to_v3.md
complexity-simpleSimple issues, which may be good for beginnersSimple issues, which may be good for beginnersdocumentationImprovements or additions to documentationImprovements or additions to documentationgood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.[Proposal] Jacobian Lens follow-up: validation deliverables + deferred PR2 scope
complexity-moderateModerately complicated issues for people who have intermediate experience with the codeModerately complicated issues for people who have intermediate experience with the codegood first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededtoolingAnything pertaining to outside tools used within the codebaseAnything pertaining to outside tools used within the codebaseTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.[Bug Report] [macOS-arm64] Cached eager attention NaNs in transformers v5 — blocks bridge KV-cache generation
discussionNo action needed yetNo action needed yetseen_by_maintainersConfirms that a maintainer is aware of this card.Confirms that a maintainer is aware of this card.toolingAnything pertaining to outside tools used within the codebaseAnything pertaining to outside tools used within the codebasewontfixThis will not be worked onThis will not be worked onStatus: Open.#1322 In TransformerLensOrg/TransformerLens;[Proposal] Add support for
cpu,meta, anddiskto TransformerBridgedevice_mapcomplexity-moderateModerately complicated issues for people who have intermediate experience with the codeModerately complicated issues for people who have intermediate experience with the codeenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededTransformerBridgeBug specific to the new TransformerBridge systemBug specific to the new TransformerBridge systemStatus: Open.#1280 In TransformerLensOrg/TransformerLens;[Question] How do I add a custom generative video transformer into TransformerLens?
complexity-highVery complicated changes for people to address who are quite familiar with the codeVery complicated changes for people to address who are quite familiar with the codeStatus: Open.#869 In TransformerLensOrg/TransformerLens;