Skip to content

About

A sequence-memory research workbench: Z3 Boolean circuit synthesis, PyTorch state-space models, attention, stack RNNs and liquid reservoirs. Compare routing, nesting, copy and counting tasks with saved experimental results.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Transformer Golf. How much memory does a sequence need? Experiments across logic, attention and recurrent memory. Z3 Boolean routing circuit synthesis; comparisons of attention, state-space models, stacks and liquid reservoirs; nesting, copying and multiple-counting tasks. Python and PyTorch. Run python -m src.scripts.run_experiments with task and model options from the guide. Research benchmarks; results depend on configuration.

About

A sequence-memory research workbench: Z3 Boolean circuit synthesis, PyTorch state-space models, attention, stack RNNs and liquid reservoirs. Compare routing, nesting, copy and counting tasks with saved experimental results.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages