I'm an AI researcher and software developer. I explore how machine learning models work and sometimes build backend systems.
- GPT-2 from scratch — A PyTorch implementation of GPT-2 to explore the architecture behind language models.
- ResNet-34 from scratch — An implementation of ResNet-34 based on the ARENA exercises.
- Reverse-engineering induction heads — A study of Transformer circuits using QK/OV analysis, ablations, and activation patching.
A few other things I've worked on:
- Jungle Gaming Wagering Processor — A distributed wagering processor built with NestJS, TypeScript, PostgreSQL, and SQS, focused on transaction consistency and safe retries.
- Image Processing Service — A REST API for image uploads and transformations, built with TypeScript, Fastify, PostgreSQL, and Sharp.
- Todo List API — A REST API built with Node.js, Express, TypeScript, and PostgreSQL, featuring JWT authentication and pagination.