Skip to content
View aleksei-khvostov's full-sized avatar

Block or report aleksei-khvostov

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
aleksei-khvostov/README.md

Aleksei Khvostov

I’m an independent AI safety and evaluation researcher based in North Carolina’s Research Triangle. My work focuses on a methodological question: how can we build evaluation environments we can trust when models, agents, and evaluators themselves can introduce measurement failures?

Current work focuses on evaluation reliability, agent oversight, and adversarial evaluation, including Russian- and English-language settings.

Selected work

  • multi-agent-safety-sim — An experimental harness for studying multi-agent oversight and trace–report consistency through simulations, deterministic checks, and separately documented model runs.
  • RuSafetyBench — Russian-language adversarial evaluation cases and qualitative pilot studies exploring how linguistic and contextual framing affects model behavior.
  • Agentic Execution Guardrail Eval — A manually curated dataset for testing guardrails against prompt injection and risky agent-generated commands or code.

Simulated behavior and deterministic checks are distinct from empirical model evidence; project notes document the scope and limits of each.

LinkedIn · Hugging Face · EA Forum

Pinned Loading

  1. llm-safety-evaluation-lab llm-safety-evaluation-lab Public

    OWASP-inspired LLM red teaming framework with adversarial test cases, automated benchmarking, and cross-model safety evaluation.

    Python

  2. pw-cli pw-cli Public

    Modern CLI password generator with memorable passphrases and an encrypted local vault.

    Python 1

  3. rusafetybench rusafetybench Public

    Open adversarial benchmark for Russian-language LLM safety evaluation.

  4. multi-agent-safety-sim multi-agent-safety-sim Public

    Experimental Python framework for simulating multi-agent AI safety failure modes

    Python