Skip to content
View SAIDUMPALA01's full-sized avatar

Block or report SAIDUMPALA01

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
SAIDUMPALA01/README.md

Hi, I'm Sai 👋

AI/ML engineer in London. I build LLM applications and the evaluations that show whether they work.

  • 🎓 MSc Computer Science, Birmingham City University (2025)
  • 📄 Published research on evaluating LLM output: A Practical Six-Dimension Evaluation Framework (Zenodo, 2026)
  • 🧪 Freelance LLM evaluation for AI labs via Mercor and Outlier: reviewing model outputs and code against detailed quality standards
  • 🔎 Open to junior AI / LLM / ML engineer and Python engineer roles in London (hybrid or on-site)

What I've built

Project What it shows
docs-rag-eval RAG over documentation with citations and "I don't know" answers, measured on 48 labelled questions (Hit@5 0.95, MRR 0.73 for BM25). BM25 written from scratch, hybrid retrieval, CI quality gate
sixdim-eval My paper as a pip-installable library: LLM-as-judge on six dimensions, judge-vs-human agreement (kappa, TPR/TNR), and a GitHub Action that fails CI when output quality drops
ResuMetric A deployed FastAPI service that catches fabricated content in AI-written CVs. Web UI, judge-consistency mode, rate limiting, tracing, Docker, live demo
uk-visa-sponsor-mcp An MCP server that lets Claude or any MCP client search the UK sponsor register and check Skilled Worker salary rules. Tested over a real stdio session
pneumonia CNN My MSc project, rebuilt after I audited my own results: patient-level splits, sensitivity-first evaluation, Grad-CAM, an API

Tools I use in these projects

Python · FastAPI · Pydantic · pytest · Anthropic API · RAG · BM25 / TF-IDF / embeddings · MCP · LLM evaluation · TensorFlow / Keras · scikit-learn · Docker · GitHub Actions · SQL

How I work

I treat evaluation as part of the product. Every project above has tests that run without API keys, and anything that uses a model reports how well it works, including where it fails.

📫 LinkedIn · ORCID · [email protected]

Pinned Loading

  1. LLm-Evaluation-framework LLm-Evaluation-framework Public

    sixdim-eval: my published six-dimension LLM evaluation framework as a pip-installable library, CLI and GitHub Action. LLM-as-judge scoring, judge-vs-human agreement, CI quality gate.

    Python 1

  2. medical-image-classification-system1 medical-image-classification-system1 Public

    Pneumonia detection from chest X-rays (MSc project), rebuilt after auditing my own results: patient-level splits, sensitivity-first evaluation, Grad-CAM, FastAPI endpoint, 23 tests.

    Python 1

  3. docs-rag-eval docs-rag-eval Public

    Retrieval-augmented QA over documentation with citations, abstention and a labelled evaluation set (BM25, hybrid retrieval, FastAPI)

    Python

  4. resumetric resumetric Public

    Automated document-quality checker that detects missing and fabricated content in AI-generated CVs, built on a published six-dimension evaluation framework.

    Python

  5. uk-visa-sponsor-mcp uk-visa-sponsor-mcp Public

    MCP server and CLI to search the UK Register of Licensed Sponsors and check job offers against Skilled Worker salary rules

    Python