Joseph Thomas

Engineer · Researcher · Essayist

Emergent behavior, applied to the largest training systems on Earth.

I build the agentic evaluations that measure Gemini. I write about the agents that will replace it.

§ argument · 2008 → 2026

A throughline, in three notes.

10B+events / day in production
16+years shipping distributed systems
4publications & patents
  1. Built robots that found odor sources by talking to each other. Master's thesis at IISc.
  2. The work became US Patent 8,838,271 — swarm-optimization algorithms for nuclear-spill detection.
  3. The same primitives — emergence, local rules, fitness landscapes — are how I think about agentic AI, ARC-AGI, and evaluating what Gemini’s agents can actually do.

“Complex, intelligent behavior emerges from simple rules applied at scale — the same principle behind modern distributed AI systems.”

— invited talk, IDSIA, Switzerland ·

§ tutorial · interactive encyclopedia

Machine learning, in pictures.

Machine Learning, Visualized. A visual encyclopedia of the ideas behind modern ML.

Editorial playgrounds, one concept at a time — starting with the linear-algebra foundations (matrix transformations, eigenvectors, PCA, SVD) and working up through gradient descent, regression, neural networks, attention, diffusion, and beyond.

§ selected work

Four projects, one throughline.

Google Cloud · 2025 → present

Gemini post-training agentic evaluations

Defining the tasks, building the datasets and implementing the scoring that measure agentic capability on Gemini checkpoints — integrated into Denigma, Google’s model-evaluation platform, for headroom measurements and head-to-head model comparisons that research leads use to prioritize capability work.

  • Gemini
  • Agentic evals
  • Benchmarks
  • Grading rubrics

Google Cloud · 2019 → 2025

CrowdCompute & DQaaS

Led backend storage and data integrity for CrowdCompute, Google’s large-scale human-data engine generating RLHF and SFT datasets for foundation models. Architected DQaaS, a low-latency LLMOps service (gRPC / Protocol Buffers) for enterprise-scale prompt versioning, testing and retrieval in GenAI and RAG workflows.

  • RLHF
  • SFT
  • LLMOps
  • RAG
  • gRPC

Amazon · 2017 → 2019

DataCraft

Architected and launched a centralized ingestion platform processing 10B+ events/day, with fault-tolerant streaming pipelines on Kinesis, Lambda, and S3 under on-call ownership. The data lake's front door.

  • Kinesis
  • Lambda
  • S3
  • Data infra

IISc · 2006 → 2008

Glowworm Swarm Optimization

Master's thesis on multi-source odor localization with swarm robotics — the work behind US Patent 8,838,271 for nuclear spill detection, and the conceptual scaffolding behind the multi-agent reasoning work I'm doing now.

  • Swarm intelligence
  • Patent
  • Research

§ the record

Research, career & service.

Patents, publications & talks

  1. [01] Detection of Nuclear Spills Using Swarm Optimization Algorithms D. Ghose, J. Thomas, K.N. Krishnanand · US Patent 8,838,271 (PCT/IB2010/055469) · Patent
  2. [02] Strategies for Locating Multiple Odor Sources using Glowworm Swarm Optimization J. Thomas, D. Ghose · Indian International Conference on Artificial Intelligence (IICAI 09), pp. 842–861 · Conference
  3. [03] A GSO-Based Swarm Algorithm for Odor Source Localization in Turbulent Environments J. Thomas, D. Ghose · Handbook of Approximation Algorithms and Metaheuristics, 2nd Ed., ed. T. F. Gonzalez (CRC Press), pp. 711–737 · Book Chapter
  4. [04] Odor Source Localization using Swarm Robotics J. Thomas · Master's thesis, Indian Institute of Science, Bangalore · Thesis
  5. [05] Industry Talk: Data Science Road University of New Brunswick · Invited Talk
  6. [06] Odor Source Localization using Swarm Robotics IDSIA (Istituto Dalle Molle di Studi sull’Intelligenza Artificiale), Switzerland · Invited Talk

Experience

  • Software EngineerNOWGoogle · Google Cloud · Mountain View, CA – present Gemini — post-training agentic evaluations (2025–present). Previously Crowd Data Platform & LLMOps: CrowdCompute, DQaaS, and technical leadership for AI data-generation tooling (2019–2025).
  • SDE — Big Data TechnologiesAmazon · Palo Alto, CA – Architected and launched DataCraft, a centralized ingestion platform processing 10B+ events daily.
  • Data ScientistDatanyze · San Mateo, CA – Owned a CRM-integrated product scoring look-alike leads; built “technographic” features from daily crawls of millions of websites. Featured in VentureBeat and SoftwareMag.
  • Energy Analytics Software DeveloperAscend Analytics · Oakland, CA – Migrated the core analytics codebase from SAS to WPS, saving an estimated $250,000 a year in licensing.
  • Senior Analyst — R&DGlobal Analytics · Chennai, India – Led a four-person team modeling credit risk for online lending from social-media profiles, generating USD 1.2M in additional revenue.
  • AssociateIdea Research and Development · Pune, India – SCION: an evolutionary algorithm maximizing supersonic intake performance in an air-breathing missile.

Education

  • MEng, Computer ScienceCornell University · Machine Learning, AI, Natural Language Processing, Algorithm Design, Databases · GPA 3.5/4.0
  • MSc (Eng), Aerospace EngineeringIndian Institute of Science · Thesis: Odor Source Localization using Swarm Robotics · GPA 7.00/8.00

On editorial boards & program committees

Also: Senior Member of IEEE · FBCS · Hackathon Raptors Fellow · IEEEXtreme Proctor · GATE 99th-percentile scholar · Utah State Grad Research Scholarship · 21 internal Google awards, including 5 spot bonuses. Mentor/TA at Google Tech Exchange; mentor at Founder Institute and Opportunity Machine.

Skills

Evaluation & LLMs
Agentic evaluation and benchmarking, eval harness design, grading rubrics and scoring, prompting / sampling / scaffolding, RAG, RLHF and SFT dataset generation, synthetic data, LLMOps, Model Context Protocol (MCP).
Infrastructure
Distributed systems, data pipelines, batch job orchestration, reliability and on-call operations, gRPC, Protocol Buffers, Docker, GCP (GKE, Vertex AI), AWS (Kinesis, Lambda, S3), vector databases.
Observability & visualization
Researcher-facing dashboards, run-artifact and trajectory visualization, monitoring and experiment tracking.
Languages
Python (primary), Java, SQL, TypeScript, R.

Things on GitHub

A short biography

Joseph Thomas, portrait

I started as an aerospace engineer designing intake systems for missiles, became a swarm-robotics researcher under Debasish Ghose at IISc, picked up a US patent and a Cornell MEng on the way, and have spent the last decade shipping data infrastructure at Amazon and Google.

Today I build post-training agentic evaluations for Gemini, after six years on the data engine behind Google's foundation models. Off-hours, I write essays and run experiments on multi-agent reasoning — the same swarm research continued in a new vocabulary.

Saratoga, California · Senior Member, IEEE · FBCS