Skip to content
Nikhil Gautam

Work

Selected engineering work

Systems I’ve worked on in production, described without confidential detail. Independent projects, when added, are listed separately and labelled as such.

Professional

Production systems

Case studies are written up one at a time and published once their details are reviewed.

  1. Search indexing driven by change data capture: database changes captured with Debezium, delivered through Kafka, and processed by consumers that keep OpenSearch indices, including vector indices, in step with the source of truth.

    Themes
    • Change data capture
    • Event-driven architecture
    • Idempotent consumers
    • Index consistency
    • Vector search
    Stack
    • Debezium
    • Kafka
    • OpenSearch
    Professional workCase study in preparation
  2. High-volume batch processing

    Large-volume data processing on AWS built with Spring Batch: orchestrating jobs, working with data in S3 and Athena, and designing retry and failure handling so that partial failures can be recovered without reprocessing everything.

    Themes
    • Data pipelines
    • Job orchestration
    • Retry and failure handling
    • Fault recovery
    Stack
    • Java
    • Spring Batch
    • AWS Batch
    • S3
    • Athena
    Professional workCase study in preparation
  3. Microservices and API performance

    Decomposing a monolith into services and improving backend performance: drawing service boundaries, moving work onto asynchronous paths, and reasoning about throughput, latency and the architectural trade-offs between them.

    Themes
    • Monolith decomposition
    • Service boundaries
    • Asynchronous processing
    • Throughput and latency
    Professional workCase study in preparation