Platform & data engineering · Bengaluru

Soumyadip Mondal

Platform and data engineer at Uniqode, Bengaluru. I build the systems that carry events from the moment they happen to the query that reads them: streaming pipelines, lakehouse storage, and the infrastructure underneath.

Currently working on OpenETL — open-source data movement.

A small failure experiment

What survives a crash?

Event 03 landed. Its checkpoint didn’t.

Last checkpoint
02
Runner
Running
Destination3 rows
  1. 01
  2. 02
  3. 03, written after the last checkpoint

Recovery resumes after checkpoint 02, replaying 03 before reading 04. The write mode determines whether 03 appears twice.

One of five small systems gamesExplore the playground

Built in the open

Selected projects

Explore all projects

02 / Google Summer of Code

cronet.dart

Google Summer of Code 2021, mentored by the Dart and Chromium teams at Google

An HTTP client for Dart and Flutter that runs on Chromium’s networking stack. It binds Cronet’s native C API through dart:ffi and follows the shape of dart:io’s HttpClient, on Android, Linux, Windows and macOS. In highly parallel workloads it ran up to twice as fast as dart:io.

Dart, C and C++. My GSoC proof of concept was published under the google organisation. Google later built the official successor, cronet_http.

import 'dart:convert';
import 'package:cronet/cronet.dart';

final client = HttpClient();
final request = await client
    .getUrl(Uri.parse('http://info.cern.ch/'));
final response = await request.close();
response.transform(utf8.decoder).listen(print);
Fetching the first website ever made, through Chromium’s network stack.

Experience

  1. – now

    Uniqode (opens in a new tab)

    Software Development Engineer III

    Near-real-time product analytics on Apache Flink, Spark, Iceberg and StarRocks. I moved lifetime analytics from Apache Pinot to Iceberg, run our streaming jobs on Kubernetes with the Flink operator, and manage the platform’s infrastructure in Terraform.

  2. –

    FactEntry (opens in a new tab), SIX Group (opens in a new tab)

    Software Engineer L2

    An ML-powered extraction platform for legal and financial documents, including a library that pulls tables out of arbitrary PDFs in milliseconds. Built on-premise with Python, Java, Kubernetes, Numaflow, Kafka and Ceph.

  3. –

    Atlan (opens in a new tab)

    Software Engineer II, from intern

    Led more than fifteen integrations and crawlers for Atlan’s metadata platform, built cross-system lineage for BI tools, and made the Argo-based orchestration behind them far more reliable. Services in Go.

Education

  1. – now

    IIIT Kalyani

    M.Tech, Computer Science and Engineering

  2. –

    Sister Nivedita University

    B.Tech, Computer Science and Engineering

    Final-year project: Theia, a voice and haptic vision assistant for people with visual impairments.

Get in touch

Have an interesting systems problem?

I’d love to hear about it. Reach out about platform engineering, data infrastructure, or open-source work.

hello@smdp.me