Open to Data & AI Platform Engineer Roles
Data & AI Platform Engineer · Databricks Certified

Sasidhar Mopuru

Building Real-Time Streaming & AI-Ready Data Systems with PySpark, Kafka, Delta Lake, and Databricks.

PySpark Apache Kafka Delta Lake Databricks Python CI/CD
Sasidhar Mopuru
Databricks Certified
50+
Data Products
40%
Faster Deployments
99.5%
Pipeline Uptime
95%+
Test Coverage
About

Engineering Data Platforms at Scale

I specialize in turning high-velocity event streams into reliable, AI-ready data products. With hands-on experience across the full data lifecycle, I design, build, and support production-grade data platforms.

I am a Data & AI Platform Engineer with 2+ years validating, building, and operating production-grade data platforms and lakehouse systems at Accenture. Contributed to 50+ data products and delivered 90+ production PySpark ETL jobs while maintaining 99.5% pipeline uptime and 95%+ test coverage. I focus on configuration-driven pipelines, data quality, testing, and reliable production operations.

My core focus is on configuration-driven data platforms, real-time pipelines, lakehouse architectures, and the engineering discipline that makes production systems reliable — testing, CI/CD, observability, and security.

# Platform in a nutshell
data_source = "Kafka"
processing = "PySpark Structured Streaming"
storage = "Delta Lake"
ci_cd = "GitLab CI/CD"
testing = "pytest, 95%+ coverage"

platform = "AI-ready, scalable, secure"
Experience

Accenture — Enterprise Data Engineering

Hands-on development and validation of configuration-driven data pipelines serving end-to-end supply-chain data products.

Data Engineer, Management and Governance Analyst

Accenture · Feb 2024 – Present (Associate to Analyst, Feb 2026, effective March 2026) · Bengaluru, India
  • Delivered 90+ production PySpark ETL jobs across 4 supply-chain sub-domains, contributing to 50+ data products through Python development, JSON configuration, and DDL development.
  • Led 12 change requests across data products and completed tag validations in a single day by comparing design documents, source messages, and data across staging, active, and history layers.
  • Worked in a 7-member E2E supply-chain data engineering team (1 lead, 1 tester, 5 DEs) covering site, supplier, item, and product sub-domains; primarily owned site and supplier pipelines while supporting item and product live monitoring.
  • Managed full lifecycle of data products: PySpark/Python main scripts, JSON configs, unit tests, SingleStore tables, Delta Lake lakehouse tables (with catalog and schemas), Control-M scheduling, IOMate job orchestration, and Acceldata monitoring across DEV, SIT, and PROD.
  • Reduced deployment time by 40% by developing configuration-driven pipeline definitions and reusable Python utilities used by the data platform and consumed by existing CI/CD workflows.
  • Achieved 99.5% pipeline uptime through modular PySpark pipelines with error handling, retry logic, schema validation, and data quality checks.
  • Maintained 95%+ overall test coverage across 60+ pytest suites with mocked components and integration patterns.
  • Improved data processing latency by 30% through partitioning, caching, and performance tuning on production pipelines.
  • Owned end-to-end data quality and platform validation for 3–4 sprint releases, validating schemas, tags, record counts, primary keys, business hash keys, and duplicate records across source-to-target data layers, and prepared SQL-based reconciliation evidence for clean production sign-off.
  • Worked with Kafka-based data pipelines and validation workflows, DDL scripts, and validation/reconciliation queries for real-time data processing, and monitored and troubleshot production pipelines.
  • Used Jira dashboards to track sprint tasks, incidents, and maintenance activities for data products across the supply-chain platform.
  • Developed data products from design documents and built downstream datasets from source schemas, applying transformation queries when multiple source data products feed a single dataset; maintained per-schema exception tables to capture invalid records with target table reference, error log, and timestamp.
PySparkKafkaDelta LakeDatabricksSingleStoreIOMateControl-MAcceldataGitLab CI/CDJiraPython
Projects

Production-Grade Data Platforms

A blend of enterprise-scale work and personal engineering labs, each focused on real-world reliability, performance, and impact.

Enterprise Configuration-Driven Data Platform

PySpark, Kafka, JSON-based job definitions, DDL, and SQL validation for Accenture data products.

90+ jobs40% faster99.5% uptime95% coverage

Cloud-Native Streaming Data Platform

Azure Event Hubs, Databricks, ADLS Gen2, and Terraform. Multi-environment IaC and exactly-once streaming with Delta Lake checkpointing.

AzureTerraformDatabricksDelta Lake

RAG Document QA Chatbot

FastAPI + Streamlit app with ChromaDB, sentence-transformers, and OpenAI/LLaMA backends. Response caching and configurable LLM backends.

FastAPIChromaDBRAG
31k–45k/s

Kafka → PySpark → Delta Pipeline

Production-style streaming ingestion, schema enforcement, watermark-based deduplication, and exactly-once checkpointing. Benchmarked at 31k–45k rows/sec on a 4-core laptop.

31k–45k rows/sec95%+ pytest coverageKafka + Delta
Open Source

OSS Contributions & Reviews

Verified upstream contributions, active PRs, and maintainer-style reviews across well-known open-source projects. Last verified: 2026-07-31.

Merged: fastify/fastify#6880

Updated TypeScript docs to reference Fastify 5.x.

View PR →

Merged: axios/axios#11113

Added missing fs import to README stream example.

View PR →

Merged: Topicspot/skillfrisk#9

Add --min-severity flag for severity filtering.

View PR →

Active: trpc/trpc#7452

Secure error reporting documentation.

View PR →

Active: jsdoc/jsdoc#2176

Align README Node.js requirement with package.json.

View PR →

Active: xxnjms1-code/kickama-prize-lab#33

$35 bounty: coordinate auth token refresh across tabs.

View PR →

Review: axios/axios#11115

Maintainer-style review covering code, tests, docs, and conventions.

View Review →
Skills

Tech Stack

Core technologies I use to build, test, and operate data platforms.

Data Engineering

PythonSQLPySparkApache SparkDelta LakeApache KafkaETL/ELTData ModelingSchema ValidationData Quality

Cloud & Data Platforms

DatabricksMicrosoft FabricAzure Event HubsADLS Gen2Delta Lake

AI / LLM

RAGLLMOpenAIChromaDBVector DatabasesSentence-TransformersFastAPIStreamlitGenAI

DevOps & Tools

GitGitHub ActionsGitLab CIDockerTerraformLinuxpytestJira
Certifications

Validated Technical Expertise

Industry-recognized credentials that back the skills and projects displayed here.

DP-700: Data Engineering with Microsoft Fabric

Microsoft · Dec 2025

Verify Credential →

Databricks PySpark Streaming Training

Accenture · Dec 2023 - Feb 2024

Google Data Analytics Professional

Coursera · 2023

Verify Credential →

NPTEL Management Information System (MIS)

Elite · 73% · IIT Kharagpur · Jul–Oct 2022

Verify Credential →
Blog

Engineering Notes

Deep dives into data platform engineering, streaming patterns, and career learnings.

Streaming Data Engineering

Building a Kafka → PySpark → Delta Pipeline

Hands-on guide to production PySpark Structured Streaming with Kafka, Delta Lake, and cloud deployment.

Read Article →
RAG & LLM

Building a RAG QA System with FastAPI and ChromaDB

How to build a retrieval-augmented generation chatbot with document ingestion, vector search, and LLM generation.

Read Article →
Certification

How I Passed the Databricks DE Associate Exam

My study plan, resources, tips, and what actually helped me pass the Databricks Data Engineer Associate exam.

Read Article →
Education

Academic Background

B.Tech in Computer Science and Technology

Madanapalle Institute of Technology & Science, Madanapalle, AP
2019–2023 · 7.97 CGPA · First Class Distinction

Intermediate

Sri Vivekananda Junior College, Chittoor, AP
2017–2019 · 9.67 CGPA

10th Grade

Z.P.H.S Kanipkam, Chittoor, AP
2016–2017 · 9.3 CGPA

JEE Mains

94.17 Percentile · 2019

Contact

Let's Build Data Platforms Together

Open to Data & AI Platform Engineer, Data Engineer, and Cloud Data Engineering roles in Bengaluru and remote. Reach out if you are hiring or want to collaborate.

sasidharmopuru@gmail.com

I typically respond within 24–48 hours.