Nk data engineering · analytics · ml

Projects & Skills

Projects I've actually built. Tools I actually use.

Analytics & BI

🗄️SQL🐍Python🐼Pandas🔢NumPy🧪SciPy📊Tableau📈Power BI📗Excel🔢DAX📉Matplotlib🌊Seaborn

Data Engineering

🔧dbt💨Airflow❄️Snowflake🔷Azure SynapseDatabricks🔥PySpark🐘Hadoop📨Kafka🔄ETL/ELT🗂️Data Modeling🌿Git

Cloud & Databases

☁️AWS🪣S3🔴Redshift🔗Glue🪄Lambda🔷Azure🗄️ADLS🐳Docker⚙️CI/CD🐘PostgreSQL🐬MySQL🗄️DynamoDB

Machine Learning & AI

🤖Scikit-learn🧠TensorFlow🔥PyTorch🌲XGBoost🔍LangChain🔍RAG⏱️Time Series❤️Keras
Data Platform for Vacation Rental Marketplace

Data Platform for Vacation Rental Marketplace

Event-driven AWS ELT pipeline with Snowflake, dbt Medallion architecture, SCD Type 2 snapshots, and a 7-task fail-fast Airflow DAG with 64 automated data quality tests.

AWSSnowflakedbtAirflowPython
🚇

MBTA On-Time Performance Prediction with ML and Parallel Processing

Distributed PySpark pipeline on Databricks ingesting 150M+ records across 5 sources, training 4 MLlib regression models, and benchmarking parallelism scaling from single-node to multi-node Spark – achieving 2.73x speedup.

PySparkDatabricksMLlibPython
Los Angeles Wildfire Visualization Pipeline with AWS and Tableau

Los Angeles Wildfire Visualization Pipeline with AWS and Tableau

Near real-time wildfire monitoring pipeline using AWS Lambda, S3, and Glue, feeding live geospatial Tableau dashboards that auto-refresh every 3 hours – reducing manual tracking by 85%.

AWS LambdaS3GlueAthenaTableau
End-to-End Azure Data Factory & Databricks Incremental Data Pipeline

End-to-End Azure Data Factory & Databricks Incremental Data Pipeline

ADF-orchestrated Databricks pipeline with parameterized incremental loads, star schema in Delta Lake with SCD Type 1, Unity Catalog governance, and high-water mark ingestion.

Azure ADFDatabricksPySparkDelta LakeUnity Catalog
🏥

Clinical Trial Data Management System

Hybrid MySQL + MongoDB system managing patient data, treatments, clinical trials, researchers, and outcomes – with Python analytics covering demographics, adverse events, and drug utilization.

MySQLMongoDBPythonSQL
🍎

Apple Retail Sales Analysis with Advanced SQL

High-performance PostgreSQL analytics across 1M+ Apple retail transactions – solving 23 business problems with query optimizations delivering up to 95% faster execution and 54% performance gains.

PostgreSQLSQLQuery Optimization
Los Angeles Crime Analysis and Predictive Modeling

Los Angeles Crime Analysis and Predictive Modeling

Python-based EDA and ARIMA time-series forecasting on LA crime data from 2020–2024, identifying vehicle theft as the top crime category and projecting a 14.89% crime reduction through late 2025.

PythonPandasARIMAMatplotlibStatsmodels