2 Degrees Investing Initiative

Data Engineer

New York, New York / Jul 2019 - Present

Implemented Airflow to replace the legacy ETL process into simpler DAG workflows which led to the efficient data flow from SQL and Flat Files sources into postgres db on Azure.

Developed python data validation scripts to compare multiple databases for the data accuracy across the system.

Created database triggers to capture the change in data in tables for future auditing purposes.

Adopting agile development process in implementing the new system which would eventually streamline the ETL process.

Rutgers University - Neuroscience Lab

Research Assistant - Data Science

Newark, New Jersey / Sep 2018 - Jun 2019

Implemented MariaDB database system to classify pre-recorded data which eliminated legacy process of storing data through Matlab files.

Developed neural network and pattern recognition algorithms establishing behavioral patterns in neuronal activity and visual cortex.

Hindsight Technology Solutions

Machine Learning Intern

Brooklyn, New York / Summer 2018

Collaborated with lead Data Scientist in developing NLP models to identify entities and we achieved 80% accuracy which helped the team to improve the core Smart-Tagging product.

Designed and developed databases and ETL solutions on AWS (EC2, S3, Lambda) which led to rich Wikipedia data for smart tagged entities.

Created useful Lambda functions with specific database operations like delete, insert and update which helped non-sql users to modify articles.

Smart-Tag in use

Tesco PLC

Senior Data Analyst / Senior Software Engineer

Bangalore & London / Sep 2010 - Aug 2017

Collaborated with Finance business team for data analysis and reporting requirements which led to exchange of knowledge and development on multiple finance functionalities.

Developed ETL models and python scripts to automate master data flow from online transaction processing system (OLTP) into online analytical processing system (OLAP) with 100% data flow accuracy.

Developed complex SQL queries and refactored existing automation scripts to improve the efficiency of the ETL models which helped double the performance of batch jobs.

Performed large scale data analysis to aid management with actionable insights and reports which influenced the direction of the business during peak trading periods.

Led the team of five to form an in-house development team which catered to the data analysis, data insights and ETL requirements.

Collaborated with Datawarehouse team to work on POC (proof of concept) to migrate Tesco Direct ETL and BI platform onto Hadoop.

Rutgers University - Rutgers Business School

September 2017 - January 2019

Graduated in Master of Information Technology and Analytics.

Golden Key International Honour Society invitee.

Winning team of Rutgers Hackathon, Fall 2018.

View Projects