Profil professionnel
Azure Certified Data Engineer with over 15 years of comprehensive IT experience, including 5 years focused on designing and implementing robust end-to-end ETL data solutions on Microsoft Azure. Proficient in building scalable data pipelines, orchestrating complex ETL/ELT workflows, and managing data lake and warehouse architectures using Azure services such as Data Factory, Databricks, and Data Lake Storage. Extensive expertise in real-time data processing with Spark Streaming in Databricks, along with a strong background in developing end-to-end data flow applications using PySpark, Python, and Spark SQL. Excellent communication skills complemented by a proactive, team-oriented approach and over 8 years of onsite experience collaborating closely with clients to deliver tailored cloud-based solutions.
Vue d'ensemble
1
1
Certification
16
16
years of professional experience
Expérience
Azure Data Engineer
Amerihealth Caritas – Fee Schedule Management
2025.03 - 2026.05
- ensuring alignment with business objectives.
- Authored and maintained data rule books; facilitated reviews and sign-offs with business and IT teams.
- Contributed to solution architecture, data modeling, and technical design; presented designs to stakeholders.
- Designed and developed scalable data ingestion pipelines using Azure Data Factory and Azure Databricks.
- Implemented centralized data governance using Unity Catalog across multiple Databricks workspaces in collaboration with platform admins.
- Created catalogs, schemas, and tables; led migration of Synapse tables to Unity Catalog-enabled Delta tables.
- Integrated and transformed structured and semi-structured data from diverse sources and formats.
- Applied Medallion Architecture (Bronze, Silver, Gold layers) to build efficient and reliable data pipelines.
- Developed PySpark and Spark SQL applications in Databricks for large-scale data processing, aggregation, and reporting.
- Built complex SQL queries and stored procedures; integrated with ADF to implement Change Data Capture (CDC) on curated data layers.
- Implemented CI/CD pipelines using Azure DevOps to support automated Build–Test–UAT–Production deployments.
- Troubleshot and resolved production issues, ensuring high availability and reliability of data pipelines.
- Delivered enhancements and performance optimizations for existing data applications in production environments.
ETL Architect | Lead Developer
Walgreens - CSO: Ab Initio to Talend Migration
2019.06 - 2021.03
- Understand current application built on Abinitio platform and list down all the modules/jobs which are to be migrated to Talend.
- Prepare sprint wise project plan and divide the jobs into multiple modules which are to be migrated from Ab Initio to Talend DI and Big Data platform.
- Work on effort and time estimation of each module consisting of Ab Initio jobs which are going to be converted in Talend DI and Bigdata platform.
- Develop complex ETL jobs using Talend Open Studio Data Integration and Big data tool.
- Build & test Talend ETL jobs and compare the test results with respective Ab Initio jobs.
- Build reusable master scripts using Unix shell scripting and integrate with Talend ETL jobs.
- Build large scale complex SQL queries and integrate with Talend Big data jobs using sql components.
- Configure Talend big data jobs to integrate with Hsadoop cluster.
- Configure master Ab Initio job to compare output result with those of Talend jobs.
- Conduct UAT meetings and walkthrough module wise and plan to deploy Talend jobs in parallel environment.
- Help in performance tuning of long running Talend Jobs.
- Build the cut off plan to deploy Talend modules in production and then compare the results with Ab Initio. Then finally shutting off Ab Initio modules.
- Monitor the application and enable the team to provide 24/7 production support.
- Implement fixes and enhance the existing application through change requests.
Azure Data Engineer
Walgreens - Campaign Management System
2021.04 - 2025.03
- Collaborated with business users to gather requirements and design a common enterprise data architecture for retail data; built scalable data lake solutions on Azure.
- Analyzed existing production systems and designed modern data solutions using Azure PaaS services aligned with current business processes.
- Led architecture design, data modeling, and technical solutioning; conducted design walkthroughs with stakeholders.
- Defined project scope, strategy, and effort estimates; communicated timelines, deliverables, and milestones to stakeholders.
- Recommended architectural improvements and integration strategies to optimize cost and performance.
- Designed and implemented ETL pipelines using Azure Data Factory to ingest data from multiple source systems into Azure Data Lake.
- Processed and transformed data using ADF Mapping Data Flows and Azure Databricks (PySpark, Spark SQL); loaded curated data into Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
- Implemented Unity Catalog in Databricks for centralized data governance across multiple workspaces in collaboration with platform admins.
- Created catalogs, schemas, and tables; migrated Synapse tables to Unity Catalog-enabled Delta tables.
- Developed PySpark and Spark SQL applications for large-scale data transformation, aggregation, and consumption-ready datasets.
- Built real-time data processing pipelines using Azure Event Hubs and Databricks to ingest and process streaming customer transaction data.
- Developed complex SQL queries and stored procedures; integrated with ADF pipelines to implement Change Data Capture (CDC).
- Established CI/CD pipelines using Azure DevOps for automated Build–Test–UAT–Deployment processes.
- Monitored applications and ensured 24/7 production support readiness for critical data systems.
- Resolved production issues and delivered enhancements to improve system stability and performance.
- Conducted regular stakeholder meetings and published weekly/monthly status reports on project progress and deliverables.
AS 400 Dev & RunOps Lead
Walgreens – Logistics Systems: Ordering Processing, Billing & Shipping
2017.01 - 2019.05
- Gathered detailed business requirements and translated them into technical design documents aligned with project needs.
- Analyzed existing system architecture and mapped business requirements to appropriate technical modules.
- Performed impact analysis to identify affected components and ensure comprehensive solution design.
- Coordinated in an Onshore-Offshore delivery model, effectively communicating business and technical requirements across teams.
- Prepared effort estimates, defined delivery timelines, and developed detailed project plans in collaboration with stakeholders.
- Developed and maintained AS400 applications using Synon, RPG, and Control Language (CL).
- Conducted unit testing, system integration testing, and supported UAT cycles with business users.
- Led code reviews and facilitated UAT walkthroughs and business sign-off sessions.
- Developed complex SQL queries and stored procedures in DB2 environments.
- Conducted regular status meetings and provided updates on project progress to stakeholders.
- Provided production support, including enhancements and bug fixes for existing applications.
- Monitored critical batch jobs to ensure seamless processing of store orders, billing, and shipping operations.
- Troubleshot production issues, performed root cause analysis (RCA), and implemented fixes for recurring failures.
- Created Standard Operating Procedures (SOPs) for business and RunOps teams to ensure smooth operational workflows.
Senior AS400 Developer
Walgreens – Store & DC Ordering: JDA Implementation
2014.08 - 2016.12
- Interact with business stake holders and SMEs to understand current legacy ordering system built over legacy AS400 architecture.
- Involve in data mapping brainstorming sessions and identify the master data from legacy source system (DB2 database).
- Perform impact analysis on the existing system to make sure all the impacted components are covered in the design document.
- Work with ETL Abinitio teams to understand the master data requirement and work on mapping the requirements to the master data tables in legacy AS400 system.
- Build new AS400 applications to fulfill master data requirement to be sent to Centralized JDA system through ETL layer.
- Integrate existing AS400 applications with new source of data coming from centralized ordering system from JDA.
- Work in Onshore-Offshore model and convey the business and technical requirements to the team.
- Conduct weekly status meeting with project stakeholders reviewing the progress of the projects.
- Participate in war room meetings during deployment phase as an AS400 SME and mitigate production issues found during deployment phases.
- Provide production support post deployment and monitor the application. Do enhancements and bug fixes in existing applications.
- Monitor critical applications in production and make sure smooth processing of daily store orders to vendors and Walgreens distribution centers.
- Create handbooks and do the knowledge transfer to the RunOps team.
AS400 Developer
Walgreens – Store Inventory Management System
2010.06 - 2014.07
- Participate in business meetings to understand and gather the requirements.
- Understand the current system and map the requirements to the impacted applications.
- Perform impact analysis on the existing system to make sure all the impacted components are covered in the design document.
- Create high level design documents and perform walkthrough meetings with business and get the signoff.
- Create technical design document with all the impacted components and get the peer review done.
- Develop the applications in AS00/Synon and do the unit testing.
- Perform system testing and work with QA team to perform quality assurance review.
- Facilitate code walkthrough and assist in user acceptance testing along with onsite team.
- Monitor critical applications and provide production support.
- Perform root cause analysis for job failures and implement permanent fixes.
- Monitor day to day incidents through BMC Remedy incident management tool.
Formation
Bachelor of Technology - Computer Science & Engineering
Compétences
- Azure Data Factory, Azure Databricks
- Python, Pyspark
- Spark SQL, Stored Procedures, P/L SQL, Unix Shell Scripting
- Azure Data Lake Storage, Unity Catalog, Azure SQL Database, Azure Synapse Data Warehouse, Oracle
- Azure Eventhub, Virtual Machines, Key Vault, Identity and Role Management
- Apache Spark Architecture, Delta Lake, HDFS, Dataframe, Spark Streaming
- Continuous Integration & Continuous Delivery using Azure DevOps
- Talend DI and Big Data, AbInitio
- Remedy, Jira, Agility, SSMS, Azure Data Explorer, Azure Data Studio, WinScp
Disponibilités professionnelles
lundi
mardi
mercredi
jeudi
vendredi
samedi
dimanche
matin
après-midi
soirée
Faites glisser pour parcourir
Certificats
- Databricks Certified Data Engineer Associate
- Databricks Certified Spark Developer Associate
- Microsoft Certified Azure Data Engineer (DP-203)
- Databricks Accredited Lakehouse Fundamentals
Projets réalisés
- Communication efficace - A assuré le suivi des ordonnances prévues du tribunal et de la correspondance entre les différents avocats.
- Résolution inventive des problèmes : - A résolu un problème lié à un produit en effectuant un test auprès des consommateurs.
- Documentation : rédaction et révision de correspondances pour tenir les employés informés du règlement et des procédures de l'entreprise.
Affiliations professionnelles
- Membre du Rotary Club (2003-2010)
- Membre de l'Association de la police de Paris (2005 à aujourd'hui)
Chronologie
Azure Data Engineer - Amerihealth Caritas – Fee Schedule Management
2025.03 - 2026.05
Azure Data Engineer - Walgreens - Campaign Management System
2021.04 - 2025.03
ETL Architect | Lead Developer - Walgreens - CSO: Ab Initio to Talend Migration
2019.06 - 2021.03
AS 400 Dev & RunOps Lead - Walgreens – Logistics Systems: Ordering Processing, Billing & Shipping
2017.01 - 2019.05
Senior AS400 Developer - Walgreens – Store & DC Ordering: JDA Implementation
2014.08 - 2016.12
AS400 Developer - Walgreens – Store Inventory Management System
2010.06 - 2014.07
Madan Mohan Malviya Engineering College - Bachelor of Technology, Computer Science & Engineering