Highly experienced Azure Data Engineer with a strong track
record of optimizing data solutions and building robust
pipelines. Skilled in Azure services like Azure Data Factory,
Azure Databricks, and Azure Synapse Analytics, with a deep
understanding of data modeling and integration. Proven ability
to collaborate across teams to deliver scalable, secure solutions
for business intelligence and analytics. Adept at
troubleshooting and passionate about leveraging cloud
technologies for data-driven decision-making. Known for
designing and developing applications using Python, converting
reports into Power BI dashboards, and educating others on
pipeline usage. Proficient in SQL, PySpark, and cloud
infrastructures like Azure and AWS. With a Diploma in
Computer Science and also pursuing Bachelor's in Computer
Science, I bring over 5 years of expertise in data management,
visualization, and design.
PIPLINE TD
Pipeline TD
Duration - Sep2022 – Present.
Test and debug tools and process to ensure stability and
usability Converting pre-existing excel or other tool-based
MIS reports to Power BI dashboards.
Designing and developing applications using python.
Act as a liaison for communicating technical issues to
Production, R&D and IT Creating dashboards, using SQL,
PYSPARK, POWER BI.
Educate artists on how to work with the pipeline
Create and update documentation explaining our processes
and tools
Develop pipeline tools and processes to meet production
needs
Communication, troubleshooting and debugging issues
understanding on Azure Data Factory, Azure Synapse, Azure
SQL, Azure Data Lake, and Azure App Service.
Thorough understanding of Azure and AWS Cloud
Infrastructure.
Projects:
Data Pipeline Development: Building end-to-end data
pipelines to extract, transform, and load (ETL) data from
various sources (databases, APIs, files) into data warehouses
or data lakes.
Data Warehousing: Designing and optimizing data
warehouse schemas (e.g., star schema, snowflake schema)
to support efficient querying and reporting.
Real-time Data Processing: Implementing streaming data
architectures using tools like Apache Kafka, Apache Spark
Streaming, or Azure Stream Analytics for real-time analytics
and processing.
Data Quality and Governance: Developing processes and
frameworks for data quality monitoring, ensuring data
integrity, and implementing data governance policies.
Cloud Migration: Migrating on-premises data infrastructure to
cloud platforms like Azure, AWS, or Google Cloud Platform to
leverage scalable and managed services.
Client Management
Visualization
Cost estimation
Client interaction
Data Management
Vendor Data Management
Evaluated trends in design concepts
Performed advanced comprehensive business analysis using
statistical analysis
Ensured accuracy of data collection and data reporting.
Design Management
Retail store design management.
Retail design concepts approval from vendor.
Coordination with vendors.