Data Engineer
Bengaluru, Karnataka, India
Full Time
Mid Level
Job Title: Data Engineer
Experience: 3–5 Years
Location: Remote
Only CV matching with JD will be Shortlisted
Role Purpose
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines within the Azure ecosystem. You will play a key role in enabling data-driven insights by developing reliable data solutions that support analytics, reporting, and business intelligence initiatives.
Key Responsibilities
- Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF)
- Work with Azure Data Lake Storage (ADLS) for data ingestion, storage, and processing
- Build and optimize data transformations using PySpark and SQL
- Integrate data from multiple structured and unstructured sources
- Ensure data quality, integrity, and consistency across pipelines
- Support implementation of Lakehouse architecture and Medallion (Bronze, Silver, Gold) layers
- Collaborate with analysts and BI teams to enable reporting and data models
- Monitor, troubleshoot, and resolve data pipeline issues
- Document data processes, workflows, and pipeline logic
Required Skills & Experience (3–5 Years)
- Hands-on experience with Azure Data Factory (ADF) and ADLS
- Strong programming skills in PySpark and SQL
- Experience in building and maintaining ETL pipelines
- Working knowledge of structured and unstructured data processing
- Basic understanding of Lakehouse architecture and Medallion framework
- Familiarity with Delta Lake concepts
- Strong problem-solving and debugging skills
Preferred Qualifications
- Experience with Azure Databricks
- Understanding of data modeling and data warehousing concepts
- Exposure to data governance and data quality frameworks
- Experience working in Agile/Scrum environments
Soft Skills
- Strong communication and stakeholder collaboration skills
- Analytical mindset with attention to detail
- Ability to work independently in a remote setup
- Team player with a proactive approach to problem-solving
Career Progression Opportunity
This role provides a pathway to grow into a Senior Data Engineer (5–10 Years) position, where responsibilities include:
- Designing end-to-end data architectures
- Working extensively with Microsoft Fabric and advanced Azure services
- Leading data engineering initiatives and mentoring team members
- Optimizing large-scale distributed data systems
Apply for this position
Required*