Full Time
Hyderabad
Posted 3 months ago
Position: Azure Data Engineer
Location: Gachibowli, Hyderabad (Onsite)
Shift: Night Shift – 7:00 PM to 4:00 AM (IST)
Salary: Negotiable
Qualification: Any Degree
Job Summary
We are seeking a skilled and motivated Azure Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and data platforms on Azure. You will work extensively with Azure data services to support ETL/ELT processes, data ingestion, data modeling, and analytics, enabling data-driven decision-making across the organization.
Key Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory (ADF), including linked services, datasets, pipelines, and triggers.
- Ingest and manage data from multiple sources into Azure Data Lake Storage (ADLS Gen2), Azure SQL Database, and other Azure storage services.
- Build and automate workflows using Azure Logic Apps, including connectors, expressions, and workflow orchestration.
- Write efficient SQL queries, views, and stored procedures in Azure SQL Database / SQL Server.
- Ensure data quality, reliability, performance optimization, and monitoring of data pipelines.
- Design and implement data models to support analytics and reporting requirements.
- Collaborate with cross-functional teams such as Data Analysts, Data Scientists, and Business stakeholders.
- Implement basic CI/CD concepts for data pipelines and deployments.
- Follow best practices for security, scalability, and cost optimization in Azure data solutions.
- Provide technical guidance and contribute to continuous improvement of data engineering practices.
Required Skills & Experience
- 1+ year of hands-on experience working with Azure data services.
Strong experience:
- Azure Data Factory (ADF) – pipelines, datasets, linked services, triggers
- Azure Logic Apps – workflow automation, connectors, expressions
- Azure Storage / ADLS Gen2 – file ingestion and data management
- Azure SQL Database / SQL Server – SQL queries and stored procedures
Solid understanding:
- ETL / ELT concepts
- Data modeling fundamentals
- Basic CI/CD concepts
- Good analytical and problem-solving skills.
- Ability to work independently and in an Agile team environment.
- Strong communication and collaboration skills.
Preferred / Good-to-Have Skills
- Experience with Microsoft Fabric, including:
- Data Pipelines
- Lakehouse
- Warehouse
- Dataflows
- Knowledge of Delta Lake concepts.
- Experience with Power BI Dataflows.
- Basic knowledge of Python or Databricks.
- Familiarity with Azure Synapse Analytics.
- Experience with Azure DevOps and deployment pipelines.
- Azure Fabric Certification (or currently pursuing).