Azure Data Engineer

DysrupIT


Date: 6 hours ago
City: Makati City
Contract type: Full time

JOB SUMMARY:

A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design.

JOB RESPONSIBILITIES:

  • Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
  • Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
  • Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
  • Ensure data quality and integrity through data validation techniques and frameworks.
  • Develop and maintain documentation for data processes, configurations, and best practices.
  • Monitor and troubleshoot data pipeline issues to ensure timely resolution.
  • Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
  • Manage the CI/CD process for deploying and maintaining data solutions.


JOB QUALIFICATIONS:

  • Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.
  • Proven experience (3+ years) as a Data Engineer or similar role dealing with data and ETL processes.
  • Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
  • Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
  • Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
  • Experience with big data technologies (e.g., Spark).
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Tax Associate

Rockwell Land Corporation, Makati City
14 hours ago
Job DescriptionThe Tax Associate will be responsible for assisting with various tax-related tasks, including the calculation and filing of different tax returns, preparation of related documents, and submission of reports. This role requires strong attention to detail, excellent organizational skills, and the ability to manage multiple tasks efficiently. The Tax Associate will ensure compliance with all tax regulations and work...

Associate, Statistical Data Scientist

Pfizer, Makati City
2 days ago
Job Summary:The role isAn Individual Contributor roleIncludes hands on programming, supporting deliverables in the study/project/portfolio/standards team, of medium – high complex statistical programming deliverablesExpected to perform activities with limited governance and guidance from Senior team members within Standards/Study/Project/Portfolio/TA’sCollaborate with Senior Programmers/Leads and complete the assigned tasksEnsures adherence to programming standards in their daily workEnsure the tasks are completed on time...

Carrier Compliance Specialist

Descartes Systems Group, Makati City
3 days ago
Descartes Unites the People and Technology that Move the WorldThe need for efficient, secure, and agile supply chains and logistics operations has become ever more critical and complex. By combining innovative technology, powerful trade intelligence and the reach of our network, Descartes helps get goods, information, transportation assets, and people where they’re needed, when they’re needed.We’re one of the most...