Azure Data Engineer
DysrupIT
Date: 4 hours ago
City: Makati City
Contract type: Full time
Job Summary
A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design.
Job Responsibilities
A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design.
Job Responsibilities
- Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
- Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
- Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
- Ensure data quality and integrity through data validation techniques and frameworks.
- Develop and maintain documentation for data processes, configurations, and best practices.
- Monitor and troubleshoot data pipeline issues to ensure timely resolution.
- Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
- Manage the CI/CD process for deploying and maintaining data solutions.
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience) and able to demonstrate high proficiency in programming fundamentals.
- Proven experience (5+ years) as a Data Engineer or similar role dealing with data and ETL processes.
- Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
- Experience utilizing SQL DML to query modern RDBMS in an efficient manner (e.g., SQL Server, PostgreSQL).
- Strong understanding of Software Engineering principles and how they apply to Data Engineering (e.g., CI/CD, version control, testing).
- Experience with big data technologies (e.g., Spark).
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Certified Medical Coder
Optum,
Makati City
4 days ago
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive...
Specialist, Sales Support
Concentrix,
Makati City
4 days ago
You Have1+ year of relevant working experienceKnowledge of Microsoft products including Word and Excel (can perform basic functions)Have necessary skills for email, phone and video communicationHandle confidential information with complete integrityExperience in administrative tasks, organization of detailed work materials, and prioritizing deadlinesAccustomed to identifying and recommending corrective action for moderately complex issuesExperience following scripts and processes according to contractual agreementsExperience...
Clinical Manager
Manila Bankers Life Insurance,
Makati City
6 days ago
Job DescriptionManage and coordinate all clinic operations, including staffing, patient scheduling, inventory management, and regulatory complianceDevelop and implement policies and procedures to streamline clinic workflows and improve patient experienceOversee the financial management of the clinic, including budgeting, invoicing, and cost-control measuresCollaborate with healthcare providers to ensure high-quality patient care and positive health outcomesManage and develop a team of administrative and...
