Software Engineer - Snowflake

White Cloak Technologies, Inc.


Date: 7 hours ago
City: Quezon City
Contract type: Contractor
Responsibilities

  • Data Pipeline Development: Design, develop, and optimize real-time and batch data pipelines using Confluent Kafka and Snowflake.
  • Streaming Data Processing: Implement event-driven architectures leveraging Kafka Streams, ksqlDB, and Kafka Connect.
  • Data Integration: Integrate structured and semi-structured data from multiple sources into Snowflake for analytics and reporting.
  • Database Management: Develop, optimize, and maintain Snowflake-based data warehouses, ensuring high availability and performance.
  • Security & Compliance: Implement data security best practices, including encryption, role-based access control (RBAC), and compliance with GDPR, HIPAA, or other relevant regulations.
  • Optimization: Optimize query performance and storage efficiency in Snowflake using clustering, partitioning, and caching techniques.
  • Testing: Conduct unit testing and data validation to ensure accuracy and reliability of data pipelines.
  • Troubleshooting: Diagnose and resolve issues related to Kafka messaging, Snowflake storage, and data transformations.
  • Documentation: Prepare and maintain technical documentation, including architecture diagrams, data flow processes, and best practices.
  • Collaboration: Work with Data Scientists, BI Teams, and Cloud Engineers to provide real-time and batch data solutions.
  • Maintenance: Monitor and maintain the stability of streaming pipelines and data warehouse operations.


Qualifications:

  • Strong understanding of real-time data streaming and event-driven architectures.
  • Experience in Snowflake data warehouse development and administration.
  • Proficiency in SQL, Python, or Scala for data processing and transformation.
  • Familiarity with cloud platforms (AWS, Azure, GCP) for data pipeline orchestration.
  • Experience with ETL/ELT processes and data pipeline automation.
  • Knowledge of CI/CD for data pipelines, version control (Git), and DevOps tools.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

SAP Controlling Consultant

IBM, Quezon City
6 hours ago
IntroductionA career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic...

Supervisor, Accounts Payable

myGwork - LGBTQ+ Business Community, Quezon City
2 days ago
This job is with Thermo Fisher Scientific, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Work ScheduleStandard (Mon-Fri)Environmental ConditionsOfficeJob DescriptionAt Thermo Fisher Scientific, we collaborate to expedite research, tackle intricate scientific hurdles, spur technological advancement, and assist patients in need. Our objective is...

Group Brand Manager

Tap Growth ai, Quezon City
2 days ago
We're Hiring: Group Brand Manager! We are looking for a dynamic and strategic Group Brand Manager to lead our brand initiatives and drive growth across multiple product lines. The ideal candidate will possess strong leadership skills, a deep understanding of brand strategy, and the ability to work collaboratively within cross-functional teams. Location: Quezon City, Philippines Work Mode: Work From Office...