Software Engineer - Snowflake
White Cloak Technologies, Inc.
Date: 3 weeks ago
City: Quezon City
Contract type: Contractor
Responsibilities
- Data Pipeline Development: Design, develop, and optimize real-time and batch data pipelines using Confluent Kafka and Snowflake.
- Streaming Data Processing: Implement event-driven architectures leveraging Kafka Streams, ksqlDB, and Kafka Connect.
- Data Integration: Integrate structured and semi-structured data from multiple sources into Snowflake for analytics and reporting.
- Database Management: Develop, optimize, and maintain Snowflake-based data warehouses, ensuring high availability and performance.
- Security & Compliance: Implement data security best practices, including encryption, role-based access control (RBAC), and compliance with GDPR, HIPAA, or other relevant regulations.
- Optimization: Optimize query performance and storage efficiency in Snowflake using clustering, partitioning, and caching techniques.
- Testing: Conduct unit testing and data validation to ensure accuracy and reliability of data pipelines.
- Troubleshooting: Diagnose and resolve issues related to Kafka messaging, Snowflake storage, and data transformations.
- Documentation: Prepare and maintain technical documentation, including architecture diagrams, data flow processes, and best practices.
- Collaboration: Work with Data Scientists, BI Teams, and Cloud Engineers to provide real-time and batch data solutions.
- Maintenance: Monitor and maintain the stability of streaming pipelines and data warehouse operations.
- Strong understanding of real-time data streaming and event-driven architectures.
- Experience in Snowflake data warehouse development and administration.
- Proficiency in SQL, Python, or Scala for data processing and transformation.
- Familiarity with cloud platforms (AWS, Azure, GCP) for data pipeline orchestration.
- Experience with ETL/ELT processes and data pipeline automation.
- Knowledge of CI/CD for data pipelines, version control (Git), and DevOps tools.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Non-Voice Entry Level
Accenture in the Philippines,
Quezon City
1 day ago
We are looking for Content Moderators and Transaction Processing New Associates to be part of our talented team!Accenture is a trusted, innovative, comprehensive, and experienced partner to leading platform companies. The Trust and Safety offering within Accenture Operations helps keep the internet safe and helps platform companies accelerate, scale, and improve their businesses.Content moderators serve as an important line of...
Application Security Specialist
Accenture in the Philippines,
Quezon City
2 days ago
Ready to join Accenture’s team of empowered people? We’re looking for candidates with the following skills and experience for this role. Do you fit the profile? If you do, we’d love to hear from you!In adherence to Accenture’s process of Identity Verification, your resume or CV must include your photo to ensure the accuracy of your application.Who we are:Accenture in...
Accountant
RELX,
Quezon City
2 days ago
Performs general accounting activities, including the preparation, maintenance and reconciliation of ledger accounts and financial statements such as balance sheets, profit-and-loss statements and capital expenditure schedules. Prepares, records, analyzes and reports accounting transactions and ensures the integrity of accounting records for completeness, accuracy and compliance with accepted accounting policies and principles. Provides financial support, including forecasting, budgeting and analyzing variations...
