Data Ingestion Engineering and Platform Engineering

At Globe, our goal is to create a wonderful world for our people, business, and nation. By uniting people of passion who believe they can make a difference, we are confident that we can achieve this goal.

Job Description

Data Ingestion & Platform Engineering is responsible for designing, building, and maintaining scalable data pipelines and systems. They ensure data is collected, stored, processed, and analyzed effectively to support business decision-making. This role requires deep technical expertise in data architecture, cloud platforms, and big data technologies, along with a strong understanding of data governance and security practices.

Duties And Responsibilities

• Data Pipeline Development: Design, develop, and optimize complex data pipelines that handle large volumes of data from multiple sources.
• Data Architecture: Define and implement data architectures that ensure efficient data processing and storage.
• Data Integration: Work on integrating diverse data sources, including relational databases, NoSQL databases, and data lakes.
• Performance Tuning: Optimize data processes for maximum efficiency and scalability.
• Data Governance and Security: Implement data governance policies and ensure compliance with security and privacy regulations.
• Collaboration: Work closely with data scientists, data analysts, and software engineers to understand data needs and provide reliable data solutions.
• Automation: Automate data workflows to improve efficiency and reduce manual intervention.
• Documentation: Maintain detailed documentation of data engineering processes, systems, and workflows.
• Mentoring: Provide guidance and mentoring to junior data engineers.
  
  
  

Hiring Requirements

Work Experience

• 10+ years of experience in data engineering or a related field, with a proven track record of leading large-scale data projects.
• Extensive experience working with cloud-based data platforms and big data technologies.
• Prior experience in mentoring and leading a team of data engineers.
• Demonstrated success in building and optimizing complex data pipelines in a high-volume data environment.
  
  
  

Must Have

• Experience in creating Continuous Integration and Continuous Deployment Pipelines using Gitlab CI or Jenkins
• Experience with Infrastructure as Code using Ansible or Terraform
• Experience with Automation (Bash scripting, Python scripting, etc.), Containers and Kubernetes, ArgoCD, JFrog
• Experience with AWS (S3, Lambda, EMR, EKS) or GCP (GCS, Cloud Run Functions, Dataproc, GKE), specifically for data engineering
  
  
  

Nice To Have

• Experience with data warehousing solutions such as Amazon Redshift, Google BigQuery, or Snowflake
• Experience on data platforms: Databricks, dbt cloud, or Confluent Cloud
• Experience with big data technologies such as Apache Hadoop, Apache Spark, or Apache Kafka.
• Experience managing orchestration platforms such as Airflow
  
  
  

Equal Opportunity Employer

Globe’s hiring process promotes equal opportunity to applicants, Any form of discrimination is not tolerated throughout the entire employee lifecycle, including the hiring process such as in posting vacancies, selecting, and interviewing applicants.

Globe’s Diversity, Equity and Inclusion Policy Commitment can be accessed here

Make Your Passion Part of Your Profession. Attracting the best and brightest Talents is pivotal to our success. If you are ready to share our purpose of Creating a Globe of Good, explore opportunities with us.