Senior Data Engineer at Alfred & Victoria Associates

Job Overview

Location
Lagos, Lagos
Job Type
Full Time
Date Posted
1 month ago

Additional Details

Job ID
143829
Job Views
35

Job Description






Job Description




  • We are seeking a highly motivated and result-driven Senior Data Engineer with a minimum of 9years experience to join our team.

  • As a Senior Data engineer, you will be responsible for architecting, designing and building data processing systems and infrastructure in a cloud environment



Responsibilities




  • Design, develop, and maintain cloud-based data pipelines and data processing systems.

  • Collaborate with stakeholders to gather requirements and define data engineering solutions.

  • Implement data integration and ETL processes to extract, transform, and load data from various sources.

  • Ensure data quality, integrity, and consistency across different data sets.

  • Optimize and fine-tune data processing and data storage systems for performance and scalability.

  • Monitor and troubleshoot data pipelines and resolve any issues that arise.

  • Collaborate with cross-functional teams to implement data governance and security measures.



Requirements




  • Minimum of 9 years’ experience in Cloud Data Engineering, Machine Learning, and Visualization.

  • Proficiency in AWS Boto3 Python SDK

  • Experience with big data processing frameworks such as Apache Spark or Hadoop.

  • Familiarity with data modeling, data warehousing, and database design principles.

  • Knowledge of Cloud Warehousing Solutions such as Amazon Redshift and Google BigQuery

  • Experience with ETL tools such as Amazon Glue

  • Knowledge of SQL and NoSQL databases.

  • Experience with data integration tools and technologies (e.g., Apache Kafka, Apache NiFi).

  • Understanding of data governance, data security, and privacy best practices.

  • Knowledge of data visualization tools (e.g., Data Studio, QuickSight, Tableau, Power BI).

  • Relevant Solution Architecture, Data engineering and Machine learning Certification,

  • Experience with containerization technologies (e.g., Docker, Kubernetes).



Similar Jobs

Cookies

This website uses cookies to ensure you get the best experience on our website. Cookie Policy

Accept