Senior Data Engineer at Alfred & Victoria Associates

Job Overview

Location
Lagos, Lagos
Job Type
Full Time
Date Posted
12 days ago

Additional Details

Job ID
143829
Job Views
30

Job Description






Job Description




  • We are seeking a highly motivated and result-driven Senior Data Engineer with a minimum of 9years experience to join our team.

  • As a Senior Data engineer, you will be responsible for architecting, designing and building data processing systems and infrastructure in a cloud environment



Responsibilities




  • Design, develop, and maintain cloud-based data pipelines and data processing systems.

  • Collaborate with stakeholders to gather requirements and define data engineering solutions.

  • Implement data integration and ETL processes to extract, transform, and load data from various sources.

  • Ensure data quality, integrity, and consistency across different data sets.

  • Optimize and fine-tune data processing and data storage systems for performance and scalability.

  • Monitor and troubleshoot data pipelines and resolve any issues that arise.

  • Collaborate with cross-functional teams to implement data governance and security measures.



Requirements




  • Minimum of 9 years’ experience in Cloud Data Engineering, Machine Learning, and Visualization.

  • Proficiency in AWS Boto3 Python SDK

  • Experience with big data processing frameworks such as Apache Spark or Hadoop.

  • Familiarity with data modeling, data warehousing, and database design principles.

  • Knowledge of Cloud Warehousing Solutions such as Amazon Redshift and Google BigQuery

  • Experience with ETL tools such as Amazon Glue

  • Knowledge of SQL and NoSQL databases.

  • Experience with data integration tools and technologies (e.g., Apache Kafka, Apache NiFi).

  • Understanding of data governance, data security, and privacy best practices.

  • Knowledge of data visualization tools (e.g., Data Studio, QuickSight, Tableau, Power BI).

  • Relevant Solution Architecture, Data engineering and Machine learning Certification,

  • Experience with containerization technologies (e.g., Docker, Kubernetes).



Similar Jobs

Full Time
Full Time
Full Time

Cookies

This website uses cookies to ensure you get the best experience on our website. Cookie Policy

Accept