We are seeking a highly motivated and result-driven Senior Data Engineer with a minimum of 9years experience to join our team.
As a Senior Data engineer, you will be responsible for architecting, designing and building data processing systems and infrastructure in a cloud environment
Responsibilities
Design, develop, and maintain cloud-based data pipelines and data processing systems.
Collaborate with stakeholders to gather requirements and define data engineering solutions.
Implement data integration and ETL processes to extract, transform, and load data from various sources.
Ensure data quality, integrity, and consistency across different data sets.
Optimize and fine-tune data processing and data storage systems for performance and scalability.
Monitor and troubleshoot data pipelines and resolve any issues that arise.
Collaborate with cross-functional teams to implement data governance and security measures.
Requirements
Minimum of 9 years’ experience in Cloud Data Engineering, Machine Learning, and Visualization.
Proficiency in AWS Boto3 Python SDK
Experience with big data processing frameworks such as Apache Spark or Hadoop.
Familiarity with data modeling, data warehousing, and database design principles.
Knowledge of Cloud Warehousing Solutions such as Amazon Redshift and Google BigQuery
Experience with ETL tools such as Amazon Glue
Knowledge of SQL and NoSQL databases.
Experience with data integration tools and technologies (e.g., Apache Kafka, Apache NiFi).
Understanding of data governance, data security, and privacy best practices.
Knowledge of data visualization tools (e.g., Data Studio, QuickSight, Tableau, Power BI).
Relevant Solution Architecture, Data engineering and Machine learning Certification,
Experience with containerization technologies (e.g., Docker, Kubernetes).