Job Description
Job Description
- We are looking for an experienced Data Engineer to join our growing team of analytics experts.
- You will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams.
- The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
- The Data Engineer will support the data team and our software developers on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
Roles and Responsibilities
- Build data pipelines that clean, transform and aggregate data from different sources.
- Create and maintain optimal data pipeline architectures.
- Develop models to be used to make predictions and answer questions for the overall business
- Assemble large, complex data sets that meet functional/non-functional business requirements.
- Work with the team to build complex algorithms that provide unique insights into the Company’s data.
- Use agile software development processes to iteratively make improvements to the Company’s end systems.
- Model front-end and back-end data sources to develop a comprehensive picture of user flows that enables impactful data analysis.
- Optimize existing infrastructure for extraction, transformation, and loading of data from various data sources using SQL and Google BigQuery.
- Prepare data for prescriptive and predictive modelling.
- Identify, design, and implement internal process improvements: automating manual processes, and optimizing data delivery for greater scalability.
- Explore ways to enhance data quality and reliability.
- Identify opportunities for data acquisition.
- Develop analytical tools and programs.
- Collaborate with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Requirements
- Degree in Computer Science, Information Technology, Engineering or other relevant fields.
- Masters Degree in Statistics, Applied Math, or related disciplines or fields is an advantage.
- Minimum of 3 years previous experience as a data engineer or in a similar role.
- Technical expertise with data models, data mining, and segmentation techniques.
- Experience with object-oriented/object function scripting languages (e.g., Java and Python).
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience using Google Cloud Platform or other similar cloud services.
- Experience working with data ETL tools and processes, DBT and Fivetran experience is a plus.
- Communication skills, especially explaining technical concepts to non-technical stakeholders
- Strong analytic skills related to working with unstructured datasets.
- Comfortable working in a dynamic environment with a research-oriented team working on concurrent projects.
Salary
N500,000 - N650,000 / Month