• Application Deadline:
• Position: Data Engineer


• Job Type Full Time , Hybrid


• Qualification BA/BSc/HND


• Experience


• Location Lagos


• Job Field ICT / Computer 
  

Job Description

• We are seeking a talented Python Expert with expertise in Azure Databricks to join our team as a Data Transformation Developer.


• As a Python Expert, you will be responsible for developing solutions using Azure Databricks to transform and manipulate data efficiently and accurately.


• You will work closely with our data engineering and data science teams to design and implement data transformation processes that meet the needs of our organization.

Responsibilities:

• Develop and maintain Python-based data transformation solutions using Azure Databricks.


• Collaborate with data engineering and data science teams to understand data requirements and design effective data transformation processes.


• Analyze and profile data to identify patterns, inconsistencies, and data quality issues that may impact data transformation processes.


• Implement data transformation logic and algorithms using Python programming language and/PySpark, ensuring efficiency, scalability, and maintainability.


• Optimize data transformation processes to enhance performance and minimize processing time.


• Develop and maintain Jupyter notebooks within Azure Databricks, ensuring smooth and reliable execution of data transformation tasks.


• Conduct thorough testing and debugging of data transformation code to ensure accuracy and reliability of results.


• Collaborate with cross-functional teams to ensure seamless integration of data transformation processes with downstream systems and applications.


• Stay updated with the latest advancements in Azure Databricks and other relevant technologies to continuously enhance data transformation capabilities.


• Provide technical guidance and mentorship to junior team members, fostering a culture of learning and growth.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field. Equivalent work experience may be considered.


• Proven experience as a Python Developer, with expertise in Python programming language.


• Strong knowledge and hands-on experience with Azure Databricks for data transformation and analytics.


• Solid understanding of data transformation techniques, algorithms, and best practices.


• Proficiency in working with large datasets and utilizing distributed computing frameworks.


• Experience with data profiling, data quality assessment, and data cleansing techniques.


• Familiarity with SQL and relational databases, including data modeling concepts.


• Strong analytical and problem-solving skills, with the ability to analyze complex data and develop effective transformation strategies.


• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.


• Self-motivated and proactive, with the ability to prioritize tasks and manage time effectively.


• Relevant certifications in Azure Databricks or related technologies are highly desirable.