Tech & Digital

Data Engineer

  • Location

    City of London

  • Sector:

    BI, Analytics & Data Science

  • Job type:

    Permanent

  • Salary:

    £45000 - £70000 per annum

  • Contact:

    Ernest Kungu

  • Contact email:

    e.kungu@ioassociates.co.uk

  • Job ref:

    BBBH140922_1720022879

Job Description:

My client is seeking a Data Engineer to join our dynamic team. In this role, you will be crucial in developing and maintaining our existing data infrastructure while exploring and implementing new cloud services to enhance efficiency. This position offers the opportunity to grow into a data architect over time, with hands-on experience and mentorship from our seasoned team.

Key Responsibilities:

  • Develop and maintain the existing data architecture, ensuring reliability, scalability, and efficiency.
  • Design and implement ETL processes and data pipelines primarily within the AWS environment.
  • Enhance and optimise our infrastructure using Python coding skills, particularly in Airflow.
  • Collaborate with cross-functional teams to understand data requirements and implement solutions.
  • Gain proficiency in AWS services such as Lambda functions, Glue, and S3 to improve data processing capabilities.
  • Demonstrate proficiency in SQL for ETL processes, including Athena and Glue iterations.
  • Utilize NoSQL databases, particularly MongoDB, for production data storage and retrieval.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 0-3 years of experience in data engineering or related roles.
  • Strong proficiency in Python programming, with experience in Airflow preferred.
  • Familiarity with AWS services such as Lambda functions, Glue, and S3 is a plus.
  • Solid understanding of SQL for ETL processes, including experience with Athena and Glue iterations.
  • Experience with NoSQL databases, particularly MongoDB, is required.
  • Ability to work collaboratively in a fast-paced environment and adapt to evolving requirements.
  • Strong problem-solving skills and attention to detail.

Benefits:

  • Competitive salary and benefits package.
  • Opportunity for career growth and advancement within a leading research firm.
  • Mentorship and learning opportunities from experienced data professionals.
  • Dynamic and collaborative work environment with a focus on innovation and excellence.
Back job search