Senior Software Engineer – Data at Atlan

May 21, 2024

Job Description

We are looking for a highly experienced Senior Data Engineer specializing in Python and Airflow to join our team at Atlan. In this role, you will be crucial in advancing our data management and workflow automation solutions using Python and Airflow.

Responsibilities:

  • Lead the design, development, and deployment of Airflow packages and services.
  • Develop and maintain Python services for data lineage and orchestration.
  • Collaborate with the lineage and package team to fulfill end-to-end orchestration needs.
  • Conduct research and proof-of-concept experiments on new orchestration and lineage-related products and libraries.
  • Mentor and guide junior team members, promoting technical excellence and continuous learning.
  • Partner with our orchestration collaborators to develop technical roadmaps and implementations.
  • Contribute to the open-source libraries and frameworks we utilize.
  • Work closely with design, product, and Engineering Managers.

Qualifications:

  • Extensive experience as a Data Engineer with a focus on Python and Airflow.
  • Demonstrated expertise in designing and developing data pipelines and workflow automation using Apache Airflow.
  • Strong understanding of data management concepts and data processing frameworks.
  • Proficiency in Python programming and experience with relevant libraries and frameworks.
  • Familiarity with both SQL and NoSQL database systems, including data modeling and database design.
  • Experience with cloud platforms such as AWS, Azure, or GCP is advantageous.
  • Excellent problem-solving skills and the ability to address complex technical challenges.
  • Strong communication and collaboration skills, capable of working effectively in a team.
  • Passion for delivering high-quality, scalable, and reliable software solutions.
  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.

Join Us at Atlan

At Atlan, we aim to empower data teams to do their best work. We strive to help Atlanians do their best work while with us and find their Ikigai.

We value creativity, innovation, and a passion for problem-solving. As a Senior Data Engineer, you’ll significantly impact our data management and workflow automation solutions. If you’re an expert in Python and Airflow and enjoy tackling complex challenges in a collaborative environment, we’d love to hear from you!

Normally, we would invite potential Atlanians to our office to meet our team and experience our culture. However, due to the global pandemic, we’ve made our internal team handbook available, which provides insight into our values, principles, and growth practices as we build our dream team.