Senior Data Engineer

Skills

Data EngineeringSQLAirflowData PipelinesData WarehousingDatabasesExtract

Role

What the job involves

The main requirements, responsibilities and hiring steps.

Requirements

8+ years of experience in data engineering
Strong proficiency in Python and SQL
Experience with SQL query profiling and optimization
Deep understanding of SQL Abstract Syntax Tree (AST) and SQL parsers
Experience in building data pipelines using Airflow or dbt

Nice to have

Understanding of cloud platforms (AWS)
Familiarity with Kubernetes (K8s)

Day to day

Design and build the backbone of our AI-powered data solutions
Enhance our AI capabilities by developing high-performance data systems
Integrate advanced AI into thousands of data teams' daily workflows

Hiring process

Apply now and let's build something amazing together.

Company

Why this team might suit you

Mission, benefits, values and useful company context.

Mission

We dream of the perfect data world, and we are on a quest to turn that dream into a reality. Our flagship product, DataPilot is an AI teammate for data teams to accelerate development workflows, reduce operational costs, and improve data governance. It’s a collection of AI agents - natively integrated into the favorite tools of data teams - to generate data documentation, data quality tests, query explanations, and much more. We have been fortunate to have bleeding-edge tech companies as our customers who believe in our dream and work closely with us to add more magic to the DataPilot.

Benefits

Competitive salary and equity
Professional development opportunities
Dynamic and intellectually stimulating work environment
Opportunities to shape the company's direction

Values

Innovation
Teamwork
Efficiency
Customer Focused
Data Integrity