Senior Software Engineer (Data Platform)

Join Zeta as a Senior Software Engineer (Data Platform) and take ownership of building and operating the data infrastructure that supports our products, analytics, machine learning, and AI systems. You will work on various aspects of the platform, including Lakehouse architecture, distributed compute, data quality, governance, lineage, security, and access controls. You will also develop tooling for data pipelines and operate Spark workloads on dynamically sized Hadoop clusters. This role requires strong experience in software engineering, distributed systems, and data processing frameworks.

• Construire et exploiter l'infrastructure de données qui soutient les produits, l'analyse, l'apprentissage automatique et les systèmes d'IA de Zeta.
• Améliorer la performance, la fiabilité, le coût et la visibilité opérationnelle des charges de travail de la plateforme.
• Développer des capacités pour la qualité des données, la gouvernance, la lignée, les métadonnées, la découvrabilité, la sécurité et le contrôle d'accès.

• Working knowledge of AWS services such as EC2, S3, Athena, and IAM
• Experience with Kubernetes, Terraform, Airflow, Trino, ClickHouse, Starrocks, or Pinot is a plus
• Strong experience in Python, Scala, Java, or another JVM language
• Experience with Spark or another distributed data-processing framework
• Familiarity with at least 1 of these areas: Lakehouse architecture, Apache Iceberg, data quality, governance, lineage, metadata, query engines, or real-time OLAP
• Strong analytical, communication, and collaboration skills
• Experience building or operating production data platforms, backend systems, or distributed systems
• Experience improving production reliability through monitoring, alerting, deployment automation, and incident response
• 7+ years of software engineering experience