Senior Data Engineer

Join SpotHero, a fast-growing startup, as a Senior Data Engineer. In this role, you will focus on backend application development, building reusable infrastructure services, and influencing technology choices for data-heavy workloads. You will work closely with various teams to understand their data storage and processing needs, design and implement data platform solutions, and ensure system scalability. Enjoy a flexible PTO policy, annual parking stipend, and comprehensive benefits package.

• Contribuer à la conception et à la mise en œuvre de solutions de plateforme de données, de l'infrastructure à l'API.
• Construire des pipelines robustes pour garantir que les données sont disponibles au bon moment et de manière évolutive.
• Collaborer avec les équipes d'analyse, de science des données, de marketing et d'autres équipes pour comprendre leurs besoins en matière de stockage et de traitement des données.

• Demonstrated experience designing and supporting technology intended to be used by other stakeholders
• You are able to design and implement high-quality software in Python
• Strong ability to communicate on both business and technology subjects
• You have experience provisioning and managing infrastructure with infrastructure-as-code tools (we use Terraform, but experience with similar tools like CloudFormation, Pulumi, or SaltStack is totally fine!)
• We care about your abilities, not how you gained them. You might demonstrate the capabilities below through any combination of relevant professional experience, experience in a research setting, formal education, self-guided learning, open source contributions, or public speaking / writing / teaching experience
• Experience with Airflow, Luigi, Prefect, or other ETL scheduling tools
• Experience using SQL to read and manage data
• Experience designing and implementing software (pipelines, services and client libraries) that is run in Docker containers, automatically tested on a continuous integration (CI) system, and versioned in git. You have experience writing shell scripts, Makefiles, or other configuration to glue together these components
• Ability to deploy containerized software in Kubernetes, or sufficient experience in similar technologies like Apache Mesos or Amazon ECS
• Hands-on experience using multiple data platforms and tools (e.g. Airflow, Hive, Kafka, Postgres, Redshift, S3, Spark, Trino, Airbyte), and experience deploying, monitoring, and maintaining at least one of them
• Experience using the latest AI tooling (Claude, Codex, etc.)
• Experience with cloud data pipeline services like dbt Cloud, Airbyte, or Hightouch
• Redshift, Presto, or other MPP database experience
• Experience with at least one JVM language (we use Kotlin, but Java or Scala experience works)
• Postgres, MySQL, or other RDBMS experience
• Message driven or streaming architectures, such as those with Kafka, Spark, Flink