Software Engineer_Data Pipeline / Analyst

Back to Job Listings 日本語の求人票はこちら About Us Macromill is a leading company in the fields of online research and marketing research. We leverage internet-based survey data and consumer purchase behavior insights to help our clients better understand consumer needs and behavior, enabling them to craft more effective marketing strategies. To achieve further growth and transformation, Macromill is revitalizing its systems, building a robust data infrastructure powered by cutting-edge technology to deliver faster and more accurate marketing research solutions, ultimately driving growth for our clients.

To realize this vision, we are actively strengthening our engineering team and are looking for individuals passionate about developing advanced systems and data-driven platforms. We embrace agile development, machine learning, IaC, and other modern technologies, fostering a flexible, dynamic environment for fast and efficient service delivery.

If you’re excited about connecting businesses and consumers through data and driving transformative impact in business, or if you’re eager to take on new technologies and lead system advancements, we invite you to join us in building the future of Macromill.

About the Job

We are looking for a skilled Data Engineer to join our team. The successful candidate will be responsible for building and maintaining scalable data pipelines, ensuring the efficient processing and storage of vast amounts of data. You will work closely with data scientists, analysts, and other stakeholders to design and implement data solutions that drive business value.

Lead the design, development, and optimization of scalable and robust data pipelines to support business intelligence and analytics.・Architect and implement advanced ETL processes to integrate data from various sources into our data warehouse and data lakes. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide strategic data solutions. Ensure the integrity, accuracy, and security of data across all platforms, implementing best practices for data governance and compliance.

Develop and maintain comprehensive documentation for data architecture, processes, and workflows. Mentor and guide junior data engineers, promoting best practices in data engineering. Stay current with emerging trends and technologies in data engineering, and drive continuous improvement initiatives within the team.

Why Join Us

You’ll transform vast, unclean datasets into high-quality, actionable insights that drive business decisions. This is a chance to create value from the very beginning of the data pipeline. As a result-driven team, we embrace experimentation and quick iteration.

You’ll have the freedom to explore new tools and approaches, making rapid adjustments to find the best solutions. This is an ideal environment for anyone passionate about continuously upskilling in a dynamic, large-scale setting. Join a team of experts who are passionate about data and technology.

You'll work alongside data scientists, engineers, and analysts in a collaborative, knowledge-sharing environment. We offer continuous learning opportunities, mentorship, and the chance to grow in a fast-evolving field, expanding both your technical expertise and impact. Your work will help shape the future of market research in Japan, turning raw data into valuable insights that drive strategic decisions for our clients.

As a leader in the field, you’ll have opportunities to represent Macromill at technical engineering events and conferences. This will not only build your personal brand but also elevate the company's presence within the technical community. Application Qualifications Minimum Qualifications Expertise in SQL and relational databases.

Proficiency in programming languages such as Python, Java, or Scala. Strong experience with ETL tools and processes. Deep understanding of cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services.

Familiarity with big data technologies (e.g., Hadoop, Spark). Excellent problem-solving skills and the ability to design and implement innovative data solutions. Strong communication and collaboration skills, with the ability to work effectively across teams and with stakeholders at all levels.

Preferred Qualifications

• Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Knowledge of data visualization tools (e.g., Tableau, Power BI).
• Experience with data modeling and database design.
• Understanding of data privacy regulations and best practices.
• Proven track record of leading data engineering projects and mentoring junior engineers.
• Who are we looking for A collaborative and proactive team player who can thrive in a fast-paced environment.
• A detail-oriented professional with a strong commitment to data accuracy and quality.
• An analytical thinker who can troubleshoot complex data pipeline issues with creative problem-solving.
• A lifelong learner who is enthusiastic about exploring new tools, techniques, and trends in data engineering.
• Someone passionate about transforming raw data into actionable insights that drive real business impact.