Scale Engineer

Senior Data Engineer, Data and AI, Customer Data Platform

Data Engineer · Senior · Full Time

SG - SingaporeSGD 130k – 180k1w ago
Apply for this role

Opens Airwallex's application page

Role

What you'll do.

Senior Data Engineer role at Airwallex building scalable ETL pipelines and data foundations for the Customer Data Platform. This position requires 5+ years of experience with batch and streaming data technologies, expertise in SQL, data warehousing, and data modeling, plus practical AI knowledge to support analytics, machine learning, and operational decision-making across a globally distributed fintech organization.

Responsibilities

  • Design and Implement Scalable ETL Pipelines: Own end-to-end responsibility for building and maintaining ETL pipelines that handle both batch and real-time data workflows. Use technologies like Databricks, DBT, and Apache Spark to process data at scale while ensuring reliability, performance optimization, and adherence to SLAs. Work with large volumes of customer financial data while maintaining data quality standards and implementing comprehensive monitoring and alerting mechanisms.
  • Architect Data Foundations and Infrastructure: Build robust data warehouses, data consumption platforms, and modern cloud data infrastructure that support multiple downstream use cases. Design systems that enable reliable data access for analytics teams, machine learning engineers, and operational stakeholders. Implement data governance frameworks, access controls, and documentation standards to ensure data trustworthiness across the organization.
  • Develop Advanced Data Models and Products: Create sophisticated data models supporting diverse business requirements including star schemas, snowflake schemas, normalized, and denormalized designs. Build data products that enable operational decision-making, support agentic AI workflows, power machine learning features, and drive business intelligence insights. Collaborate with stakeholders to understand evolving data needs and iterate on models accordingly.
  • Implement Real-Time Streaming Solutions: Develop and optimize streaming data architectures using Apache Kafka, Apache Flink, or similar technologies to enable real-time data availability. Build event-driven data pipelines that support immediate operational decisions and AI-powered actions. Ensure low-latency data delivery while maintaining data consistency and fault tolerance in production environments.
  • Apply Data Engineering and AI Best Practices: Implement industry best practices for data engineering, focusing on code quality, testing frameworks, and documentation. Apply AI and machine learning principles to solve practical business problems in creative and scalable ways. Stay current with emerging data technologies and AI methodologies, contributing to technical strategy and architectural decisions.
  • Collaborate with Distributed Global Teams: Partner with globally distributed engineering, data science, product, and business teams to deliver complex technical initiatives. Provide clear technical communication, mentorship, and knowledge sharing. Lead design discussions, conduct code reviews, and contribute to architectural decisions that impact multiple teams and systems.
  • Ensure Data Quality and Reliability: Implement comprehensive data quality frameworks, testing strategies, and validation mechanisms. Monitor pipeline health, troubleshoot issues, and implement solutions to prevent data inconsistencies. Build automated data quality checks and establish SLAs for data availability and accuracy.

Qualifications

What we look for.

Technical

  • ETL Pipeline Design and Implementation

    Proven expertise designing and implementing scalable ETL pipelines handling both batch and streaming workflows at enterprise scale, with experience optimizing for performance, reliability, and maintainability.

  • Streaming Data Technologies

    Strong hands-on experience with streaming platforms such as Apache Kafka or Apache Flink, including topics like event streaming architecture, partitioning strategies, fault tolerance, and real-time data delivery.

  • SQL and Database Management

    Advanced SQL proficiency including complex queries, query optimization, window functions, and CTEs. Deep understanding of relational database management systems, indexing strategies, and performance tuning.

  • Data Warehousing Architecture

    Comprehensive knowledge of data warehouse design, including dimensional modeling approaches, slowly changing dimensions (SCDs), incremental loading strategies, and query optimization for analytical workloads.

  • Data Modeling and Schema Design

    Expert-level understanding of data schemas including star schemas, snowflake schemas, normalized designs for transactional systems, and denormalized designs for analytical systems. Ability to select appropriate approaches based on use case requirements.

  • Cloud Data Platforms

    Experience with modern cloud data infrastructure, particularly Google Cloud Platform data services, including BigQuery, Cloud Storage, and data integration tools. Understanding of cloud-native data architecture patterns.

  • Data Processing Frameworks

    Proficiency with Apache Spark, DBT (Data Build Tool), and similar frameworks for building reproducible, maintainable data transformation pipelines. Experience with distributed processing concepts and optimization techniques.

  • AI and Machine Learning Fundamentals

    Understanding of AI/ML concepts and ability to apply data engineering principles to support machine learning workflows, including feature engineering, data preparation, and pipeline orchestration for model training and inference.

Education

  • Bachelor's Degree in Computer Science, Information Systems, or Related Field

    A bachelor's degree or higher qualification in Computer Science, Information Systems, Mathematics, Engineering, Statistics, or a closely related discipline. Advanced degrees such as Master's are a plus but not required.

Experience

  • 5+ Years Data Engineering Experience

    Minimum five years of professional experience in data engineering, designing and implementing ETL pipelines, data warehousing, or related data infrastructure roles at technology companies or organizations with significant data complexity.

  • Batch and Streaming Pipeline Development

    Demonstrated experience building both batch processing pipelines for periodic data processing and streaming pipelines for real-time data ingestion and processing in production environments.

  • Cross-Functional Collaboration

    Proven ability to work effectively with distributed teams across geographies, time zones, and organizational functions. Experience partnering with analytics, data science, engineering, and business stakeholders to understand and implement data requirements.

  • Problem-Solving and Attention to Detail

    Strong analytical capabilities with a track record of identifying root causes, proposing scalable solutions, and implementing robust fixes. Demonstrated attention to data accuracy, consistency, and quality in complex systems.

Skills

Required

  • SQL

    Advanced SQL for complex data transformations, query optimization, and analytical queries. Must be comfortable writing efficient queries against large datasets and understanding execution plans.

  • Apache Spark

    Hands-on proficiency with Spark for distributed data processing, including RDDs, DataFrames, and Spark SQL. Experience optimizing Spark jobs for performance and cost efficiency.

  • Apache Kafka or Apache Flink

    Production experience with Kafka for event streaming architectures or Flink for complex stream processing, including handling backpressure, state management, and exactly-once semantics.

  • Data Warehouse Design

    Expertise in designing data warehouses and implementing dimensional models, understanding slowly changing dimensions, fact and dimension tables, and analytical query optimization patterns.

  • DBT (Data Build Tool)

    Experience using DBT for building modular, version-controlled data transformation pipelines. Knowledge of documentation, testing, and best practices for managing data models as code.

  • Cloud Platforms (GCP, AWS, or Azure)

    Hands-on experience with cloud data services on at least one major platform, such as Google Cloud Platform (BigQuery, Dataflow), AWS (Redshift, Glue), or Azure (Synapse, Data Factory).

  • Data Modeling

    Strong ability to design data schemas using star schema, snowflake schema, normalized, and denormalized approaches based on specific business and technical requirements.

  • Debugging and Troubleshooting

    Expert-level ability to diagnose and resolve data pipeline issues, analyze logs, and implement monitoring and alerting for production data systems.

Preferred

  • Databricks

    Nice to have

    Experience with Databricks for unified data analytics and AI, including Delta Lake for ACID transactions, and using Databricks as a collaborative platform for data engineers, data scientists, and analysts.

  • Apache Airflow

    Nice to have

    Familiarity with Airflow for workflow orchestration, DAG management, and scheduling complex data pipelines across distributed systems.

  • Google Cloud Platform Expertise

    Nice to have

    Deep knowledge of GCP data services including BigQuery, Cloud Storage, Pub/Sub, Dataflow, and understanding of GCP's ecosystem for modern data infrastructure.

  • AI/ML Pipelines

    Nice to have

    Experience building data pipelines that support machine learning workflows, including feature stores, model training data preparation, and inference data pipelines.

  • FinTech or Financial Services Domain Knowledge

    Nice to have

    Background in financial technology, banking, or payments industries, with understanding of financial data models, compliance requirements, and operational considerations specific to financial institutions.

  • Python Programming

    Nice to have

    Proficiency in Python for building custom data processing applications, orchestration scripts, and data quality frameworks.

  • Version Control and CI/CD

    Nice to have

    Experience with Git version control and continuous integration/continuous deployment practices for data pipelines, ensuring code quality and reliable deployments.

  • Global Team Collaboration

    Nice to have

    Proven experience working with geographically distributed teams, managing asynchronous communication, and contributing to global technical initiatives.

Tech stack

Languages

SQLPython

Frameworks

Apache SparkDBT (Data Build Tool)Apache KafkaApache Flink

Databases

Google BigQueryDelta LakeRelational Databases (PostgreSQL, MySQL, Oracle)

Tools

DatabricksApache AirflowGoogle Cloud Platform (GCP)Git and Version Control

Other

Data Modeling TechniquesReal-Time Data ArchitectureData Governance and QualityPipeline Monitoring and Observability

Compensation

Pay and benefits.

Base·SGD 130,000 – 180,000

Equity·Stock options

Benefits

  • Equity Compensation

    Stock options or equity grants as part of the comprehensive compensation package, aligning employee interests with company growth as Airwallex scales its fintech operations globally.

  • Professional Development

    Access to training, conferences, and continuing education opportunities to stay current with emerging data technologies, cloud platforms, and AI/ML advancements in the data engineering field.

  • Collaborative Work Environment

    Five days per week in Airwallex's modern Singapore office with world-class facilities, fostering collaboration across the globally distributed 2,300+ person team and providing access to leadership and cross-functional partners.

  • Career Growth Opportunities

    Opportunities to advance within a rapidly growing fintech organization with clear paths to staff engineer, technical lead, or management roles. Exposure to cutting-edge financial technology and AI applications.

  • Diverse Project Exposure

    Work on high-impact projects supporting 675,000+ businesses including McLaren Racing, Qantas, SHEIN, and TikTok. Experience building infrastructure for global commerce and real-time financial operations.

  • Global Impact

    Contribute to regulated financial infrastructure spanning North America, Europe, the Middle East, and Asia-Pacific. Work on systems processing billions in cross-border transactions affecting millions of users globally.

Full posting

Original listing.

About Airwallex

Airwallex is the AI-native financial operating system for a real-time, intelligent economy. More than 675,000 businesses, including McLaren Racing, Qantas, SHEIN, and TikTok, use us, directly or through our platform partners, to run their financial operations or build and monetize financial products of their own.

We started in Melbourne in 2015 to build the infrastructure global commerce runs on. We're the regulated backbone behind global payments: not by accident, but by design. A decade plus, 85+ licenses, and a financial infrastructure spanning North America, Europe, the Middle East, and Asia-Pacific.

We're co-headquartered in San Francisco and Singapore, with more than 2,300 people across 27 offices. We hire builders with founder-level energy, people who move fast with good judgment, dig in with real curiosity, and make calls from first principles rather than waiting to be told what to do. Read our operating principles to see it in full.

 

How you'll make impact

You'll build the data foundations that power Airwallex's Customer Data Platform, helping teams turn customer information into trusted, reusable data for analytics, machine learning, operational decision-making, and practical AI applications.

  • Own scalable ETL pipelines across batch and real-time workflows, using technologies such as Databricks, DBT, and Spark

  • Build reliable data foundations across data warehouses, data consumption platforms, and modern cloud data infrastructure

  • Develop data models and data products that support operational needs, agentic workflows, machine learning, and business intelligence including star, snowflake, normalised, and denormalised designs

  • Apply data engineering and AI best practices to solve practical problems in creative and scalable ways

  • Partner with globally distributed teams to deliver complex technical work with strong problem-solving, attention to detail, communication, and collaboration

This is an in-office role — you'll be in our Singapore office five days a week.

What we're looking for

Essentials

  • A bachelor’s degree or higher in Computer Science, Information Systems, Mathematics, or a related field

  • At least five years of experience designing and implementing scalable ETL pipelines, including batch and streaming workflows

  • Experience with streaming technologies such as Apache Kafka or Apache Flink

  • Strong proficiency in SQL, database management systems, data warehousing, and data modelling for business intelligence, machine learning, and operational needs

  • Solid understanding of data schemas, including star, snowflake, normalised, and denormalised designs

  • Excellent analytical and problem-solving abilities, attention to detail, and effective communication and collaboration skills

  • An understanding of AI and an interest in applying data engineering and AI in practical and creative ways

Preferred

  • Familiarity with Google Cloud Platform and modern data infrastructure tools, including Databricks and Airflow

  • Experience working with globally distributed teams

Learn more about your team

The Customer Data Platform team is building Airwallex’s trusted customer-data foundation—unifying customer entities, signals and metrics so that teams, products and AI systems can make better decisions and take action.

 
 

Applicant Safety Policy: Fraud and Third-Party Recruiters

To protect you from recruitment scams, please be aware that Airwallex will not ask for bank details, sensitive ID numbers (i.e. passport), or any form of payment during the application or interview process. All official communication will come from an @airwallex.com email address. Please apply only through careers.airwallex.com or our official LinkedIn page.

Airwallex does not accept unsolicited resumes from search firms/recruiters. Airwallex will not pay any fees to search firms/recruiters if a candidate is submitted by a search firm/recruiter unless an agreement has been entered into with respect to specific open position(s). Search firms/recruiters submitting resumes to Airwallex on an unsolicited basis shall be deemed to accept this condition, regardless of any other provision to the contrary.

Equal opportunity

Airwallex is proud to be an equal opportunity employer. We value diversity and anyone seeking employment at Airwallex is considered based on merit, qualifications, competence and talent. We don’t regard color, religion, race, national origin, sexual orientation, ancestry, citizenship, sex, marital or family status, disability, gender, or any other legally protected status when making our hiring decisions. If you have a disability or special need that requires accommodation, please let us know.

Apply for this position

Redirects to Airwallex's application page.

Other roles

More at Airwallex.

View all 103 roles