Senior Data Engineer

Job Description

Job Description What is the opportunity? Compliance is a team within Global Functions Technology that deals with trading and employee surveillance, privacy, and risk governance. This position is within the Compliance Technology area of GFT. This role will focus on building high-performance big data applications and analytics platforms. What will you do? Develop expertise in the trade surveillance data infrastructure and application portfolio Design and implement scalable data pipelines, ETL processes, and data integration solutions Build and optimize data models and database schemas to support business analytics and reporting needs Collaborate with cross-functional teams to gather requirements and translate them into technical data solutions Implement data quality frameworks and monitoring to ensure data accuracy and reliability Provide technical guidance on data architecture, best practices, and emerging technologies Support production data systems and troubleshoot data-related issues Document data processes, pipelines, and system architecture What do you need to succeed? Must have: 5 years of hands-on development experience with big data technologies, specifically Spark, Scala, and distributed computing frameworks Strong programming skills in Scala and Python with experience building production-grade applications Proven experience working with big data platforms such as Databricks, Snowflake, or Hadoop ecosystem Knowledge of streaming technologies (Kafka, Spark Streaming) and event-driven architectures Familiarity with AI-assisted development workflows, including prompt engineering for code generation and the ability to critically evaluate AI-generated code for correctness and security Solid understanding of data structures, algorithms, and performance optimization for large-scale data processing Experience with version control, testing frameworks, and CI/CD practices in a collaborative development environment Nice-to-have : Experience with kdb or time-series databases for financial data Familiarity with containerization and cloud-native development (Docker, Kubernetes) Capital Markets/Wealth management and/or regulatory/compliance domain knowledge What’s in it for you? We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual. A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable Leaders who support your development through coaching and managing opportunities Ability to make a difference and lasting impact Work in a dynamic, collaborative, progressive, and high-performing team A world-class training program in financial services Flexible work/life balance options Opportunities to do challenging work #LI-POST #

Required Skills