We are looking for a highly skilled and experienced Lead Data Software Engineer to join our collaborative team.

As part of our engineering team, you will lead efforts to design, build, and optimize data pipelines and workflows, enabling our business to deliver innovative financial solutions for our customers across 1,500 branches and online platforms. Your expertise in data engineering, leadership skills, and passion for leveraging cutting-edge technologies will drive meaningful business outcomes, inspire your team, and enhance our data-driven decision-making capabilities.

Responsibilities

• Lead the design and development of ingestion pipelines from multiple sources to raw data storage (e.g., S3) using micro-batch, batch, and streaming processes
• Oversee and improve the implementation of data quality checks, logging, and monitoring frameworks for reliable pipeline operations
• Guide and monitor the transformation of raw data into data products by applying complex business logic and requirements
• Manage and ensure optimal functionality of multiple data feeds to external systems using micro-batch and streaming patterns
• Evaluate, recommend, and propose advancements to the team’s data platform architecture to improve scalability and align with business goals
• Ensure high availability, performance optimization, and reliability of large-scale distributed data systems
• Collaborate with cross-functional teams to deploy and operationalize pipelines, while ensuring seamless integration of data solutions into production environments
• Mentor and provide technical guidance to data engineers, fostering a collaborative and innovative work environment
• Proactively track emerging technologies and industry developments, introducing innovative solutions to enhance team capabilities
• Lead efforts in establishing data governance practices and ensuring compliance with all regulatory and privacy standards
  
  
  

Requirements

• 5+ years of experience as a data engineer, preferably in consumer finance or similar industries involving consumer loans, collections, servicing, optional products, or insurance sales
• 1+ years of relevant leadership experience
• Proven ability to lead and mentor engineering teams, cultivating growth and technical excellence
• Advanced background in math, statistics, computer science, data science, or a related discipline
• Expert-level programming skills in one or more languages such as Snowflake, Java, Scala, Python, or C#
• Extensive production experience with technologies such as HDFS, YARN, Hive, Spark, Kafka, Oozie/Airflow, and containerization tools like Docker/Kubernetes
• Advanced proficiency in data mining and programming tools (e.g., SAS, SQL, R, Python) and database systems including PostgreSQL, Redshift, Snowflake, or Greenplum
• Strong expertise in business intelligence and analytical tools, technologies, and techniques for generating actionable data insights
• Demonstrated history of deploying, managing, and automating scalable data pipelines on cloud platforms, including AWS, with storage and processing tools
• Ability to quickly learn, adapt, and integrate emerging tools and technologies into existing workflows
• Exceptional communication skills, with a strong ability to explain technical concepts and solutions to both technical and non-technical stakeholders
• Deep understanding of performance optimization for large-scale distributed systems and Big Data infrastructures
• Fluency in English, with a proficiency level of B2+ or higher
  
  
  

Nice to have

• AWS certification validating advanced expertise in cloud technologies
• Practical experience with Spark Streaming, Kafka Streaming, or Kafka Connect for real-time, high-throughput data processing
• Hands-on expertise with the ELK Stack (Elasticsearch, Logstash, Kibana) for powerful monitoring and analytics solutions
• Familiarity with NoSQL databases like Cassandra or MongoDB for scalable, non-relational data storage
• Experience with CI/CD tools such as Jenkins or GitLab, along with tools like Jira and Confluence for effective project management and collaboration
  
  
  

We offer

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn