Discover your dream Career
For Recruiters
Synpulse

Senior Data Engineer (Pyspark/Scala)

Synpulse Kuala Lumpur, Malaysia
Posted 4 days ago Permanent Competitive
Are you excited about transforming the way we bank by using the latest technology? We are too!

About the job:
  • Develop processes of the ingestion of data using various programming languages, techniques and tools from systems implemented using Oracle, Teradata, SAP, and Hadoop technology stack.
  • Evaluate and make decisions around dataset implementations designed and proposed by peer engineers.
  • Build large consumer database models for financial planning & analytics including Balance Sheet, PnL, Cost Analytics and Related Ratios.
  • Develop ETL, real time and batch data processes feeding into in-memory data infrastructure.
  • Perform and document data analysis, data validation, and data mapping/design.
  • Work with clients to solve business problems in fraud, compliance and financial crime and present project results.
  • Use emerging and open-source technologies such as Spark, Hadoop, and Scala.
  • Collaborate on scalability issues involving access to massive amounts of data and information.
  • You should be comfortable with working with high profile clients on their sites.
You:
  • Minimum of 10 years of hands-on experience in data engineering.
  • Proficiency in managing large datasets and optimizing performance using Apache Spark (Pyspark/Scala).
  • Working knowledge of both relational (Postgres) and NoSQL databases (preferably Elasticsearch).
  • Experience with Java, Gradle, Docker, Microservices, and TypeScript is considered advantageous.
  • Deep understanding of distributed systems and cloud technologies (AWS, GCP, Azure, etc.).
  • Proven track record in all stages of the software development lifecycle, including requirements analysis, design, architecture, development, testing, deployment, release, and support.
  • Ability to thrive in a dynamic, agile environment, collaborating effectively within a geographically distributed team.
  • Experience in leading a small team of technologists, providing guidance and resolving technical challenges within one's expertise.
We:
  • Want to transform what banking means with you!
  • Are inclusive and diverse
  • Will guide you
  • Are committed to creating a flexible, supportive work environment that helps you effectively manage your work and family commitments
  • Embrace innovate-thinking and entrepreneurship in everything we do
  • Are award winning and known for our commitment to outcomes
  • Apply the latest tech and new ways of working
  • Support your personal growth
Your documents to start the process:
  • Your link to your git/code repo
  • A short summary of you
  • Resume or CV
We look forward to hearing from you soon.
Should you have any queries, feel free to contact our local HR representative.
Our people are our most valuable asset. They drive our growth and anchor our success. They are experts, thought leaders, and trusted partners of our global clients. The Synpulse OneSpirit is reflected in our people and unrivaled culture of collaboration, inclusion, entrepreneurship, and fun. We are good corporate citizen in our communities and we celebrate success together with our Synpulse crypto token. https://player.vimeo.com/video/543018190
Client Serving
Technology Consulting
Experienced Professional
Hybrid
  • Develop processes of the ingestion of data using various programming languages, techniques and tools from systems implemented using Oracle, Teradata, SAP, and Hadoop technology stack.
  • Evaluate and make decisions around dataset implementations designed and proposed by peer engineers.
  • Build large consumer database models for financial planning & analytics including Balance Sheet, PnL, Cost Analytics and Related Ratios.
  • Develop ETL, real time and batch data processes feeding into in-memory data infrastructure.
  • Perform and document data analysis, data validation, and data mapping/design.
  • Work with clients to solve business problems in fraud, compliance and financial crime and present project results.
  • Use emerging and open-source technologies such as Spark, Hadoop, and Scala.
  • Collaborate on scalability issues involving access to massive amounts of data and information.
  • You should be comfortable with working with high profile clients on their sites.
  • Minimum of 10 years of hands-on experience in data engineering.
  • Proficiency in managing large datasets and optimizing performance using Apache Spark (Pyspark/Scala).
  • Working knowledge of both relational (Postgres) and NoSQL databases (preferably Elasticsearch).
  • Experience with Java, Gradle, Docker, Microservices, and TypeScript is considered advantageous.
  • Deep understanding of distributed systems and cloud technologies (AWS, GCP, Azure, etc.).
  • Proven track record in all stages of the software development lifecycle, including requirements analysis, design, architecture, development, testing, deployment, release, and support.
  • Ability to thrive in a dynamic, agile environment, collaborating effectively within a geographically distributed team.
  • Experience in leading a small team of technologists, providing guidance and resolving technical challenges within one's expertise.
Full-time

", "description": "Develop processes of the ingestion of data using various programming languages, techniques and tools from systems implemented using Oracle, Teradata, SAP, and Hadoop technology stack.Evaluate and make decisions around dataset implementations designed and proposed by peer engineers.Build large consumer database models for financial planning & analytics including Balance Sheet, PnL, Cost Analytics and Related Ratios.Develop ETL, real time and batch data processes feeding into in-memory data infrastructure.Perform and document data analysis, data validation, and data mapping/design.Work with clients to solve business problems in fraud, compliance and financial crime and present project results.Use emerging and open-source technologies such as Spark, Hadoop, and Scala.Collaborate on scalability issues involving access to massive amounts of data and information.You should be comfortable with working with high profile clients on their sites.
Job ID  req3042
ABOUT COMPANY
Singapore
716 Employees Consultancy
At Synpulse, our people are our most important asset. For over 25 years, we work closely with our clients across the world as a consulting partner, ...
More Jobs From Synpulse
Synpulse
Junior Data Engineer (Fresh Graduate)
Synpulse
Kuala Lumpur, Malaysia
4 days ago Full time Competitive
Synpulse
Solution Architect (Application Architecture)
Synpulse
Kuala Lumpur, Malaysia
4 days ago Full time Competitive
Synpulse
Backend Engineer (Kotlin)
Synpulse
Kuala Lumpur, Malaysia
4 days ago Full time Competitive
Synpulse
Data Engineer (Quantexa Certified)
Synpulse
Kuala Lumpur, Malaysia
4 days ago Full time Competitive
Synpulse
Talent Acquisition Partner
Synpulse
Singapore
4 days ago Full time Competitive
Synpulse
Talent Acquisition Partner
Synpulse
Hong Kong
4 days ago Full time Competitive
Synpulse
Regional HR Business Partner
Synpulse
Singapore
4 days ago Full time Competitive
Synpulse
Intern - Consultant
Synpulse
Taipei, Taiwan
4 days ago Full time Competitive
Synpulse
Associate Consultant, Data Scientist
Synpulse
Taipei, Taiwan
4 days ago Full time Competitive
Synpulse
Associate Consultant - Banking Technology
Synpulse
Taipei, Taiwan
4 days ago Full time Competitive

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.
Recommended Jobs