We are looking for an experienced Big Data Engineer to strengthen our international team in banking sector. Fluent English is a must, German is an advantage.
Role Description
- Solution Compliance DataMart running Hadoop Cloudera
- DataMart used as a central data hub for various the compliance use cases supporting the identification of the frauds in the customers transactions.
- Logic is written in PySpark and is integration with the surrounding solution via files and via Kafka
Tasks
- Data engineering development brining additional changes into the Compliance DataMart
- Developing new features
- Data preparation
- Supporting data scientists
Requirements
- Experience in ETL implementation
- Cloudera experience is necessary
- Spark
- Bash
