Az álláshirdetés lejárt.
Are you an experienced Data Engineer looking for a new challenge? Join us in transforming a large-scale enterprise data warehouse from a legacy PLSQL-based on-premise system into a modern, scalable cloud-based platform using Databricks, Delta Lake, and Azure.
This is a key role in a high-impact migration project, where you’ll help redesign, rebuild, and modernize our data infrastructure using best-in-class cloud technologies.
Key Responsibilities:
- Analyze and migrate an existing on-premise PLSQL-based data warehouse to the cloud using Databricks
- Redesign and implement ETL/ELT pipelines using Apache Spark to serve evolving business needs
- Build and optimize a new architecture based on Delta Lake and the medallion architecture (bronze-silver-gold)
- Integrate structured and semi-structured data from diverse sources (Azure Data Lake, SQL databases, REST APIs, etc.)
- Ensure data quality, security, and compliance (GDPR, RBAC, Data Governance best practices)
- Collaborate closely with BI, data science, and business teams to support data-driven decision-making
- Contribute to architectural decisions, tooling choices, and best practices
- Optionally mentor junior team members
Requirements:
- 4–5+ years of experience in building and maintaining data-driven systems, ideally in enterprise environments
- Strong hands-on experience with Databricks, Apache Spark, and Delta Lake
- Working knowledge of PLSQL to understand and help migrate legacy logic
- Advanced knowledge of Python and SQL
- Experience working in Azure cloud environments (especially Data Lake, Data Factory)
- Familiarity with CI/CD tools (Azure DevOps, GitHub Actions)
- Strong problem-solving skills and systems thinking
- Professional communication skills in English
Nice to Have:
- Experience designing or implementing medallion architectures or Data Lakehouse models
- Familiarity with Airflow or other workflow orchestration tools
- Hands-on experience with data migration projects (e.g., on-prem → cloud)
- Relevant certifications (e.g., Databricks Certified Data Engineer Associate, Microsoft Azure)
What We Offer:
- A technically challenging project focused on modernizing an enterprise data platform
- Work with cutting-edge technologies: Databricks, Spark, Azure, Delta Lake
- Remote work options
- Continuous learning opportunities (certifications, conferences, training)
- Supportive, experienced team and modern engineering culture
- Competitive compensation and benefits package
- Opportunity to work as a contractor (freelance) is also available