Senior Data Engineer (ADB + Spark)
- Back-End
- Preferred from Brazil, Bulgaria, Colombia, Georgia, Hungary, Lithuania, Poland, Romania, Uzbekistan
- 3000 - 5000 USD
- Senior
- Full-Time
- Remote
Job Description
XY DIGITAL is hiring a Senior Data Engineer (ADB + Spark) for an international data modernization initiative involving enterprise-scale transformation. You’ll be working with high-impact technologies like Databricks, Spark, and Azure, contributing to the design and optimization of scalable data systems. The client is a global consulting giant with top-tier standards. If you are passionate about performance, structure, and cloud-native data workflows, this project is for you.
Interview Process
Step 1: Initial HR screening
Step 2: Technical interview with practical tasks or live problem solving
Step 3: Final interview with engineering lead and delivery manager
Start Date: Immediate
Contract: Long-term / Open-ended
Key Responsibilities
Design, build, and maintain high-performing Spark-based data applications
Apply and enforce coding best practices and project-wide standards
Lead code reviews and performance optimization cycles
Collaborate with multi-role teams on technical delivery and infrastructure integration
Maintain documentation, data workflows, and architecture diagrams
Troubleshoot and resolve issues related to data pipeline performance
Guide and mentor other engineers for consistent code quality and scalable practices
Communicate clearly with team members and stakeholders across time zones
Requirements
5+ years of hands-on experience in software or data engineering
In-depth experience with Apache Spark, including Databricks or Azure Synapse/Fabric
Proficient in Python with strong data manipulation using Pandas/Polars
Experience working with Parquet and Delta Tables in production environments
Proven track record in scalable data processing, transformation, and optimization
Strong analytical mindset and attention to detail
Well-organized, self-managing, and comfortable with fast-paced delivery cycles
Ability to prioritize and adapt without losing sight of project goals
Skill & Experience
Experience with Azure SaaS services such as Service Bus, Data Lake, Blob Storage, Redis
Familiarity with FastAPI
Working knowledge of Docker and Kubernetes
Solid grasp of microservices architecture and cloud-based deployment practices
Data Engineering
Apache Spark
Databricks
Azure Synapse / Fabric
Python
Parquet
Delta Tables
Azure Cloud
Docker
Kubernetes
FastAPI