Luxoft_Senior Data Engineer / Developer (AWS)
The Senior Data Engineer will design, build, and optimize large-scale data infrastructure, ensuring efficient data collection, processing, and availability to support advanced analytics and data-driven decision-making. Role description: Design ETL/ELT pipelines for network telemetry data Interface with on-premises data collection systems Implement Iceberg table structures, also for time-series data • Optimize data processing for analytics • Manage data quality and lineage • Implement pipeline observability Implement modern data protection strategies Qualifications: 5+ years experience with AWS Glue, S3, Athena, IAM, Lakeformation, Lambda, S3 Tables Apache Iceberg and lakehouse architectures Java (Python, Scala) for data processing Familiarity with data formats (JSON, Avro, Parquet) • Time-series database queires Data processing (Spark, DuckDB, Flink, AirFlow, Prefect) • Graph Theory • Excellent SQL Knowledge • English: B1 Nice to have: • AWS Certifications Originally posted on Himalayas