Data Engineer

About Creai: At Creai, we specialize in harnessing the power of artificial intelligence and machine learning to transform businesses. Our mission is to help clients reduce costs, increase efficiency, and unlock new opportunities through cutting-edge AI solutions. Position Description: As a Data Engineer, you will be a key technical leader responsible for designing, building, and operating highly complex, scalable, and high-performance data architectures and pipelines. You will lead the integration of diverse data sources and the transformation of large volumes of information to support advanced analytics and artificial intelligence solutions. You will have a significant impact on the technical direction of our data platform, mentoring others and solving the most difficult challenges related to data quality, governance, and efficiency. This Role Requires Leadership in: Data Pipeline Development: Designing and building optimized, scalable code for complex, distributed data pipelines (batch and streaming), applying advanced data design patterns, and promoting best practices. Data Quality and Testing Strategies: Designing and implementing robust testing strategies for pipelines and datasets (including data quality tests), and guiding others in writing high-quality tests. Advanced Debugging and Observability: Debugging complex issues...