Databricks Data Engineer and Scientist

Parra Consulting Group (PCG) is seeking a Databricks Data Engineer and Scientist to support a federal client’s critical enterprise Lakehouse. This position designs, builds, and maintains robust data pipelines and applies data science, AI, and analytics skills to turn raw data into actionable insights across the business. This successful candidate will be responsible for the following: Design, build, and maintain robust, end-to-end data pipelines for an enterprise Lakehouse on Databricks and AWS. Develop and manage ETL processes with comprehensive logging and error handling to troubleshoot and resolve issues. Design data models within a Bronze, Silver, and Gold medallion architecture, selecting dimensional or relational approaches as appropriate. Analyze and decompose complex legacy SQL, rebuild pipelines and models, and compare results to validate accuracy and performance. Optimize pipeline performance and scalability using techniques such as partitioning, bucketing, and caching. Use AI-assisted coding tools to accelerate pipeline analysis, data engineering, and data modeling tasks. Help ensure data security and compliance, and collaborate with cross-functional teams to deliver analytics-ready data. Required Qualifications Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Math, Physics, or Information Systems and Technology. 8+ years of experience designing, developing, deploying, and managing ETL processes and data pipelines. Ability to obtain and mai