AWS Data Engineer

About the Role

This AWS Data Engineer role involves designing, developing, and maintaining scalable ETL/ELT data pipelines on AWS to ingest, transform, and load data from diverse sources. You will work with AWS Glue, AWS Redshift, and other AWS data services to deliver end-to-end data engineering solutions for analytics, BI, or data science use cases. Your expertise will also be applied to implementing data governance, metadata management, and data cataloging using AWS-native or similar tools.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines on AWS to ingest, transform, and load data from diverse sources.
• Build and optimize data workflows using AWS Glue, ensuring reliability, reusability, and performance of jobs and crawlers.
• Design, implement, and manage data warehousing solutions on AWS Redshift, including schema design, partitioning, and performance tuning.
• Implement data quality checks, validation rules, and monitoring to ensure accuracy, completeness, and consistency of data assets.
• Collaborate with analytics and business teams to understand reporting and BI requirements and translate them into efficient data models and datasets.
• Apply best practices for security, compliance, and governance across AWS data services, including access control and encryption standards.
• Troubleshoot and resolve data pipeline issues, optimize job performance, and proactively improve system reliability and scalability.

Skills & Qualifications

• Deep hands-on experience with AWS Glue, including job orchestration, Glue Studio/Jobs, and integration with other AWS data services.
• Strong experience with AWS Redshift, including cluster management, query optimization, workload management, and cost/performance tuning.
• AWS-related certification (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect, or AWS Certified Developer) is a strong plus.
• Ability to work in cross-functional teams, communicate technical concepts clearly, and mentor junior engineers on AWS data best practices.
• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Knowledge of data governance, metadata management, and data cataloging using AWS-native or similar tools.
• Experience with data quality checks, validation rules, and monitoring to ensure accuracy, completeness, and consistency of data assets.

What You'll Learn

In this role, you will gain hands-on experience with AWS data services, including Glue, Redshift, and other related tools. You will also develop skills in data governance, metadata management, and data cataloging, as well as best practices for security, compliance, and governance. Additionally, you will learn how to design, develop, and maintain scalable ETL/ELT data pipelines on AWS, and how to collaborate with analytics and business teams to understand reporting and BI requirements.

Resume Tip

When applying for this role, make sure to highlight your experience with AWS data services, including Glue and Redshift. Also, be sure to mention any relevant certifications you may have, such as AWS Certified Data Analytics or AWS Certified Solutions Architect. Additionally, emphasize your ability to work in cross-functional teams, communicate technical concepts clearly, and mentor junior engineers on AWS data best practices.