Virtusa
Airflow
Job Description
Mandatory Skills: AWS Data Services, Python, SQL, Data Lake
Secondary Skills: DBT, Airflow, DevOps
JD: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team.
Key Responsibilities:
Design, develop, and maintain scalable data pipelines and systems on AWS.
Implement and manage ETL processes using Python and Apache Airflow.
Develop and execute comprehensive testing plan and test cases to ensure data quality and integrity.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Optimize and troubleshoot data workflows and performance issues.
Document and maintain data architecture, processes, and systems.
Experience in operating Scrumban or POD delivery model.
Required Skills:
Proficiency in AWS services such as S3, Redshift, Lambda, and Glue.
Strong programming skills in Python for data manipulation and automation.
Experience with Apache Airflow for orchestrating complex workflows.
Solid understanding of testing methodologies and tools or python scripting for data validation.
Knowledge of data integration tools such as Talend, Nucleus, or similar.
Knowledge of data transformation tools such as Data Build Tool or Abinito will be an Advantage.
Preferred Qualifications:
Bachelors or Masters degree in Computer Science, Engineering, or a related field.
7+ years of experience in data engineering or a related role.
Experience with big data technologies such as Hadoop, Spark, or Kafka.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills.
AWS Certification
Jobs at Hyderabad
Amazon
Case Mgr (MLOA)[S]
Freshers/Experienced
Hyderabad, Telangana
Last Date: Aug. 19, 2025
Oracle
Software Developer 3
Professional
Hyderabad, Telangana
Last Date: Sept. 21, 2025
Oracle
Principal Applications Engineer, Sa…
Professional
Hyderabad, Telangana
Last Date: Dec. 14, 2025
Amazon
Business Intel Engineer I, GTS Fiel…
Freshers/Experienced
Hyderabad, Telangana
Last Date: Aug. 19, 2025
Amazon
Software Development Engineer II, S…
Freshers/Experienced
Hyderabad, Telangana
Last Date: Aug. 19, 2025
Amazon
ML Data Associate-II
Freshers/Experienced
Hyderabad, Telangana
Last Date: Aug. 19, 2025
Oracle
Senior Applications Engineer
Professional
Hyderabad, Telangana
Last Date: Oct. 16, 2025
Amazon
AI Content Expert
Freshers/Experienced
Hyderabad, Telangana
Last Date: Aug. 19, 2025
Senior Technical Program Manager, D…
Freshers/Experienced
Hyderabad, Telangana
Last Date: Aug. 14, 2025
More Jobs at Virtusa