Virtusa

Airflow

Job Description

Mandatory Skills: AWS Data Services, Python, SQL, Data Lake

Secondary Skills: DBT, Airflow, DevOps

JD: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team.

Key Responsibilities:

Design, develop, and maintain scalable data pipelines and systems on AWS.

Implement and manage ETL processes using Python and Apache Airflow.

Develop and execute comprehensive testing plan and test cases to ensure data quality and integrity.

Collaborate with cross-functional teams to understand data requirements and deliver solutions.

Optimize and troubleshoot data workflows and performance issues.

Document and maintain data architecture, processes, and systems.

Experience in operating Scrumban or POD delivery model.

Required Skills:

Proficiency in AWS services such as S3, Redshift, Lambda, and Glue.

Strong programming skills in Python for data manipulation and automation.

Experience with Apache Airflow for orchestrating complex workflows.

Solid understanding of testing methodologies and tools or python scripting for data validation.

Knowledge of data integration tools such as Talend, Nucleus, or similar.

Knowledge of data transformation tools such as Data Build Tool or Abinito will be an Advantage.

Preferred Qualifications:

Bachelors or Masters degree in Computer Science, Engineering, or a related field.

7+ years of experience in data engineering or a related role.

Experience with big data technologies such as Hadoop, Spark, or Kafka.

Strong problem-solving skills and attention to detail.

Excellent communication and collaboration skills.

AWS Certification


Jobs at Hyderabad

Amazon

Digital Associate, Ring Data Engine…

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: June 24, 2025

Oracle

Consulting Technical Manager

Professional

Hyderabad, Telangana

View Details

Last Date: Nov. 25, 2025

Capgemini

SAP BTP (CAPM, IS, RAP) | 4 to 12 y…

Experienced Professionals

Hyderabad, Telangana

View Details

Last Date: June 25, 2025

Virtusa

Java - Project Manager

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Oracle

Software Developer 3

Professional

Hyderabad, Telangana

View Details

Last Date: Nov. 25, 2025

Amazon

Support Engineer, Amazon

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: July 1, 2025

Virtusa

Consultant

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Amazon

FinOps Manager - AP (L5), Corporate…

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: June 24, 2025

Amazon

Sr. Supply Chain Manager, ROC India

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: July 1, 2025

Google

Manager, gTech Ads

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: July 3, 2025

Amazon

Software Development Engineer II, A…

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: June 24, 2025

Amazon

SDE2

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: June 24, 2025




More Jobs at Virtusa

Virtusa

Senior Java Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 14, 2025

Virtusa

UI Angular Developer

Full Time

Chennai, Tamil Nadu

View Details

Last Date: June 30, 2025

Virtusa

Datawarehouse - ETL

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

ETL Testing

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Dec. 31, 2025

Virtusa

IOS Lead

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 14, 2025

Virtusa

Azure DevOps

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2025

Virtusa

Project Manager

Full Time

Hyderabad, Telangana

View Details

Last Date: Sept. 30, 2025

Virtusa

Java Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 14, 2025

Virtusa

Senior Consultant

Full Time

Bangalore, Karnataka

View Details

Last Date: Aug. 31, 2025

Virtusa

Angular Frontend Developer

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Virtusa

API Automation

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2025

Virtusa

RPG/400 Developer

Full Time

Pune, Maharashtra

View Details

Last Date: Dec. 31, 2025




Actively Recruiting Companies at Hyderabad, Telangana