{"id":112421,"date":"2025-09-06T22:01:22","date_gmt":"2025-09-06T22:01:22","guid":{"rendered":"https:\/\/www.whitehattoolbox.com\/jobs\/consultant-data-engineer-aws-python-spark-databricks-for-etl-agentic-ai-2\/"},"modified":"2025-09-06T22:01:22","modified_gmt":"2025-09-06T22:01:22","slug":"consultant-data-engineer-aws-python-spark-databricks-for-etl-agentic-ai-2","status":"publish","type":"post","link":"https:\/\/www.whitehattoolbox.com\/jobs\/consultant-data-engineer-aws-python-spark-databricks-for-etl-agentic-ai-2\/","title":{"rendered":"Consultant -Data Engineer ( AWS, Python, Spark, Databricks for ETL -Agentic AI"},"content":{"rendered":"

Ready to build the future with AI?<\/span>At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s , our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies\u2019 most complex challenges.<\/span>If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what\u2019s possible, this is your moment.<\/span>Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions \u2013 we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at and on , , , and .<\/span>Inviting applications for the role of Consultant -Data Engineer ( AWS, Python, Spark, Databricks for ETL -Agentic AI!<\/span>In this role, you’ll be part of Genpact’s transformation under GenpactNext, as we lead the shift to Agentic AI Solutions\u2014domain-specific, autonomous systems that redefine how we deliver value to clients. You’ll help drive the adoption of innovations like the Genpact AP Suite in finance and accounting, with more Agentic AI products set to expand across service lines.<\/span>Responsibilities<\/b><\/span>Design, develop, and manage scalable ETL pipelines using AWS Glue, Databricks, Apache Spark, and Python to process structured and unstructured data from diverse sources.<\/span>AWS, Python, Spark, Databricks for ETL-Agentic AI, Strong experience in Python and SQL , Proven expertise in AWS services such as S3, Lambda, Glue, EMR, and Redshift. Strong understanding of security principles and best practices for cloud-based environments. Write clean testable code, engage in code reviews and agile ceremonies<\/span>Build and orchestrate data workflows integrating with services such as AWS Lambda, Step Functions, S3, and Redshift, ensuring high availability and performance.<\/span>Optimize Spark jobs for performance and cost-efficiency across Databricks and AWS Glue environments using partitioning, job bookmarks, and dynamic frame operations.<\/span>Develop and maintain secure data solutions in AWS, leveraging IAM roles, KMS encryption, and VPC-based security to meet compliance and governance standards.<\/span>Migrate legacy ETL jobs and data from on-prem systems to cloud-native architectures on AWS Glue, Redshift, and DynamoDB.<\/span>Implement and monitor data pipeline performance, performing debugging and tuning of Spark jobs to ensure reliable execution and minimal downtime.<\/span>Collaborate in the design and review of technical solutions, translating business requirements and user stories into scalable data engineering architectures.<\/span>Perform unit testing and data validation to ensure functional correctness of pipelines before deployment.<\/span>Lead production deployment and coordinate with release management to ensure seamless delivery of data solutions.<\/span>Recommend cost-effective, secure, and high-performing cloud-based data solutions, reducing manual overhead and operational burden.<\/span>Contribute to backup, disaster recovery, and business continuity strategies for critical data assets.<\/span>Participate in code reviews, technical design discussions, and DevOps integration for CI\/CD of data pipelines using tools like Git, CodePipeline, or Databricks Repos.<\/span>Qualifications we seek in you!<\/span>Minimum Qualifications<\/b><\/span>Experience in designing, implementing data pipelines, build data applications, data migration on AWS<\/span>Strong experience of implementing data lake using AWS services like Glue, Lambda, Step, Redshift<\/span>Experience of Databricks will be added advantage<\/span>Strong experience in Python and SQL<\/span>Proven expertise in AWS services such as S3, Lambda, Glue, EMR, and Redshift.<\/span>Advanced programming skills in Python for data processing and automation.<\/span>Hands-on experience with Apache Spark for large-scale data processing.<\/span>Proficiency in SQL for data querying and transformation.<\/span>Strong understanding of security principles and best practices for cloud-based environments.<\/span>Experience with monitoring tools and implementing proactive measures to ensure system availability and performance.<\/span>Excellent problem-solving skills and ability to troubleshoot complex issues in a distributed, cloud-based environment.<\/span>Strong communication and collaboration skills to work effectively with cross-functional teams.<\/span>Preferred Qualifications\/ Skills<\/span>Master\u2019s Degree-Computer Science, Electronics, Electrical or equivalent<\/span>AWS Data Engineering & Cloud certifications, Databricks certifications<\/span>Experience with multiple data integration technologies and cloud platforms<\/span>Knowledge of Change & Incident Management process<\/span>Why join Genpact?<\/span>Lead AI-first transformation \u2013 Build and scale AI solutions that redefine industries<\/span>Make an impact \u2013 Drive change for global enterprises and solve business challenges that matter<\/span>Accelerate your career\u2014Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills<\/span>Grow with the best \u2013 Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace<\/span>Committed to ethical AI \u2013 Work in an environment where governance, transparency, and security are at the core of everything we build<\/span>Thrive in a values-driven culture \u2013 Our courage, curiosity, and incisiveness – built on a foundation of integrity and inclusion – allow your ideas to fuel progress<\/span>Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.<\/span>Let\u2019s build tomorrow together.<\/span>Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military\/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
\n Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a ‘starter kit,’ paying to apply, or purchasing equipment or training.<\/p>\n

Apply Now<\/a> <\/b><\/center><\/p>\n","protected":false},"excerpt":{"rendered":"

Ready to build the future with AI? At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s , our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and<\/p>\n","protected":false},"author":1,"featured_media":112422,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[20,71,15,148],"tags":[],"class_list":["post-112421","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-it-jobs","category-it-jobs-jobs-in-uae","category-jobs-in-india","category-python-jobs"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.whitehattoolbox.com\/jobs\/wp-content\/uploads\/2025\/09\/112421-consultant-data-engineer-aws-python-spark-databricks-for-etl-agentic-ai.png?fit=%2C&ssl=1","jetpack-related-posts":[{"id":122919,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-lead-consultant-python-developer\/","url_meta":{"origin":112421,"position":0},"title":"We\u2019re Hiring Lead consultant Python Developer","author":"Admin","date":"December 6, 2025","format":false,"excerpt":"Ready to build the future with AI? At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s AI Gigafactory, our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":116393,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/lead-consultant-aws-python-developer\/","url_meta":{"origin":112421,"position":1},"title":"Lead Consultant, AWS Python Developer","author":"Admin","date":"September 18, 2025","format":false,"excerpt":"Ready to build the future with AI? At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s , our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global enterprises\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":142637,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-consultant-python-developer\/","url_meta":{"origin":112421,"position":2},"title":"We\u2019re Hiring Consultant-Python Developer","author":"Admin","date":"February 19, 2026","format":false,"excerpt":"Ready to build the future with AI? At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s AI Gigafactory, our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":143190,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-lead-consultant-python-aws-sql\/","url_meta":{"origin":112421,"position":3},"title":"We\u2019re Hiring Lead Consultant, Python+ AWS+ SQL","author":"Admin","date":"February 20, 2026","format":false,"excerpt":"Ready to build the future with AI? At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s AI Gigafactory, our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":168494,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-assistant-manager-data-management-using-python\/","url_meta":{"origin":112421,"position":4},"title":"We\u2019re Hiring Assistant Manager, Data Management using Python","author":"Admin","date":"March 28, 2026","format":false,"excerpt":"Ready to build the future with AI? At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s AI Gigafactory, our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":168965,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-assistant-manager-data-management-using-python-2\/","url_meta":{"origin":112421,"position":5},"title":"We\u2019re Hiring Assistant Manager, Data Management using Python","author":"Admin","date":"March 29, 2026","format":false,"excerpt":"Ready to build the future with AI? At Genpact, we don\u2019t just keep up with technology\u2014we set the pace. AI and digital innovation are redefining industries, and we\u2019re leading the charge. Genpact\u2019s AI Gigafactory, our industry-first accelerator, is an example of how we\u2019re scaling advanced technology solutions to help global\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pg9e9d-tff","_links":{"self":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/112421","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/comments?post=112421"}],"version-history":[{"count":0,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/112421\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/media\/112422"}],"wp:attachment":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/media?parent=112421"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/categories?post=112421"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/tags?post=112421"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}