{"id":12390,"date":"2024-12-16T12:02:31","date_gmt":"2024-12-16T12:02:31","guid":{"rendered":"https:\/\/www.whitehattoolbox.com\/jobs\/sr-data-engineer4-yrs-hadoop-scala-python-java-2\/"},"modified":"2024-12-16T12:02:31","modified_gmt":"2024-12-16T12:02:31","slug":"sr-data-engineer4-yrs-hadoop-scala-python-java-2","status":"publish","type":"post","link":"https:\/\/www.whitehattoolbox.com\/jobs\/sr-data-engineer4-yrs-hadoop-scala-python-java-2\/","title":{"rendered":"Sr. Data Engineer(4+ Yrs, Hadoop, Scala, Python, Java"},"content":{"rendered":"<p><b>Company Description<\/b><span class=\"br\"><\/span>Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose &#8211; to uplift everyone, everywhere by being the best way to pay and be paid.<span class=\"br\"><\/span>Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.<span class=\"br\"><\/span><b>Job Description<\/b><span class=\"br\"><\/span>Team Summary<span class=\"br\"><\/span>The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing fraud losses.<span class=\"br\"><\/span>What a Sr Data Engineer does at Visa:<span class=\"br\"><\/span>The Sr Data Engineer will be a member of RSS team in Asia Pacific. The position will be based in Visa&#8217;s Bangalore office.<span class=\"br\"><\/span>The individual will be accountable for supporting and driving the design, development and implementation of analytics-driven strategies as well as high-impact solutions for Visa clients. He\/she will bring in deep expertise from banking and payments with a strong background in data pipelines to solve complex problems and unlock business value.<span class=\"br\"><\/span><b>Responsibilities<\/b><span class=\"br\"><\/span>Experience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark)<span class=\"br\"><\/span>Responsible for the implementation and test of scalable distributed ensuring security, timeliness and quality of data.<span class=\"br\"><\/span>Experience supporting production systems<span class=\"br\"><\/span>Work closely with other engineers and peers to design and develop ETL pipelines<span class=\"br\"><\/span>Work with product managers in understanding and clarifying on the requirements<span class=\"br\"><\/span>Demonstrate inclination towards continuous learning and professional development.<span class=\"br\"><\/span>Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment.<span class=\"br\"><\/span>This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership\/site), with a general guidepost of being in the office 50% or more of the time based on business needs.<span class=\"br\"><\/span><b>Qualifications<\/b><span class=\"br\"><\/span><b>Basic Qualifications<\/b><\/p>\n<ul>\n<li>2 or more years of work experience with a Bachelor&#8217;s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)<\/li>\n<\/ul>\n<p><b>Preferred Qualifications<\/b><\/p>\n<ul>\n<li>5+ yrs. work experience with a Bachelor&#8217;s degree or 4+ Master&#8217;s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.<\/li>\n<li>Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)<\/li>\n<li>Experience in writing Spark and Hive code to process large data sets in Hadoop environments<\/li>\n<li>Strong experience with SQL for extracting, aggregating, and processing big data using Hadoop<\/li>\n<li>Development experience in one or more of the following: Scala, Python or Java.<\/li>\n<li>Basic experience with Unix\/Shell or Python scripting<\/li>\n<li>Exposure to Scheduling tools like Airflow and Control &#8211; M will be a plus<\/li>\n<li>Experience using VCS like Git<\/li>\n<li>Basic understanding of RDBMs viz, MS SQL, DB2, Oracle, etc for data retrieval<\/li>\n<li>Understanding of Kafka, Apache Hudi is a plus.<\/li>\n<\/ul>\n<p><b>Additional Information<\/b><br \/>\n       Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.<span class=\"br\"><\/span><b>Additional Information<\/b><span class=\"br\"><\/span>Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.<\/p>\n<p><center><b><a rel=\"nofollow noopener\" href=\"https:\/\/www.careerjet.co.in\/jobad\/in9ab29787117d8cf9aeaec4eb0b431953?affid=0852fd5db5a52cbcd75bf945aa534932\" class=\"button purchase\" target=\"_blank\">Apply Now<\/a> <\/b><\/center><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[148],"tags":[],"class_list":["post-12390","post","type-post","status-publish","format-standard","hentry","category-python-jobs"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":116395,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/data-engineer-2023-2024-graduate-java-python-and-spark-hadoop-sql\/","url_meta":{"origin":12390,"position":0},"title":"Data Engineer &#8211; 2023\/2024 Graduate (Java\/python AND Spark\/Hadoop, SQL)","author":"Admin","date":"September 18, 2025","format":false,"excerpt":"Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and\u2026","rel":"","context":"In &quot;IT Jobs&quot;","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-gulf-countries\/jobs-in-uae\/it-jobs-jobs-in-uae\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":104858,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/director-data-engineering-15-years-experience-skills-python-hadoop-spark-kafka-genai\/","url_meta":{"origin":12390,"position":1},"title":"Director &#8211; Data Engineering (15+ years&#8217; experience, Skills: &#8211; Python, Hadoop, Spark, Kafka, GenAI)","author":"Admin","date":"August 15, 2025","format":false,"excerpt":"Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and\u2026","rel":"","context":"In &quot;IT Jobs&quot;","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-gulf-countries\/jobs-in-uae\/it-jobs-jobs-in-uae\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":104572,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/data-engineer-0-5-1-5-yrs-of-experience-in-sql-python\/","url_meta":{"origin":12390,"position":2},"title":"Data Engineer (0.5 &#8211; 1.5 yrs of experience in SQL, Python)","author":"Admin","date":"August 14, 2025","format":false,"excerpt":"Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and\u2026","rel":"","context":"In &quot;IT Jobs&quot;","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-gulf-countries\/jobs-in-uae\/it-jobs-jobs-in-uae\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":104574,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/staff-sw-engineer-java-or-python-opensearch-2\/","url_meta":{"origin":12390,"position":3},"title":"Staff SW Engineer &#8211; Java OR Python, OpenSearch","author":"Admin","date":"August 14, 2025","format":false,"excerpt":"Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and\u2026","rel":"","context":"In &quot;IT Jobs&quot;","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-gulf-countries\/jobs-in-uae\/it-jobs-jobs-in-uae\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":127929,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-staff-sw-engineer-golang-full-stack-cybersecurity-ai-2\/","url_meta":{"origin":12390,"position":4},"title":"We\u2019re Hiring Staff SW Engineer (Golang Full Stack) \u2013 Cybersecurity AI","author":"Admin","date":"December 18, 2025","format":false,"excerpt":"Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and\u2026","rel":"","context":"In &quot;Golang Jobs&quot;","block_context":{"text":"Golang Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/software-development\/golang-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":128386,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-staff-sw-engineer-golang-full-stack-cybersecurity-ai-3\/","url_meta":{"origin":12390,"position":5},"title":"We\u2019re Hiring Staff SW Engineer (Golang Full Stack) \u2013 Cybersecurity AI","author":"Admin","date":"December 19, 2025","format":false,"excerpt":"Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and\u2026","rel":"","context":"In &quot;Golang Jobs&quot;","block_context":{"text":"Golang Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/software-development\/golang-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pg9e9d-3dQ","_links":{"self":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/12390","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/comments?post=12390"}],"version-history":[{"count":0,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/12390\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/media?parent=12390"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/categories?post=12390"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/tags?post=12390"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}