{"id":64608,"date":"2025-04-20T09:59:07","date_gmt":"2025-04-20T09:59:07","guid":{"rendered":"https:\/\/www.whitehattoolbox.com\/jobs\/in-senior-associate_spark-pyspark-azure-_data-analytics_advisory_bangalore\/"},"modified":"2025-04-20T09:59:07","modified_gmt":"2025-04-20T09:59:07","slug":"in-senior-associate_spark-pyspark-azure-_data-analytics_advisory_bangalore","status":"publish","type":"post","link":"https:\/\/www.whitehattoolbox.com\/jobs\/in-senior-associate_spark-pyspark-azure-_data-analytics_advisory_bangalore\/","title":{"rendered":"IN-Senior Associate_Spark, Pyspark, Azure _Data &#038; Analytics_Advisory_Bangalore"},"content":{"rendered":"<p>Line of Service Advisory<span class=\"br\"><\/span>Industry\/Sector Not Applicable<span class=\"br\"><\/span>Specialism Data, Analytics &#038; AI<span class=\"br\"><\/span>Management Level Senior Associate<span class=\"br\"><\/span>Job Description &#038; Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.<span class=\"br\"><\/span>In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.<span class=\"br\"><\/span>*Why PWC<span class=\"br\"><\/span>At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more .<span class=\"br\"><\/span>At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm\u2019s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. &#8220;<span class=\"br\"><\/span><b>Responsibilities:<\/b><span class=\"br\"><\/span>Design, develop, and optimize data pipelines and ETL processes using PySpark or Scala to extract, transform, and load large volumes of structured and unstructured data from diverse sources.<span class=\"br\"><\/span>Implement data ingestion, processing, and storage solutions on Azure cloud platform, leveraging services such as Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics.<span class=\"br\"><\/span>Develop and maintain data models, schemas, and metadata to support efficient data access, query performance, and analytics requirements.<span class=\"br\"><\/span>Monitor pipeline performance, troubleshoot issues, and optimize data processing workflows for scalability, reliability, and cost-effectiveness.<span class=\"br\"><\/span>Implement data security and compliance measures to protect sensitive information and ensure regulatory compliance.<span class=\"br\"><\/span><b>Requirement<\/b><span class=\"br\"><\/span>Proven experience as a Data Engineer, with expertise in building and optimizing data pipelines using PySpark, Scala, and Apache Spark.<span class=\"br\"><\/span>Hands-on experience with cloud platforms, particularly Azure, and proficiency in Azure services such as Azure Databricks, Azure Data Lake Storage, Azure Synapse Analytics, and Azure SQL Database.<span class=\"br\"><\/span>Strong programming skills in Python and Scala, with experience in software development, version control, and CI\/CD practices.<span class=\"br\"><\/span>Familiarity with data warehousing concepts, dimensional modeling, and relational databases (e.g., SQL Server, PostgreSQL, MySQL).<span class=\"br\"><\/span>Experience with big data technologies and frameworks (e.g., Hadoop, Hive, HBase) is a plus.<span class=\"br\"><\/span>Mandatory skill sets:<span class=\"br\"><\/span>Spark, Pyspark, Azure<span class=\"br\"><\/span><b>Preferred skill sets:<\/b><span class=\"br\"><\/span>Spark, Pyspark, Azure<span class=\"br\"><\/span>Years of experience required:<span class=\"br\"><\/span>4 &#8211; 8<span class=\"br\"><\/span><b>Education qualification:<\/b><span class=\"br\"><\/span>B.Tech \/ M.Tech \/ MBA \/ MCA<span class=\"br\"><\/span>Education (if blank, degree and\/or field of study not specified) Degrees\/Field of Study required: Master of Engineering, Master of Business Administration, Bachelor of Technology<span class=\"br\"><\/span>Degrees\/Field of Study preferred:<span class=\"br\"><\/span>Certifications (if blank, certifications not specified)<span class=\"br\"><\/span>Required Skills PySpark<span class=\"br\"><\/span>Optional Skills Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Analytical Thinking, Apache Hadoop, Azure Data Factory, Communication, Creativity, Data Anonymization, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling, Data Pipeline, Data Quality, Data Transformation, Data Validation {+ 18 more}<span class=\"br\"><\/span>Desired Languages (If blank, desired languages not specified)<span class=\"br\"><\/span>Travel Requirements Not Specified<span class=\"br\"><\/span>Available for Work Visa Sponsorship? No<span class=\"br\"><\/span>Government Clearance Required? No<span class=\"br\"><\/span>Job Posting End Date<\/p>\n<p><center><b><a rel=\"nofollow noopener\" href=\"https:\/\/www.careerjet.co.in\/jobad\/in3f776c113b7081dbce279fe7f48c759b?affid=0852fd5db5a52cbcd75bf945aa534932\" class=\"button purchase\" target=\"_blank\">Apply Now<\/a> <\/b><\/center><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Line of Service Advisory Industry\/Sector Not Applicable Specialism Data, Analytics &amp; AI Management Level Senior Associate Job Description &amp; Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into<\/p>\n","protected":false},"author":1,"featured_media":64609,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[15,24],"tags":[],"class_list":["post-64608","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-jobs-in-india","category-mba-jobs"],"jetpack_publicize_connections":[],"jetpack-related-posts":[{"id":115151,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/etic-fabric-data-engineer-senior-associate\/","url_meta":{"origin":64608,"position":0},"title":"ETIC, Fabric Data Engineer &#8211; Senior Associate","author":"Admin","date":"September 14, 2025","format":false,"excerpt":"Line of Service Advisory Industry\/Sector Technology Specialism Advisory - Other Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologi...","rel":"","context":"In &quot;Jobs In Egypt&quot;","block_context":{"text":"Jobs In Egypt","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-gulf-countries\/jobs-in-egypt\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":111535,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/in_senior-associate_-aws-data-engineer_da_advisory_pan-india\/","url_meta":{"origin":64608,"position":1},"title":"IN_Senior Associate_ AWS Data Engineer_D&#038;A_Advisory_PAN India","author":"Admin","date":"September 4, 2025","format":false,"excerpt":"Line of Service Advisory Industry\/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role\u2026","rel":"","context":"In &quot;Jobs in India&quot;","block_context":{"text":"Jobs in India","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":110788,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/in_senior-associate_data-scientist-_da_advisory_pan-india\/","url_meta":{"origin":64608,"position":2},"title":"IN_Senior Associate_Data Scientist _D&#038;A_Advisory_PAN India","author":"Admin","date":"September 2, 2025","format":false,"excerpt":"Line of Service Advisory Industry\/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role\u2026","rel":"","context":"In &quot;Jobs in India&quot;","block_context":{"text":"Jobs in India","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":106147,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/in-senior-associate_pmo_data-analytics_advisory_pan-india-2\/","url_meta":{"origin":64608,"position":3},"title":"IN-Senior Associate_PMO_Data &#038; Analytics_Advisory_PAN India","author":"Admin","date":"August 19, 2025","format":false,"excerpt":"Line of Service Advisory Industry\/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their\u2026","rel":"","context":"In &quot;Data Science Jobs&quot;","block_context":{"text":"Data Science Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/data-science-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":100209,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/in_manager_qliksense-developer_data-and-analytics_advisory_mumbai\/","url_meta":{"origin":64608,"position":4},"title":"IN_Manager_Qliksense Developer_Data and Analytics_Advisory_Mumbai","author":"Admin","date":"July 31, 2025","format":false,"excerpt":"Line of Service Advisory Industry\/Sector Not Applicable Specialism Data, Analytics & AI Management Level Manager... Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...","rel":"","context":"In &quot;Data Science Jobs&quot;","block_context":{"text":"Data Science Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/data-science-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":126813,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-in-senior-associate_node-fs-developer_data-analytics_advisory_pan-india\/","url_meta":{"origin":64608,"position":5},"title":"We\u2019re Hiring IN-Senior Associate_Node FS Developer_Data &#038; Analytics_Advisory_PAN India","author":"Admin","date":"December 11, 2025","format":false,"excerpt":"Line of Service Advisory Industry\/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their\u2026","rel":"","context":"In &quot;IT Jobs&quot;","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pg9e9d-gO4","jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.whitehattoolbox.com\/jobs\/wp-content\/uploads\/2025\/04\/64608-in-senior-associate-spark-pyspark-azure-data-analytics-advisory-bangalore.png?fit=%2C&ssl=1","_links":{"self":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/64608","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/comments?post=64608"}],"version-history":[{"count":0,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/64608\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/media\/64609"}],"wp:attachment":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/media?parent=64608"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/categories?post=64608"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/tags?post=64608"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}