{"id":51890,"date":"2025-03-16T02:59:33","date_gmt":"2025-03-16T02:59:33","guid":{"rendered":"https:\/\/www.whitehattoolbox.com\/jobs\/data-engineer-pysparkscalagcppython\/"},"modified":"2025-03-16T02:59:33","modified_gmt":"2025-03-16T02:59:33","slug":"data-engineer-pysparkscalagcppython","status":"publish","type":"post","link":"https:\/\/www.whitehattoolbox.com\/jobs\/data-engineer-pysparkscalagcppython\/","title":{"rendered":"Data Engineer – Pyspark,Scala,GCP,Python"},"content":{"rendered":"

Job Description:<\/b><\/span>Loc: Trivandrum,Kochi,Bangalore,Chennai,Pune<\/span>Exp : 5-7 Years<\/span>Notice Period : Immediate – 30 days<\/span>Job Description<\/b><\/span>UST Global\u00ae is seeking a highly skilled Data Engineer with expertise in Python – GCP, Scala and Data Science\/ML to join our team. This role focuses on developing, testing, and deploying machine learning models, data analytics solutions, and leveraging cutting-edge technologies to drive data-driven decision-making. Strong communication skills are essential for collaborating with both technical teams and business stakeholders.<\/span>Responsibilities<\/b><\/span>Design, develop, and deploy scalable machine learning models and advanced analytics solutions.<\/span>Implement data processing workflows using tools like PySpark and GCP services such as Vertex AI, BigQuery, and DataProc.<\/span>Perform data exploration, feature engineering, and model evaluation to ensure optimal performance and accuracy.<\/span>Write clean, maintainable, and efficient code in Python to process and analyze large datasets.<\/span>Collaborate with cross-functional teams to understand business requirements and translate them into actionable insights.<\/span>Develop and maintain APIs using FastAPI to integrate machine learning models into production environments.<\/span>Ensure data quality and consistency through rigorous validation and monitoring processes.<\/span>Troubleshoot and resolve performance issues in data processing and machine learning workflows.<\/span>Stay updated on the latest trends and advancements in data science, machine learning, and big data technologies.<\/span>Skills and Qualifications<\/b><\/span>Mandatory Skills:<\/b><\/span>Proven experience as a Data engineer preferably in a big data environment.<\/span>Strong expertise in Python and hands-on experience in Data Science\/ML workflows.<\/span>Proficiency in PySpark for distributed data processing.<\/span>Experience with GCP services, including Vertex AI, BigQuery, GCS, and DataProc.<\/span>Solid understanding of machine learning concepts, algorithms, and best practices.<\/span>Other Skills:<\/b><\/span>Proficiency in tools like Hive, Spark, and Apache Hudi for big data processing and storage.<\/span>Familiarity with data visualization tools and techniques.<\/span>Experience in API development with FastAPI or similar frameworks.<\/span>Strong problem-solving skills and the ability to work with large, complex datasets in a fast-paced environment.<\/span>Solid knowledge of data warehousing concepts, data modeling, and schema design.<\/span>Excellent communication and interpersonal skills to collaborate effectively with diverse teams and stakeholders.<\/span>Skills:<\/b><\/span>Python<\/span>GCP<\/span>Pyspark<\/span>Bigquery<\/span>About Company:<\/b><\/span>UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world\u2019s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients\u2019 organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact\u2014touching billions of lives in the process.<\/p>\n

Apply Now<\/a> <\/b><\/center><\/p>\n","protected":false},"excerpt":{"rendered":"

Job Description: Loc: Trivandrum,Kochi,Bangalore,Chennai,Pune Exp : 5-7 Years Notice Period : Immediate – 30 days Job Description UST Global\u00ae is seeking a highly skilled Data Engineer with expertise in Python – GCP, Scala and Data Science\/ML to join our team. This role focuses on developing, testing, and deploying machine learning models, data analytics solutions, and<\/p>\n","protected":false},"author":1,"featured_media":51891,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[20,71,15,148],"tags":[],"class_list":["post-51890","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-it-jobs","category-it-jobs-jobs-in-uae","category-jobs-in-india","category-python-jobs"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.whitehattoolbox.com\/jobs\/wp-content\/uploads\/2025\/03\/51890-data-engineer-pysparkscalagcppython.png?fit=1306%2C840&ssl=1","jetpack-related-posts":[{"id":167957,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-gcp-data-engineer-with-pyspark-and-python-expertise\/","url_meta":{"origin":51890,"position":0},"title":"We\u2019re Hiring GCP Data Engineer with PySpark and Python Expertise","author":"Admin","date":"March 28, 2026","format":false,"excerpt":"robust, scalable data pipelines on Google Cloud Platform. The ideal candidate will have strong expertise in Python..., Dataproc, and Cloud Storage. \u00b7 Develop high-quality, efficient, and well-documented code in Python and PySpark for data...","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":128355,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-senior-data-engineer-python-pyspark\/","url_meta":{"origin":51890,"position":1},"title":"We\u2019re Hiring Senior Data Engineer – Python & Pyspark","author":"Admin","date":"December 19, 2025","format":false,"excerpt":"The Senior Data Engineer will be responsible for the architecture, design, development, and maintenance of our data platforms, with a strong focus on leveraging Python and PySpark for data processing and transformation. This role requires a strong technical leader who can work independently and as part of a team, contributing\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":115683,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/data-engineer-python-pyspark-3-10-yr-experience\/","url_meta":{"origin":51890,"position":2},"title":"Data Engineer \u2013 Python \/ PySpark | 3-10 yr Experience","author":"Admin","date":"September 16, 2025","format":false,"excerpt":"Job Title: Data Engineer \u2013 Python \/ PySpark Experience: 3 to 10 years Number of Position: 4 Location: Pune (Client - USA) Work Model: Full-time, hybrid work, 3 days\/week in office(Client location.) Job Type: Contract-to-Hire Client Domain: Utilities \/ Energy About the Role We are seeking a highly skilled Data\u2026","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":102436,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/data-engineer-azure-databricks-pyspark-python-airflow\/","url_meta":{"origin":51890,"position":3},"title":"Data Engineer – Azure Databricks, Pyspark, Python, Airflow","author":"Admin","date":"August 7, 2025","format":false,"excerpt":"Collaborate with Data Science team and productionize the ML Models. Participate in a rotational support schedule to provide...Job Description Junior Data Engineer - Azure Databricks, Pyspark, Python, Airflow __Chennai\/Pune India (1- 2 years...","rel":"","context":"In "Data Science Jobs"","block_context":{"text":"Data Science Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/data-science-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":109245,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/python-aws\/","url_meta":{"origin":51890,"position":4},"title":"Python AWS","author":"Admin","date":"August 28, 2025","format":false,"excerpt":"will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java...","rel":"","context":"In "IT Jobs"","block_context":{"text":"IT Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":139143,"url":"https:\/\/www.whitehattoolbox.com\/jobs\/were-hiring-consultant-data-science-analytics\/","url_meta":{"origin":51890,"position":5},"title":"We\u2019re Hiring Consultant Data Science & Analytics","author":"Admin","date":"February 14, 2026","format":false,"excerpt":"What We'll Bring: Key Responsibilities: Design, develop, and deploy machine learning and deep learning models for real-world applications. Analyze large-scale datasets using Spark and SQL to uncover trends and patterns. Collaborate with data engineers, analysts, and business stakeholders to define data-driven strategies. Build and maintain robust data pipelines and model\u2026","rel":"","context":"In "Data Science Jobs"","block_context":{"text":"Data Science Jobs","link":"https:\/\/www.whitehattoolbox.com\/jobs\/category\/jobs-in-india\/it-jobs\/data-science-jobs\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pg9e9d-duW","_links":{"self":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/51890","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/comments?post=51890"}],"version-history":[{"count":0,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/posts\/51890\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/media\/51891"}],"wp:attachment":[{"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/media?parent=51890"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/categories?post=51890"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.whitehattoolbox.com\/jobs\/wp-json\/wp\/v2\/tags?post=51890"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}