Data Engineer – Pyspark,Scala,GCP,Python

Job Description:Loc: Trivandrum,Kochi,Bangalore,Chennai,PuneExp : 5-7 YearsNotice Period : Immediate – 30 daysJob DescriptionUST Global® is seeking a highly skilled Data Engineer with expertise in Python – GCP, Scala and Data Science/ML to join our team. This role focuses on developing, testing, and deploying machine learning models, data analytics solutions, and leveraging cutting-edge technologies to drive data-driven decision-making. Strong communication skills are essential for collaborating with both technical teams and business stakeholders.ResponsibilitiesDesign, develop, and deploy scalable machine learning models and advanced analytics solutions.Implement data processing workflows using tools like PySpark and GCP services such as Vertex AI, BigQuery, and DataProc.Perform data exploration, feature engineering, and model evaluation to ensure optimal performance and accuracy.Write clean, maintainable, and efficient code in Python to process and analyze large datasets.Collaborate with cross-functional teams to understand business requirements and translate them into actionable insights.Develop and maintain APIs using FastAPI to integrate machine learning models into production environments.Ensure data quality and consistency through rigorous validation and monitoring processes.Troubleshoot and resolve performance issues in data processing and machine learning workflows.Stay updated on the latest trends and advancements in data science, machine learning, and big data technologies.Skills and QualificationsMandatory Skills:Proven experience as a Data engineer preferably in a big data environment.Strong expertise in Python and hands-on experience in Data Science/ML workflows.Proficiency in PySpark for distributed data processing.Experience with GCP services, including Vertex AI, BigQuery, GCS, and DataProc.Solid understanding of machine learning concepts, algorithms, and best practices.Other Skills:Proficiency in tools like Hive, Spark, and Apache Hudi for big data processing and storage.Familiarity with data visualization tools and techniques.Experience in API development with FastAPI or similar frameworks.Strong problem-solving skills and the ability to work with large, complex datasets in a fast-paced environment.Solid knowledge of data warehousing concepts, data modeling, and schema design.Excellent communication and interpersonal skills to collaborate effectively with diverse teams and stakeholders.Skills:PythonGCPPysparkBigqueryAbout Company:UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.