Apply for this Job
Experience : 12+ Years Duration : Contract Role Passport No & LinkedIn is Mandatory Mandatory Skills: Oil & Gas refinery, Python, Databricks (SQL/Data Engineering), Apache Spark Description: Design, develop, and maintain scalable data pipelines using Python, Databricks, and Apache Spark. Collaborate with data scientists and analysts to understand data requirements and deliver efficient solutions. Implement and optimize ETL processes to ensure data quality and integrity. Develop and maintain SQL queries and scripts for data extraction, transformation, and loading. Monitor and troubleshoot data workflows to ensure high availability and performance. Work with large datasets to perform data cleaning, transformation, and analysis. Stay up-to-date with the latest industry trends and technologies to continuously improve our data infrastructure. Requirements: Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or in a similar role. Strong proficiency in Python programming. Hands-on experience with Databricks and SQL for data engineering tasks. Expertise in Apache Spark for big data processing. Familiarity with cloud platforms such as AWS, Azure, or Google Cloud. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills.
Date Posted: 09 May 2025
Apply for this Job