Python/PySpark Developer 6+ Months (Remote) Frisco, TX Client:- Evolent Health
Implementation: NTT Data
Work location : Frisco, TX (Permanent remote from anywhere in US but the candidate should be able to support CST work hours.
Rate : $75/hour (Please look for 10+ years experienced candidates)
Responsibilities - Design, develop, and deploy scalable data processing pipelines using Python and PySpark.
- Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.
- Write efficient, optimized, and secure code to process, transform, and analyze large volumes of data.
- Implement data ingestion processes from various data sources to the data processing platform.
- Create and maintain data pipelines and workflows for data processing and analytics.
- Perform data quality checks and ensure data integrity throughout the system.
- Troubleshoot and debug production issues to identify and resolve technical problems
- Collaborate with cross-functional teams to ensure seamless integration of data processing applications with other systems.
Requirements - Bachelor's degree in computer science, engineering, or a related field.
- 5+ years of experience in Python development with specific experience in PySpark. and Apache Spark
- 5+ years of experience as a software developer
- Strong to expert proficiency in Python programming language.
- Show expertise in writing and optimizing SQL queries and scripts
- Experience with distributed computing frameworks like PySpark and Apache Spark.
- Hands on experience using Microsoft Fabric in at least one project
- Knowledge of data processing and analytics techniques.
- Experience with data integration and ETL processes.
- Familiarity with data storage and querying systems like SQL and NoSQL databases.
- Understanding of data structures, algorithms, and distributed systems.
- Excellent problem-solving and analytical skills.
- Experience in Healthcare and Health Plan domains and be able to demonstrate domain knowledge to enhance data solutions
- Hands on experience with FHIR
- Technical or Team Lead experience is a plus