Apply for this Job
Job Responsibilities:
Design and Develop using AWS ETL Solutions, Glue, PySpark, Python, etc.
Strong RDBMS skills on PostgreSQL
Should be able to understand existing code and understand the business logic, Integration with other components, DB connections, Other AWS services interactions key failure points etc.
Design solutions to handle large volume of data
Collaborate with other teams to integrate solutions with existing systems
Write clean, maintainable, and efficient code
Troubleshoot and debug issues as they arise
Skills and Experience Required:
Required:
Total 10+ years of experience in design and leading development projects
5+ years of experience in designing and implementing AWS ETL solutions
5+ years of strong experience in Database development with minimum 3 years of experience in PostgreSQL database managing data ingestion, building efficient procedures and functions.
Experience working with Glue, Glue Catalog to initiate the backend processes.
Able to process data using PySpark, Data frame Partitioning, Spark SQL, Dynamic frames, etc.
Working experience in other Python libraries like Panda, XLSWriter.
Working with various file formats like Parquet, Excel, Flat Files, etc.
Ability to recommend design best practices when ingesting data.
Demonstrated ability to process large volumes of data.
Ability to work independently and manage responsibilities.
Experience working in onshore-offshore model.
Excellent verbal, written and interpersonal communication skills.
Desired:
Performance tuning and database optimization experience
Understanding of other AWS Cloud service, such as S3, RDS, Lambda, Security Groups
Experience in other cloud native data technologies (Redshift\Snowflake\Athena etc.)
Knowledge of DevOps tools like Jenkins / Nexus/ JFrog etc.
Financial industry knowledge
This is a remote position.
Date Posted: 09 April 2025
Apply for this Job