Our client seeks an
Data Engineer for a long-term project in
Boston, MA . Below is the detailed requirement
Title: Data Engineer
Location : Boston, MA (Remote)
Contract : 12 Months Job Description: Bachelor's degree preferably in Computer Science, Information technology, Computer Engineering, or related IT discipline or equivalent experience with 12+ Minimum Experience
Skills Needed:
- Snowflake cloud data warehouse and AWS S3.
- Strong hands-on SQL skills/ Stored procedures / writing complex queries
- Good knowledge of Data warehousing and all related concepts. Hands on experience in Data Ingestion from different sources
- Candidate must be strong in SQL
- Must have 4 years of Relevant experience in working with Snowflake cloud data warehouse and exposure to AWS S3.
- Implementing SCD Techniques like slowly changing dimensions (type1, type2 and type3).
- Experience in working with AWS S3 and Snowflake cloud data warehouse.
- Good exposure in Snowflake Cloud Architecture and SnowSQL and SNOWPIPE for continuous data ingestion.
- Handling large and complex data sets like JSON, ORC, PARQUET, CSV files from various sources like AWS S3.
- Hands-on experience in bulk loading and unloading data into Snowflake tables.
- Experience in writing complex SQL scripts using Statistical Aggregate functions and Analytical functions to support ETL in snowflake cloud data warehouse.
- Experience with performance tuning of SnowFlake data warehouse with Query Profiler, Caching and Virtual data warehouse scaling
- Knowledge on redshift (Good to have)
- Knowledge on AWS EC2, lambda
- Good to have python