Cloud Data Engineer
6-12 months
Location: Newark, NJ / Tampa, FL(Hybrid schedule: 3 days onsite, 2 days WFH)
Description
• Bachelors' degree is required in a relevant field.
• 6+ years of experience working in a data engineering role supporting an on-prem Data Lake; experience within institutional asset management is a plus.
• 4+ years of strong experience with working on cloud platforms (AWS, Azure) (CloudFormation Templates, IAM, Aurora, EventBridge, Lambda, CloudWatch);
• 2+ years of experience with Snowflake (SnowSQL, SnowPark)
• 5+ years of experience with any relational database (SQL, Store procedures, functions)
• 5+ years of experience with Python, Spark and SQL programming languages .
• Extensive hands-on experience in modern data lake architecture, database development, and data modeling.
• Knowledge of real-time data streaming and real-time analytics
• Knowledge of Microsoft suite of tools is desired (Power BI, Synapse suite of analytics tools, Azure Data Factory)
• Strong implementation skills and working knowledge of data structures, algorithms and big data tools (Spark, Hadoop, Python, SQL, NoSQL, Hive); Must have hands-on experience using Spark.
• Solid Linux OS and Shell Scripting experience.
• Experience working with big data technologies and data formats (e.g., Parquet, Delta, Iceberg)
• Extensive experience with at least one of the following RDMS: Oracle, SQL Server, Postgres or MySQL.
• Strong communication skills: able to partner with technical and business stakeholders to drive innovative solutions.
• Prior experience using data governance technology tools.
• Prior experience in a lead role is desired but not required.
• Experience working in an agile environment embracing collaboration within and across teams.
• Excellent written and verbal communication skills.
• Detail oriented; Analytical with strong problem-solving abilities.
• Professional and energetic self-starter. Comfortable with ambiguity, able to effectively take the conceptual to the pragmatic.