Lead Data Engineer

This Jobot Job is hosted by: Isaiah Rosario
Are you a fit? Easy Apply now by clicking the "Apply" button and sending us your resume.
Salary: $150,000 - $190,000 per year

A bit about us:

We are a globally recognized investment advisor manages funds in real assets like natural resources and real estate, with over 4,000 transactions completed since inception. The firm, with around 130 team members across major US and European cities, manages capital for diverse clients worldwide.

Why join us?

• Proven Track Record: The firm has completed over 4,000 transactions since its inception, showcasing its expertise and success in strategic consolidation.
• Global Presence: With offices in major cities across the US and Europe, you'll be part of a diverse and international team.
• Innovative Approach: The firm leverages advanced technologies like AI, machine learning, and data science to identify market opportunities and optimize investment decisions.
• Diverse Clientele: The firm manages capital for a wide range of clients, including pension funds, foundations, endowments, insurance companies, and families worldwide.

Job Details

Responsibilities:

• Lead the design and implementation of data pipelines from extraction (API, scraping, pyodbc) to cleansing/transformation (Python, TSQL) and loading into SQL databases or data lakes.
• Develop and oversee robust data architectures for efficient querying and analytics.
• Collaborate with teams to deploy data solutions meeting business needs.
• Translate business requirements into technical solutions with smooth coordination between engineering and other teams.
• Guide the development of optimized data models for both relational (3NF) and dimensional (Kimball) architectures.
• Create scalable, reliable data models and optimize them for performance and usability.
• Maintain infrastructure for large-scale data solutions using cloud platforms (e.g., Azure) and container technologies (e.g., Docker).
• Utilize modern data platforms such as Snowflake and Fabric effectively in large-scale data solutions.
• Optimize data pipelines using tools like Apache Airflow, Prefect, DBT, and SSIS, ensuring efficiency and reliability.

Requirements:

• 5+ years of experience in data engineering, specializing in the development and maintenance of data pipelines and architectures.
• Proficient in working with large-scale data platforms and cloud environments.
• Strong expertise in relational databases, dimensional data modeling, and cloud-native solutions.
• Skilled in using data engineering tools like Apache Airflow, Prefect, and various cloud storage platforms.
• Exceptional problem-solving abilities, adept at navigating complex technical challenges.

Interested in hearing more? Easy Apply now by clicking the "Apply" button.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.