Srdata Engineer GCP

San Francisco, California

Decision Minds
Apply for this Job
Job Description
Senior Data Engineer(GCP)

About Us:

Decision Minds is an AI-first Data Solutions company specializing in Data Cloud solutions, AI, and Digital Engineering. We work with Fortune 500 companies across technology, financial services, and healthcare, helping them modernize their data platforms, implement AI-driven solutions, and optimize cloud data costs.

Role Overview:

We are seeking a Senior Data Engineer with deep hands-on experience in the Google Cloud Platform (GCP) ecosystem. The ideal candidate will have extensive experience building scalable, high-performance data pipelines and working with structured and semi-structured data, ideally within a security or SaaS product environment.

Key Responsibilities:

• Build and optimize ETL/ELT pipelines using Data flow, BigQuery, Cloud Composer (Airflow), and Pub/Sub.

• Work closely with data architects, product managers, and security analytics teams to enable secure, scalable data flows.

• Integrate data from multiple structured and unstructured sources including APIs, cloud services, and operational databases.

• Optimize query performance and storage for large-scale datasets in BigQuery.

• Automate data workflows, monitoring, and observability pipelines.

• Ensure compliance with data governance, security, and access control standards.

• Participate in code reviews, architecture discussions, and technical leadership sessions.

Required Skills and Experience:

• 7+ years of data engineering experience, with 3+ years on GCP.

• Strong command of Python, SQL, and data pipeline development using Apache Beam / Data flow.

• Proven experience with BigQuery, Cloud Storage, Pub/Sub, Cloud Functions, and Airflow/Cloud Composer.

• Hands-on experience in building robust, scalable, and production-grade pipelines.

• Experience with schema evolution, metadata management, and versioned data lakes.

• Experience working with security, SaaS, or finance data domains is a plus.

• Good understanding of DevOps practices, CI/CD, Git, and Terraform/IaC for data infrastructure.

• Excellent communication skills and ability to work cross-functionally.

Preferred Qualifications:

• GCP Professional Data Engineer certification.

• Familiarity with Tableau, Looker or other BI tools built on BigQuery.

• Knowledge of data privacy regulations (GDPR, CCPA) and secure data engineering practices.

Work Environment:

• Must be able to work onsite in Santa Clara, CA at least 3 days a week.

• Fast-paced, enterprise-scale environment with high visibility projects.

• Collaborative culture with strong engineering and product alignment.

Why Join Us?

• Work with a team of industry-leading AI and data professionals.

• Engage with Fortune 500 companies in finance and technology.

• Opportunity to work on cutting-edge data engineering and AI-powered solutions.

• Competitive compensation and benefits package.
Date Posted: 18 May 2025
Apply for this Job