Sr Data Engineer GCP

Job Title: Sr Data Engineer

Location: Alpharetta, GA (Hybrid) ( Need Locals only )

Duration: Long Term

Client: Agreeya/Telecommunication

Description:

Working Model: Hybrid- In Office Tuesday and Thursday every week - Local candidates only

This role has got updates after the manager call.

We are looking for SR GCP Data Engineer, local Profiles only.

But These Data Engineers need to be really good with SQL Server Stack and development - SSIS/SSRS.

Some Python is needed for API integrations and Tableau or PowerBI knowledge is desired here.

Do look for - GCP Data Engineer Certification

Responsibilities:

• 10+ years of experience in data engineering.

• Design, develop, and maintain new data capabilities and infrastructure for utilizing Telecommunication, third-party, and partner data to enhance Telecommunication's data products and solutions

• Design, develop, and implement scalable data pipelines and ETL/ELT processes using SSIS, Python and API integrations

• Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation

• Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions

• Work with large datasets, ensuring data quality, accuracy, and performance

• Implement data transformation, integration, and validation processes to support analytics and reporting needs

• Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency

• Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security

• Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes

• Document data processes, data lineage, and technical specifications for future reference

• Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system.

• Develop, build, and implement new data collection systems where needed.

• Provide training and guidance on new systems that are being implemented.

• Participate in code reviews, ensuring adherence to coding standards and best practices

• Collaborate with other teams to automate deployment and monitoring of data pipelines

• Proven experience in data engineering, with a strong track record of designing and implementing data solutions

• Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.)

• In-depth understanding of data warehousing concepts, cloud platforms (GCP), and data modeling techniques

• Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools(SSIS)

• Passion for and engagement with emerging trends in data, AI/Client, analytics, and digital experiences

• Experience in data product development, analytical models, and model governance

• Experience in anonymizing data and managing the use of data

• Experience in data hygiene procedures, identity resolution capabilities or data management a plus

• Familiarity with BI technologies (e.g. Microsoft Power BI, Tableau)

• Ability to create strategies and plans that define how information can be utilized to support an organization's overall business strategy, and how that information and data is organized, and governed inside an organization

• Familiarity with industry best practices for collection and use of data

• Outstanding problem-solving skills and the ability to navigate complex data challenges

• Proven abilities to take initiative and be innovative

• Analytical mind with a problem-solving aptitude

• Effective communication and collaboration skills to work with both technical and non-technical stakeholders

MUST HAVE SKILLS:

Microsoft SQL Server

Microsoft Business Intelligence(SSIS,SSAS & SSRS)

Python

GCP Data Services

Tableau

EDUCATION/CERTIFICATIONS:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field

• Microsoft/Oracle SQL, GCP Data Engineer Certification, Tableau Data Analyst Certification