We are looking for a Sr. Data Analytics Architect will be responsible for designing, implementing, and maintaining data pipelines and infrastructure to support our organization's data-driven decision-making processes. You will work closely with analysts and other stakeholders to ensure data availability, quality, and reliability.
Responsibilities:
- Design, build, and maintain robust data pipelines that extract, transform, and load (ETL) data from various sources into data warehouses or data lakes. These pipelines should be scalable and efficient
- Manage and optimize data warehouses to ensure high performance, availability, and scalability
- Implement best practices for data modeling and schema design
- Integrate data from different systems and sources, ensuring data consistency and accuracy
- Collaborate with cross-functional teams to understand data requirements
- Implement data quality checks and validation processes to identify and rectify data inconsistencies or anomalies
- Ensure data is accurate, complete, and up-to-date
- Optimize data processing and query performance to meet business requirements
- Identify and resolve bottlenecks in data pipelines and database systems
- Implement and maintain data security measures to protect sensitive information
- Follow best practices for data encryption, access control, and compliance with data privacy regulations
- Create and maintain documentation for data pipelines, processes, and data schemas and ensure knowledge sharing within the team
- Set up monitoring and alerting systems to proactively detect and address issues with data pipelines and infrastructure
- Perform troubleshooting and root cause analysis
- Design systems that can scale with growing data volumes
- Automate routine tasks to improve operational efficiency
- Collaborate with analysts, software engineers, and other stakeholders to understand data requirements and deliver solutions that meet their needs
- Stay updated on emerging technologies and tools in the data engineering field
- Evaluate and recommend new technologies that can enhance data processing capabilities
Basic Qualifications:
- Bachelor's degree in computer science, or related field
- Proven 5+ years of experience as a Data Engineer, preferably in a senior or lead role
- Strong programming skills in languages such as Python, Java, or Scala
- Proficiency in SQL and experience with relational and NoSQL databases
- Expertise in data warehousing and ETL processes
- Familiarity with data integration and data modeling concepts
- Knowledge of big data technologies such as Hadoop, Spark, or Kafka is a plus
- Experience with cloud platforms like AWS, Azure, or Google Cloud
- Strong problem-solving and troubleshooting skills
- Excellent communication and collaboration skills