Data Engineer

Role Description: "Design and Development: Designing and developing data pipelines for structured, semi-structured, and unstructured data. Data Processing: Implementing data processing solutions using various frameworks for batch, real-time, and event-driven processing. Data Pipeline Management: Managing and maintaining data pipelines, including monitoring, troubleshooting, and ensuring performance. Data Integration: Integrating data from various sources, including databases, cloud platforms, and APIs. Data Warehousing: Building and maintaining data warehouses to store and manage data. Data Quality: Ensuring data accuracy, consistency, and completeness. Collaboration: Collaborating with other teams, including data scientists and analysts, to understand their needs and deliver solutions. Documentation: Providing clear and concise documentation for data pipelines and systems. Monitoring and Maintenance: Monitoring the performance of data pipelines, identifying bottlenecks, and implementing improvements. Required Skills:Programming: Strong proficiency in Python and other relevant programming languages.SQL: Experience with SQL and database management systems.Data Modeling: Understanding of data modeling principles and design.ETL: Experience with ETL processes and tools.Data Warehousing: Knowledge of data warehousing concepts and technologies.Cloud Computing: Familiarity with cloud platforms like AWS, Azure, or GCP.Big Data Technologies: Experience with big data technologies like Hadoop, Spark, or Kafka.Databases: Understanding of various database types and their use cases.Data Analysis: Ability to perform basic data analysis and identify trends.Problem-Solving: Strong analytical and problem-solving skills.Communication: Excellent communication skills to collaborate with other teams. "

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.