Data Engineer

Data Engineer

As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support the organization's data needs. You will work closely with data scientists, analysts, and other stakeholders to ensure that data is efficiently collected, stored, processed, and made accessible for analysis and reporting purposes. Your role will involve collaborating with cross-functional teams to understand requirements, identify opportunities for data integration and automation, and implement solutions that drive actionable insights and enable data-driven decision-making.

Key Responsibilities:

Design, develop, and deploy data pipelines and ETL processes to ingest, transform, and load structured and unstructured data from various sources into data storage systems.

Optimize data pipelines for performance, reliability, and scalability, ensuring efficient processing and storage of large volumes of data.

Work with stakeholders to understand data requirements and translate them into technical specifications and solutions.

Implement data quality checks and monitoring to ensure the accuracy, completeness, and integrity of data throughout the pipeline.

Collaborate with data scientists and analysts to provide them with access to high-quality data for analysis and modeling.

Evaluate and integrate new technologies and tools to improve data infrastructure, processing efficiency, and analytics capabilities.

Document data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintainability.

Stay current with industry trends, best practices, and emerging technologies in data engineering and big data processing.

Qualifications:

Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field. Advanced degree preferred.

Proven experience as a Data Engineer or similar role, with a strong background in building and maintaining data pipelines and infrastructure.

Proficiency in programming languages such as Python, Java, Scala, or SQL for data processing and manipulation.

Hands-on experience with big data technologies and frameworks such as Hadoop, Spark, Kafka, and NoSQL databases.

Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., S3, Redshift, BigQuery).

Strong understanding of data modeling, database design principles, and data warehousing concepts.

Excellent problem-solving skills and attention to detail, with the ability to analyze complex data issues and implement effective solutions.

Good communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.

This job description outlines the key responsibilities and qualifications expected from a Data Engineer position. The role plays a critical part in ensuring the organization can effectively manage and leverage its data assets for informed decision-making and business insights.

Axis Group is an Equal Opportunity/Affirmative Action employer. Qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, veteran status, age, marital status, genetic information, or any other protected characteristic under applicable law. All candidates must be legally authorized to work in the United States. Axis Group will not consider Visa Sponsorship for this position.