Data Engineer

Role- Data Engineer

Location- Lewisville, TX (On-site)

Type: Contract

IMP Tech Mahindra and end Client Paccar

Responsibilities

Ideal candidate should have below matching experience from Data Engineering in Real Time data streaming assignments using

AWS Component stack AWS-Kinesis,FarGate /AWS-S3/AWS-EventBridge/AWS-SQS/SNS & Confluent KAFKA

Responsibilities:

Build and document automated data pipelines from a wide range of data sources with an emphasis on automation and scale: Handled large streaming data set (volume / size) and performed initial Data Pattern identification with AWS-Kinesis.

Develop highly available applications and APIs to support near-real-time integrations using an AWS-based technology stack: Designed and developed REST APIs as prototype to support near-real-time vehicle / any other domain based data using SWAGGER and presented the design to the business stakeholders. Converted the prototypes to full scale development using AWS technology stack such as AWS-Event Bridge, AWS-SQS, AWS-SNS & Confluent-KAFKA.

Ensure product and technical features are delivered to spec and on-time in a DevOps fashion: Authored "Software-Design-Specification" based on Product Feature requirement & user stories, implemented within agile-sprint cadence of the program.

Contribute to overall architecture, framework, and design patterns to store and process high data volumes: Collaboratively worked with Architect and contributed on improving the large datasets by decomposing un-structured data into "Structure" , "Semi-Structured" along with design patterns Circuit Break / MVC, etc and designed the storage framework with AWS-S3/AWS-Dynamo-DM/AWS-RDS.

Skills:

Bachelors; degree in Computer Science, Informatics, or a related field required

3+ years of experience in a data engineering role

2+ years of experience with AWS and related services (e.g., EC2, S3, SNS, Lambda, IAM, Snowflake)

Hands-on experience with ETL tools and techniques (Desirable)

Basic proficiency with a dialect of ANSI SQL, APIs, and Python

Knowledge of and experience with RDBMS platforms, such as MS SQL Server,

MySQL, NoSQL, Postgres

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.