Senior Data Engineer

USC & GC Only

ROLE SUMMARY The Sr Engineer role plans, designs, develops and tests high-quality, innovative and fully performing software systems or applications for software enhancements and new products. Key responsibilities include:
• Contribute to full software development life cycle
• Write maintainable, extensible, tested code, while complying with coding standards
• Produce specifications and determine operational feasibility
• Continuously Integrate and deliver software components into a fully functional software system
• Facilitate end to end user testing with customers
• Troubleshoot, debug and upgrade existing systems CAREER LEVEL SUMMARY
• Proficiency: Fully mastered in immediate function/domain and has developed competent skills in complimentary functions or domains. Is able to train junior members in mastered domain knowledge.
• Direction: Is largely autonomous, working on a day to day basis without supervision or support. Occasionally checks in with manager for questions, direction. Provides support or direction to more junior members.
Show Less
dditional Skills & Qualifications

• 8+ years of total development experience
• 5+ years of experience as a Data Engineer with large, complex data sources
• Experience designing, building and operationalizing large scale enterprise data solutions and applications using AWS data and analytics services in combination with other services/platforms - Spark, EMR, RedShift, Kinesis, Kinesis Firehose, Athena, Lambda & AWS Glue
• Experience with data pipeline and workflow management tools: Airflow, Step Functions etc
• Ability to implement both batch and streaming data pipelines in the AWS and change data capture (CDC) experience
• Advanced working SQL knowledge and experience working with relational databases and NOSQL databases.
• Experience designing and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Scala.
• Experience with infrastructure-as-code tools such as Terraform (preferably) or CloudFormation
• Kubernetes experience for developing, deploying, and orchestrating micro-services is plus
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Understanding of concepts regarding security, privacy, performance, etc
Show Less
Employee Value Proposition (EVP)
Work Environment
hybrid work environment