Senior Data Engineer

JOB DESCRIPTION
Pay Range : $65-75/hr on W2

Team: Interflow /DAP Reporting: DAP Reporting is responsible for reports, analytics data on the digital test administration. Interflow works on generating reports for all the digital test administration. These reports are used to understand the health of the administration and report stats for leadership. This team is responsible for providing live reports to check on the status of the exams and provide canned post admin reports to analyze the admins in detail.
Profile: Data Analyst will work closely with Architects and leads in the Interflow team, key business stakeholders including program staff to support the organizations effort in the areas of data Analysis and information management. Role should have strong experience in writing super complex SQL queries to extract data for reports. Candidate should have experience working with large set of data. These reports are very critical for the company, and we are looking for an expert who is capable of handling, consuming and extracting large sets of data for analysis and reports.

We use Tableau and Quicksight for Data Analysis; Apache Spark for Big Data Processing; and they should have used at least one AI tool: Amazon Q; Google Cloud AI; Google Cloud Smart Analytics; Tableau AI
Responsibilities
Expertise to understand complex queries, proof test, and tweak for the intended use. Critical analysis skills to extract data and analyze the data for inconsistencies and issues.
Good hands-on experience of working with python.
Must have led implementation of any market popular AI tools for analyzing the data and creating trend reports.
Good analytical skills and experience in handling large sets of data
Demonstrate the ability to access, trace, analyze, and remediate data issues leveraging SQL and applicable AWS tools such as Athena and Redshift.
Strong SQL skills and ability to work with different data sources.
Automate the data extract pull and able to visualize these on charts/graphs/Tableau
Gather, analyze, and interpret data to solve specific use cases. Develop and participate in the review of requirements, data mappings, database specifications documentation and other artifacts and clearly communicate to both the business and technical team members the interpretation of the data.
Design and manage information systems, conduct analysis, and generate accurate and comprehensive reports on operational data.
Very strong in documentation of data artifacts, design and reports details.
Support Architects, Leads and product owners to ensure that all aspects of the information analysis and requirements gathering process are completed with the highest degree of accuracy and quality, including the development and socialization of key project artifacts.
Support ad hoc data requests as required as part of DevOps team.
Review, extract, and analyze data and information on system processes and procedures.
Experience developing testing strategies and identifying comprehensive test scenarios based on business requirements.
Demonstrated experience with AWS Lambda, NodeJS, SNS/SQS, S3, IAM, CloudWatch, RDS, DynamoDB, Redshift and Athena.
Willingness and ability to perform in multiple roles on a team, including testing and production support in addition to data analysis.
Strong ability to understand and internalize the big picture and broader implications.
Communicate and understand business goals and requirements, and work to create data solutions that add value to the business.
Support team with functional, regression and end to end testing efforts with a focus on flow of data ensuring that features deliver the expected functionality with high quality.
Self-starter with ability to set priorities, work independently and attain goals.
Develop data-driven reporting solutions from concept to deployment.
Focus on designing and developing effective user-friendly reporting assets including interfaces and outputs.
Cultivate and maintain knowledge of products, data systems and information assets.
Work with a highly proficient team using Tableau/Tableau Server, SQL, Relational/Columnar Databases, Data Modeling, MS Office
Develop scripts to extract data in Athena, Timestream and Redshift.
Exhibit good communication and practical decision-making skills, a believer in good feedback and documentation.
About You
BA/BS required (major in an analytical field desired)
A minimum of 5 to 10+ years work-related experience.
Experience in hands-on development of reporting applications for the Web in a professional environment
Passion for new technology and adapting to the latest tools in data analysis and reporting.
The Ethos of continuous improvement and interest in learning new things.
More about you
Strong analytical thinking and structured problem-solving ability
Ability to handle multiple projects and assignments simultaneously and effectively in a cross-functional team environment.
Versed on the agile methodology and best practices.
Excellent interpersonal and collaboration skill with the ability to work with a diverse set of colleagues, across functions, from different organizations, disciplines, etc.
Self-starter, ability to set priorities, work independently and attain goals