Role : Sr. Data Engineer ( ETL + Hadoop + Python + Spark/PySpark )
Location 1 : Charlotte , NC
Location 2 : Jersey City , NJ
Location 3 : Plano , TX
Need only local candidates - no relocation , must be able to work on Artech's W2
No H1 transfer here
DO NOT send me C2C candidates / Please DO NOT send me your bench hotlist
Top 5 Skills :
- Python
- Spark/PySpark
- BigData Ecosystem ( Hadoop , HIVE , Hbase etc )
- ETL/Informatica
- Heavy SQL
Job Description:
- Responsible for developing complex requirements, enhancing, modifying and/or maintaining applications in the Financial Crimes technology to accomplish business goals. Software developers design, code, test, debug and document programs as well as support activities for the maintaining the application.
- Work closely with business partners in defining requirements for system applications.
- Typically requires 10+ years of applicable experience.
- Utilizes in-depth knowledge of business requirements, business environments, and technological alternatives to recommend innovations that enhance and/or provide a competitive advantage to the organization. Responsible for providing insight and direction from a data perspective, assessment of impact on technology systems and participation in the full development lifecycle of the capability being delivered.Contribute to story refinement/defining requirements. Estimate work necessary to realize a story/requirement through the delivery lifecycle. Perform proof of concept as necessary to mitigate risk or implement new ideas. Setup and automate continuous integration/continuous delivery pipeline.
- Working closely with Production Support teams, Platform teams and Business Partners, this person handles technical aspects of the application, including Change Management, Maintenance, Platform Upgrades, and Changes to requirements from both upstream and downstream interfacing applications.
- Demonstrated data sourcing, data analysis and modeling skills with the ability to build innovative data provisioning models to support large scale financial crimes data sourcing initiatives.
- Work with a team of Data Analysts and Developers related to Data to ensure best practice and governance is followed. Promoting and applying best practices and standards at a project, program level.
Partners with the business to develop plans, including ongoing success measures, to sustain the change. - Accountable for analyzing present-state, developing alternative future-state approaches and facilitating implementation. Effectively communicates with managers, peers and business partners on deliverables and timelines. Responsible for being Agile and following agile practice. In parallel, ensuring all Enterprise Change Standards are met.
- Experience in Teradata 16.x , SQL/BTEQ scripting, TPT, Informatica 10.x UNIX Shell scripting, Autosys, Cloudera CDP, Hadoop (Hive, Impala, PySpark, Scala) and Data analysis.
- Strong Data sourcing, data modelling and provisioning skills as related to support large scale AML monitoring and surveillance data assets.
- Database -Executed database intensive development, data migrations and conversions.
- Knowledge and experience working with SQL performance tuning.
- A person who can handle all at once - Design/Build, Hands-on development, Co-ordination of development in distributed environment
- Very good at engaging Business stakeholders and apt at Business engagement and requirement discovery
- Good experience in SDLC, Agile, Continuous Integration Continuous Delivery, and change management (CICD ) - Jira, Bitbucket, Jenkins, Artifactory, Ansible
- Good knowledge of Unix and development of shell scripts is required
- Good to have business knowledge in financial domains related to Anti-Money Laundering and Financial Crimes Effective communication and listening skills Software development in Agile environment.
- Education:
BS/MS in Computer Science, Engineering, or any quantitative discipline