Senior DataOps Engineer

3 weeks ago

Jersey City, United States Federal Home Loan Bank of New York Full time

Position Overview: This position is responsible for: • Identifying opportunities for eliminating bottlenecks throughout the Bank's operational data ecosystem • Enhancing efficiency and effectiveness of data infrastructure and delivery processes using scripting/automation with a focus on data integrity, reliability, and consistency • Build and support highly available data pipelines and related integrations

Team Overview: As part of the Data Management Office (DMO), the Operational Data Services team streamlines, automates, hardens, and modernizes the processes and technologies by which the Bank's operational data is stored, shared, protected, and maintained at quality levels that are fit for purpose.

Essential Job Function:

Partner with DevOps team to apply their standards and best practices to DataOps initiatives Develop DataOps-specific standards and best practices in alignment with DevOps Provide thought leadership in identifying reusable, flexible, and scalable data pipeline based automated solutions Perform system analysis to identify gaps and impediments for continuous data integration and delivery Develop, construct, test, operationalize and maintain data pipelines for operational and analytical efficiencies Automate workflows for faster delivery of data from conception to operationalization Set up best practice standards for data engineering in alignment with Bank's defined Enterprise and data architecture Manage and enhance Bank's Non-IT Python Scripting environment for secure and automated script/package deployment Effectively plan/prioritize/manage workload and project deliverables to deliver timely business value Collaborate with Technology, business, and vendor stakeholders to plan, design, test, and deliver data pipelines and infrastructure Ensure all design and deliverables comply with PMLC, SDLC, DMO, and Bank standards Ensure monitoring and optimization of Bank's RDS instances for cost-effectiveness and compliance with Bank standards Provide training on supported capabilities. Collaborate with other Data Management Office staff as needed to advance the maturity of the bank's overall data management. Identify existing and avoid building new roadblocks to delivering business value in a timely manner. Skills: Interpersonal skills: Team-oriented, collaborative, and coaching skills Strong analytical, conceptual, and critical thinking abilities Clear and concise communication and the ability to present ideas in user-friendly language Effective leadership qualities to negotiate with and influence a variety of stakeholders Effective relationship management skills at all levels Technical Skills:

Passionate about automation and developing best practices Strong organizational and process/workflow design skills Keen ability to identify and analyze patterns using complex data sets Good knowledge of agile delivery and DevOps frameworks Good ability to think at and switch between multiple levels (e.g., conceptual vs. logical vs. physical data models, strategic vs. tactical planning) Good understanding of data management functions as per the Data Management Body of Knowledge (DMBOK) and its application to design, development, and implementation of operational data solutions Experience: Minimum of Five years of experience in a Data Engineer role 3-5 years of hands-on experience in creating continuous integration and delivery pipelines leveraging cloud native architectures/technologies on Amazon Web Services (AWS) Cloud 3-5 years of hands-on experience with DevOps tools for design, build, test, release, and monitor jobs - Jenkins/Ansible preferred 3-5 years of hands-on experience working with SQL, NoSQL database systems, data warehouses, and streaming solutions. Postgres, Oracle, SQL Server, Snowflake, Amazon Relational Database Services (RDS) preferred 3-5 years of demonstrated experience with building, combining, analyzing, and optimizing large and complex data sets Two plus years working with one or more of the technologies: Kafka, API Gateway, Kinesis, Docker, Apache Airflow, and/or Lambda 1-2 years of experience in design and development of: Optimized AWS RDS instances including replication using AWS Database Migration Services (DMS) Information management/data architectures Multi-tier data layers and frameworks Data Integration methods for transactional systems Cloud storage solutions 1-2 years of working experience with scripting languages, and/or statistical tools: Python, R, Scala, SAS Working knowledge of security/monitoring tools and their integration with pipeline Knowledge of AI, ML, and Microservices deployment and release management will be a plus Basic understanding of Machine Learning and Artificial Intelligence concepts Education/Certifications:

Bachelor's degree in computer science, engineering, or related discipline. Master's degree preferred. Professional experience will be considered in lieu of education. Certifications in AWS DevOps, AWS RDS/DMS, data engineering, data science, automation, or database technologies a plus. However, generally recognized certifications in data management, scripting or automation will be preferred

Salary Range: $130, 600 to $150,000

Skills: #J-18808-Ljbffr

  • Machine Learning Engineer

    3 weeks ago

    Jersey City, United States ATR International Full time

    11 month contract Hybrid in Jersey City, NJ (3 days onsite weekly) Large client in banking industryW2 onlyJob Description: DataOps is a centralized customer support team within Technology Reference Data Group, that is focused on solving important and complex problems related to Infrastructure Data.We are seeking an experienced Machine Learning engineer to...

  • Machine Learning Engineer

    3 weeks ago

    Jersey City, United States ATR International Full time

    11 month contract Hybrid in Jersey City, NJ (3 days onsite weekly) Large client in banking industryW2 onlyJob Description: DataOps is a centralized customer support team within Technology Reference Data Group, that is focused on solving important and complex problems related to Infrastructure Data.We are seeking an experienced Machine Learning engineer to...

  • Senior Solutions Engineer

    6 days ago

    Jersey City, United States The Port Authority of NY & NJ Full time

    Description Position at The Port Authority of NY & NJ About the Role Reporting to the Program Director of Engineering Solutions, the Senior Solutions Engineer/PM is responsible for leading the adoption, administration, and support of all "off the shelve" technology-based solutions within the Engineering Department. The Senior Solutions Engineer will...

  • Senior Solutions Engineer

    6 days ago

    Jersey City, United States The Port Authority of NY & NJ Full time

    Description Position at The Port Authority of NY & NJ About the Role Reporting to the Program Director of Engineering Solutions, the Senior Solutions Engineer/PM is responsible for leading the adoption, administration, and support of all "off the shelve" technology-based solutions within the Engineering Department. The Senior Solutions Engineer will...

  • Senior Network Engineer

    3 days ago

    Jersey City, United States Veterans Sourcing Group LLC Full time

    Senior Network Engineer Remote - Any location, working in EST Long term project The Global Network Services is looking for a Senior Network Engineer focused on Real Estate projects and network infrastructures. The successful candidate will be responsible for designing and implementing functional network infrastructures within the global landscape of 400+...

  • Senior Data Engineer

    6 days ago

    Sioux City, Iowa, United States Horizontal Talent Full time

    Overview:Architect and refine our Databricks-centric data platform, emphasizing scalable integrations and advanced entity resolution strategies.Lead the charge towards a data mesh infrastructure, promoting domain-centric design and decentralized data management.Enhance our DataOps capabilities, emphasizing data observability, discovery, and lineage to...

  • Senior Structural Engineer

    2 days ago

    Jersey City, United States EnergeiaWorks Full time

    Looking for a Senior Structural Engineer to join a growing, well-established, and reputable C&I and Utility-scale Solar+Storage Engineering and Consulting firm. Strong opportunity to expand on Project Management experience/skills. *Must be a licensed SE or PE with experience doing structural analysis/design of commercial buildings. Why you should apply: ...

  • Senior Structural Engineer

    1 week ago

    Jersey City, United States EnergeiaWorks Full time

    Looking for a Senior Structural Engineer to join a growing, well-established, and reputable C&I and Utility-scale Solar+Storage Engineering and Consulting firm. Strong opportunity to expand on Project Management experience/skills. *Must be a licensed SE or PE with experience doing structural analysis/design of commercial buildings.Why you should apply:...

  • Senior Structural Engineer

    1 week ago

    Jersey City, United States EnergeiaWorks Full time

    Looking for a Senior Structural Engineer to join a growing, well-established, and reputable C&I and Utility-scale Solar+Storage Engineering and Consulting firm. Strong opportunity to expand on Project Management experience/skills. *Must be a licensed SE or PE with experience doing structural analysis/design of commercial buildings.Why you should apply:...

  • Senior Structural Engineer

    1 week ago

    Jersey City, United States EnergeiaWorks Full time

    Looking for a Senior Structural Engineer to join a growing, well-established, and reputable C&I and Utility-scale Solar+Storage Engineering and Consulting firm. Strong opportunity to expand on Project Management experience/skills. Make sure to apply with all the requested information, as laid out in the job overview below. *Must be a licensed SE or PE...

  • Senior Structural Engineer

    1 week ago

    Jersey City, United States EnergeiaWorks Full time

    Looking for a Senior Structural Engineer to join a growing, well-established, and reputable C&I and Utility-scale Solar+Storage Engineering and Consulting firm. Strong opportunity to expand on Project Management experience/skills. *Must be a licensed SE or PE with experience doing structural analysis/design of commercial buildings.Why you should apply:...

  • Staff Electrical

    5 days ago

    Salt Lake City, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job Description Job Description Description: C&I Engineering is looking for a talented and driven individual to join our team! About the opportunity: Senior/Staff Electrical Engineer C&I is an employee-owned, full-service engineering design firm providing engineering/design/project management and procurement services to various clients in oil & gas, food &...

  • Senior Software Engineer

    3 days ago

    Jersey City, United States Affiliated Monitoring Full time

    Job Type Full-time Description *This is mostly a remote position but does require the ability to work in our corporate office in Union, NJ a minimum of 1 - 2 days a month.* We seek a Senior Software Engineer with a deep software engineering mindset interested in developing an intimate understanding of our business through daily interactions with our...

  • Senior Development Engineer

    3 days ago

    Jersey City, United States HSBC Full time

    Job description Senior Development Engineer, HSBC Technology & Services (USA) Inc., Jersey City, NJ: The Senior Development Engineer will function as a senior member of Markets and Securities Services Operations Technology (MSSOT) Americas Post Trade Technology team and work closely with the functional and regional teams. Responsible for managing...

  • Senior Water Resouces Engineer

    3 weeks ago

    Jersey City, United States Schnabel Engineering Full time

    Schnabel is an employee-owned, professional consulting firm that focuses on solving problems related to the earth and environment through specialization in water, geotechnical, and infrastructure engineering. Schnabel's high standards for quality, business ethics, and concern for the communities they live in and support, are a vital part of who we are and...

  • Senior Reliability Engineer

    1 month ago

    Jersey City, United States Ben Aris Full time

    Job Summary: The Senior Reliability Engineer will identify and resolve mechanical issues, improving quality, capacity, and reliability. Collaborating with onsite technical teams, corporate networks, and vendors, you'll strive to improve plant reliability and performance while applying technical knowledge to analyze causes of long-term reliability issues,...

  • Senior Modern Workplace Endpoint Security Engineer

    1 week ago

    Jersey City, United States MUFG - Mitsubishi UFJ Financial Group, Inc. Full time

    We are seeking a highly skilled and experienced Senior Modern Workplace Endpoint Security Engineer. The successful candidate will be part of the Incubation engineering and strategy team. Understanding of packaging and deploying M 365 products to both Security Engineer, Engineer, Security, Technical Support, Cybersecurity, Workplace

  • Staff Electrical

    4 days ago

    Salt Lake City, United States CHEMICAL & INDUSTRIAL ENGINEER Full time

    Job DescriptionJob DescriptionDescription:C&I Engineering is looking for a talented and driven individual to join our team!About the opportunity: Senior/Staff Electrical EngineerC&I is an employee-owned, full-service engineering design firm providing engineering/design/project management and procurement services to various clients in oil & gas, food &...

  • Senior Reliability Engineer

    4 weeks ago

    Jersey City, United States Ben Aris LLC Full time

    Job DescriptionJob DescriptionJob Summary: The Senior Reliability Engineer will identify and resolve mechanical issues, improving quality, capacity, and reliability. Collaborating with onsite technical teams, corporate networks, and vendors, you'll strive to improve plant reliability and performance while applying technical knowledge to analyze causes of...

  • Senior Software Engineer

    5 days ago

    Jersey City, United States BayOne Solutions Full time

    Title: Senior Software Engineer Location: NJ, Chicago, IL, Palo Alto and SF, CA, Jersey City (3 days onsite) Job Type: Full-Time. Rate: $90 - $100/hr on only W2 Skills Required: - Must have experience with Kafka - Proficiency in AWS and Terraform - Go lang is a plus, but proficiency in Python or Java is acceptable Job Summary: As a Senior Software Engineer,...