Senior Data Engineer

3 weeks ago


New York, United States IT America Inc Full time
Job DescriptionJob Description

SENIOR Data Engineer

Location: NYC, NY

US Citizens and GC Holders

3 days a. week onsite

Pyspark expertise, Scala, Databricks and AWS are a must have.

Qualifications:
Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.
Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plus
Expert-level experience in data architecture, data types/formats, optimizing code and ETL jobs, data architecture, data modeling, data contracts a key requirement for successful collaboration with data architects and visualization developers.
Expert-level professional hands-on experience in extensible data pipeline development using Databricks, Alteryx, AWS Glue and Lambda functions.
Expert-level professional hands-on experience with RDBMS, ETL scripting tools and IDEs, data pipeline development, and management using orchestration/monitoring tools.
Expert-level knowledge and experience in implementing software engineering security best practices and contributing to design/engineering for DevSecOps.
Expert-level experience with master data management strategies, rules-based engines, and tools for multi-stage data correlation on large data sets.
Must have experience managing deployment and leading the release of code to production.
Expert-level understanding of data visualization tools and requirements for business customers.

Responsibilities:
Work on migrating applications from an on-premises location to the cloud service providers.
Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation.
Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.
Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology.
Perform problem analysis, data analysis, reporting, and communication.
Work with peers across the system to define and implement best practices and standards.
Assess applications and help determine the appropriate application infrastructure patterns.
Use best practices and knowledge of internal or external drivers to improve products or services.

Additional Skills & Qualifications

Expert-level experience working in agile setting or being an agile best-practice mentor.
Expert-level experience working in Jira, confluence, and contributing to engineering team documentation/playbooks.
Proven experience influencing and partnering with product management, Product Owners in translating business requirements into data and engineering specifications.



  • New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Data Engineer

    1 month ago


    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    1 month ago


    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    3 weeks ago


    New York, United States Stott and May Full time

    Senior Data EngineerFull-TimeHybrid (NYC)Base Salary - $140-170k DOEMy client is a pioneering company dedicated to leveraging cutting-edge technology to revolutionize the healthcare industry. Their focus is to develop innovative solutions aimed to improve consumer health outcomes through data-driven approaches. They are one of the leaders in shaping the...


  • New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    18 hours ago


    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    1 month ago


    New York, United States Storm3 Full time

    ⚡ Senior Data Engineer Series B, Startup ️ New York (Hybrid) $200,000 + Significant Equity + BonusThe company is a leading provider of virtual care to help tackle substance use. ‍ Responsibilities:Develop and maintain data pipelines for extracting, transforming and loading data from various sources into our data warehouses using tools like dbt,...

  • Senior Data Engineer

    1 month ago


    New York, United States VeracityID Full time

    Job DescriptionJob DescriptionSalary: The roleVeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments. VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.Its application suite employs multiple large...

  • Project Engineer

    2 days ago


    New York, United States Engineer Rec Full time

    Our client are seeking Project Engineers for multiple projects along the East Coast, USA. Are you a Project Engineer currently looking for a new challenge and experienced in supporting offshore wind projects? If so please read on. The Project Engineer has the skills and experience to take a leading role related to land and underground installation of high...


  • New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse?Are you interested in working with stakeholders to solve complex data pipeline and cloud problems?Are you open and able to work on a full-time/perm/W2 contract basis?A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...

  • Senior Consultant

    4 weeks ago


    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization. You will be part of a highly collaborative...

  • Senior Consultant

    4 weeks ago


    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization.You will be part of a highly collaborative...

  • Data Engineer

    1 month ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Senior Civil Engineer

    9 hours ago


    New York, United States Olsson Full time

    Olsson Senior Civil Engineer - Data Center Manhattan , Missouri Apply Now We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our...


  • New York, United States Jane Street Full time

    About the Position We're looking for an experienced Senior Data Center Engineer to design, build, scale, and perform daily upkeep in our regional data and colocation centers. This is a hands-on position that will require a strong communicator with excellent people skills who can manage projects and take ownership. You will join an interdisciplinary team made...

  • Sr Data Engineer

    1 month ago


    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Sr Data Engineer

    1 month ago


    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Data Engineer

    2 weeks ago


    New York, United States Vertisystem Full time

    Only W2 Candidate required:MUST BE FULLY KNOWLEDGABLE IN PYTHON, SQL, AND ETL Min 7 years • Ability to work as part of a team, as well as work independently or with minimal direction. • Excellent written, presentation, and verbal communication skills. • Collaborate with data architects, modelers and IT team members on project goals.Summary: The main...

  • Senior Data Engineer

    2 weeks ago


    New York, United States Vertisystem Full time

    Only W2 Candidate required:MUST BE FULLY KNOWLEDGABLE IN PYTHON, SQL, AND ETL Min 7 years • Ability to work as part of a team, as well as work independently or with minimal direction. • Excellent written, presentation, and verbal communication skills. • Collaborate with data architects, modelers and IT team members on project goals.Summary: The main...


  • New York, United States HappyFunCorp Full time

    Job DescriptionJob DescriptionSenior Data Engineer - Remote - Contract*This position is 100% remote*HappyFunCorp helps businesses develop great products and deliver powerful technical solutions with a blend of deep engineering skills, human-focused design, and a culture that makes working with us enjoyable. We've partnered with startups, small and...