Senior Data Engineer

3 months ago


new york city, United States Roots Automation Full time

Senior Data Engineer


Company Overview:

At Roots, our mission is to make work more human. We are developing fully autonomous, AI-powered Digital Coworkers that streamline tedious and repetitive tasks for the enterprise. By tackling core challenges in natural language understanding and computer vision, we are building an automation product that embodies the future of work. Our platform makes automation accessible to everyone, enabling users to generate automations by describing tasks in simple English, while solving complex business problems with enterprise-grade results and performance.


Harnessing the power of AI, machine learning, and analytics on our data is fundamental to our business. Our production processes capture vast amounts of data, which feed directly into our training and analytics pipelines. As this data continues to grow, we need a data engineer to design and build the data architecture that underpins our AI systems and supports our evolving needs for reporting and business analytics.


At Roots, we are committed to building a team of talented individuals who share our love for innovation and problem-solving. We encourage curious minds from a wide array of disciplines and backgrounds to apply.


Responsibilities:

  • Collaborate with stakeholders across engineering, research, product, sales, and marketing to capture their data production workflows.
  • Design and build ETL pipelines or similar methodologies to merge and refine data into a centralized data lake, optimizing it for analytics, reporting, and model training.
  • Implement de-identification techniques to protect sensitive information.
  • Build, monitor and maintain data infrastructure, ensuring reliability, performance, scalability, and cost-effectiveness.
  • Ensure security, integrity, and compliance of data according to industry standards


Qualifications:

  • 4+ years of experience as a data engineer.
  • Expertise in ETL scheduling tools like Airflow, Prefect, Luigi, or comparable frameworks.
  • Proficiency in Python.
  • Experience in working with databases, data warehouses, and data lakes.
  • Experience with DataBricks, Snowflake, or similar data platforms
  • Strong written and verbal communication skills, with a particular emphasis on the written word. We greatly appreciate public articles or blogs that showcase writing skills.
  • Ability to work independently, prioritize tasks, and manage multiple projects simultaneously in a fast-paced and dynamic environment.


As a startup, Roots Automation offers a high-paced environment with ample growth and learning opportunities across multiple disciplines.



  • New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Data Engineer

    2 weeks ago


    New York, United States TechnoGen Full time

    Please Note: As of July 22, 2021, our team will require that all candidate submissions include a LinkedIn profile. Please do not submit any candidates that do not have a LinkedIn. Kforce has a client in Brooklyn, NY that is seeking a Senior Data Engineer. Our team is headquartered in Brooklyn but has a remote-first culture and we encourage remote applicants...

  • Senior Data Engineer

    2 months ago


    New York, New York, United States TechnoGen Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a Senior Data Engineer to join our Data Infrastructure team at TechnoGen. As a Senior Data Engineer, you will be responsible for building and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to...

  • Senior Data Engineer

    3 weeks ago


    New York, United States TechnoGen Full time

    Please Note: As of July 22, 2021, our team will require that all candidate submissions include a LinkedIn profile. Please do not submit any candidates that do not have a LinkedIn. Kforce has a client in Brooklyn, NY that is seeking a Senior Data Engineer. Our team is headquartered in Brooklyn but has a remote-first culture and we encourage remote applicants...


  • New York, United States Hudson Data Full time

    Job Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...

  • Senior Data Engineer

    2 weeks ago


    New York, United States Match Group Full time

    As a Senior Data Engineer on the Product Platform team, you will be instrumental in designing, building, and optimizing data pipelines and products that support foundational product services that are crucial to the operation of Hinge. Your work will have a direct impact on the reliability and scalability of these services, which are essential for delivering...

  • Senior Data Engineer

    2 months ago


    new york city, United States Roots Automation Full time

    Senior Data Engineer Company Overview: At Roots, our mission is to make work more human. We are developing fully autonomous, AI-powered Digital Coworkers that streamline tedious and repetitive tasks for the enterprise. By tackling core challenges in natural language understanding and computer vision, we are building an automation product that embodies the...

  • Senior Data Engineer

    3 weeks ago


    New York, United States The Custom Group of Companies Full time

    Senior Data Engineer New York, NY - Hybrid position Onsite 2 days a week (local to area) Rate $100-$110 per hour 1+ year contract Must be a USC to obtain L2 security clearance No Corp to Corp or 3rd party agencies We are looking for a Senior Data Engineer to join our team of professionals. The selected individual should be well versed in Databricks and AWS....


  • New York, New York, United States Data Intellect Full time

    About This RoleWe are seeking a highly skilled Senior Financial Data Developer to join our team. In this role, you will be responsible for developing and maintaining complex financial data systems using kdb+.This is an exciting opportunity for someone who is passionate about working with data and wants to make a real impact in the financial industry.

  • Senior Data Engineer

    2 weeks ago


    New York, New York, United States NYU Langone Health Full time

    Job Title:Senior Data Engineer - Data Integration and AnalyticsJob Summary:NYU Langone Health is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a critical role in designing and developing robust ETL pipelines to integrate diverse data sources.Key Responsibilities:Strategize, design, and develop automated cloud...


  • New York, New York, United States Capital One Full time

    Capital One is seeking a Senior Data Architect and Engineer to drive the design and implementation of high-performance data ecosystems that support real-time, intelligent experiences for its Risk Management functions.This role involves shaping the Risk Management Data domains that will drive standardized data assets and products. The ideal candidate will...

  • Senior Data Engineer

    2 weeks ago


    New York, United States CV Library Full time

    SENIOR DATA ENGINEER AT BOUTIQUE ANALYTICS FOCUSED HEDGE FUNDBase Salary is $175K to $200K (based upon candidate and experience); Plus Bonus; and Excellent BenefitsIncredible Organization with Equally Incredible People | New York (SoHo), NY | Onsite Four (4) Days per WeekMulti-office, solidly established, international, boutique analytics-focused hedge fund...

  • Senior Data Engineer

    2 weeks ago


    New York, United States MDCalc Full time

    Overview MDCalc is the most trusted and broadly used medical reference for clinical decision making tools, used by millions of clinical users worldwide. We're the #1 medical reference for clinical decision tools and content and we're used by more than 65% of US doctors quarterly. To continue to further accelerate and steward this growth, we are seeking a...

  • Senior Data Engineer

    2 weeks ago


    New York, United States MDCalc Full time

    Overview MDCalc is the most trusted and broadly used medical reference for clinical decision making tools, used by millions of clinical users worldwide. We're the #1 medical reference for clinical decision tools and content and we're used by more than 65% of US doctors quarterly. To continue to further accelerate and steward this growth, we are seeking a...

  • Senior Data Engineer

    2 weeks ago


    New York, United States MDCalc Full time

    Overview MDCalc is the most trusted and broadly used medical reference for clinical decision making tools, used by millions of clinical users worldwide. We're the #1 medical reference for clinical decision tools and content and we're used by more than 65% of US doctors quarterly. To continue to further accelerate and steward this growth, we are seeking a...


  • New York, United States Delphi-US Full time

    Job Title : Senior ELT Data Engineer (Contract) - Job5213 Location : Remote Additional Information : 12 month Contract, EST hours We are looking for a Senior Data Engineer to join our growing team and help us build our new ELT architecture from the ground up. You will work with dbt, Fivetran, Snowflake, GitHub, and modern CI/CD & IAC tools to design,...


  • New York, United States SumerSports Full time

    Job DescriptionJob DescriptionSenior Data Engineer About SumerSports:SumerSports is a leading football intelligence technology company that specializes in providing an innovative suite of products for football fans and NFL clubs. We are a collection of executives, engineers, data scientists, and visionaries from NFL clubs, technology startups, finance, and...

  • Data Engineer

    1 month ago


    new york city, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...

  • Data Engineer

    1 month ago


    new york city, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...


  • New York, New York, United States Vic Full time

    About Vic.aiVic.ai is a pioneering company revolutionizing B2B transactions by leveraging cutting-edge AI technology. By automating business data tracking and providing real-time, statistically sophisticated insights, we're transforming the industry.As a leading-edge organization, we're fortunate to have renowned investors and partners, including Costanoa...