Data Engineer

2 weeks ago

New York, United States The New York Public Library Full time
Overview
This is a temporary four-year grant-funded position.
The New York Public Library is looking to expand our Data Engineering team with a new engineer. In this role you’ll have the opportunity to contribute to new and existing data pipelines that help the library understand our activities and support many staff members in making important decisions for the direction of NYPL. The focus of this role is on expanding our data collection while maintaining data fidelity, accuracy and privacy (see our Privacy Policy here) in our data warehouse. A special focus of this role will be for the collection of data from our public domain Digital Research Books Project, which is helping increase access to a wide range of materials not previously available online.
We are looking for someone we can count on to: Own:
  • Data pipelines and codebases to ensure data consistency and access that can help drive decision making at NYPL
  • Data policies that can help regulate data access and create a consistent picture of NYPL’s activities
Teach:
  • Help NYPL staff understand the usefulness, and limitations, of collected data and how to use it to reach their goals
  • Collaborate with other NYPL engineers to connect data pipelines to new and existing projects
Learn:
  • Work with product owners to understand available data and how it may be accessed
  • Follow new developments in data engineering and apply these best practices to data engineering at NYPL
Improve:
  • Collaborate with other NYPL engineers to find best practices and implement new skills into our data engineering work
  • Document existing and new data pipelines, helping our data engineering team communicate the success of our work
Some expectations for this role are that within: 1 month, this person will:
  • Become familiar with the existing data management systems and the pipelines that have already been created
  • Understand the data that NYPL is collecting, their sources and their significance
  • Meet with key stakeholders in Digital and other departments to understand their roles in this work
  • Develop an understanding of Digital Research Books (DRB) and its data requirements
3 months, this person will:
  • Be comfortable both ingesting and extracting data in our data warehouse 
  • Begin building understanding of the systems that connect to the warehouse with the help of of data engineering team members
  • Work on our existing ETL systems to improve and extend them
6 months and beyond, this person will:
  • Create new pipelines to add data from new sources to our data warehouse
  • Take ownership of key data pipelines and reporting requirements
  • Develop strong relationships with other engineers, product and project managers and other stakeholders outside of digital
  • Contribute to delivering on NYPL Digital’s strategic goals for data collection
  • Help create automated reports on key metrics that support NYPL’s annual goals
  • Grow data engineering as a unit within NYPL Digital
Responsibilities: 
  • Understand data engineering team priorities and requirements for data collection, reporting, and analysis
  • Work with the Data Engineering Product and Project Managers to understand the core KPIs they are being asked to collect
  • Collaborate with other engineers across the department to understand project requirements and contribute to the designing of complex ETL pipelines
  • Communicate with stakeholders from other NYPL Departments to understand desired data collection, requirements and limitations
  • Support staff in generating regular data reports, including fetching data from the data warehouse if necessary
  • Help ensure best practices-based development of data pipelines and other tools, with the goal of increasing the capacity and reliability of these pipelines
Required Education, Experience & Skills Required Education & Certifications
  • Bachelor's Degree - OR - 5+ years of hands-on development experience on relevant tech stack
Required Experience
  • 5+ years of hands-on development experience on relevant tech stack
Required Skills
  • 3+ years of software engineering experience with focus on data aggregation and analysis pipelines
  • Production experience with Python
  • Excellent knowledge of relational databases
  • Familiarity with Data Warehouse technologies (such as AWS’s RedShift)
  • Proficiency in producing and consuming spreadsheets (Excel/CSV/Smartsheet)
  • Strong knowledge of the design & use of APIs, particularly using REST
  • Experience with cloud platforms (AWS strongly preferred)
  • The ability to work independently and proactively, as well as to collaborate with colleagues around Digital and the rest of the library
Managerial/Supervisory Responsibilities
  • None
More... Core Values
All team members are expected and encouraged to embody the NYPL Core Values:
  • Be Helpful to patrons and colleagues
  • Be Resourceful in solving problems 
  • Be Curious in all aspects of your work
  • Be Welcoming and Inclusive
Work Environment
  • Office Setting
  • Hybrid work environment; requires onsite work in NYC - not remote
Physical Duties
  • Limited physical effort is required
  • May require travel within NYC
Pre-Placement Physical Required?
No

Union/Non Union
Non-Union

FLSA Status
Exempt

Schedule Monday - Friday, 9am - 5pm

This job description represents the types and levels of responsibilities that will be required of the position and shall not be construed as a declaration of all of the specific duties and responsibilities for the role. Job duties may change if Library priorities change. Employees may be directed to perform job-related tasks other than those specifically presented in this description as needed.

The New York Public LibrarySalary Statement At the Library, we believe that pay transparency and pay equity are important to ensuring we source the best candidates and keep the best employees. When making a determination as to the appropriate salary for a candidate, we consider a variety of factors such, including, but not limited to, the position requirements, the skills, prior experience, and educational background required or preferred for the job, the scope and impact of the role within the organization, internal peer equity, and the candidate's specific training, experience, education level, and skills. No single factor is conclusive; the Library reserves the right to consider any and all relevant factors and make a decision consistent with its policies.
Union Salaries are determined by collective bargaining agreement(s).

  • Data Engineer

    1 month ago

    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Manufacturing Engineer

    4 days ago

    New York, United States Onset Data Loggers Full time

    Based in Bourne, Massachusetts, for more than 40 years Onset has been dedicated to designing and producing high-quality data loggers. Our manufacturing processes ensure precision and reliability in data logging technology. Onset's products are trusted worldwide for capturing critical data, making them an essential choice for professionals and organizations...

  • Data Engineer

    7 days ago

    New York County, New York, United States Codex Tech-IT Full time

    Codex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a strong focus on data quality and accuracy, our Data Engineers play a crucial role in ensuring our clients have...

  • Data Engineer

    6 days ago

    New York, United States New York Blood Center Full time

    Data EngineerJob Locations US-NY-New YorkJob ID 2024-6284Category Information TechnologyMinimum Rate USD $100,000.00/Yr.Maximum Rate USD $115,000.00/Yr.Work Location Type HybridOverviewAt New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge...

  • Data Engineer

    2 weeks ago

    New York, United States Numeus Full time

    Numeus is a diversified digital asset investment firm built to the highest institutional standards, combining synergistic businesses across Trading, Alpha Strategies, Asset Management, and Venture Capital . Numeus was founded by successful executives with decades of experience across the finance, blockchain and technology industries, with a shared passion...

  • Data Engineer

    2 weeks ago

    New York, United States NR Consulting Full time

    Data Engineer SME Location: NYC / Charlotte (Candidate should be open for hybrid work model) Duration: 12 months Responsibilities: A background in financial services, investment banking, regulated sectors and large enterprise DevOps and Agile engineering practitioner with experience of test driven development Ability to work independently on specialized...

  • Data Engineer

    3 weeks ago

    New York, United States Net2Source Inc. Full time

    W2 Candidates OnlyPosition: Data Engineer – IIILocations: New York, NY - 10038 (Hybrid)Duration: 12+ months ContractQualifications:Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plusExpert-level experience in...

  • Data Engineer

    3 weeks ago

    New York, United States Net2Source Inc. Full time

    W2 Candidates OnlyPosition: Data Engineer – IIILocations: New York, NY - 10038 (Hybrid)Duration: 12+ months ContractQualifications:Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plusExpert-level experience in...

  • Software Engineering Manager

    1 month ago

    New York, New York, United States Domino Data Lab Full time

    Who we areDomino Data Lab powers model-driven businesses with its leading Enterprise AI platform trusted by over 20% of the Fortune 100. Domino accelerates the development and deployment of data science work while increasing collaboration and governance. With Domino, enterprises worldwide can develop better medicines, grow more productive crops, build better...

  • Data Engineering

    1 month ago

    New York, United States Understood Full time

    **About Understood**: Understood is a nonprofit focused on shaping the world for difference. We raise awareness of the challenges and strengths of people who learn and think differently. Our resources help people navigate challenges, gain confidence, and find support and community so they can thrive. Having a shared commitment to our values is a key factor...

  • Data Engineer

    4 weeks ago

    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Data Engineer

    1 week ago

    New York County, New York, United States New York Blood Center Inc Full time

    Overview: At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...

  • Data Engineer

    4 weeks ago

    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...

  • Data Engineer

    1 month ago

    New York, United States Beauty by Imagination (BBI) Full time

    Beauty by ImaginationData EngineerHybridPosition Overview:We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in owning the ETL processes, developing Power BI dashboards, and supporting our data analysts in...

  • Data Engineer

    4 weeks ago

    New York, United States Beauty by Imagination (BBI) Full time

    Beauty by ImaginationData EngineerHybridPosition Overview:We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in owning the ETL processes, developing Power BI dashboards, and supporting our data analysts in...

  • Data Engineer

    4 weeks ago

    New York, United States Beauty by Imagination (BBI) Full time

    Beauty by ImaginationData EngineerHybridPosition Overview:We are seeking a highly skilled and motivated Data Engineer to create and manage a data warehouse, integrating data from various sources including NetSuite, IRI, and other sales data. This role is pivotal in owning the ETL processes, developing Power BI dashboards, and supporting our data analysts in...

  • DevOps Engineer

    2 weeks ago

    New York, United States Creative Data Resources Full time

    Duties: Hybrid Schedule Client is seeking a hands-on DevOps Engineer who will lead the way for our DevOps environment. The ideal engineer will bring their experiences, best practices, and a collaborative attitude to help drive DevOps initiatives. To be successful, one must effectively communicate with our trade support and operations team to orchestrate...

  • Data Engineer

    2 weeks ago

    New York, United States Jane Street Full time

    About the Position We are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do. Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...

  • Data Engineer

    3 weeks ago

    New York, United States Open Systems Technologies Full time

    A financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...

  • Data Engineer

    3 weeks ago

    New York, United States Open Systems Technologies Full time

    A financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...