Senior Data Engineer

2 weeks ago

New York, United States Blood Bank of Delmarva Full time
Overview

At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing needs of our diverse communities, further our lifesaving strategic goals in a rapidly changing environment, and expand our impact on the local, national, and global communities we serve.

Responsibilities

As a Senior Data Engineer, you'll be a pivotal figure in defining and advancing our data infrastructure vision. Reporting to the Director of Data Engineering, your role will be crucial in designing, implementing, and refining databases, data pipelines, and data interfaces to ensure scalability and performance. Your proficiency in SQL, Python, and cloud environments (Azure, AWS, or Google Cloud) will empower you to develop solutions that are both robust and optimally aligned with our strategic goals. With a solid grasp of Big Data concepts, including Spark and Cloud ETL tools like Databricks, you will enhance our capabilities in handling complex data challenges. By adopting Agile/SCRUM methodologies, you'll drive innovative and timely project deliveries. You'll also mentor junior engineers, promoting a culture of excellence and continuous improvement. As a senior member of our team, you will work closely with data scientists, BI teams, software engineers, and other stakeholders to translate complex data requirements into practical and impactful engineering strategies.

Candidates must be able to report into one of the following NYBCe locations:New York City, NY; Kansas City, Missouri; St. Paul, Minnesota; Providence , RI and Newark, DE.

Responsibilities:
  • Data Pipeline Design & Optimization: Design, implement, and optimize robust and scalable data pipelines using SQL, Python, and cloud-based ETL tools such as Databricks. Ensure efficient data flow and processing to support large-scale data handling.
  • Data Modeling: Develop and refine data models to accurately represent business processes, ensuring they're scalable and fully integrate with our extensive data architecture, including Big Data frameworks like Spark.
  • Data Architecture: Enhance our overarching data architecture strategy, assisting in decisions related to data storage, consumption, integration, and management within cloud environments (Azure, AWS, or Google Cloud).
  • Agile/SCRUM: Lead and contribute within Agile/SCRUM frameworks to ensure timely and efficient project deliveries. Actively participate in sprints and stand-ups, applying these methodologies to streamline development.
  • Collaboration: Partner with data scientists, BI teams, and other engineering teams to understand and translate complex data requirements into actionable engineering solutions.
  • Mentorship: Guide and mentor junior data engineers, promoting best practices in SQL, Python, and cloud technologies, and fostering a culture of continuous learning and improvement.
  • Quality & Governance: Uphold and champion data quality standards and governance policies, ensuring reliability and compliance in all data-related tasks.
  • Performance Tuning: Monitor and enhance the performance of data infrastructure, proactively identifying and resolving bottlenecks or inefficiencies in cloud and Big Data environments.
  • Innovation: Stay abreast of emerging data engineering and AI technologies and methodologies, recommending and implementing innovative tools or practices as appropriate.
  • Documentation: Generate comprehensive documentation for data processes, pipelines, and architectures to ensure clarity and ease of maintenance for the team, including detailed descriptions of cloud and Big Data implementations.
Qualifications

Required Minimum Education & Experience:

Education:

Bachelor's Degree in Computer Science, Data Science, Information Technology or other quantitative disciplines such as Science, Statistics, Economics, or Mathematics.

Essential Experience:
  • 7+ years of progressive experience in data engineering, with significant expertise in designing, implementing, and optimizing databases and data pipelines.
  • Extensive hands-on experience with SQL Server, Oracle, or other relational database management systems (RDBMS).
  • Proficiency in SQL and Python for advanced data manipulation and analytics.
  • Demonstrated experience with data modeling and architecture for both analytics and transactional systems within large-scale environments.
Cloud and Big Data Experience:
  • Proficient with at least one major cloud data platform (Azure, AWS, Google Cloud) with practical application in data engineering projects.
  • Familiarity with Big Data technologies such as Spark and Cloud ETL tools like Databricks, focusing on scalability and real-time processing capabilities.
Methodology and Tools:
  • Proven track record of using Agile and SCRUM methodologies to drive successful project delivery in a dynamic development environment.
  • Experience in developing data models for integration and analysis that support business intelligence and data analytics initiatives.
Any combination of education, training, and experience that provides the required knowledge, skills, and abilities to perform the essential functions of the job.

Preferred Qualifications:

Education: Master's Degree in Computer Science, Data Science, Information Technology or other quantitative disciplines such as Science, Statistics, Economics, or Mathematics.

Experience with the Microsoft Azure technology stack or similar technologies in competing platforms.

Practical knowledge of data analytics and visualization tools to aid in data-driven decision making and reporting.

Certifications & Licenses:

Professional certification in Agile and SCRUM methodologies (e.g., Certified ScrumMaster (CSM), SAFe Agilist).

Certifications in Python and SQL programming (e.g., Microsoft Certified: Python Programming Specialist, Oracle SQL Certification).

Certifications in cloud services relevant to the job (e.g., AWS Certified Solutions Architect, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).

Big Data certifications (e.g., Cloudera Certified Professional (CCP): Data Engineer, Databricks Certified Professional Data Scientist).

Willing to attain certification, if not currently certified.

Required Knowledge, Skills & Abilities:

Knowledge
  • Fluent Communication: Ability to articulate complex data concepts and project updates clearly to both technical and non-technical stakeholders.
  • Strong Data Analysis Ability: Expertise in analyzing large datasets to derive insights and inform business decisions.
  • Proficiency in SQL and Python: High level of skill in SQL and Python for data analysis, data manipulation and scripting.
  • ETL/ELT Architecture: In-depth knowledge of developing and managing ETL and ELT architectures using various tools and frameworks.
  • Cloud Experience: Experience with cloud platforms such as Azure, AWS, or Google Cloud, and their respective data services and tools.
  • Big Data Concepts: Understanding of Big Data technologies and frameworks, including Spark and Cloud ETL tools such as Databricks.
  • Agile and SCRUM Knowledge: Familiarity with Agile methodologies and SCRUM practices, capable of integrating these into project management and daily workflows.
  • Quality Assurance and Data Governance: Knowledge of data quality standards and governance, ensuring data integrity and compliance across all processes.
Skills
  • Collaboration: Ability to work effectively with cross-functional teams, including data scientists, BI analysts, and software engineers, to implement data solutions.
  • Mentorship and Leadership: Skills in mentoring junior engineers and leading project teams to promote knowledge sharing and professional growth within the team.
  • Innovation and Continuous Learning: Commitment to staying updated on the latest industry trends and technologies in data engineering and implementing them as relevant.
Abilities
  • Ability to interact with customers one-on-one or in large groups
  • Ability to work independently with remote supervision.
  • Ability to build in receiving feedback as part of the development process, and seek consistent and constructive feedback.
  • Ability to embrace accountability and ownership

For applicants who will perform this position in New York City or Westchester County, the proposed annual salary is $125,000 to $135,000 a year. For applicants who will perform this position outside of New York City or Westchester County, salary will reflect local market rates and be commensurate with the applicant's skills, job-related knowledge, and experience.

  • Senior Systems Engineer

    2 days ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Data Engineer

    1 month ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    1 month ago

    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    3 weeks ago

    New York, United States Stott and May Full time

    Senior Data EngineerFull-TimeHybrid (NYC)Base Salary - $140-170k DOEMy client is a pioneering company dedicated to leveraging cutting-edge technology to revolutionize the healthcare industry. Their focus is to develop innovative solutions aimed to improve consumer health outcomes through data-driven approaches. They are one of the leaders in shaping the...

  • Senior Data Engineer

    17 hours ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    2 days ago

    New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    1 month ago

    New York, United States Storm3 Full time

    ⚡ Senior Data Engineer Series B, Startup ️ New York (Hybrid) $200,000 + Significant Equity + BonusThe company is a leading provider of virtual care to help tackle substance use. ‍ Responsibilities:Develop and maintain data pipelines for extracting, transforming and loading data from various sources into our data warehouses using tools like dbt,...

  • Senior Data Engineer

    1 month ago

    New York, United States VeracityID Full time

    Job DescriptionJob DescriptionSalary: The roleVeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments. VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.Its application suite employs multiple large...

  • Senior Data Engineer

    1 week ago

    New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse?Are you interested in working with stakeholders to solve complex data pipeline and cloud problems?Are you open and able to work on a full-time/perm/W2 contract basis?A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...

  • Project Engineer

    2 days ago

    New York, United States Engineer Rec Full time

    Our client are seeking Project Engineers for multiple projects along the East Coast, USA. Are you a Project Engineer currently looking for a new challenge and experienced in supporting offshore wind projects? If so please read on. The Project Engineer has the skills and experience to take a leading role related to land and underground installation of high...

  • Senior Consultant

    4 weeks ago

    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization. You will be part of a highly collaborative...

  • Senior Consultant

    4 weeks ago

    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization.You will be part of a highly collaborative...

  • Data Engineer

    1 month ago

    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Senior Civil Engineer

    8 hours ago

    New York, United States Olsson Full time

    Olsson Senior Civil Engineer - Data Center Manhattan , Missouri Apply Now We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our...

  • Senior Data Center Engineer

    2 days ago

    New York, United States Jane Street Full time

    About the Position We're looking for an experienced Senior Data Center Engineer to design, build, scale, and perform daily upkeep in our regional data and colocation centers. This is a hands-on position that will require a strong communicator with excellent people skills who can manage projects and take ownership. You will join an interdisciplinary team made...

  • Sr Data Engineer

    1 month ago

    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Sr Data Engineer

    1 month ago

    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Data Engineer

    2 weeks ago

    New York, United States Vertisystem Full time

    Only W2 Candidate required:MUST BE FULLY KNOWLEDGABLE IN PYTHON, SQL, AND ETL Min 7 years • Ability to work as part of a team, as well as work independently or with minimal direction. • Excellent written, presentation, and verbal communication skills. • Collaborate with data architects, modelers and IT team members on project goals.Summary: The main...

  • Senior Data Engineer

    1 week ago

    New York, United States Vertisystem Full time

    Only W2 Candidate required:MUST BE FULLY KNOWLEDGABLE IN PYTHON, SQL, AND ETL Min 7 years • Ability to work as part of a team, as well as work independently or with minimal direction. • Excellent written, presentation, and verbal communication skills. • Collaborate with data architects, modelers and IT team members on project goals.Summary: The main...

  • Senior Data Engineer

    6 days ago

    New York, United States HappyFunCorp Full time

    Job DescriptionJob DescriptionSenior Data Engineer - Remote - Contract*This position is 100% remote*HappyFunCorp helps businesses develop great products and deliver powerful technical solutions with a blend of deep engineering skills, human-focused design, and a culture that makes working with us enjoyable. We've partnered with startups, small and...