Data Engineer Lead

3 days ago

Quincy, Massachusetts, United States State Street Bank Full time
Job Title: Data Engineer Lead - Sr. Position

We are seeking a highly skilled Data Engineer Lead to join our team at State Street Bank. As a key member of our Global Technology Services (GTS) team, you will play a critical role in driving the company's digital transformation and expanding business capabilities using industry best practices and advanced technologies.

Key Responsibilities:

  • Design, develop, and maintain data pipelines in Azure for ingesting, transforming, and loading data from various sources into centralized Azure data lakes and Databricks Delta Lake.
  • Ensure data quality and integrity throughout the process.
  • Implement efficient ELT/ETL processes to ensure data quality, consistency, and reliability.
  • Develop transformation processes to clean, aggregate, and enrich raw data, ensuring it is in the appropriate format for downstream analysis and consumption.
  • Integrate data from diverse sources to provide a unified view of information.
  • Design and implement efficient data models and database schemas that support the storage and retrieval of structured and unstructured data.
  • Optimize data storage and access for performance and scalability.
  • Implement knowledge of modern data processing principles to streamline data import/transformation processes.
  • Leverage modern data pipeline tools to reduce human attention during ETL process.
  • Ensure the efficiency and reliability of data ingestion and processing.
  • Work closely with cross-functional teams to understand data requirements and translate them into technical solutions.
  • Monitor data pipelines, troubleshoot issues, and ensure data integrity and security.
  • Implement data quality controls and validation processes to identify and rectify data anomalies, inconsistencies, and errors.
  • Collaborate with stakeholders to define and enforce data governance standards and policies.
  • Identify performance bottlenecks in data pipelines and database systems and optimize queries, data structures, and infrastructure configurations to improve overall system performance and scalability.
  • Implement appropriate security measures to protect sensitive data and ensure compliance with data privacy regulations.
  • Monitor and address data security vulnerabilities and risks.
  • Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver effective data solutions.
  • Document data engineering processes, data flows, and system configurations.
  • Stay updated with the latest trends, tools, and technologies in the field of data engineering.
  • Proactively identify opportunities to improve data engineering practices and contribute to the evolution of data infrastructure.
  • Provide support to the development team with managing multiple instances of databases and servers, implementing complex queries with proper tuning, provide input to design impacting data, manage data infrastructure in Azure (DataLake, DataWarehouse and Synapse).

Requirements:

  • Hands-on experience with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure SQL Database, etc.
  • Strong experience in data engineering, including data pipeline development, ETL/ELT processes, and data modeling.
  • Strong proficiency in SQL and experience with programming languages such as Scala, or Java.
  • In-depth knowledge of SQL and experience with relational and non-relational databases such as Snowflake, SQLServer, Oracle.
  • Knowledge of data warehousing concepts, dimensional modeling, and best practices.
  • Experience working in a multi-developer environment, using version control (i.e. Git).
  • Excellent problem-solving skills and ability to work independently as well as part of a team.
  • Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect is a plus.
  • Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
  • Bachelor's Degree level qualification in a computer or IT related subject.
  • 10+ years of overall IT industry experience.
  • 8+ years of overall Bigdata data pipeline experience.
  • 8+ years of experience as a Data Engineer, with a focus on designing and implementing data solutions on the Azure Databricks.
  • 8+ years of experience on cloud-based development including Azure Services, Azure Devops, Kubernetes, Docker.
  • Experience on Snowflake is plus.

About State Street:

State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we're making our mark on the financial services industry. For more than two centuries, we've been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.

What We Value:

We truly believe our employees' diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.

Salary Range: $120,000 - $202,500 Annual

Location: Quincy, Massachusetts

Type: Full time

  • Data Engineer Lead

    22 hours ago

    Quincy, Massachusetts, United States Peapod Digital Labs Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer Lead to join our team at Peapod Digital Labs. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our data infrastructure to support business growth and innovation.Key Responsibilities:Design and develop data pipelines and architectures...

  • Data Engineering Lead

    3 weeks ago

    Quincy, Massachusetts, United States State Street Bank Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at State Street Bank. As a Data Engineering Lead, you will be responsible for designing, developing, and maintaining large-scale data pipelines and systems that support the acquisition, storage, transformation, and analysis of large volumes of data.Key ResponsibilitiesDesign...

  • Critical Facilities Engineer

    5 days ago

    Quincy, Massachusetts, United States Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of data center services, committed to delivering high-quality, reliable, and efficient solutions to our customers. Our team is dedicated to creating a workplace of inclusion, equity, respect, and acceptance, where everyone feels valued and empowered to contribute their best work.Job...

  • Data Engineer

    3 weeks ago

    Quincy, Massachusetts, United States Brooksource Full time

    Job Title: Data EngineerBrooksource is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and develop cloud-based data management systemsTranslate business requirements into user-acceptable...

  • Data Engineer

    3 days ago

    Quincy, Massachusetts, United States Brooksource Full time

    Job Title: Data EngineerBrooksource is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and develop cloud-based data management systemsTranslate business requirements into user-acceptable...

  • Data Engineer

    3 weeks ago

    Quincy, Massachusetts, United States Tata Consultancy Services Full time

    Job Title: Database DeveloperJob Summary:We are seeking a highly skilled Database Developer to join our team at Tata Consultancy Services. The ideal candidate will have extensive experience in Databricks, Snowflake, and ETL concepts, with a strong background in Scala programming language.Key Responsibilities:Design and develop scalable data engineering...

  • Data Engineer II

    21 hours ago

    Quincy, Massachusetts, United States Peapod Digital Labs Full time

    Job Title: Data Engineer IIAt Peapod Digital Labs, we're seeking a highly skilled Data Engineer II to join our team. As a key member of our data engineering team, you will contribute to the design, development, and maintenance of our data pipelines and architecture.Key Responsibilities:Design and develop data pipelines to support business intelligence and...

  • Cloud Data Engineer

    1 month ago

    Quincy, Massachusetts, United States State Street Corporation Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team at State Street Corporation. As a Cloud Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems in the cloud.Key ResponsibilitiesDesign and develop scalable data processing systems using cloud-based technologies...

  • Cloud Engineering Lead

    23 hours ago

    Quincy, Massachusetts, United States NavitsPartners Full time

    Job Title : Senior Cloud EngineerDuration : 12 monthsLocation : Quincy, MA (Hybrid)Summary:NavitsPartners is seeking a Senior Cloud Engineer to lead the design, implementation, and support of a Data Platform as part of a Data Modernization program. The role will support central data capabilities across various agencies, including work with cloud data tools...

  • Software Engineering Lead

    1 month ago

    Quincy, Massachusetts, United States State Street Full time

    About the RoleWe are seeking a highly skilled and experienced technical professional to join our team at State Street as a Software Engineering Lead. This is a key role that will involve driving technical excellence and delivering application solutions across our DataGX platform.Key ResponsibilitiesDrive technical excellence by analyzing, designing,...

  • Data Architect with Data Governance

    3 days ago

    Quincy, Massachusetts, United States eTek IT Services, Inc. Full time

    Job OverviewWe are seeking a highly skilled Data Architect to lead our data management initiatives. The successful candidate will have a strong background in data governance, quality engineering, and data management.Key Responsibilities:Design and implement data governance and quality tooling programsLead large-scale data integration and modernization...

  • Data Engineer with Databricks and Azure

    12 hours ago

    Quincy, Massachusetts, United States Syntricate Technologies Full time

    Job Title: Data Engineer with Databricks and AzureJob Description:We are seeking a highly skilled Data Engineer with expertise in Databricks and Azure to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining cloud-based data systems using Databricks and Azure. Your primary focus...

  • Software Engineering Lead

    4 weeks ago

    Quincy, Massachusetts, United States State Street Full time

    About the RoleWe are seeking a highly skilled technical professional to join our team at State Street as a Software Engineering Lead. In this role, you will be responsible for driving technical excellence and delivering application solutions by collaborating with on-shore and off-shore teams.Key ResponsibilitiesDrive technical excellence by analyzing,...

  • Data Scientist

    4 weeks ago

    Quincy, Massachusetts, United States Pro IT Inc Full time

    Job OverviewPro IT Inc is seeking a highly skilled Data Engineer to lead the development and design of our big data platform using Hadoop and Scala.Key ResponsibilitiesDesign and develop scalable big data solutions using Hadoop and Scala.Collaborate with cross-functional teams to integrate data engineering solutions with existing systems.Develop and maintain...

  • Data Architect with Data Management Expertise

    3 weeks ago

    Quincy, Massachusetts, United States eTek IT Services, Inc. Full time

    Job OverviewWe are seeking a highly skilled Data Architect with expertise in Data Management to join our team at eTek IT Services, Inc. As a key member of our organization, you will be responsible for leading the design, configuration, and implementation of data management platforms and components.Key ResponsibilitiesLead the design, configuration, and...

  • Senior Data Architect and Engineer

    4 weeks ago

    Quincy, Massachusetts, United States State Street Corporation Full time

    About the RoleWe are seeking a highly skilled Data Architect and Engineer to join our team at State Street Corporation. As a key member of our Global Technology Services (GTS) team, you will play a crucial role in driving our digital transformation and expanding business capabilities using industry best practices and advanced technologies.Key...

  • Senior Data Engineer Position

    4 days ago

    Quincy, Massachusetts, United States Apex Systems Full time

    Job Title: Senior Data EngineerJob Description:A world-class technology services business, Apex Systems, is seeking a highly skilled Senior Data Engineer to join their team. As a Senior Data Engineer, you will be responsible for designing, implementing, and supporting cloud applications and AWS services. Your expertise in cloud database platforms, such as...

  • Senior Data Architect and Engineer

    1 week ago

    Quincy, Massachusetts, United States State Street Full time

    About the RoleWe are seeking a highly skilled Data Architect and Engineer to join our team at State Street. As a key member of our Global Technology Services (GTS) team, you will play a crucial role in designing, developing, and implementing data infrastructure and analytics initiatives.Key ResponsibilitiesDesign and develop data pipelines to efficiently...

  • Route/Switch Lead Engineer

    4 weeks ago

    Quincy, Massachusetts, United States World Wide Technology Full time

    About the RoleWe are seeking a highly skilled Route/Switch Engineer / Deployment Engineer to lead our network migration and deployment projects. The ideal candidate will possess deep expertise in routing and switching, with a strong emphasis on BGP and complex setups.This role requires a high degree of independence and technical acumen, particularly in...

  • Data Scientist

    3 weeks ago

    Quincy, Massachusetts, United States Pro IT Inc Full time

    Job OverviewPro IT Inc is seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing big data platforms using Hadoop and Scala.Key ResponsibilitiesDesign and develop big data platforms using Hadoop and Scala.Develop and maintain data pipelines to ensure data...