Staff Data Engineer

4 weeks ago


Boston MA United States State Street Corporation Full time
Who we are looking for
The State Street Security Architecture, Analytics & Fusion Engineering (SA 2 FE) team is looking for a Staff Data Engineer, Integrations Lead . The Fusion Analytics and Data Engineering team delivers models, insights, and tooling to help Cybersecurity teams make faster, more informed decisions as we work to secure State Street's digital footprint. As a Data/Analytics Engineer, you will develop the data flows, analytics pipelines, and production machine-learning systems -- in collaboration with data product managers, architects, engineers, and other team members -- to create analytics & ML-driven data products that support our mission to build predictive models and intelligent systems that help secure State Street's information and infrastructure. This is a unique greenfield project and we are looking for an experienced technical leader with broad experience in architecture, operations, and engineering to help design and deliver a model platform, and lead and mentor a growing team of cybersecurity data professionals.

Due to the role requirements this job needs to be performed primarily in the office with some flex work opportunities available.

What you will be responsible for
As a Staff Cyber Data Engineer, Integrations Lead you will
  • Design and build global distributed petabyte scale data-mesh systems for high availability, high throughput, data consistency, security, and privacy, defining our next generation of security data analytics tooling.
  • Use your understanding of large scale data processing and analytics to wrangle our unique cybersecurity data and create analyses and tools that point to the most significant business, governance, and risk management impacts.
  • Design and build petabyte scale systems for high availability, high throughput, data consistency, security, and end user privacy, defining our next generation of data analytics tooling
  • Build data modeling and ELT workflows to produce Raw, Rationalized, co-Related, and Reporting data flows for graph, timeseries, structured, and semi-structured cybersecurity data
  • Work alongside the global cybersecurity architecture & engineering leadership to develop and deliver capabilities to support Cyber Data Science initiatives both internally and in partnership with detection and response teams, and governance and risk management teams across our CISO organization.
  • Mentor and train engineers and architects, and build out a Data Mesh, Lakehouse, Kappa Streaming and Data Security Architecture practice.


What we value
These skills will help you succeed in this role
  • 10+ years of experience with Python, Java, or similar languages, with cloud infrastructure (e.g. AWS, GCP, Azure), and deep experience working with big data processing infrastructures and ELT orchestration
  • Experience developing distributed batch and real-time feature stores, and developing coordinated batch, streaming and online model execution workflows, building and optimizing large scale data processing jobs in Spark, GraphX/GraphFrames, Spark Structured Streaming, as well as scaling graph and time-series native operations.
  • Experience with designing for data lineage, federation, governance, compliance, security, and privacy - hands on experience with commercial DataSecOps platforms like Immuta, Satori and/or experience building custom access control (RBAC/ABAC), data masking, tokenization, and FPE systems for cloud data lake environments. Experience with globally distributed federated data systems is highly desirable.
  • Experience with data quality monitoring and with building continuous data pipelines and implementing history and time-travel using modern data lake storage layers like Delta Lake, Iceberg, and LakeFS
  • Experience with MLOps and iterative cycles of end-to-end development, MRM coordination, deployment, and monitoring of production grade ML models in a regulated high-growth tech environment5+ years of experience with Python, Java, or similar languages, with cloud infrastructure (e.g. AWS, GCP, Azure), and deep experience working with big data processing infrastructures and ELT orchestration

Education & Preferred Qualifications
  • B.S., M.S., or PhD. in Computer Science or equivalent work experience
  • 8+ years of experience building large scale distributed systems and data analytics processes on cloud native, in-memory, and fit-for-purpose hybrid infrastructure. Experience with cybersecurity data and globally distributed log & event processing systems with data mesh and data federation as the architectural core is highly desirable.
  • Experience in big data technologies like Presto/Trino, Spark & Flink, Airflow & Prefect, RedPanda & Kafka, Iceberg & Delta Lake, Snowflake & Databricks, MemGraph & Neo4J as well as modern security tooling like Splunk, Panther, Datadog, Elastic, Arcsight etc.
  • Experience designing and building data warehouse, data lake or lake house using batch, streaming, lambda and data mesh solutions and with improving efficiency, scalability, and stability of system resources.
  • Experience working with data warehouses or Databases like Snowflake, Redshift, Postgres, Cassandra etc
  • Experience writing and optimizing complex SQL and ETL development and designing and building data warehouse, data lake or lake house solutions. Experience building Data APIs and integrations using tools like GraphQL, Apache Arrow, gRPC, ProtoBuf, designing large scale stream processing systems with Flink, Kafka, NiFI, and similar technologies.
  • Experience with distributed systems and distributed data storage and large-scale data warehousing solutions, like BigQuery, Athena, Snowflake, Redshift, Presto, etc.
  • Experience working with large datasets and best in class data processing technologies for both stream and batch processing, graph and time series data, notebooks and analytic visualization environments.
  • Strong communication and collaboration skills particularly across teams or with functions like data scientists or business analyst.

Are you the right candidate? Yes
We truly believe in the power that comes from the diverse backgrounds and experiences our employees bring with them. Although each vacancy details what we are looking for, we don't necessarily need you to fulfil all of them when applying. If you like change and innovation, seek to see the bigger picture, make data driven decisions and are a good team player, you could be a great fit.
Why this role is important to us
Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.

We offer a collaborative environment where technology skills and innovation are valued in a global organization. We're looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company.

Join us if you want to grow your technical skills, solve real problems and make your mark on our industry.

About State Street
What we do. State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we're making our mark on the financial services industry. For more than two centuries, we've been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.
Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary by location, but you may expect generous medical care, insurance and savings plans, among other perks. You'll have access to flexible Work Programs to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.
Inclusion, Diversity and Social Responsibility. We truly believe our employees' diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.
State Street is an equal opportunity and affirmative action employer.

Salary Range:
$140,000 - $222,500 Annual
The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.


  • Boston, United States Lilt Full time

    Job DescriptionJob DescriptionSTAFF DATA ENGINEERLILT is the leading AI solution for enterprise translations. Our stack made up of our Contextual AI Engine, Connector APIs, and Human Adaptive Feedback enables global organizations to adopt a true AI translation strategy, focusing on business outcomes instead of outputs. With LILT, innovative,...

  • Staff Engineer, Data

    3 weeks ago


    Boston, United States AcuityMD Full time

    AcuityMD is a technology company that connects software and data to help MedTech companies of all sizes transform how they bring their products to market. Each year, the FDA approves ~6,000 new medical devices. Our platform helps MedTech companies identify opportunities where physicians and sites of care can better serve their patients so they can improve...


  • Boston, MA, United States Commonwealth of Massachusetts Full time

    The Executive Office of Technology Services and Security (EOTSS) places our customers and constituents at the heart of everything we do. We offer responsive digital services and productivity tools to more than 40,000 state employees, who provide essential information and services to the citizens of the Commonwealth. We also serve constituents, providing...

  • VP Data Engineering

    2 weeks ago


    Boston, MA, United States Socium Recruitment Full time

    VP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. As the VP of Data Engineering, you'll be the mastermind behind our data strategy and the leader of our data engineering dream team....


  • Boston, MA, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, iTech Solutions, is seeking the following. Apply via Dice today! Azure Data Lake Principal Architect Hybrid Position 1-2x a week onsite at client Direct Hire/Perm Hours: 8:30am-5pm Candidate needs to have experience doing solution architecture on Azure....

  • VP Data Engineering

    2 weeks ago


    Boston, MA, United States Socium Recruitment Full time

    VP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They aren’t afraid to do things differently, and they’re on a mission to make a real impact with our innovative...


  • Boston, MA, United States WiseHire Recruitment Full time

    WiseHire are seeking a Head of Data Engineering to lead the Analytics, Data Science, and Data Engineering teams within a growing organization. You'll shape the data strategy, architecture, data platform, and collaborate with various stakeholders to address their data needs, all while aligning with the wider business goals. This hands-on role involves...


  • Boston, MA, United States Constant Contact, Inc. Full time

    At Constant Contact, we're on a quest to revolutionize our data capabilities. We're looking for a visionary Director of Data Engineering & Data Warehousing to lead this transformation. In this senior leadership role, you'll be overseeing the development, implementation, and management of our D&A data lake as part of an evolving enterprise...

  • VP of Data Engineering

    2 months ago


    Boston, MA, United States Selby Jennings Full time

    Qualifications Possess a Bachelor's degree or higher in Computer Science, Management Information Systems, Business Information Systems, Mathematics, or a related field. Have over 7 years of experience in data engineering, including leadership roles within agile environments, focused on delivering top-tier technological solutions using modern SDLC...

  • VP of Data Engineering

    2 months ago


    Boston, MA, United States Selby Jennings Full time

    Qualifications Possess a Bachelor's degree or higher in Computer Science, Management Information Systems, Business Information Systems, Mathematics, or a related field. Have over 7 years of experience in data engineering, including leadership roles within agile environments, focused on delivering top-tier technological solutions using modern SDLC...


  • Boston, United States Ellevation Education Full time

    **Staff Engineer/Tech Lead (Analytics Data Warehouse)** Boston, MA or Remote / Engineering Engineering / Full Time Over the last 10 years, Ellevation Education has built a thriving business serving the administrators, teachers, and specialists who support English Learners at public schools across the US. Today, over 1,000 school districts use our software to...


  • Boston, United States Ellevation Education Full time

    **Staff Engineer/Tech Lead (Analytics Data Warehouse)** Boston, MA or Remote / Engineering Engineering / Full Time Over the last 10 years, Ellevation Education has built a thriving business serving the administrators, teachers, and specialists who support English Learners at public schools across the US. Today, over 1,000 school districts use our software to...


  • Boston, MA, United States Shift Technology Full time

    Did you know that about 10% of all insurance payouts are flowing directly into the pockets of fraudsters? The future of insurance starts with Decisions Made Better. Shift Technology harnesses the power of AI to enable the world’s leading insurance organizations to make better decisions. Our products automate and optimize decisions from underwriting to...


  • Boston, MA, United States Videa Health, Inc. Full time

    Staff Machine Learning Engineer (Deep Learning) VideaHealth is a cutting-edge AI-powered solution for dentistry, developed by a team of seasoned leaders, engineers, AI scientists, and clinicians spun out of MIT. Our product is already used by thousands of dental clinicians to improve the quality of care through faster diagnoses, increase operating...


  • Boston, MA, United States Quantexa Full time

    Job Description Job Description Founded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 8 years, 15 locations and 700+ employees later we still believe that today. We connect the dots within our customers data using dynamic entity resolution and...

  • Data Engineer

    2 months ago


    Boston, Massachusetts, United States Northeastern University Full time

    The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration.The College's schools, departments, and programs—with disciplines...

  • Data Engineer

    2 months ago


    Boston, United States Northeastern University Full time

    The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration. The College’s schools, departments, and programs—with...

  • Data Engineer

    1 week ago


    Boston, United States Northeastern University Full time

    The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration. The College’s schools, departments, and programs—with...

  • Data Engineer

    2 weeks ago


    Boston, Massachusetts, United States Northeastern University Full time

    The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration.The College's schools, departments, and programs—with disciplines...


  • Boston, United States Zing Data Full time

    You’ll help implement and bring to market core features on Zing Data’s platform for next-generation business intelligence that is collaborative, easy, and works on iOS, Android and the web. You’ll be working on the core user experience of our product that has multiple front ends - web, iOS, Android. We’re looking to extend the footprint of this...