Senior Data Engineer

3 weeks ago

New York, United States Bloomberg Full time
Bloomberg's Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases. We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products.

At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets.

Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009. We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions. Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most.

We are looking for skilled Senior Data Engineers to join our team if you have a strong background in software development and a passion for data science. You will work with us on building technologies and tools to ensure the correctness of our search datasets, to protect our clients' personally identifiable information, and to enable key stakeholders to derive insights for the purposes of informing their decisions on the future development of Bloomberg's Search products.

Join the AI Group as a Senior Data Engineer and you will have the opportunity to:

  • Develop and maintain a productionized logging system that produces verifiably correct datasets to support both online Business Intelligence applications as well as offline ML Model training and evaluation pipelines.
  • Implement reusable, efficient, maintainable, and testable code that works on different platforms and scales to billions of data points for the purposes of sessionization, ingestion, and metrics computation.
  • Work with application and product teams to define data needs and SLAs, then implement a data model using idiomatic schema designs tailored to the dataset's intended use case.
  • Design and implement metrics measuring various aspects of the Bloomberg search experience and create Business Intelligence dashboards to help subject matter experts continuously monitor quality, extract actionable insights, and identify new feature development opportunities.


We are looking for a Senior Data Engineer with:

  • 4+ years of experience working with Python and at least one other object-oriented programming language (C/C++, Java, etc.).
  • A degree in Computer Science, Engineering, Mathematics, or similar field of study or equivalent work experience.
  • An understanding of Computer Science fundamentals such as data structures and algorithms and a data oriented approach to problem-solving.
  • Excellent communication skills and the ability to collaborate with engineering peers as well as non-engineering stakeholders.
  • A proven track record building ETL pipelines leveraging technologies such as Kafka Streams, Kafka Connect, Flink, or Spark Streaming.
  • Prior experience building or extending data lakes, using various storage, cataloging, and retrieval technologies such as S3, HDFS, Hadoop, HBase, Hive, Trino, Presto, Cassandra, Spark.
  • Familiarity with workflow orchestration technology, such as Argo, Airflow, or Oozie.

  • Senior Security Systems Engineer

    1 month ago

    New York, New York, United States Acquired Data Solutions Full time

    Job Title: Senior Security Systems EngineerWe are seeking a highly skilled Senior Security Systems Engineer to join our team at Acquired Data Solutions, Inc. in Egg Harbor, NJ.Job Summary:The successful candidate will be responsible for performing in-depth engineering analysis of security-related systems to determine their potential for further development,...

  • Senior Data Engineer

    2 months ago

    New York, United States Coda Search│Staffing Full time

    A tech startup company in the healthcare space is looking to hire a Senior Data Engineer.Duties & Essential Job FunctionsDevelop, release, and maintain high quality data pipelines using Python, FiveTran, DBT, and SnowflakeOwn and guide the development of our data infrastructureDevelop custom integrations using DagsterConfigure reverse ETL integrations using...

  • Senior Data Engineer

    2 months ago

    New York, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Senior Data Engineer

    3 months ago

    New York, United States Roots Automation Full time

    Senior Data Engineer Company Overview: At Roots, our mission is to make work more human. We are developing fully autonomous, AI-powered Digital Coworkers that streamline tedious and repetitive tasks for the enterprise. By tackling core challenges in natural language understanding and computer vision, we are building an automation product that embodies the...

  • Senior Data Engineer

    1 month ago

    New York, New York, United States VALiNTRY Full time

    Job SummaryVALiNTRY is seeking a highly skilled Senior Analytics Engineer to support our Business Intelligence lead in managing the enterprise's data pipeline and ecosystem from end to end. As a key member of our team, you will collaborate with cross-functional business partners to understand their needs and transform raw data into actionable insights.Key...

  • Senior Data Infrastructure Engineer

    4 weeks ago

    New York, New York, United States Vimeo Full time

    Job Title: Senior Data Infrastructure EngineerJob Summary:Vimeo is seeking a highly skilled Senior Data Infrastructure Engineer to manage and optimize our vector databases and data stores, including Elastic Search and AWS OpenSearch. The ideal candidate will have a strong background in cloud platforms and SRE principles, as well as experience leading data...

  • Senior Data Engineer

    2 months ago

    New York, United States Capital One Full time

    114 5th Ave (22114), United States of America, New York, New YorkSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Senior Data Engineer

    4 weeks ago

    new york city, United States Coda Search│Staffing Full time

    A tech startup company in the healthcare space is looking to hire a Senior Data Engineer.Duties & Essential Job FunctionsDevelop, release, and maintain high quality data pipelines using Python, FiveTran, DBT, and SnowflakeOwn and guide the development of our data infrastructureDevelop custom integrations using DagsterConfigure reverse ETL integrations using...

  • Senior Data Engineer

    1 month ago

    new york city, United States Coda Search│Staffing Full time

    A tech startup company in the healthcare space is looking to hire a Senior Data Engineer.Duties & Essential Job FunctionsDevelop, release, and maintain high quality data pipelines using Python, FiveTran, DBT, and SnowflakeOwn and guide the development of our data infrastructureDevelop custom integrations using DagsterConfigure reverse ETL integrations using...

  • Senior Data Science Engineer

    3 months ago

    New York, United States Publicis Sapient Full time

    Job Description Your Impact: The purpose of the Senior Associate, Data Science is to work with clients undergoing a data-driven transformation (DDT) across the globe. The Senior Associate will accelerate and drive the DDT strategy for clients, working in partnership with digital directors, client teams, and practice capability. Furthermore, the...

  • Senior Data Engineer

    2 months ago

    New York, United States Capital One Full time

    Center 2 (19050), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Senior Data Engineer

    2 months ago

    New York, United States Capital One Full time

    West Creek 1 (12071), United States of America, Richmond, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Senior Data Engineer

    2 months ago

    New York, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...

  • Senior Data Engineer

    2 months ago

    New York, United States Capital One Full time

    130 5th Ave (22130), United States of America, New York, New YorkSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Senior Data Engineer

    1 month ago

    NEW YORK, United States Capital One Careers Full time

    114 5th Ave (22114), United States of America, New York, New YorkSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors,...

  • Senior Data Platform Engineer

    5 months ago

    New York, United States Harnham Full time

    Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hrIt's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join their...

  • Data Engineer

    6 months ago

    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Senior Data Engineer

    2 months ago

    New York, United States Capital One Full time

    11 West 19th Street (22008), United States of America, New York, New YorkSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...

  • Data Engineer

    2 weeks ago

    New York, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...

  • Senior Data Engineer

    2 weeks ago

    New York, United States DailyPay Full time

    Job DescriptionJob DescriptionAbout Us:DailyPay, Inc. is transforming the way people get paid. As the industry's leading on-demand pay solution, DailyPay uses an award-winning technology platform to help America's top employers build stronger relationships with their employees. This voluntary employee benefit enables workers everywhere to feel more...