Data Engineer

6 days ago

Bellevue, WA, United States Diverse Lynx Full time
Role - Data Engineer / Support Analyst - Databricks

Location: New York, NY / Hamilton Township, NJ /Bellevue, WA - onsite

Contract

Job Description

We are seeking an experienced Data Engineer / Support Analyst with strong expertise in Databricks, Azure cloud services and batch job support. The ideal candidate will have a background in financial markets or trading systems, with hands-on experience managing data pipelines, FTP file transfers, and real-time/batch processing in a production environment.

Key Responsibilities:

Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.

Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.

Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.

Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.

Manage FTP/SFTP file transfers between internal systems and external vendors.

Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.

Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.

Required Skills & Experience:

10+ years of experience in data engineering or production support within financial services or trading environments.

Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric.

Strong Python and SQL programming skills.

Experience with Bloomberg data feeds (BPIPE, TSIP,SFTP).

Experience with Git, CI/CD pipelines, and Azure DevOps.

Proven ability to support batch jobs, troubleshoot failures, and manage job scheduling.

Experience handling FTP/SFTP file transfers and automation (e.g., using scripts or managed file transfer tools).

Solid understanding of equities trading, fixed income trading, trading workflows, and financial instruments.

Excellent communication, problem-solving, and stakeholder management skills.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • Principal Architect, Data Center Engineering

    2 weeks ago

    Bellevue, WA, United States Fleet Data Centers Full time

    Fleet Data Centers designs, builds and operates mega-scale data center campuses. Fleet provides its customers flexibility and predictability to meet their upside demand forecasts, addressing a key need in the market as traditional leased models are struggling to keep pace with the demand for new Cloud and AI infrastructure. Fleet is led by a team of industry...

  • Data Architect

    2 days ago

    Bellevue, WA, United States Anicca Data Science Solutions Full time

    Benefits: 401(k) Paid time off Requirements: Shall at a minimum have a Bachelor’s degree in Computer Science, Computer Engineering, Data Science, Information Technology Management or Engineering, or other comparable Certifications or experience in the data domain. Shall have a minimum of five (5) years of experience in the data-related roles, including...

  • Data Engineer

    7 days ago

    Bellevue, WA, United States META Full time

    Summary: Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D...

  • Data Engineer

    6 days ago

    Bellevue, WA, United States META Full time

    Summary: Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D...

  • Data Engineer

    4 days ago

    Bellevue, WA, United States META Full time

    Summary: Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D...

  • Data Engineer

    2 weeks ago

    Bellevue, WA, United States META Full time

    Summary: Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D...

  • Data Engineer

    1 week ago

    Bellevue, WA, United States META Full time

    Summary: Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D...

  • Data Engineer

    2 days ago

    Bellevue, WA, United States META Full time

    Summary: Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D...

  • Data Engineer

    2 days ago

    Bellevue, WA, United States Purple Drive Full time

    Key Responsibilities Responsibilities and essential job functions include but are not limited to the following: Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities Build fault-tolerant, self-healing, adaptive, and...

  • Data Engineer

    2 weeks ago

    Bellevue, WA, United States Purple Drive Full time

    Key Responsibilities Responsibilities and essential job functions include but are not limited to the following: Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities Build fault-tolerant, self-healing, adaptive, and...