Databricks Engineer

2 weeks ago

New York, United States AI Talent Flow Full time
Job DescriptionJob Description AI TalentFlow: Databricks Engineer

Fuel Innovation in Financial Services with Data Engineering Expertise

About AI TalentFlow:

AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who power those organizations. Our success is intertwined with your success, and we are committed to fueling the innovative spirit of our clients with top-tier talent in AI, Data, Analytics, Product, and Agile.

About the Role:

Are you a passionate data engineer with deep experience in the financial services industry? Do you thrive in a fast-paced environment and possess a strong understanding of data pipelines, machine learning, and cloud platforms? If so, this role might be the perfect fit for you

In this exciting opportunity, you will play a critical role in leveraging data to drive innovation within the financial services sector. You will collaborate with business stakeholders, data scientists, and software engineers to design, develop, and implement efficient and scalable data pipelines on Databricks. You will also be responsible for identifying and building valuable use cases for data within the financial services domain (e.g., trading, broker-dealer, asset management, investment management). This role offers the chance to make a real impact by contributing to the development of robust and repeatable data-driven solutions that deliver tangible business value.

Responsibilities:

  • Partner with business stakeholders to understand their data needs and identify high-impact use cases for data within the financial services industry.
  • Design, develop, and implement efficient and scalable data pipelines using Apache Spark on Databricks.
  • Develop and maintain data pipelines for various financial services domains, such as trading, risk management, portfolio analysis, and regulatory compliance.
  • Perform data cleaning and transformation tasks to ensure data quality and consistency.
  • Build robust and reusable data pipelines that adhere to best practices and coding standards.
  • Collaborate with data scientists to prepare data for machine learning models.
  • Develop and integrate Python scripts and SQL queries for data manipulation and analysis.
  • Leverage cloud platforms like AWS and Snowflake for data storage and integration.
  • Monitor and maintain data pipelines to ensure smooth operation and identify potential issues.
  • Stay up-to-date on the latest advancements in data engineering technologies and financial services trends.
  • Document data pipelines and processes for clear communication and knowledge sharing.

Qualifications:

  • 3+ years of experience as a Data Engineer or related role.
  • Strong understanding of data warehousing concepts and data modeling principles.
  • Extensive experience with Apache Spark and Databricks (or similar data processing frameworks).
  • Proficiency in Python and SQL, with experience in data manipulation and analysis libraries.
  • Experience building data pipelines for the financial services industry (e.g., trading, broker-dealer, asset management, investment management) is a strong plus.
  • Familiarity with cloud platforms like AWS and Snowflake for data storage and integration.
  • Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
  • A passion for learning and staying up-to-date on the latest advancements in data engineering technologies.

Ready to join a dynamic team and leverage your expertise to shape the future of financial services? We encourage you to apply


 

Powered by JazzHR

agdAScRJOa

  • Databricks Engineer

    1 week ago

    New York, United States EZDynamic, LLC Full time

    No Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Databricks EngineerRole & ResponsibilitiesDesigning, building, and maintaining medallion architecture-based data pipelines in Databricks platformsHandling raw data ingestion through Delta Live Tables while...

  • Databricks Engineer

    1 week ago

    New York, United States EZDynamic, LLC Full time

    No Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Databricks EngineerRole & ResponsibilitiesDesigning, building, and maintaining medallion architecture-based data pipelines in Databricks platformsHandling raw data ingestion through Delta Live Tables while...

  • Senior Staff Software Engineer

    7 days ago

    New York, NY, United States DataBricks Full time

    P-1125SummaryAt Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions.Our...

  • Senior Staff Software Engineer

    6 days ago

    New York, NY, United States DataBricks Full time

    P-1126SummaryAt Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions.Our...

  • Databricks Engineer

    3 weeks ago

    New York, United States AI TalentFlow Full time

    AI TalentFlow: Databricks Engineer Fuel Innovation in Financial Services with Data Engineering Expertise About AI TalentFlow: AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who power those organizations. Our success is intertwined with your success, and we are...

  • Databricks Engineer

    4 weeks ago

    New York, United States AI TalentFlow Full time

    AI TalentFlow: Databricks EngineerFuel Innovation in Financial Services with Data Engineering ExpertiseAbout AI TalentFlow:AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who power those organizations. Our success is intertwined with your success, and we are committed...

  • Databricks Engineer

    1 week ago

    New York, United States AI Talent Flow Full time

    AI TalentFlow: Databricks Engineer Fuel Innovation in Financial Services with Data Engineering Expertise About AI TalentFlow: AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who power those organizations. Our success is intertwined with your success, and we are...

  • Databricks Engineer

    3 days ago

    New York, United States AI TalentFlow Full time

    AI TalentFlow: Databricks EngineerFuel Innovation in Financial Services with Data Engineering ExpertiseAbout AI TalentFlow:AI TalentFlow specializes in accelerating startup growth, scaling enterprise solutions, and nurturing the career growth of the individuals who power those organizations. Our success is intertwined with your success, and we are committed...

  • Senior Data Architect, Databricks Expert

    2 weeks ago

    New York, United States Harnham Full time

    Senior Data Architect Fully Remote6-Month Contract, possible extensions$95-$115/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their...

  • Sr. Data Architect Azure

    2 weeks ago

    New York, United States Diverse Lynx Full time

    Title Sr. Data Architect Azure & Databricks Duration 12 Months Location New York / Weehawken, NJ (Day 1 onsite ) Mandatory Skills Databricks, Azure Datalake, PySpark, Java. No of Open Positions 1 Job Description : Minimum 12+ years of IT experience and at least 5+ years in cloud native data engineering solution design/architecture and...

  • Senior Data Engineer

    4 weeks ago

    New York, New York, United States The Cypress Group Full time

    Location: Fully Remote (Must live in the US)We are seeking a Senior Data Engineer to join our team and play a crucial role in scaling out our healthcare marketing platform.As a key member of our engineering team, you will be working with Scala, Apache Spark, and Databricks to develop and maintain our data infrastructure.Develop and maintain scalable data...

  • Sr. Cloud Data Engineer

    1 week ago

    New York, United States EZDynamic, LLC Full time

    No Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Cloud Data Engineer: This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is...

  • Sr. Cloud Data Engineer

    1 week ago

    New York, United States EZDynamic, LLC Full time

    No Visa sponsorship (Only GC holders or U.S. Citizens may apply)- - Please answer all questions provided. Incomplete submissions will NOT be reviewed - -Cloud Data Engineer: This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is...

  • Software Engineer, Data

    6 days ago

    New York, United States Simplebet Full time

    Our mission is to power the future of fan engagement.  Simplebet is a B2B sports technology company that uses machine learning and real-time solutions to make every moment of every sporting event a betting opportunity. We’re reimagining how people enjoy sports with products that are simple, intuitive, and entertaining. Our technology powers micro-betting...

  • Software Engineer, Data

    2 weeks ago

    New York, New York, United States Simplebet Full time

    Our mission is to power the future of fan engagement. Simplebet is a B2B sports technology company that uses machine learning and real-time solutions to make every moment of every sporting event a betting opportunity. We're reimagining how people enjoy sports with products that are simple, intuitive, and entertaining. Our technology powers micro-betting...

  • Product Manager

    4 weeks ago

    new york, United States Atechstar Full time

    Your responsibilitiesDeeply understand and communicate user needs and use cases around the Databricks and Spark ecosystems. Devise define and communicate a product strategy for improving the experience of writing and running data pipelines that use Databricks or Spark Guide our development teams to deliver powerful polished features are Educate our field...

  • Product Manager

    3 weeks ago

    New York, New York, United States Atechstar Full time

    Your responsibilitiesDeeply understand and communicate user needs and use cases around the Databricks and Spark ecosystems. Devise define and communicate a product strategy for improving the experience of writing and running data pipelines that use Databricks or Spark Guide our development teams to deliver powerful polished features are Educate our field...

  • azure data engineer

    12 hours ago

    New York, New York, United States Atechstar Full time

    Job Description Roles and ResponsibilitiesExperience in Perform Design Development & Deployment using Azure Services (Data Factory Databricks PySpark SQL) Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity. Experience in create the Technical Specification...

  • azure data engineer

    1 month ago

    New York, New York, United States Atechstar Full time

    Job DescriptionRoles and ResponsibilitiesExperience in Perform Design Development & Deployment using Azure Services (Data Factory Databricks PySpark SQL) Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity. Experience in create the Technical Specification Design...

  • Senior Data Engineer

    5 days ago

    New York, United States Blood Bank of Delmarva Full time

    Overview At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...