Databricks Engineer

2 weeks ago


San Francisco, California, United States Bayone Full time
Job Summary:

Bayone is seeking a highly skilled Databricks Engineer to join our team. The ideal candidate will have expertise in optimizing Databricks streaming jobs, managing large clusters, and setting up policies for cost allocation. Additionally, they should have experience with monitoring tools, Azure Storage life cycle management, and Azure DevOps. Knowledge of Azure recommendations and CosmoDB fine-tuning is a plus.

Key Responsibilities:

Optimize Databricks streaming jobs for improved performance and efficiency
Manage large Databricks clusters and set up policies for cost allocation
Implement monitoring tools for long-running unattended pipelines and report failures
Set up Azure Storage life cycle management policies for data tiering
Collaborate with the team to roll out new AI-enabled and data-driven features and functionalities

Requirements:

3+ years of experience in Databricks development and optimization
Strong knowledge of Azure Storage life cycle management and Azure DevOps
Experience with monitoring tools and CosmoDB fine-tuning
Excellent problem-solving skills and attention to detail

What We Offer:

Competitive salary and benefits package
Opportunities for professional growth and development
Collaborative and dynamic work environment

How to Apply:

If you are a motivated and experienced Databricks Engineer looking for a new challenge, please submit your resume and cover letter for consideration.

  • San Francisco, California, United States Databricks Full time

    About the RoleDatabricks is seeking a seasoned Product Manager to lead the development of our SaaS product, driving growth and customer adoption. As a key member of our team, you will be responsible for defining and executing the product strategy, working closely with cross-functional teams to deliver a world-class product.Key ResponsibilitiesDevelop and...

  • Databricks Engineer

    2 weeks ago


    San Francisco, California, United States Bayone Full time

    Job Title: Databricks EngineerWe are seeking a highly skilled Databricks Engineer to join our team at Bayone. As a Databricks Engineer, you will play a key role in helping us roll out new AI-enabled and data-driven features, functionalities, and personalization.Key Responsibilities:Optimize Databricks Streaming Jobs: Utilize your expertise to optimize...


  • San Francisco, California, United States Databricks Full time

    Job Title: Senior Engineering ManagerWe are seeking a highly skilled Senior Engineering Manager to lead our Vector Search team at Databricks. As a key member of our engineering organization, you will be responsible for developing and operating a highly-available cloud native Vector Search service.About the RoleThe successful candidate will have a strong...


  • San Francisco, California, United States Databricks Full time

    Job SummaryWe are seeking a highly skilled Technical Solutions Engineer to join our team at Databricks. As a Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide...


  • San Francisco, California, United States Databricks Full time

    Job Title: Endpoint Engineer - IT Service DeskWe are seeking an experienced Endpoint Engineer to join our IT Service Desk team. As an Endpoint Engineer, you will be responsible for managing and securing endpoints across our organization. This includes designing and implementing endpoint security solutions, managing endpoint configurations, and ensuring...


  • San Francisco, California, United States DataBricks Full time

    Unlock the Power of Data with DatabricksWe're seeking a talented Senior Software Engineer to join our team and help us revolutionize the way data is used to drive business decisions. As a key member of our engineering team, you'll work closely with product management to design and develop innovative solutions that make insights from data simple and...

  • Databricks Engineer

    2 weeks ago


    San Francisco, California, United States Bayone Full time

    Key ResponsibilitiesOptimize Databricks Streaming Jobs: Leverage expertise in optimizing Databricks streaming jobs to ensure seamless data processing and minimize latency.Cluster Management: Manage large Databricks clusters, set up policies, and streamline tags for cost-effective allocation.Monitoring and Reporting: Set up monitoring tools for long-running...


  • San Francisco, California, United States Databricks Full time

    Job DescriptionWe are seeking a highly skilled Staff Software Engineer to join our Cloud Infrastructure team at Databricks. As a key member of our engineering team, you will be responsible for designing, developing, and operating large-scale distributed systems that power our cloud-based data platform.Key Responsibilities:Design and implement scalable and...


  • San Francisco, California, United States Databricks Full time

    Network Infrastructure and Automation SpecialistWe are seeking an experienced Network Infrastructure and Automation Specialist to join our Corporate Engineering team at Databricks. As a key member of our team, you will be responsible for building and maintaining our campus network infrastructure, including LAN, WAN, and VPN approaches. You will develop and...


  • San Francisco, California, United States Databricks Full time

    About the Role:We are seeking a highly skilled Senior Staff Machine Learning Engineer to join our team at Databricks. As a technical lead, you will oversee and supervise projects and engineers on the team, playing a key role in building our Generative AI platform and products.Key Responsibilities:Design and implement our ML infrastructure and GenAI platform...


  • San Francisco, California, United States Databricks Full time

    About the Role:We are seeking a highly skilled Senior Staff Machine Learning Engineer to play a key role in building our Generative AI platform and products. As a technical lead, you will oversee and supervise projects and engineers on the team, driving our technology vision and roadmap.Key Responsibilities:Design and implement our ML infrastructure and...


  • San Francisco, California, United States Databricks Full time

    We are seeking a highly skilled Senior Staff Software Engineer/Principal Software Engineer to join our Engineering team at Databricks. As a key member of our team, you will play a critical role in shaping the direction and roadmap for our product, driving concrete initiatives and changes that directly impact key metrics like monthly active users, and taking...


  • San Francisco, California, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Distributed Systems team at Databricks. As a key member of our team, you will be responsible for designing and implementing next-generation systems that leapfrog state-of-the-art in database systems, storage systems, and distributed systems.Key ResponsibilitiesDesign and...


  • San Francisco, California, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Backend Software Engineer to join our team at Databricks. As a Backend Software Engineer, you will be responsible for designing, implementing, and operating micro-services for the Databricks platform and product.Key Responsibilities:Design and implement scalable and efficient micro-services using Java, Scala, and...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States DataBricks Full time

    About DatabricksDatabricks is the data and AI company, empowering organizations to unlock the power of their data and AI. With a unified platform, we enable data teams to solve complex problems, drive business outcomes, and create value for their customers.Job SummaryWe are seeking a highly skilled Software Engineer - Backend to join our team. As a key...


  • San Francisco, California, United States Databricks Full time

    We are seeking a highly skilled AI Performance Optimization Engineer to join our team at Databricks. The ideal candidate will have hands-on experience with deep learning frameworks, high-performance linear algebra libraries, and distributed systems development.Key Responsibilities:Explore and analyze performance bottlenecks in ML training and...


  • San Francisco, California, United States Databricks Full time

    Mosaic AI, now part of Databricks, is seeking an experienced machine learning platform engineer to build out our generative AI platform for the ML model development lifecycle, including pre-training of large language models (LLMs), fine-tuning, evaluation, and serving.You will thrive in this role if you have a strong sense of end-to-end ownership and enjoy...


  • San Francisco, California, United States Databricks Full time

    Pioneering a cutting-edge Generative AI platform, Databricks is seeking a highly skilled Senior Staff Machine Learning Engineer to spearhead the development of our ML infrastructure and drive our technology vision & roadmap.Key Responsibilities:• Oversee projects and engineers, ensuring seamless collaboration and technical excellence.• Design and...

  • Software Engineer

    4 weeks ago


    San Francisco, California, United States DataBricks Full time

    About DatabricksDatabricks is the data and AI company. We empower organizations to unlock the power of their data and AI, enabling them to make informed decisions and drive business outcomes.Job SummaryWe are seeking a highly skilled Software Engineer - Backend to join our team. As a Backend Software Engineer, you will play a critical role in designing,...


  • San Francisco, California, United States DataBricks Full time

    About DatabricksDatabricks is the data and AI company. We are passionate about empowering data teams to solve the world's toughest problems by building and running the world's best Data Intelligence Platform.Job SummaryWe are seeking a highly skilled Senior Software Engineer to join our team. As a key member of our engineering team, you will work closely...