Senior Data Engineer

3 days ago

Santa Clara, California, United States Blue River Technology Full time
Job Title: Senior Software Engineer, Data Platform

We are seeking a highly skilled Senior Software Engineer to join our Data/CVML platform team at Blue River Technology. The ideal candidate will have a strong background in building and optimizing data platforms, with expertise in data pipeline architecture, infrastructure, and data flow.

The successful candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. They will work closely with data scientists, analysts, software engineers, and product managers to understand data requirements and deliver data solutions that align with business goals.

The ideal candidate will have a strong analytical mindset, excellent problem-solving skills, and the ability to troubleshoot complex data-related issues. They will also have excellent communication skills to collaborate effectively with technical and non-technical stakeholders.

We offer a competitive salary range of $142,000 - $250,000, along with eligibility for our bonus and benefit programs. Our salary ranges are determined by role, level, and location, and individual pay is determined by work location and additional factors.

Key Responsibilities:
  • Create and maintain optimal data platforms for ingesting machine logs, image data, and various other types of datasets.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL, Databricks Spark, and AWS 'big data' technologies.
  • Build and enhance CVML pipelines, and integrate data within Kubeflow and Databricks using pyTorch and its ecosystem.
  • Work with stakeholders including the Product, Data, and Infra teams to assist with data-related technical issues and support their data infrastructure needs.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing their workflows.
  • Triage and fix support issues related to data anomalies.
  • Collaboration: Work closely with cross-functional teams, including data scientists, analysts, software engineers, and product managers, to understand data requirements and deliver data solutions that align with business goals.
  • Documentation: Create and maintain technical documentation, including data flow diagrams, architecture designs, and standard operating procedures.
  • Technology Evaluation: Stay up-to-date with industry trends and emerging technologies related to data engineering, recommending and implementing new tools and frameworks as appropriate.
Requirements:
  • 10+ years of experience building data platforms/data backends.
  • 5+ years of experience working with Python.
  • Experience building and optimizing 'big data' data pipelines using Spark, architectures, and data sets.
  • Familiar with best practices in building CVML pipelines.
  • Strong analytic skills related to working with unstructured datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • They should also have experience using the following software/tools:
    • Experience with relational SQL and NoSQL databases, including MongoDB
    • Experience with data pipeline and orchestration platforms such as Airflow
    • Experience with AWS cloud services: EC2, RDS DBs
    • Experience with Terraform.
  • Strong problem-solving skills and ability to troubleshoot complex data-related issues.
  • Excellent communication skills to collaborate effectively with technical and non-technical stakeholders.
  • Attention to detail and commitment to producing high-quality, well-documented code.
Preferred Experience and Skills:
  • Experience with image processing and labeling platforms.
  • Can understand some C++ or Go, or talk with people that do.
  • Prior experience in the autonomy and robotics space is a huge plus.
  • Experience with image processing pipelines.
  • Familiarity with robotics logs.
  • Knows how to use git and/or other versioning systems.

We are an equal-opportunity employer and do not discriminate based on race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. Please contact us to request an accommodation.

  • Senior Data Center Engineer

    3 days ago

    Santa Clara, California, United States TCWGlobal Full time

    Job Title: Senior Data Center EngineerWe are seeking a highly skilled Senior Data Center Engineer to join our team at TCWGlobal. As a Senior Data Center Engineer, you will be responsible for designing, implementing, and maintaining our data center infrastructure to ensure high availability and performance.Key Responsibilities:Design and implement data center...

  • Senior AWS Data Engineer

    4 weeks ago

    Santa Clara, California, United States Sira Consulting Full time

    About Sira ConsultingJob Title: Senior AWS Data EngineerJob SummarySira Consulting is seeking a highly skilled Senior AWS Data Engineer to join our team. As a Senior AWS Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on AWS.Key ResponsibilitiesDesign and Implement Data Processing...

  • Senior Data Center Engineer

    6 days ago

    Santa Clara, California, United States TCWGlobal Full time

    Job Title: Senior Data Center EngineerWe are seeking a highly skilled Senior Data Center Engineer to join our team at TCWGlobal. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our data center infrastructure.Key Responsibilities:Design and implement data center infrastructure, including power...

  • Senior Data Center Engineer

    2 weeks ago

    Santa Clara, California, United States TCWGlobal Full time

    Job SummaryWe are seeking a highly skilled and experienced Senior Data Center Engineer to join our team at TCWGlobal. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our data center infrastructure.Key ResponsibilitiesDesign and implement data center infrastructure solutions to meet business...

  • Senior Data Architect

    2 weeks ago

    Santa Clara, California, United States Yasha Staffing Full time

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to pioneer data governance for our client and drive the adoption of generative AI safely across the company.This is a hands-on technical role involving deep collaboration across engineering teams to implement policies, procedures, and technical frameworks for safe and...

  • Senior Software Engineer

    4 weeks ago

    Santa Clara, California, United States Cloudera Full time

    About the RoleWe are seeking an experienced Senior Software Engineer to join our Data Services Platform organization at Cloudera. As a key member of our team, you will be responsible for designing, building, and delivering a microservices-based platform layer for Cloudera's Data Services on Google Cloud Platform (GCP).Key ResponsibilitiesDesign and implement...

  • Staff Data Engineer

    3 weeks ago

    Santa Clara, California, United States Infoblox Full time

    Job Title: Staff Data EngineerDescriptionHybrid Role: This position requires working in the office in Tacoma, WA, or Santa Clara, CA, at least 2 days a week.Infoblox is a leader in cloud-first networking and security services. Our solutions empower organizations to take full advantage of the cloud to deliver network experiences that are inherently simple,...

  • Data Center Engineer

    3 weeks ago

    Santa Clara, California, United States Cypress HCM Full time

    Data Center Technician Job DescriptionCypress HCM is seeking a skilled Data Center Technician to join our team. As a Data Center Technician, you will be responsible for troubleshooting and resolving issues related to server power supply, network connectivity, and console connectivity.Key Responsibilities:Perform hardware diagnostic and troubleshooting of...

  • Senior Data Center Engineer

    3 weeks ago

    Santa Clara, California, United States Quantum World Technologies Inc. Full time

    Job Title: Lab Admin and LinuxJob Summary:We are seeking a highly skilled Lab Admin and Linux professional to join our team at Quantum World Technologies Inc. The ideal candidate will have a strong background in Linux systems administration, data center operations, and network engineering.Key Responsibilities:Administer and maintain Linux systems, including...

  • Senior Data Center Engineer

    3 weeks ago

    Santa Clara, California, United States Quantum World Technologies Inc. Full time

    Job Title: Lab Admin and LinuxJob Summary:We are seeking a highly skilled Lab Admin and Linux professional to join our team at Quantum World Technologies Inc. The ideal candidate will have a strong background in Linux systems administration, data center operations, and network engineering.Key Responsibilities:Design, implement, and maintain high-performance...

  • Senior Process Engineer

    2 weeks ago

    Santa Clara, California, United States OMNIVISION Full time

    Job Title: Senior Process EngineerWe are seeking a highly skilled Senior Process Engineer to join our team at OMNIVISION. As a key member of our engineering team, you will be responsible for developing and optimizing color and machine learning processes for our state-of-the-art CMOS image sensor products.Key Responsibilities:Collaborate with color foundry to...

  • Senior Reliability Engineer

    2 weeks ago

    Santa Clara, California, United States Omni Vision Inc Full time

    Job Title: Senior Reliability EngineerOmni Vision Inc is seeking a highly skilled Senior Reliability Engineer to join our team. As a key member of our engineering team, you will be responsible for ensuring the quality and reliability of our CMOS Image Sensor products.Key Responsibilities:Review reliability qualification testing results and determine whether...

  • Senior Power Engineer

    3 days ago

    Santa Clara, California, United States NVIDIA Full time

    Job Title: Senior Emulation Power EngineerWe are seeking a highly skilled Senior Emulation Power Engineer to join our team at NVIDIA. As a key member of our Emulation Power Team, you will play a critical role in driving the development of energy-efficient products.About the Role:As a Senior Emulation Power Engineer, you will be responsible for analyzing...

  • Senior Software Engineer

    4 weeks ago

    Santa Clara, California, United States SA TECHNOLOGIES Full time

    About SA TechnologiesSA Technologies Inc. is a leading IT consulting firm with a strong presence in the US, Canada, Mexico, and India. As an Oracle Gold Partner, SAP Services Partner, and IBM Certified enterprise, we offer cutting-edge solutions to our clients.We pride ourselves on being a direct client-driven organization, ensuring that our clients receive...

  • Mechanical Engineering Lead

    4 days ago

    Santa Clara, California, United States Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of data center infrastructure, committed to delivering exceptional facilities and services to our customers. Our mission is to empower businesses to thrive in a rapidly changing digital landscape.Job OverviewWe are seeking a highly skilled Mechanical Engineering Lead to join our Design &...

  • Senior Power Engineer

    2 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    Job Title: Senior Emulation Power EngineerNVIDIA is seeking a highly skilled Senior Emulation Power Engineer to join our team. As a key member of our Emulation Power Team, you will play a critical role in analyzing fullchip and unit-level power data, driving ASIC teams to improve their units' power efficiency, and researching, developing, and deploying...

  • Senior Systems Engineer

    1 week ago

    Santa Clara, California, United States SiTime Corporation Full time

    Job Title: Senior Systems EngineerSiTime Corporation is seeking a highly skilled Senior Systems Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and developing precision timing solutions for the Aerospace and Defense industry.Key Responsibilities:Manage comprehensive understanding of timing...

  • Senior Principal Thermal Engineer

    2 weeks ago

    Santa Clara, California, United States Org_Subtype_BU022_Infrastructure_Solutions_Group Full time

    Job Title: Senior Principal Thermal EngineerWe are seeking a highly skilled Senior Principal Thermal Engineer to join our team in the Infrastructure Solutions Group. As a key member of our team, you will be responsible for designing and developing innovative cooling solutions for our data center infrastructure.Key Responsibilities:Design and develop liquid...

  • Senior Engineering Technician

    2 weeks ago

    Santa Clara, California, United States Sustainable Talent Limited Liability Company Full time

    Job Title: Senior Engineering TechnicianSustainable Talent Limited Liability Company is seeking a highly skilled Senior Engineering Technician to join our team. As a key member of our Infrastructure, Planning, and Process (IPP) quality assurance labs, you will play a critical role in ensuring the smooth operation of our testing and validation processes.Key...

  • Senior DevOps Engineer

    2 weeks ago

    Santa Clara, California, United States Sigmaways Inc Full time

    Job Title: Senior DevOps EngineerSigmaways Inc is seeking a highly skilled Senior DevOps Engineer to join our engineering team. As a key member of our team, you will play a crucial role in designing, implementing, and maintaining our complex software systems.Key Responsibilities:Design and develop high-quality software that meets our scalability and...