Senior Data Engineer

4 weeks ago


Oakland, United States SirenOpt Full time

About Us

SirenOpt® provides manufacturing intelligence solutions that accelerate sustainable and smart manufacturing of advanced coatings, thin films and nano-scale materials, with demonstrated use cases across battery, aerospace, semiconductor, electronic and many other industries.


More specifically, SirenOpt is pioneering a paradigm shift in advanced materials characterization by leveraging cold atmospheric plasma, machine learning and predictive analytics to non-destructively create uniquely distinctive, multifaceted material fingerprints in real-time. SirenOpt transforms measurement blind spots into rich multi-layered material insights, which enable intelligent performance-centric decision-making. SirenOpt thus accelerates R&D and process optimization, enhances product performance, and delivers higher production quality to maximize value in both in-line and off-line applications.

Job Description

We are seeking a highly skilled Senior Data Engineer with experience in designing, implementing, and optimizing database solutions, ensuring robust data flow, managing data pipelines, enhancing data process efficiencies, and building systems to collect, manage, and transform raw data into actionable insights. You will work closely with our engineering and data teams to diagnose bottlenecks, implement enhancements, and create a seamless data ecosystem. The ideal candidate will have a strong background in SQL and cloud infrastructure, with the ability to optimize data storage, visualization, and analytics over long periods of time.


This role offers an exciting opportunity to be at the forefront of technological innovation, working with cutting-edge systems in a collaborative and dynamic environment. If you are a driven and skilled engineer looking to make a significant impact in advanced manufacturing and the green energy transition, we encourage you to apply.

Key Responsibilities:

  • Database Performance Tuning: Analyze and optimize database performance by identifying bottlenecks and implementing best practices for indexing, query optimization, and schema design.
  • Database Design and Architecture: Collaborate with stakeholders to design and implement efficient database architectures that meet business requirements and ensure scalability. Optimize data storage and compression techniques to maximize efficiency and minimize costs.
  • SQL Query Optimization: Rewrite and optimize SQL queries to improve execution times and reduce resource consumption, ensuring efficient data retrieval and manipulation.
  • Monitoring and Observability: Utilize observability tools like Prometheus and Grafana to monitor database performance metrics, set up alerts, and create dashboards for real-time insights.
  • Data Visualization: Design and implement data visualization tools and dashboards to provide insights into large datasets
  • Data Serialization and Investigation. Utilize expertise in network protocols, specifically Protocol Buffers, to facilitate efficient data serialization and communication between services.
  • Data Integrity and Security: Ensure data integrity and security by implementing appropriate access controls, backup strategies, and compliance measures.
  • Collaboration with Development Teams: Work closely with software development teams to integrate database solutions with applications, ensuring seamless data flow and application performance.
  • Client Support: Work closely with clients to provide support in best practices and project and data management
  • Documentation and Best Practices: Document database designs, optimization strategies, and maintenance procedures to facilitate knowledge sharing and adherence to best practices.
  • Continuous Improvement: Stay updated with the latest database technologies and trends, and proactively recommend improvements to enhance database performance and reliability.


Qualifications

  • Bachelor’s (or higher) degree in Computer Science, Engineering, or a related field
  • 10+ years of industry experience, 7+ years working with data-intensive applications
  • Proven experience as a Data Engineer or similar role
  • Proven experience with data-intensive application development and is up to speed on the best tools for the jobs
  • Proficiency in Python (Java/Scala/R/Rust is a plus)
  • Strong proficiency in SQL and database management systems (e.g., MySQL, PostgreSQL, Oracle)
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform
  • Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake)
  • Knowledge of data compression techniques and data visualization tools (e.g., Tableau, Power BI, Plotly)
  • Hands-on experience with observability tools, specifically Prometheus and Grafana.
  • Strong understanding of network protocols, especially Protocol Buffers
  • Familiarity with data engineering frameworks and tools (e.g., Apache Kafka, Apache Airflow).
  • Knowledge of machine learning and data analytics concepts
  • Excellent communication and collaboration skills
  • Ability to work independently and in a team environment

  • Senior Data Engineer

    3 months ago


    Oakland, United States Pivotal Talent Search Full time

    Job DescriptionJob DescriptionWe are seeking a Senior Data Engineer who is experienced with data pipelines and data wrangling to join a nationally recognized renewable energy provider. You will expand and optimize existing data infrastructure, working closely with IT and Data Science team members. This person ideally has previous experience as a Software...


  • Oakland, United States The TAgency Full time

    About The CompanyThe company provides manufacturing intelligence solutions that accelerate sustainable and smart manufacturing of advanced coatings, thin films and nano-scale materials, with demonstrated use cases across battery, aerospace, semiconductor, electronic and many other industries.We are seeking a highly skilled Staff Electrical Engineer to help...


  • Oakland, United States The TAgency Full time

    About The CompanyThe company provides manufacturing intelligence solutions that accelerate sustainable and smart manufacturing of advanced coatings, thin films and nano-scale materials, with demonstrated use cases across battery, aerospace, semiconductor, electronic and many other industries.We are seeking a highly skilled Staff Electrical Engineer to help...

  • Senior Data Engineer

    4 weeks ago


    Oakland, United States SirenOpt Full time

    About UsSirenOpt® provides manufacturing intelligence solutions that accelerate sustainable and smart manufacturing of advanced coatings, thin films and nano-scale materials, with demonstrated use cases across battery, aerospace, semiconductor, electronic and many other industries.More specifically, SirenOpt is pioneering a paradigm shift in advanced...


  • Oakland, California, United States PTS Data Center Solutions, Inc. Full time

    Position Title: Senior Mechanical Design EngineerCompany Overview: PTS Data Center Solutions, Inc. has been at the forefront of engineering and constructing data center facilities across diverse industries for over 25 years.Key Responsibilities:Design and outline mechanical systems tailored for data center and computer room initiatives.Deliver technical...


  • Oakland, California, United States PTS Data Center Solutions, Inc. Full time

    Position Title: Senior Mechanical Design EngineerCompany Overview: PTS Data Center Solutions, Inc. has been at the forefront of designing and constructing data center facilities across diverse industries for over 25 years.Key Responsibilities:Design and specify mechanical systems tailored for data center and computer room initiatives.Offer technical guidance...


  • Oakland, New Jersey, United States PTS Data Center Solutions, Inc. Full time

    Position Title: Senior Mechanical Systems EngineerOrganization: PTS Data Center Solutions, Inc.With over 25 years of expertise, PTS Data Center Solutions, Inc. excels in the design and construction of data center facilities across diverse industries.Key Responsibilities:Develop and specify mechanical systems tailored for data center and computer room...

  • Data Engineer, Senior

    2 weeks ago


    Oakland, United States Blue Shield of California Full time

    Your Role The Data Engineering Development team is responsible for design, development, test and deployment of large enterprise data warehouse/BI data solutions using both on-prem and cloud technologies. The Data Engineer, Senior will report to the Manager, Data Engineering Development. In this role you will be responsible for design, development, and...


  • Oakland, California, United States PTS Data Center Solutions, Inc. Full time

    Position Title: Senior Mechanical Design EngineerCompany Overview: PTS Data Center Solutions, Inc. has been at the forefront of designing and constructing data center facilities across various industries for over 25 years.Key Responsibilities:Design and define mechanical systems tailored for data center and computer room initiatives.Provide engineering...


  • Oakland, California, United States PTS Data Center Solutions, Inc. Full time

    Position Title: Senior Mechanical Design EngineerCompany Overview: PTS Data Center Solutions, Inc. has been at the forefront of designing and constructing data center facilities across various industries for over 25 years.Key Responsibilities:Design and specify mechanical systems tailored for data center and computer room projects.Provide technical...


  • Oakland, California, United States PTS Data Center Solutions, Inc. Full time

    Position Title: Senior Mechanical Design EngineerCompany Overview: PTS Data Center Solutions, Inc. has been at the forefront of designing and constructing data center facilities across diverse industries for over 25 years.Key Responsibilities:Develop and define mechanical systems tailored for data center and computer room initiatives.Offer technical guidance...

  • Data Engineer, Senior

    2 months ago


    OAKLAND, United States PG&E Corporation Full time

    Requisition ID # 159114 Job Category: Information Technology Job Level: Individual ContributorBusiness Unit: Information TechnologyWork Type: HybridJob Location: Oakland  Department OverviewInformation Systems Technology Services is a unified organization comprised of various departments which collaborate effectively in order to deliver high quality...


  • Oakland, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within the enterprise from the various sources through intake layers into down downstream data marts. The Quality Enginer, Senior will report to the IT Manager. In this role you...


  • Oakland, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within the enterprise from the various sources through intake layers into down downstream data marts. The Quality Enginer, Senior will report to the IT Manager. In this role you...


  • Oakland, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within the enterprise from the various sources through intake layers into down downstream data marts. The Quality Enginer, Senior will report to the IT Manager. In this role you...


  • Oakland, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within the enterprise from the various sources through intake layers into down downstream data marts. The Quality Enginer, Senior will report to the IT Manager. In this role you...


  • Oakland, United States Blue Shield of California Full time

    Your RoleThe Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within the enterprise from the various sources through intake layers into down downstream data marts. The Quality Enginer, Senior will report to the IT Manager. In this role you will...


  • Oakland, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within the enterprise from the various sources through intake layers into down downstream data marts. The Quality Enginer, Senior will report to the IT Manager. In this role you...


  • Oakland, CA, United States Blue Shield of California Full time

    Your Role The Data Services Quality Engineering team is part of the BSC Data & Analytics Organization. We provide testing services for Data & Analytics projects that involve data within the enterprise from the various sources through intake layers into down downstream data marts. The Quality Enginer, Senior will report to the IT Manager. In this role you...


  • Oakland, United States PTS Data Center Solutions Full time

    Role: Sr. Mechanical Design Engineer Employer Brand: PTS Data Center Solutions, Inc. has been a recognized leader in design/building data center facilities for Government, institutions, commercial enterprise, and data center operators for over 25 years. Organization’s Core Values: PTS is a forward-thinking, adaptable, and always-learning organization. ...