Senior Data Engineer

2 weeks ago


Sunnyvale, United States Illumio Full time

On-site work model with 5 days in office/week in Sunnyvale, CA 

Targeted hire date of February 1, 2024

About the Team:

Illumio's new Machine Learning (ML) team embodies a culture of thought leadership, independence, and responsibility, holding a significant and highly visible role within our Engineering division. This dynamic team is tasked with developing state-of-the-art ML solutions for complex cybersecurity challenges. Working directly with the leadership team, the team shapes Illumio's strategic direction and reinforces our leadership in Zero Trust Segmentation. In a world facing some of the greatest cybersecurity threats in history, the impact of our ML team is profound and far-reaching. 

We're looking for engineers who are ready to bring diverse perspectives, innovate relentlessly, and tackle challenging enterprise security issues head-on, leaving a significant mark in the cybersecurity landscape. 

About the Role:

As a data engineer, you should have strong analytical skills and the ability to combine data from different sources to power machine learning that solves cybersecurity issues faced by diverse businesses today. To excel in this role, you must be excited about designing, building and optimizing the data pipelines and building the data platform for model training and production. Your work will have a direct impact on our customers using the ML models for their infrastructure security. 

Key Responsibilities:
  • Build and manage data pipelines for ML model training by extracting data from multiple sources including APIs and cloud storage 

  • Implement processes that ensure the high quality and integrity of data used in ML models. Monitor data feeds and troubleshoot any data anomalies. 

  • Build feature store for storage and retrieval in real-time or batch-mode  

  • Collaborate with backend engineers to build an ML platform for training and inference.  

  • Transforming data for machine learning training and production use-cases 

  • Manage streaming traffic data and static information collection with optimized data pipelines  

Experience:
  • Bachelor's in computer science or equivalent degree. Master's degree a plus

  • 5+ years of relevant experience

  • Experience building data lake solutions and integrations with ML training platform in AWS/Azure 

  • Hands-on experience with database/schema design  (preferably Parquet)  

  • Scalable data pipelines to extract, transform, and load data from a variety of sources 

  • Experience with ML data pipeline workflow management tools like Apache Airflow etc. 

  • Hands-on experience with cloud platforms and cloud storage services with AWS, Azure, or GCP.  

  • Experience with optimizing data pipelines for performance and throughput 

About Illumio:

Illumio, the pioneer and market leader of Zero Trust segmentation, prevents breaches from becoming cyber disasters. Illumio protects critical applications and valuable digital assets with proven segmentation technology purpose-built for the Zero Trust security model. Illumio ransomware mitigation and segmentation solutions see risk, isolate attacks, and secure data across cloud-native apps, hybrid and multi-clouds, data centers, and endpoints, enabling the world’s leading organizations to strengthen their cyber resiliency and reduce risk.

Illumio believes that an environment of unique backgrounds, experiences, viewpoints, and individual contributions drives our success and makes us stronger together. We are dedicated to creating and maintaining a diverse culture and emphasizing inclusion and belonging. 

Pay Range:

$200,000 USD - $240,000 USD

The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, location, experience, knowledge, skills, abilities, as well as internal equity, alignment with market data, or applicable laws.

Benefits:

At Illumio we offer a wide range of benefits to our eligible team members. Our benefit programs vary by location and can include Medical, Dental, Vision Coverage – Health and Dependent Savings Accounts – Life and Disability Programs – Paid Parental Leave – Voluntary Benefit Programs – Company Sponsored Wellness Program – Wellness Reimbursement Program - Retirement Savings – Equity Opportunities – Paid time off and Paid Holidays – Employee Incentive Program.#LI-KD1 #LI-ONSITE


  • Senior Data Engineer

    2 weeks ago


    Sunnyvale, United States TWO95 International Full time

    Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from other team...

  • Senior Data Engineer

    4 weeks ago


    Sunnyvale, California, United States Two95 International Inc. Full time

    Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject matter in both business and technical terminology. Guide and learn from...


  • Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...


  • Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...


  • Sunnyvale, United States Wilco Source Full time

    1. Bachelor's or Master's degree in Computer Science, Engineering, or related field.2. 10+ years of experience in data engineering, with a focus on GCP technologies.3. Strong proficiency in SQL, Scala, and Python for data manipulation and analysis.4. Hands-on experience with GCP services, including BigQuery, Cloud Storage, andDataflow.5. Solid understanding...


  • Sunnyvale, California, United States Intuitive Surgical Full time

    Job DescriptionPrimary Function of PositionThe Senior Human Factors Engineer collaborates with various teams to develop new products that are practical, profitable, and appealing.As part of product-development teams, the Senior Human Factors Engineer plays a key role in user-centered design research. They examine use-related risks, conduct usability testing,...

  • Senior Engineer

    6 days ago


    Sunnyvale, United States SALT Full time

    Senior Engineer - Sunnyvale, CA - Onsite Our client is an industry leader in high-perfomance GPS nav systems for aviation applications. As a Senior Systems Engineer you will be working on embedded systems, working on GPR receivers which are implemented into aircrafts, designing circuit boards, and more. Additional Responsibilities You will interact closely...

  • Senior Engineer

    5 days ago


    Sunnyvale, United States SALT Full time

    Senior Engineer - Sunnyvale, CA - Onsite A high number of candidates may make applications for this position, so make sure to send your CV and application through as soon as possible. Our client is an industry leader in high-perfomance GPS nav systems for aviation applications. As a Senior Systems Engineer you will be working on embedded systems, working...

  • Senior Engineer

    4 weeks ago


    Sunnyvale, United States Salt Full time

    Senior Engineer - Sunnyvale, CA - OnsiteOur client is an industry leader in high-perfomance GPS nav systems for aviation applications. As a Senior Systems Engineer you will be working on embedded systems, working on GPR receivers which are implemented into aircrafts, designing circuit boards, and more.Additional ResponsibilitiesYou will interact closely with...

  • Senior Engineer

    1 month ago


    Sunnyvale, United States Salt Full time

    Senior Engineer - Sunnyvale, CA - OnsiteOur client is an industry leader in high-perfomance GPS nav systems for aviation applications. As a Senior Systems Engineer you will be working on embedded systems, working on GPR receivers which are implemented into aircrafts, designing circuit boards, and more.Additional ResponsibilitiesYou will interact closely with...

  • Senior Engineer

    1 month ago


    Sunnyvale, United States Salt Full time

    Senior Engineer - Sunnyvale, CA - OnsiteOur client is an industry leader in high-perfomance GPS nav systems for aviation applications. As a Senior Systems Engineer you will be working on embedded systems, working on GPR receivers which are implemented into aircrafts, designing circuit boards, and more.Additional ResponsibilitiesYou will interact closely with...


  • Sunnyvale, United States Amazon.com, Inc. Full time

    As a Senior Optical Engineer, you will engage with an experienced cross-disciplinary staff to conceive and design innovative consumer products. You will work closely with an internal interdisciplinary team, and outside partners to drive key aspects o Optical, Engineer, Electrical Engineer, Senior, Product Engineer, Technology, Systems

  • BIG Data Engineer

    1 month ago


    Sunnyvale, United States QData Full time

    Required Skills & Experience Experience range 8-14 years Java Development Experience Data Engineer. Python. Hadoop Stack Data Pipeline Using ETL or another tool spark – spark streaming RDD SQL NoSQL Cassandra Handling High Volume Data AWS Experience Experience On Big Data Migration Experience is PLUS

  • BIG Data Engineer

    1 month ago


    Sunnyvale, California, United States QData Full time

    Required Skills & Experience Experience range 8-14 years Java Development Experience Data Engineer. Python. Hadoop Stack Data Pipeline Using ETL or another tool spark – spark streaming RDD SQL NoSQL Cassandra Handling High Volume Data AWS Experience Experience On Big Data Migration Experience is PLUS


  • Sunnyvale, United States Illumio Full time

    Senior Machine Learning Engineer On-site work model of 5 days in office/week in Sunnyvale, CA As a Senior Machine Learning Engineer, you will have the opportunity to build and lead a new team focused on developing cutting-edge machine learning solutions for our industry-leading Zero Trust security products.  You will be responsible for driving the design,...


  • Sunnyvale, United States Veear Full time

    Job Description: s a Senior Software Engineer V on the Hardware Testing Infrastructure team at Meta, you will be a key player in defining the testing approach, creating the necessary resources, and fostering a culture of quality within our ASIC team. Your primary focus will be on hands-on software development, automation, and ensuring that our ASIC...


  • Sunnyvale, United States Illumio Full time

    Senior Backend Software Engineer (Python (Golang a plus))On-site work model of 5 days in office/week in Sunnyvale, CA In this role, you will focus on the Azure Firewall Management Program over the next year. You will work in conjunction with Illumio's Core product and our newest product, CloudSecure, to deliver on customer-facing products and initiatives. As...


  • Sunnyvale, United States Koko Home Full time

    Koko Home is seeking a Data Pipeline Engineer to develop and maintain data pipelines from our IoT devices all the way to our model building infrastructure. As this is a healthcare focused company, we’re seeking candidates with experience working within clinical and regulatory environments. MedTech/SaMD/HCIT experience is a plus.This role entails:Insuring...


  • Sunnyvale, United States Koko Home Full time

    Koko Home is seeking a Data Pipeline Engineer to develop and maintain data pipelines from our IoT devices all the way to our model building infrastructure. As this is a healthcare focused company, we’re seeking candidates with experience working within clinical and regulatory environments. MedTech/SaMD/HCIT experience is a plus.This role entails:Insuring...


  • Sunnyvale, United States Koko Home Full time

    Koko Home is seeking a Data Pipeline Engineer to develop and maintain data pipelines from our IoT devices all the way to our model building infrastructure. As this is a healthcare focused company, we’re seeking candidates with experience working within clinical and regulatory environments. MedTech/SaMD/HCIT experience is a plus.This role entails:Insuring...