Data Systems Engineer

3 months ago


San Francisco, United States Unreal Gigs Full time
Job DescriptionJob Description

Company Overview: Welcome to the cutting-edge of data systems engineering At our company, we're passionate about harnessing the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions. Join us and be part of a dynamic team committed to shaping the future of data systems engineering.

Position Overview: As a Data Systems Engineer, you'll be at the forefront of designing, building, and optimizing our data systems infrastructure. Working closely with cross-functional teams of data scientists, software engineers, and business analysts, you'll ensure the reliability, scalability, and efficiency of our data systems. If you're passionate about data engineering and eager to tackle complex challenges in data infrastructure, we want you on our team.

Requirements

Key Responsibilities:

  1. Data Systems Architecture: Design and architect scalable and resilient data systems infrastructure to meet business requirements and support data processing and analytics needs.
  2. Data Pipeline Development: Develop and maintain data pipelines to ingest, process, and transform large volumes of data from various sources into usable formats for analysis and reporting.
  3. Data Storage and Management: Implement and manage data storage solutions, including databases, data lakes, and distributed file systems, ensuring optimal performance and reliability.
  4. Data Integration: Integrate data from diverse sources, including internal databases, external APIs, and third-party data providers, ensuring data consistency and integrity.
  5. Performance Optimization: Optimize data systems performance for speed, scalability, and cost-effectiveness, leveraging caching, indexing, partitioning, and other techniques.
  6. Data Security and Governance: Implement data security controls and governance policies to protect sensitive data and ensure compliance with regulatory requirements.
  7. Monitoring and Maintenance: Monitor data systems for performance, availability, and reliability, proactively identifying and addressing issues to minimize downtime and ensure data integrity.
  8. Documentation and Collaboration: Document data systems architecture, processes, and best practices, and collaborate with cross-functional teams to ensure alignment and transparency.

Qualifications:

  • Bachelor's degree or higher in Computer Science, Engineering, or related field.
  • Strong background in data engineering, with hands-on experience in designing, building, and optimizing data systems infrastructure.
  • Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark, Apache Flink, or Apache Beam.
  • Experience with distributed computing technologies and concepts, including Hadoop, MapReduce, and distributed file systems (e.g., HDFS).
  • Familiarity with database technologies such as SQL, NoSQL, and NewSQL databases, as well as cloud-based data storage solutions.
  • Strong problem-solving abilities and analytical thinking, with a keen attention to detail and a passion for tackling complex technical challenges.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits

  • Competitive salary: The industry standard salary for Data Systems Engineers typically ranges from $140,000 to $210,000 per year, depending on experience and qualifications. Exceptional candidates may be eligible for higher compensation packages.
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible work hours and remote work options.
  • Generous vacation and paid time off.
  • Professional development opportunities, including access to training programs, conferences, and workshops.
  • State-of-the-art technology environment with access to cutting-edge tools and resources.
  • Vibrant and inclusive company culture with team-building activities and social events.
  • Opportunities for career growth and advancement within the company.
  • Exciting projects with real-world impact across diverse industries.
  • Chance to work alongside top talent and industry experts in the field of data systems engineering.

Join Us: Ready to shape the future of data systems engineering? Apply now to join our team and be part of an exciting journey of innovation and discovery


  • Lead Data Engineer

    2 weeks ago


    San Francisco, United States StreetLight Data Full time

    StreetLight pioneered the use of Big Data analytics to shed light on how people, goods, and services move, empowering smarter, data-driven transportation decisions. The company applies proprietary machine-learning algorithms and data processing resources to measure travel patterns of vehicles, bicycles and pedestrians that enable complex transportation...

  • Data Systems Engineer

    3 months ago


    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the cutting-edge of data systems engineering! At our company, we're passionate about harnessing the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions. Join us and be part of a dynamic...

  • Data Systems Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionCompany Overview: Welcome to the cutting-edge of data systems engineering! At our company, we're passionate about harnessing the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions. Join us and be...

  • Data Systems Engineer

    14 hours ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the cutting-edge of data systems engineering! At our company, we're passionate about harnessing the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions....

  • Senior Data Engineer

    2 months ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Senior Data Engineer

    4 weeks ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and lead our efforts in...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and lead...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....

  • Data Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join us and be part of a dynamic team...

  • Data Engineer

    14 hours ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...

  • Data Engineer

    3 months ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...


  • San Francisco, California, United States Plato Systems Full time

    Plato Systems is on a mission to supercharge manufacturing operations by using spatial activity data and AI to improve capacity, productivity, and safety. Spun out of Stanford in 2019, we have built an intelligent analytics platform fueled by our revolutionary device which uses machine perception and sensor fusion to provide an operations digital twin that...

  • Data Scientist

    2 weeks ago


    San Francisco, United States StreetLight Data Full time

    StreetLight pioneered the use of Big Data analytics to shed light on how people, goods, and services move, empowering smarter, data-driven transportation decisions. The company applies proprietary machine-learning algorithms and data processing resources to measure travel patterns of vehicles, bicycles and pedestrians that enable complex transportation...

  • Software Engineer

    2 weeks ago


    San Francisco, United States Factory Full time

    Factory is looking for highly capable engineers focused on harnessing and managing data that powers both our internal AI-driven systems and external customer-facing features. What you will do and achieve Design, build, and maintain optimal data pipelines that support a variety of data consumers, from internal teams focused on Droid optimization to external...