Senior Software Engineer, Data Platform

4 weeks ago

Stanford, United States SmartNews Full time
About SmartNews

SmartNews is a global leader in redefining information and news discovery, committed to providing users with accurate, timely information and supporting quality journalism. We combine the power of our unique machine-learning technology with the expertise of our first-rate editorial team to bring news that matters to millions of users from our over 3,000 global publishing partners.

Founded in 2012 in Tokyo, Japan, SmartNews has offices in Tokyo, San Francisco, Palo Alto, New York, and Singapore.

The Team

The Data Platform Team is responsible for building systems that will power the next 5 years of SmartNews data analytics. They develop and maintain common data platforms, ETL pipelines and data analytics infrastructure that can operate with low latency and high reliability while maintaining 99.99% uptime or above.

The Role

As a Data Platform Engineer, you will play a pivotal role in ensuring that data within the SmartNews environment is highly available, with minimal latency and correctly transferred. You will be a key architect in building and maintaining systems that will power the data use at SmartNews for the next five years. Your expertise will contribute to the foundation that supports SmartNews' ambitious growth goals.

Your Reponsibilities
  • Be the team SME expert in Data pipelines
  • Develop and realize the overall data strategy for the company
  • Develop and manage ETL/ELT pipelines and infrastructure of analytics databases
  • Cooperate with the product team, data science team to design data features to enable product improvement and timely business KPI measurements.
  • Be involved in data technology and security to be able to help design the next generation of data platform infrastructure
  • Determine the importance of each dataset and take appropriate measures to ensure data reliability and quality according to priority
  • Improve the reliability and speed of queries for ever-increasing volumes of data
  • Implement new types of data workflows (e.g. automatic retraining of machine learning models for predicting user churn)
  • Build dashboards to visualize key metrics
Requirements

Minimum requirements
  • At least 2 years of team lead experience
  • Able to prioritize and work on data issues ranging from overall data strategy to detailed data modification
  • Experience with data warehousing and business intelligence systems
  • 5 years of programming experience (understand multiple languages)
  • Experience with Hive, Airflow, Scylla, Redis, Elastic search
  • Experience in development related to Spark, Hadoop, Flink, Clickhouse, Presto/Trino
  • Experience with data processing related to an app or website.
  • Experience with Modern Machine Learning technologies
  • Have architected/implemented a data warehouse
  • Experience designing and creating data tables
  • BS degree or above in related fields
  • Experience with AWS (EC2, Kinesis, EMR, S3, etc.)
  • Eligible to work in the US
Nice to have experiences/skills
  • Experience in dashboard development with modern tools, such as Tableau or Superset
  • Experience with infrastructure or data workflows for machine learning
  • Knowledge of real-time streaming data systems
  • Strong interest in new big data tools and technologies
  • Business-level Japanese
Benefits

Compensation and Benefits
  • Compensation range: $175,000 to $230,000 base salary, plus bonus and equity
  • 401(k) with employer matching
  • Up to 100% medical, dental, and vision insurance for you and your family
  • A benefits plan with monthly allowances
  • Complimentary lunch, snacks, and beverages in the office

  • Senior Software Engineer

    2 months ago

    Stanford, United States Machinify, Inc. Full time

    Machinify is a revolutionary healthcare software company with a mission to ensure that patients get the right medical treatment, at the right time, at the right price. Our cloud-based Machinify AI platform leverages the latest advances in machine learning, large language models, data analytics, and cloud processing to solve previously intractable problems,...

  • Senior Software Engineer, Runtime

    1 month ago

    Stanford, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized...

  • Senior Software Engineer, Runtime

    4 weeks ago

    Stanford, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized...

  • Data Scientist

    1 day ago

    Stanford, United States Tesla Full time

    **Data Scientist / Software Engineer (Drive Integration Systems)** ????Engineering & Information Technology????Palo Alto, California?? ID113961???? Data is deeply embedded in the product and engineering culture at Tesla. We rely on data lots of it to improve autopilot, to optimize hardware designs, to proactively detect faults, and to optimize load on the...

  • Staff Engineer: Platform/Back-end

    1 month ago

    Stanford, United States Anvilogic Inc Full time

    We're looking for a Staff Software Engineer to join the platform team at Anvilogic. We are a successful, venture funded startup with the mission of re-imagining the Security Operation Center (SOC) enabling network defenders to rapidly respond to escalating cyber attacks. We have a passionate and rapidly growing customer base, and we are looking for staff...

  • Staff Engineer: Platform/Back-end

    4 weeks ago

    Stanford, United States Anvilogic Inc Full time

    We're looking for a Staff Software Engineer to join the platform team at Anvilogic. We are a successful, venture funded startup with the mission of re-imagining the Security Operation Center (SOC) enabling network defenders to rapidly respond to escalating cyber attacks. We have a passionate and rapidly growing customer base, and we are looking for staff...

  • Full Stack Software Engineer

    2 days ago

    Stanford, United States Vets Hired Full time

    Job DescriptionJob DescriptionWe are looking for a full-time Software Engineer to join the core Geo Match team as a technical lead and programmer. In this role, you will collaborate closely with faculty and staff (including our existing Senior Software Engineer) to develop, adapt, and scale the Geo Match software tool for governments and nonprofits serving...

  • Senior Software Engineer, Deep Learning

    2 months ago

    Stanford, United States Tesla Full time

    **Senior Software Engineer, Deep Learning - Autopilot AI** ????Engineering & Information Technology????Palo Alto, California?? ID111813???? **The Role** As a member of the Autopilot AI team you will design, implement, and optimize deep learning dataset generation, training, and evaluation tools and infrastructure to advance the state of the art in perception...

  • Senior Software Engineer, Deep Learning

    4 weeks ago

    Stanford, United States Tesla Full time

    **Senior Software Engineer, Deep Learning - Autopilot AI** ????Engineering & Information Technology????Palo Alto, California?? ID111813???? **The Role** As a member of the Autopilot AI team you will design, implement, and optimize deep learning dataset generation, training, and evaluation tools and infrastructure to advance the state of the art in perception...

  • Java Software Engineer III

    2 months ago

    Stanford, United States Catalytic Data Science Full time

    Job DescriptionJob DescriptionSalary: Highly Competitive - DOEWho You Are REMOTE OPPORTUNITY You are passionate about continuously delivering quality software as well as the craft of software engineering and eager to join a team of life scientists and software engineers that believe the brightest minds in research should have the best tools to leverage...

  • Java Software Engineer III

    4 weeks ago

    Stanford, United States Catalytic Data Science Full time

    Job DescriptionJob DescriptionSalary: Highly Competitive - DOEWho You Are REMOTE OPPORTUNITY You are passionate about continuously delivering quality software as well as the craft of software engineering and eager to join a team of life scientists and software engineers that believe the brightest minds in research should have the best tools to leverage...

  • Senior Engineer, Hardware Prototyping

    7 days ago

    Stanford, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale.SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized...

  • Senior Product Manager: API Platform and Integrations

    3 weeks ago

    Stanford, United States Databook Full time

    [Bay Area, North America] Databook stands at the cutting edge of generative AI, driving a revolution in strategic sales and relationship management with our groundbreaking innovation, DatabookGPT. DatabookGPT represents a significant leap forward, building on the success of our Strategic Relationship Management (SRM) application. This conversational AI sales...

  • Senior Engineer, Hardware Prototyping

    6 days ago

    Stanford, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized...

  • Full-Stack Software Engineer

    5 hours ago

    Stanford, United States Stanford University Full time

    Full-Stack Software Engineer (GeoMatch) **School of Humanities and Sciences, Stanford, California, United States** Information Technology Services Post Date Jun 20, 2024 Requisition # 103687 The Immigration Policy Lab (IPL) at Stanford University is seeking to hire a full-time Software Engineer to join its GeoMatch project team. The GeoMatch team partners...

  • Software Engineer, Infrastructure

    4 weeks ago

    Stanford, United States Matroid Full time

    About Matroid Matroid's mission is to enable computers to visually understand the world. With a "no programming required" product, Matroid empowers businesses and industry with our computer vision solutions. Our users can deploy cutting-edge, deep neural networks on the cloud or on-premise with the click of a button. Founded in 2016 by a Stanford...

  • Senior DevOps Infrastructure Engineer

    3 weeks ago

    Stanford, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized...

  • Senior Principal Engineer, Runtime

    4 weeks ago

    Stanford, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized...

  • Principal Software Engineer, Machine Learning

    2 weeks ago

    Stanford, California, United States SambaNova Systems Full time

    The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova SuiteTM is the first full-stack, generative AI platform, from chip to model, optimized...

  • Internship, Embedded Software Engineer, Vehicle Software

    2 weeks ago

    Stanford, United States Tesla Full time

    Consider before submitting an application: This position is expected to start around August/September 2024 and continue through the entire Fall term (i.e. through December 2024) or into Spring 2025 if available. We ask for a minimum of 12 weeks, full-time and on-site, for most internships. International Students: If your work authorization is through CPT,...