Staff Software Engineer, Data Infrastructure

1 month ago


Mountain View, United States ASAPP Full time

Join our team at ASAPP, where we're developing transformative Vertical AI designed to improve customer experience. Recognized by Forbes AI 50, ASAPP designs generative AI solutions that transform the customer engagement practices of Fortune 500 companies. With our automation and simplified work processes, we empower people to reach their full potential and create exceptional experiences for everyone involved. Work with our team of talented researchers, engineers, scientists, and specialists to help solve some of the biggest and most complex problems the world is facing.

The Data Engineering team at ASAPP designs, builds and maintains our mission-critical core data infrastructure and analytics platform. Accurate, easy-to-access, and secure data is critical to our natural language processing (NLP) customer interaction platform which interacts with tens of millions of end-users in real-time.

We're looking to hire a skilled Engineer who can contribute to the software systems which manage our data infrastructure, that handle our ever-growing volumes of data and the demands we want to make of it. Automation is a key part of our workflow, so you'll help design and build highly-available data processing pipelines that self-monitor and report anomalies. You'll need to be an expert in ETL processes and know the in's and out's of various data stores that serve data rapidly and securely to all internal and external stakeholders. As part of our fast-growing data engineering team, this role will also play an integral role in shaping the future of data infrastructure as it applies to improving our existing metric-driven development and machine learning capabilities.

Applicants with all or some relevant combination of the requirements listed below are encouraged to apply. We are able to consider remote and hybrid candidates for this role.

What you'll do

    • Design and deploy improvements to our mission-critical production data pipeline, data warehouses, data systems
    • Recognize data flow patterns and generalizations to automate as much as possible to drive productivity gains
    • Expand our logging and monitoring processes to discover and resolve anomalies and issues before they become problems
    • Develop state-of-the-art automation and data solutions in Python, Spark and Flink
    • Maintain, Manage, Monitor our infrastructure related including Kafka, Kubernetes, Spark, Flink, Jenkins, general OLAP and RDBMS databases, S3 objects buckets, permissions
    • Increase the efficiency, accuracy, and repeatability of our ETL processes
    • Know how to make the tradeoffs required to ship without compromising quality
What you'll need
    • 12+ years of experience in general software development and/or dev-ops, sre roles in AWS.
    • 5+ years experience in data engineering, data systems, pipeline and stream processing.
    • Expertise in at least one flavor of SQL, e.g. Redshift, Postgres, MySQL, Presto/Trino, Spark SQL, Hive
    • Proficiency in a high-level programming language(s). We use Python, Scala, Java, Kotlin, and Go
    • Experience with CI/CD (continuous integration and deployment)
    • Experience with workflow management systems such as Airflow, Oozie, Luigi, and Azkaban
    • Experience implementing data governance, i.e. access management policies, data retention, IAM, etc.
    • Confidence operating in a devops-like capacity working with AWS, Kubernetes, Jenkins, Terraform, etc. thinking about automation, alerting, monitoring, and security and other declarative infrastructure
What we'd like to see
    • Bachelor's Degree in a field of science, technology, engineering, or math, or equivalent hands-on experience
    • Experience in maintaining and managing kafka (not just using)
    • Experience in maintaining and managing OLAP/HA database systems (not just using)
    • Familiarity handling Kubernetes clusters for various jobs, apps, and high throughput
    • Technical knowledge of data exchange and serialization formats such as Protobuf, Avro, or Thrift
    • Experience in either deploying and creating Spark Scala and/or Flink applications.
    >


ASAPP is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, or veteran status. If you have a disability and need assistance with our employment application process, please email us at careers@asapp.com to obtain assistance. #LI-AG1 #LI-Remote

  • Mountain View, Arkansas, United States ASAPP Full time

    Transformative Data Infrastructure OpportunitiesASAPP is a leader in Vertical AI, recognized by Forbes AI 50, and we're seeking a skilled Staff Software Engineer, Data Infrastructure to join our team. Our mission-critical core data infrastructure and analytics platform relies on accurate, easy-to-access, and secure data, which is critical to our natural...


  • Mountain View, California, United States LinkedIn Full time

    Job Title: Staff Software Engineer - Data Center Infrastructure OperationsAt LinkedIn, we're seeking a highly skilled Staff Software Engineer to join our team and lead the development and management of infrastructure business operations software and data systems from concept through production life-cycle.This is a unique opportunity to join a globally...


  • Mountain View, Arkansas, United States ASAPP Full time

    Transform customer experiences with ASAPP's Vertical AI. Recognized by Forbes AI 50, we design generative AI solutions for Fortune 500 companies. Our automation and simplified work processes empower people to reach their full potential. Work with our team of talented researchers, engineers, scientists, and specialists to solve complex problems. The Data...


  • Mountain View, California, United States Wisk Aero Full time

    We are seeking a highly skilled Staff Software Engineer to join our team at Wisk Aero. As a key member of our Engineering organization, you will be responsible for architecting and implementing data infrastructure, devops, and APIs to automate as many processes as possible for engineering.The ideal candidate will have a strong background in software...


  • Mountain View, California, United States Nuro Full time

    About NuroNuro is a robotics company that aims to improve everyday life through innovative technology. Founded in 2016, the company has spent years developing autonomous driving solutions.With over $2 billion in funding from top investors, Nuro has partnered with leading brands to revolutionize the way goods are transported.About the RoleNuro is seeking a...


  • Mountain View, Arkansas, United States Waymo Full time

    Waymo is a pioneering autonomous driving technology company with a mission to become the most trusted driver. With a rich history dating back to the Google Self-Driving Car Project in 2009, Waymo has been dedicated to building the Waymo Driver-The World's Most Experienced DriverTM-to enhance access to mobility while saving thousands of lives lost to traffic...


  • Mountain View, United States META Full time

    Summary: Meta is seeking an experienced Software Engineer to join the Software Engineering (Infrastructure) team. The Software Engineering (Infrastructure) team builds large distributed components that run Facebook. Our code serves millions of requests per second and it does so with sub-second latency and in a fault tolerant manner. We handle everything from...


  • Mountain View, United States META Full time

    Summary: Meta is seeking an experienced Software Engineer to join the Software Engineering (Infrastructure) team. The Software Engineering (Infrastructure) team builds large distributed components that run Facebook. Our code serves millions of requests per second and it does so with sub-second latency and in a fault tolerant manner. We handle everything from...


  • Mountain View, California, United States Contextual AI Full time

    Data Infrastructure EngineerContextual AI is seeking a highly skilled Data Infrastructure Engineer to join our team. As a key member of our Data Infrastructure team, you will be responsible for designing, building, and operating foundational data services that power product development, applied research, and customers' data-intensive workloads.Key...


  • Mountain View, United States Nuro Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver™ is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and...


  • Mountain View, United States Nuro Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro is a leading autonomous technology company with vehicles on road today in California and Texas. The company's core technology is the Nuro Driver, an integrated autonomous driving system consisting of state-of-the-art, AI-first software and custom-built sense and compute...


  • Mountain View, California, United States NewsBreak Full time

    About NewsBreakNewsBreak is revolutionizing the way users interact with local news and their communities by bridging local users, content creators, and businesses. Our mission is to foster safer, more vibrant, and authentically connected lives.We are seeking a talented Data Infrastructure Engineer to help shape the future of NewsBreak. As a key member of our...


  • Mountain View, California, United States LinkedIn Full time

    Job SummaryAs a Staff Software Engineer on our Compute Infrastructure SRE team, you will play a key role in building the next-generation infrastructure and platforms for LinkedIn. This is a unique opportunity to work on a high-profile, high-impact ongoing project that will touch every aspect of our engineering organization.About the RoleIn this role, you...


  • Mountain View, California, United States Nuro Full time

    About the RoleNuro is a leading autonomous technology company that exists to better everyday life through robotics. Our core technology is the Nuro Driver, an integrated autonomous driving system consisting of state-of-the-art, AI-first software and custom-built sense and compute hardware.The team plays a crucial role in the advancement of autonomous driving...


  • Mountain View, California, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Software Engineer to join our Runtime team at Databricks. As a key member of our engineering team, you will be responsible for building the next generation of distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance.Our team is passionate...


  • Mountain View, United States HMBL Full time

    Stay hungry. Stay HMBL. We are your premiere Executive Search and Technical Recruiting agency. Contrary to your average 'spray-and-pray' firm, we position ourselves as extensions of the most innovative, up-and-coming tech companies. At HMBL, we take strategic approaches to sourcing and leverage data and analysis for top quality talent acquisition. Are you...


  • Mountain View, California, United States LinkedIn Full time

    Cloud Security Engineer - Staff Software EngineerAt LinkedIn, we're committed to protecting our members' data and ensuring the security of our platform. As a Cloud Security Engineer - Staff Software Engineer, you'll play a critical role in designing and implementing secure cloud infrastructure and applications.Responsibilities:Design and implement secure...


  • Mountain View, California, United States LinkedIn Full time

    Job SummaryAs a Senior Staff Software Engineer, Systems Infrastructure Specialist at LinkedIn, you will play a key role in building the next-generation infrastructure and platforms for our global workforce. You will lead the development of large-scale, distributed systems and databases, and work closely with technical leadership and management to contribute...


  • Mountain View, California, United States Kodiak Robotics Full time

    About Kodiak RoboticsKodiak Robotics is a leading company in the development of self-driving technology for long-haul trucks and defense applications. Our mission is to revolutionize the freight industry by providing a safe and efficient transportation solution.Job DescriptionWe are seeking a highly skilled Software Engineer to join our team and contribute...


  • Mountain View, California, United States Moveworks Full time

    About the RoleMoveworks is seeking a highly skilled Senior Software Engineer to join our Core Infrastructure team. As a key member of this team, you will be responsible for architecting the next generation of our AI infrastructure.The ideal candidate will have a strong background in designing, building, and maintaining backend distributed systems. You will...