Senior Data Engineer for Big Data Platforms

2 days ago


San Francisco, California, United States TEKsystems Full time
About the Role

We are seeking a highly skilled Senior Data Engineer to join our team in supporting our data platform.

This is a 6-month contract-to-hire opportunity with excellent growth prospects.

Key Responsibilities
  • Support our data platform, responsible for collecting, storing, processing, and analyzing vast amounts of data across the organization.
  • Work closely with other support teams and provide excellent customer service to internal clients.
  • Migrate from Teradata to Spark platform, ramping up on Hadoop and Hive for ETL pipelines.
Requirements
  • 5-8 years of experience as a professional software engineer or operations engineer.
  • Hands-on experience developing software with Ab Initio, SQL, & Unix shell scripting.
  • 2 years of experience developing in a UNIX/Teradata environment.
  • 1 year of experience with big data technologies.

The ideal candidate will possess:

  • Enthusiasm for constant improvement as a Data Engineer.
  • Ability to review and critique code and proposed designs, offering thoughtful feedback.
  • Skilled in writing and presenting, able to craft messages that are clearly expressed and easily understood.
About You
  • Strong understanding of Ab Initio, Teradata, and Unix Scripting.
  • Familiarity with schedulers like Control-M.
  • Experience with distributed, scalable, and reliable data pipelines.

With your exceptional skills and passion for data engineering, you'll be an integral part of our team, driving innovation and excellence in our data platform.



  • San Jose, California, United States HireIO Inc Full time

    Unlock the Power of Data with Our TeamHireIO Inc is seeking a highly skilled Data Engineering Lead for Big Data Platforms to join our Experimentation and Evaluation team.Estimated Salary: $250,000 - $350,000 per yearAbout UsWe're building the next-gen A/B testing platform that empowers our company to make data-driven decisions. Our mission is to create a...


  • San Francisco, California, United States WEX, Inc. Full time

    Job Overview:WEX, Inc. is seeking a highly motivated and experienced Senior Data Engineer to join our Data team. As a key member of the team, you will be responsible for designing, developing, and implementing large-scale data platforms and systems that support business-critical applications.About the Role:In this role, you will work closely with...


  • San Francisco, California, United States TEKsystems Full time

    Job OverviewWe are seeking an experienced Senior Data Operations Engineer to join our team and support our data platform.The ideal candidate will have a strong background in Ab-Initio, Teradata, and Unix Scripting, with experience in building and supporting distributed, scalable, and reliable data pipelines.Key Responsibilities:Support the migration from...


  • San Francisco, California, United States USM Business Systems Full time

    Job Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...


  • San Francisco, California, United States Coatue Management L.L.C. Full time

    Job Title: Senior Big Data Solutions ArchitectAbout the Role:We are seeking an experienced Senior Big Data Solutions Architect to join our team at Coatue Management L.L.C. This is a unique opportunity to work with a leading investment firm and contribute to the design and implementation of big data solutions.Responsibilities:Design and implement scalable big...


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • San Francisco, California, United States ZipRecruiter Full time

    **Company Overview:**At ZipRecruiter, we're building the largest and most accurate job search platform in the world. Our data platforms play a crucial role in supporting our core products and hundreds of millions of users.**Salary Range:** $120,000 - $180,000 per year**Job Description:As a Software Development Engineer on our Data Platform team, you'll have...


  • San Francisco, California, United States Zing Data, Inc. Full time

    Drive Data-Driven Growth">We are seeking an experienced Senior Product Designer to lead the design of our data-driven products. As a key member of our team, you will play a crucial role in shaping the user experience and driving business growth through innovative product design.">About the Role">">Design and develop new features: Collaborate with...


  • San Francisco, California, United States CV Library Full time

    About CV LibraryCV Library is a dynamic and innovative company that requires exceptional talent to build and maintain its cutting-edge data infrastructure.We are looking for a skilled Data Platform Infrastructure Developer to join our team and contribute to the development of our global data platform. As a member of our data platform team, you will have the...


  • San Francisco, California, United States Tbwa ChiatDay Inc Full time

    About The CompanyNotion is a fast-growing startup dedicated to making software toolmaking ubiquitous. We're passionate about building a company as diverse and creative as the millions of people Notion reaches worldwide.We value trust, reliability, and security above all else, striving to earn our users' continued trust while delivering a fast, reliable, and...


  • San Francisco, California, United States USM Business Systems Full time

    USM Business SystemsSenior Data Modeler/Data Architect + Big Data/Hadoop OpportunityLocation: Nationwide (Remote)Contract Length: 6+ MonthsEstimated Salary Range: $120,000 - $180,000 per yearAbout the Role:The Senior Data Modeler/Data Architect will be an integral member of the Digital Insights & Architecture team within USM Business Systems. This highly...


  • San Jose, California, United States Tik Tok Full time

    Secure the Future of TikTok's DataTikTok, a global leader in short-form mobile video, is seeking a skilled Data Security Engineer to join its Data Management Suite team. Located in various global offices, including Los Angeles, New York, London, and Singapore, this role presents an opportunity to work on one of the largest data platforms in the world.About...


  • San Jose, California, United States Tik Tok Full time

    Job DescriptionTikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. We are looking for talented individuals to join our Data Platform team as a Big Data Engineer Intern.Responsibilities:Translate business requirements into technical implementations and build batch and real-time data...


  • San Francisco, California, United States AirTree Ventures Pty Full time

    At Linktree, we are seeking a skilled Senior Data Platform Architect to join our team as we continue to drive innovation in the data platform space. As a key member of our engineering team, you will play a crucial role in building and maintaining a robust, scalable data platform that supports our mission to empower anyone to curate, grow and monetize their...


  • San Francisco, California, United States Amplitude Full time

    Amplitude is a leading digital analytics platform that helps companies drive business growth through data-driven decision making. Our platform empowers teams to capture reliable data, uncover valuable insights about customer behavior, and take swift action.We're seeking an experienced Data Engineering Lead to join our Query team. As a key member of this...


  • San Francisco, California, United States Faire Full time

    Data Engineer for Scalable Data PlatformsFaire is an online wholesale marketplace that empowers entrepreneurs to grow their businesses. Our mission is to level the playing field by leveraging technology and data.As a Data Engineer on our Core Data Infrastructure team, you will design and build data capabilities that inform product launches and roadmaps. You...


  • San Francisco, California, United States Amazon Data Services, Inc. Full time

    About Amazon Data Services, Inc.At Amazon Data Services, Inc., we're passionate about delivering exceptional customer experiences. As the world's most comprehensive and broadly adopted cloud platform, we're committed to innovation and excellence in all that we do.We're seeking a highly skilled Data Center Operations Specialist to join our team. In this...


  • San Francisco, California, United States WEX, Inc. Full time

    We are seeking a highly experienced Senior Data Engineering Leader to join our team at WEX, Inc.About the Role:The ideal candidate will have 10+ years of experience in software design and development, with strong technical skills in programming languages and cloud architecture tools. They will lead the technical vision and strategy of our Data Lake platform,...


  • San Francisco, California, United States Lilt Full time

    About the RoleAt Lilt, we are seeking a highly experienced Software Engineering Manager to lead our Data Platform team. As a key member of our leadership team, you will be responsible for identifying, hiring, and building a world-class team of software engineers, researchers, and data analysts to drive the creation of our next-generation data platform.Key...


  • San Francisco, California, United States Unity Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data & ML Platform team at Unity. This role involves designing and optimizing large-scale data platforms and machine learning infrastructure systems for efficiency, reliability, and cost-effectiveness.Key ResponsibilitiesDesign and optimize large-scale data platforms and machine...