Senior Data Engineer

4 days ago


San Jose, California, United States TikTok Full time

Senior Data Engineer (Multiple Positions)
San JoseRegularR&DJob ID: A02372
Responsibilities
About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

About the Team
Our team plays a crucial role in ensuring the company's success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you'll be part of a team that's developing new solutions to new challenges. It's working fast, at scale, and we're making a difference. We are looking for talents to join us on this exciting journey

Responsibilities
- Build a Data Warehouse that can cater to batch and streaming data and Data Products that provide useful information to build efficient data metrics and dashboards which will be used to make smarter business decisions to support business growth.
- Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, multi-dimensional analysis).
- Design and implement reliable, scalable, robust, and extensible big data systems that support core products and business.
- Recommend different ways to constantly improve data reliability and quality.
- Establish solid design and best engineering practice for engineers as well as non-technical people.
- Deploy application changes to cloud environment, configure data attributes, schedule batch jobs, manage computing resources, and setup monitoring tools and alerts.
- Mentor junior and intern Data Engineers.
Qualifications
Qualifications
Must have a Master's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 2 years of related work experience; OR a Bachelor's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 5 years of post-bachelor's, progressive related work experience.

Of the required experience, must have 2 years of experience in each of the following:
- Performing data analysis, design, and development of highly efficient, reliable, and scalable ETL applications using SQL, C#, and Python;
- Transforming big data using Spark and M/R (map reduce) for data insights, reporting, and analytics, and transferring data to Hadoop Distributed File System (HDFS) using Sqoop;
- Building data pipelines and implementing partitioning and bucketing in hive to organize and query data, and performing query tuning to improve the speed of daily user analytics and reports;
- Performing code changes and reviews using Git version control and performing workflow management using JIRA; and
- Automating system maintenance and deployment tasks by creating and scheduling cron jobs using Shell script.

Type: Full time, 40 hours/week
Location: San Jose, CA
Salary Range: $ $355000 per year


  • Senior Data Engineer

    2 weeks ago


    San Jose, California, United States Hume AI Inc Full time

    Join our team at Hume AI, where we are looking for a skilled software engineer specializing in data engineering to contribute to our innovative mission. Become part of our efforts to ensure that artificial intelligence is driven by human values, a fundamental challenge (and opportunity) of our time.About Us:Hume AI is committed to developing AI that...

  • Senior Data Architect

    2 weeks ago


    San Jose, California, United States B. I. R. Solutions, LLC Full time

    Senior Data ArchitectExperience Level: Need very Experience.Client: Large Semiconductor CompanyNumber of positions:1Duration: 6 to 9 MonthsWork Mode: Onsite Location: San Jose, CaliforniaTerms: C2C (Corp-to-Corp) Please apply if you have relevant real-time experience. Background and employment verification will be conducted.Interview Process: There will be...


  • San Diego, California, United States Kforce Full time

    RESPONSIBILITIES:Kforce has a client in San Diego, CA that is seeking a Senior Cloud Data Engineer to be Hybrid - 3 days onsite in La Jolla, CA area. Responsibilities and Duties: Senior Data Cloud Engineer will create data systems used in the company's products Working closely with a diverse group of hardware & software engineers, systems engineers, and...


  • San Jose, California, United States McAfee Full time

    Role Overview:As the leader of McAfee's Enterprise Data Analytics team, you will drive ownership of data insights at McAfee. You will manage McAfee's data curation and governance function and lead a high-performing, cross-functional team of data Engineers and Technical Data Stewards to deliver data of high quality and reliability.This is a remote position...


  • San Jose, California, United States McAfee Full time

    Role Overview:As the leader of McAfee's Enterprise Data Analytics team, you will drive ownership of data insights at McAfee. You will manage McAfee's data curation and governance function and lead a high-performing, cross-functional team of data Engineers and Technical Data Stewards to deliver data of high quality and reliability.This is a remote position...

  • Data Engineer

    2 weeks ago


    San Jose, California, United States Adobe Full time

    Data Engineer Opportunity at AdobeAdobe is dedicated to revolutionizing the digital world. We provide individuals and businesses with the necessary tools to create extraordinary digital experiences. Our focus is on enabling people to craft stunning images, videos, and apps, redefining how companies engage with customers across all platforms.If you have a...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, California, United States Airwallex Full time

    Airwallex is a global payments fintech company transforming the way businesses move and manage money globally. We have built a global financial infrastructure platform to help businesses transact, collect and pay across 130+ countries and 50+ currencies, without the constraints of the traditional global financial system. We've grown to 13 global locations...


  • San Jose, California, United States Anthro Energy, Inc. Full time

    About the Job As Senior Battery Engineer, youll work with the Product Team bringing Anthros technology into customer products and services; making safer batteries a reality. A successful Senior Battery Engineer is driven, organized and detail oriented; communicates with ease to technical and non-technical teams; thrives in a fast-paced, ambiguous, startup...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, California, United States FOCUSKPI INC Full time

    Job DescriptionFocusKPI is seeking a talented Senior Data Engineer to join our client who believes Ethereum holds the key to solving crucial coordination issues. From its beginnings as a research group, our client is dedicated to expanding its technology and values. Currently, the main obstacle to Ethereum's growth is performance and scalability, and we are...

  • Data Engineer

    2 weeks ago


    San Jose, California, United States Zscaler Full time

    About ZscalerZscaler is a leading company in accelerating digital transformation for customers, making them more agile, efficient, resilient, and secure. Their Zero Trust Exchange platform, a cloud-native solution, protects numerous customers worldwide from cyber threats and data loss by securely connecting users, devices, and applications regardless of...


  • San Jose, California, United States Zoom Full time

    Job Description:Understand Big Data architecture, research and provide proven solutions for building large-scale data processing platforms. Design, then implement highly effective automated methods to build and update Big Data infrastructure. Design, then implement advanced service monitoring system for Big Data platform. Determine and develop operation...

  • Senior Data Engineer

    3 weeks ago


    San Francisco, California, United States Nightfall AI Full time

    Nightfall AI ) is the unified platform that prevents data leaks and enables secure collaboration by protecting sensitive data and controlling how it's shared. For decades, legacy data leak prevention (DLP) solutions have failed to adequately protect sensitive information. Traditional DLP is outdated, intrusive, and complex - it wasn't designed for today's...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, California, United States Checkr Full time

    About CheckrCheckr builds people infrastructure for the future of work. And we believe everyone should have a fair chance to work. That's why we've designed a faster—and fairer—way to screen job seekers. Established in 2014 and valued at $5B, Checkr puts modern technology powered by machine learning in the hands of hiring teams, helping thousands of...


  • San Jose, California, United States Cloudious LLC Full time

    Cloudious LLC is one of the fastest emerging IT Solutions and Services company headquartered in San Jose, CA with their global offices in Canada, EMEA & APAC.We are currently hiring a seasoned Senior Integration Engineer who comes with a strong consulting mindsetSenior Integration Engineer(Hybrid-Weekly Twice)Location: San Jose, CA or Lehi, UtahLong term: 1+...


  • San Jose, California, United States Cisco Full time

    Who We Are: We are the Chief Data & Analytics Office (CDAO) responsible for managing enterprise data and metrics. Our focus is driven by Cisco's evolution and increased market leadership in recurring revenue business models. Key subject areas within CDAO include Analytics and Data Science, Data Architecture, Data Platforms, Data Engineering, Core Data...


  • San Francisco, California, United States SoFi Full time

    Employee Applicant Privacy NoticeWho we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The...


  • San Jose, California, United States Stryker Full time

    Work Flexibility: Hybrid or OnsiteStryker is seeking a Senior Design Quality Engineer NPD in San Jose, CA. The Senior Design Quality Engineer NPD serves a key role in new product development at Stryker Endoscopy, a pioneer in visualization for Minimally Invasive Surgery (MIS). As the market leader in rigid endoscopy, Stryker continues to set the pace in...


  • San Diego, California, United States Kyocera Full time

    Company Overview With nearly 80,000 employees globally, Kyocera is a leading manufacturer of high-tech Ceramics which are used in a variety of industries including aerospace, automotive, medical applications, and semiconductor processing. You will find our innovative materials in everything from smartphones to space shuttles Check out our profile video Look...

  • Senior Data Analyst

    1 month ago


    San Jose, California, United States Apollose Full time

    Responsibilities Onboard and investigate data from multiple sources identify and trouble-shoot issues that reside in first-party and third-party datasets. Design and build interactive and visually appealing dashboards reports and data visualizations using Domo or Tableau. Document development of information data architecture and process flows. Provide...

  • Senior Data Analyst

    4 weeks ago


    San Jose, California, United States Apollose Full time

    Responsibilities Onboard and investigate data from multiple sources identify and trouble-shoot issues that reside in first-party and third-party datasets. Design and build interactive and visually appealing dashboards reports and data visualizations using Domo or Tableau. Document development of information data architecture and process flows. Provide...