Senior Big Data Specialist

3 weeks ago


San Jose, California, United States TechnoGen Full time
Job Description

We are looking for a skilled Senior Data Engineer to join our team at TechnoGen. In this role, you will be responsible for designing, building, and launching efficient and reliable data pipelines to support our data science team's efforts. You will work closely with cross-functional teams to identify data needs and develop strategies to meet them.

As a key member of our Data Science team, you will contribute to a variety of projects and technologies depending on partner needs. Your expertise in SQL, Python, and data warehousing architecture will enable you to build highly scalable and reliable data pipelines that move data across multiple platforms. You will also be responsible for developing and owning data quality standards for your areas of responsibility.

Key Responsibilities:
* Partner with leadership, engineers, program managers, and data scientists to understand data needs.
* Design, build, and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches, and real-time systems.
* Build data expertise and own data quality for your areas.

Requirements:
* 5+ years Data Engineering experience.
* Expert in SQL with good understanding of how relational databases work.
* Good Python Programming experience.
* Experience with Data Warehousing Architecture.
* Experience with workflow management engines like Airflow, Dataswarm, Luigi etc.
* 5+ years experience in custom ETL design, implementation, and maintenance.
* Experience with data quality and validation.
* Experience with SQL performance tuning and e2e process optimization.
* Experience querying massive datasets using Presto, Hive etc.

What We Offer:
* A competitive salary of $180,000 - $220,000 per year, commensurate with experience.
* Opportunities for growth and professional development in a dynamic and innovative environment.
* Collaborative and inclusive company culture that values diversity and creativity.

Acknowledgement: This job posting is provided by TechnoGen.

  • San Jose, California, United States TEPHRA Full time

    We are TEPHRA, a dynamic organization committed to excellence in big data engineering. We are now seeking a seasoned Big Data Technology Specialist to enhance our team's capabilities. In this pivotal role, you will play a crucial part in architecting and implementing robust big data solutions using advanced technologies such as HDFS, Apache Spark, and...


  • San Jose, California, United States Tekfortune Inc Full time

    **Job Description**Tekfortune Inc is seeking a Senior Big Data Pipeline Architect to join our team. As a key member of our technical team, you will be responsible for designing, implementing, and optimizing complex data pipelines using Google Cloud technologies such as Cloud Composer, DataFlow, and DataProc clusters.The ideal candidate will have a strong...


  • San Jose, California, United States SAMSUNG SDS Full time

    Job OverviewWe are seeking a seasoned senior software architect with at least 8 years of experience in designing and implementing scalable, distributed systems to join the Data Analytics Team at Samsung SDS. The ideal candidate will have a strong background in data analytics platform design and architecture, as well as expertise in big data technologies such...

  • Big Data Specialist

    3 weeks ago


    San Jose, California, United States Tik Tok Full time

    About the JobWe are seeking talented individuals to join our Global live Data BP team as Data Engineers. Your primary responsibility will be to construct offline and real-time data warehouses for TikTok Live business. You will handle large-scale data processing, providing services for the entire lifecycle of big data, covering data generation, transmission,...


  • San Francisco, California, United States SS&C Full time

    About UsSS&C is a leading provider of financial services and healthcare technology solutions with a global presence. Our team is dedicated to delivering high-quality products and services that meet the evolving needs of our clients.Job SummaryWe are seeking an experienced Senior Data Engineer to join our team and lead the design and implementation of our...

  • Big Data Specialist

    3 weeks ago


    San Francisco, California, United States Jacobs Full time

    Jacobs is seeking a talented Senior Data Engineer to lead data engineering projects and help productize data products and algorithms into our scalable analytics platform. As a key member of our team, you will work closely with cross-functional teams to understand data needs and develop customized solutions for customers.The ideal candidate will have a strong...

  • Big Data Architect

    3 weeks ago


    San Jose, California, United States TEPHRA Full time

    Job Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at TEPHRA. The successful candidate will design and implement scalable big data solutions to support our business growth.About the Role:- Design, develop, and deploy large-scale big data architectures.- Collaborate with cross-functional teams to define and...


  • San Diego, California, United States Apple Full time

    Big Data Analytics SpecialistWe're looking for an experienced engineer to join our team and contribute to the design, development, and maintenance of our analytics infrastructure. As a Big Data Analytics Specialist, you will be responsible for analyzing complex data sets and developing innovative solutions.Key Responsibilities:Analyze large data sets to...

  • Big Data Specialist

    3 weeks ago


    San Francisco, California, United States Unity Technologies Full time

    About UsWe are Unity Technologies, the world's leading platform for creating real-time 3D content. Our company overview highlights our commitment to innovation and customer satisfaction. We offer a dynamic work environment where you can grow your skills and advance your career.">This is an exciting opportunity to join our Unity Ads Data Engineering team as a...


  • San Jose, California, United States Syntricate Technologies Full time

    Job Summary:Syntricate Technologies is seeking a highly experienced Senior Data Modeling Specialist - SAP HANA to join our team. As a Senior Data Modeling Specialist, you will be responsible for designing and developing data models for SAP HANA, ensuring optimal performance and scalability. You will work closely with cross-functional teams to manage the...


  • San Diego, California, United States CoStar Realty Information, Inc. Full time

    Senior Cloud Data EngineerCelebrate your passion for big data engineering by joining our dynamic team at CoStar Realty Information, Inc.! We're seeking an exceptional Senior Data Engineer with expertise in designing, building, testing, and deploying high-quality applications that handle massive amounts of data.In this role, you'll collaborate with...


  • San Diego, California, United States Agile Enterprise Solutions Inc. Full time

    About Agile Enterprise Solutions Inc.Agile Enterprise Solutions (AES) is a software development and consulting company with three offices in the US, offering a range of services including ERP solutions for Oracle and SAP, Microsoft technologies, and web technologies. Our team consists of over 200 experienced consultants serving clients across the United...


  • San Jose, California, United States TEPHRA Full time

    At TEPHRA, we are seeking a highly skilled Big Data Engineer-Assurance to join our team. This individual will be responsible for architecting and designing solutions, including hands-on work to build and manage Big Data Stack to support Platform And Application Development.The ideal candidate must have deep expertise in HDFS and Apache Spark. Additionally,...


  • San Jose, California, United States United Software Group Full time

    Job Description:Senior Data Insights SpecialistAbout the Role:We are seeking an experienced Senior Data Insights Specialist to join our team at United Software Group. As a key member of our data-driven organization, you will be responsible for driving business decisions with actionable insights and recommendations. This is a pivotal role in shaping our data...


  • San Jose, California, United States ACL Digital Full time

    Job Summary: Big Data Analytics ExpertAFL Digital is seeking a highly skilled Big Data Analytics Expert to join our team. As a key member of our team, you will play a crucial role in developing and maintaining client/stats models, working closely with the data engineering team to build client models on security data.Salary Range: $150,000 - $190,000 per year...


  • San Jose, California, United States VDart Full time

    Job Overview: VDart is seeking an experienced Senior Data Specialist to join our team. In this role, you will work closely with cross-functional teams to design, develop, and maintain our enterprise data environment. Your expertise in data management domains such as master data management, reference data, data warehousing, BI & Analytics, ETL and API...


  • San Jose, California, United States HireIO Inc Full time

    At HireIO Inc, we're looking for a talented Big Data Systems Architect to lead the development of our next-gen A/B testing platform. This platform will empower our company to make data-driven decisions for our products. The supported scenarios include recommendation, push, ads, search, mobile app, UI interaction, and service upgrades.As a software engineer...


  • San Jose, California, United States CodeForce Full time

    Become a Senior SAP HANA Data Modeler at CodeForceWe are seeking a highly experienced Senior SAP HANA Data Modeler to join our team. This is a senior-level role that requires expertise in SAP S4/HANA, HANA modeling, SQL skills, and big data with enterprise data warehousing experience.The estimated salary for this role is around $160,000 - $220,000 per year,...


  • San Jose, California, United States ZipRecruiter Full time

    **About the Role**We are looking for a skilled Big Data Systems Lead Developer to lead the development of our data platform. The successful candidate will have experience in building large-scale distributed systems in a product environment.In this role, you will be responsible for designing and implementing reliable, scalable, robust, and extensible big data...


  • San Francisco, California, United States Windfall Data, Inc. Full time

    Lead Data Modeling Expert for WindfallWe are seeking a seasoned Senior Data Modeling Specialist to join our team at Windfall, a leading people intelligence and AI company. As a key member of our data science team, you will be responsible for developing and deploying predictive models that drive business outcomes.About the Role:Data Model Development: Design...