Senior Data Engineer/ Data Engineering Architect

2 months ago


San Jose, United States DESIGNLIBRO INC Full time
Job DescriptionJob DescriptionResponsibilities
  • Design robust and scalable data system architecture to collect, process, and store large volumes of data from IoT devices.
  • Design and build data systems that support real-time, customer facing data applications, ensuring data integrity and efficient retrieval processes.
  • Design and build a data validation framework to guarantee the accuracy and consistency of data across all stages of the pipeline, ensuring reliable insights and decision-making.
  • Implement data architectures to continuously improve AI models through automated feedback loops and data collection processes.
  • Optimize data processing workflows for AIoT tasks.
  • Collaborate with product owners to translate data requirements into actionable data engineering solutions.
  • Collaborate with other engineers, product owners to solve challenging problems.
  • Evangelize software engineering best practices and lead by example.

Qualifications
  • Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
  • 5+ years of proven experience in data engineering, with a strong focus on data warehousing and data system architecture.
  • Expertise in design and build IoT data systems. 
  • Expertise in architecting that power high-volume consumer application.
  • Expertise in big data and streaming technologies (Python, Java, Kafka, Spark,Spark Streaming).
  • Expertise in moderen database technology (MongoDB, ElasticSearch, StarRocks, S3, Snowflake, Bigquery etc).
  • Experience with data annotation tools and processes for machine learning datasets.
  • Familiarity with MLOps practices and tools for managing AI model lifecycles.
  • Knowledge about deploying systems into a production Cloud Native Environment (AWS or similar).
  • Experience in Java Spring Framework is a plus
  • Experience with video data handling and image processing is a plus


  • San Jose, California, United States TechnoGen Full time

    Job Title: Senior Data Solutions ArchitectJob Summary:We are seeking a highly skilled Senior Data Solutions Architect to join our team at TechnoGen. As a key member of our data engineering team, you will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.Key Responsibilities:Create robust data...


  • San Jose, United States TechnoGen Full time

    Senior Data Engineer We are looking for Senior Data Engineers to build data pipelines for the Data Center business group's Data Science team at the largest social media organization using its next generation data tools. As a member of a centralized Data Science/Data Engineering team you will contribute to a variety of projects and technologies, depending on...


  • San Jose, California, United States eBay Full time

    Unlock the Power of Data with eBayWe are seeking a highly skilled Senior Data Engineer to join our team at TCGplayer, a subsidiary company of eBay. As a member of our Data Engineering team, you will play a critical role in designing and implementing datastores, data architectures, and data flows for microservices that are scalable, reliable, and efficient.


  • San Diego, United States LanceSoft Full time

    Principal Data Engineer/ Architect Temp to perm Full time - Pay $70 ot $100/hr based on experience Remote As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization's data strategy using software engineering...

  • Senior Data Architect

    18 hours ago


    San Antonio, Texas, United States TransPecos Banks Full time

    Transform Your Career with TransPecos BanksAbout the RoleWe are seeking a highly skilled Senior Data Architect to join our team at TransPecos Banks. This is an exciting opportunity to work in a fast-paced environment and contribute to the development of innovative data solutions.Salary & BenefitsThe salary for this position is estimated to be around $125,000...


  • San Francisco, California, United States Unreal Gigs Full time

    Job Title: Senior Data ArchitectAbout Unreal Gigs: Welcome to the forefront of data-driven innovation. Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries.Estimated Salary Range: $250,000 - $350,000 per yearPosition Overview: As a Senior Data Architect at Unreal Gigs, you will...


  • San Jose, California, United States DESIGNLIBRO INC Full time

    Job DescriptionKey ResponsibilitiesData System ArchitectureIoT Data SystemsData Validation FrameworkAI Model ImprovementData Processing WorkflowsQualificationsEducationExperienceExpertiseIn order to excel in this role, candidates should have a Bachelor's degree in Computer Science, Data Science, Engineering, or a related field, along with 5+ years of...


  • San Jose, United States VDart Full time

    Job Title: Senior Data Engineer Location: San Jose, CA or Austin, TX - Onsite Duration: / Term: 6+ months - Contract Job Description: Senior level data engineer to work in the Enterprise data environment. Understand project requirements, prioritization with alignment of project priorities with program level goals Work with product managers/ BSAs and...

  • Data Architect

    6 days ago


    San Diego, California, United States LanceSoft Full time

    {"title": "Senior Software Engineer/Data Architect", "description": "LanceSoftAbout the Role:We are seeking a highly skilled Senior Software Engineer/Data Architect to lead our data engineering team in designing, building, and maintaining high-performance software systems to manage analytical data pipelines that fuel our organization's data strategy using...

  • Data Engineer

    1 week ago


    San Diego, United States LanceSoft Full time

    Title: Senior Software Engineer/Data Engineer Location: Remote Duration: 6 Months (Temp to perm) Description: About the role: As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization's data strategy using...


  • San Jose, California, United States RAMPS International Inc. Full time

    About the Role:RAMPS International Inc. is seeking an experienced Big Data Architect and Engineer to join our team in San Jose, CA.Job Description:We are looking for a skilled professional with hands-on experience in designing, deploying, monitoring, tuning, and troubleshooting Hadoop infrastructure. The ideal candidate will have strong...


  • San Jose, California, United States United Software Group Full time

    Job Title: Senior Data ArchitectAbout the Role:United Software Group is seeking a highly skilled Senior Data Architect to collaborate with Director/VP-level stakeholders. This role will be pivotal in shaping how we collect, measure, track, and report data for the organization, focusing on driving metrics-based project delivery.Key...

  • Data Engineer

    1 week ago


    San Francisco, United States Unreal Gigs Full time

    Are you passionate about building data infrastructure that powers advanced analytics and machine learning? Do you thrive on transforming raw data into well-organized, accessible, and reliable datasets that fuel data-driven decision-making? If you're excited about working with cutting-edge data technologies and architecting scalable pipelines, then our client...


  • San Jose, California, United States SAMSUNG SDS Full time

    Our Employees Are Among The Most Talented People In Their Fields And The Key To Our SuccessAt Samsung SDS, we encourage our employees to showcase their talent through our diverse corporate culture. Our strength is our people. Each individual makes an impact on the company and plays a vital role in contributing to the company's success. Our employees are...

  • Data Engineer

    2 weeks ago


    San Francisco, United States ZipRecruiter Full time

    Job DescriptionAre you passionate about designing, building, and maintaining data pipelines that support robust data architectures and facilitate seamless data flow? Do you excel in creating scalable solutions that empower data-driven decision-making? If you’re ready to develop and optimize data systems that drive impactful analytics, our client has the...


  • San Francisco, California, United States USM Business Systems Full time

    Job Title: Senior Data Engineer + Big Data/HadoopJob Summary:The Data Architect and Engineer will be an integral member of the team within Data Services. This is a highly technical and hands-on role with responsibility to lead design, implement and support data architecture deliverables for multiple data integration, data management, data warehousing,...


  • San Diego, California, United States ASML US, LLC Full time

    **Job Summary**We are seeking a highly skilled **Senior Data Architect** to join our team at ASML US, LLC. As a key member of our organization, you will be responsible for designing and implementing complex data systems that meet the needs of our customers.**Responsibilities*** Manage the specification and analysis of at least one Business Driver and/or...


  • San Jose, California, United States Analog Devices, Inc. Full time

    Job SummaryAs a Principal Data Engineer at Analog Devices, Inc., you will lead the design and implementation of advanced data solutions that support our enterprise-wide data strategy. This role involves driving the architecture, development, and optimization of a scalable, secure master data platform that powers advanced analytics and data-driven...


  • San Jose, California, United States Moss Adams LLP Full time

    Job SummaryMoss Adams LLP seeks a Senior Data Engineer to lead the development, testing, and maintenance of the firm's analytical data assets. This role collaborates with data scientists, report writers, and stakeholders to define business needs and build scalable data processing pipelines.Main Responsibilities:Manage and support Azure Machine Learning...

  • Data Architect

    2 weeks ago


    San Jose, United States Net2Source Inc. Full time

    Net2Source is a Global Workforce Solutions Company headquartered at NJ, USA with its branch offices in Asia Pacific Region. We are one of the fastest growing IT Consulting company across the USA and we are hiring " Data Architect " for one of our clients. We offer a wide gamut of consulting solutions customized to our 450+ clients ranging from Fortune...