Data Engineer

4 days ago

San Francisco, California, United States InterSources Inc Full time

Job Title:
AI Data Engineer

Duration:
3-6 Months CTH

Experience:
Minimum 12+ Years

Job Description:

  • Design, build, and maintain large-scale data pipelines and architectures to support AI and machine learning initiatives.
  • Collaborate with data scientists, AI engineers, and analytics teams to ensure seamless data flow for model development and deployment.
  • Develop and optimize ETL processes to extract, transform, and load data from multiple structured and unstructured sources.
  • Build data platforms that enable high-performance AI/ML model training, testing, and monitoring.
  • Ensure data quality, integrity, and availability across all AI-driven systems.
  • Work with massive datasets to preprocess, cleanse, and structure data for analytics and machine learning applications.
  • Integrate cloud-based data services and tools to support large-scale AI workloads.
  • Automate data workflows and support the deployment of AI models using MLOps best practices.
  • Research and implement the latest advancements in data engineering and AI infrastructure technologies.

Required Skills:

  • Minimum 12 years of experience in Data Engineering with a strong focus on AI/ML data systems.
  • Proficiency in programming languages such as Python, SQL, and Scala.
  • Strong experience with big data tools and frameworks such as Spark, Hadoop, Hive, and Kafka.
  • Hands-on experience with data pipeline orchestration tools like Airflow or Databricks.
  • Expertise in cloud platforms such as AWS, Azure, or Google Cloud (preferably with AI/ML services).
  • Solid understanding of data modeling, warehousing, and data lake architectures.
  • Experience integrating data for machine learning workflows and managing feature stores.
  • Familiarity with ML frameworks such as TensorFlow, PyTorch, and Scikit-learn.
  • Knowledge of MLOps tools like MLflow, Kubeflow, or DataRobot for production model deployment.
  • Strong understanding of APIs, REST services, and real-time data streaming solutions.

Preferred Skills:

  • Experience with data governance, metadata management, and lineage tracking.
  • Familiarity with generative AI data preparation and LLM data pipelines.
  • Exposure to NLP, computer vision, or AI model integration within data systems.
  • Experience with CI/CD pipelines for data and AI model automation.
  • Excellent analytical, problem-solving, and communication skills.
  • Strong background in mathematics, statistics, or computer science fundamentals.

Education:

  • Bachelor's degree in Computer Science, Data Engineering, or related field required.
  • Master's preferred.

  • Data Engineer

    1 week ago

    San Francisco, California, United States Zapier Full time

    About ZapierWe're humans who simply think computers should do more work.At Zapier, we're not just making software—we're building a platform to help millions of businesses globally scale with automation and AI. Our mission is to make automation work for everyone by delivering products that delight our customers. You'll collaborate with brilliant people, use...

  • Data Engineer

    4 days ago

    San Francisco, California, United States Air Apps Full time

    About Air AppsAt Air Apps, we believe in thinking bigger—and moving faster. We're a family-founded company on a mission to create the world's first AI-powered Personal & Entrepreneurial Resource Planner (PRP), and we need your passion and ambition to help us change how people plan, work, and live. Born in Lisbon, Portugal in 2018—and now with offices in...

  • Data Engineer

    2 weeks ago

    San Francisco, California, United States Sigma Full time $140,000 - $155,000 per year

    About The RoleWe're hiring our first Data Engineer within Tech Operations at Sigma. In this role, you'll build the data foundation that powers critical insights across Engineering and Tech Operations. You will architect, scale, and optimize data models and pipelines across Snowflake and Databricks, fueling everything from internal decision-making to...

  • Data Engineer

    4 days ago

    San Francisco, California, United States Stefanini Group Full time

      Job DescriptionStefanini Group is hiringStefanini is looking for a Data Engineer for various location across USA (Hybrid).For quick apply, please connect with Prakhar Goel: / W2 Candidates OnlyPosition SummaryAs a Data Engineer, this CW will be responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn...

  • Data Engineer

    2 weeks ago

    San Francisco, California, United States Kikoff Full time

    ResponsibilitiesWe are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and scale high-leverage data models, foundational datasets and scalable infrastructure that enables analytics, modeling, and experimentation. Your responsibilities includes:Build and...

  • Data Engineer

    1 week ago

    San Francisco, California, United States Haystack Full time

    We're working with Cognizant on this role.Azure Data EngineerSan Francisco, HybridAbout the RoleCognizant is looking for an experienced Azure Data Engineer with strong skills across Azure Databricks, Azure Synapse Analytics, PySpark, and Azure Data Factory. You will design and implement scalable data solutions that support advanced analytics and enterprise...

  • Data Engineer

    1 week ago

    San Francisco, California, United States Mercor Full time

    About MercorMercor is at the intersection of labor markets and AI research. We partner with leading AI labs and enterprises to provide the human intelligence essential to AI development.Our vast talent network trains frontier AI models in the same way teachers teach students: by sharing knowledge, experience, and context that can't be captured in code alone....

  • Data Engineer

    2 days ago

    San Francisco, California, United States Career Mentors Full time

    Job description Location: San Francisco, CA and Jersey City, NJWork Mode: Hybrid (3 Days Onsite / 2 Days Remote)Employment Type: W2 Only (No C2C or 1099)Candidate Requirement: Local candidates preferred (must be located near San Francisco or Jersey City)As an AWS Data Engineer, you will be a key member of our data engineering team, responsible for building...

  • Platform Data Engineer

    2 days ago

    San Francisco, California, United States Neon Redwood Full time

    About Neon RedwoodNeon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities.The RoleWe are seeking an...

  • Sr. Data Engineer

    2 days ago

    San Francisco, California, United States Neon Redwood Full time

    About Neon RedwoodNeon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities.The RoleWe are seeking an...