Data Engineer

4 weeks ago


Los Angeles, United States People Source Consulting Full time

Would you be interested in a data engineering role at a fast-paced AI (LLM) start-up comprised of Meta, Google, AWS, and Microsoft alumni?

You can expect to: Curate and manage large-scale data ingestion and indexing pipelines, ensuring data quality and error handling. Design robust data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness. Ensure the secure handling of data through end-to-end encryption, data isolation, and other best practices. Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability. Work closely with the

team

to integrate search infrastructure that meets the needs of large language models and retrieval systems.

Your first 3 months will include: You have a strong grasp infrastructure, architecture, performance concerns, SDLC and practices. You have successfully enhanced their data ingestion framework, demonstrating significant improvements in the efficiency and scalability of data collection. Your contributions have directly improved the scalability, and performance of their data infrastructure, setting new benchmarks for data quality and access. You are finding opportunities to learn, mentor and promote best practices in areas of your expertise. Your colleagues count on you for your technical advice.

A successful candidate will have: Demonstrated experience with building and optimising search infrastructure in a cloud environment. Prior experience working in both small and large companies A product orientated mindset Strong programming and engineering skills, with proficiency in Python and experience with cloud infrastructure (AWS, Google Cloud, Azure) and data infrastructure (SQL, NoSQL, inverted indexes, vector databases). Commitment to secure data practices and a keen interest in staying updated with the latest technologies and methodologies in data engineering. A track record of successfully scaling data pipelines to handle large volumes of data continuously. Independent problem-solver with a passion for data and a proactive approach to overcoming challenges.

They operate a hybrid working model with offices in Mountain View. You'll receive a highly competitive salary, equity package, comprehensive health insurance, unlimited PTO, 401K, travel budget, office equipment allowance and VISA sponsorship if required.

Apply below to join a challenging in house LLM (large language model) project backed by significant investors

#J-18808-Ljbffr


  • Data Engineer

    1 month ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    4 days ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    4 weeks ago


    Los Angeles, United States Proliance Consulting Full time

    Data EngineerLength: until 10/31/24 (strong possibility of extension or conversion)Associate Vendors: We are accepting applications from candidates who are currently authorized to work in the US for any employer without sponsorship.Role & Responsibilities• Build complex data engineering pipelines using Python and Airflow to hydrate datamarts in Snowflake...

  • Data Engineer

    4 weeks ago


    Los Angeles, United States VISART Full time

    Responsibilities Implement data ingestion routines both real time and batch using best practices in data modeling. Develop ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust scalable operable solutions that work well within the overall data...

  • Data Engineer

    1 month ago


    Los Angeles, California, United States VISART Full time

    Responsibilities Implement data ingestion routines both real time and batch using best practices in data modeling. Develop ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust scalable operable solutions that work well within the overall data architecture....

  • Data Engineer II

    1 week ago


    Los Angeles, California, United States Riot Games Full time

    Data Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...

  • Lead Data Engineer

    2 hours ago


    Los Angeles, United States SoLo Funds Full time

    SoLo Funds is on a mission to help the millions of Americans that live paycheck to paycheck and can’t survive a money crunch. Launched in 2018 as a unique and proprietary lending marketplace, today SoLo is the leading alternative financial solution providing the fastest loans available for borrowers and the opportunity for lenders to earn significant...


  • Los Angeles, California, United States Riot Games Full time

    Data Engineers at Riot bring deep knowledge of data management so we can synthesize data within and across data domains. Our engineers are player and Rioter focused and aim to find solutions that make players excited to experience our games, and Rioters excited to deliver on our mission. Principal Engineers, at Riot, are often called on to help with the...


  • Los Angeles, United States Meta Full time

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • Sr. Data Engineer

    4 hours ago


    Los Angeles, United States Motion Recruitment Full time

    We are a quantitatively driven, independent Investment Advisory that helps clients who are frustrated with Wall Street’s high expenses, excessive risks, and conflicts of interest. By bringing aboard top talent in computer science and finance, and investing heavily in technology infrastructure, we have created an innovative platform to provide...

  • Sr Data Engineer

    4 weeks ago


    Los Angeles, United States wipros Full time

    Responsibilities Building data architectures and data pipelines to collectively bring together data. Designing solutions using Microsoft Azure services and other tools. Assuring that data is cleansed mapped transformed and optimized for storage and use according to business and technical requirements Automating tasks and deploying production standard...

  • Sr Data Engineer

    4 weeks ago


    Los Angeles, California, United States wipros Full time

    Responsibilities Building data architectures and data pipelines to collectively bring together data. Designing solutions using Microsoft Azure services and other tools. Assuring that data is cleansed mapped transformed and optimized for storage and use according to business and technical requirements Automating tasks and deploying production standard code....

  • Staff Data Engineer

    4 weeks ago


    Los Angeles, United States Metropolis Full time

    Job DescriptionJob DescriptionLocation: Santa Monica, CA, Seattle, WA, Chicago, IL, Nashville, TN or New York City, NY (Hybrid) The CompanyMetropolis develops advanced computer vision and machine learning technology that makes mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in...

  • Data Engineer II

    1 week ago


    Los Angeles, United States Riot Games Full time

    Data Engineers at Riot bring deep knowledge of specific technical areas and also value the opportunity to work in many broader domains. Our engineers are player-focused and aim to find solutions that make players excited to experience our games. Senior Engineers, at Riot, are often called on to help with the hardest problems on a project by using their...


  • Los Angeles, United States Keeling Labs Full time

    Job DescriptionJob DescriptionOur MissionFounded in 2022, Keeling Labs was started as a place to develop and apply machine learning to solve the world's biggest problem—climate change. Our current priority is getting the grid to run on 100% clean energy, which is currently limited by battery storage (specifically, the algorithms that control...

  • Senior Data Engineer

    3 hours ago


    Los Angeles, United States Motion Recruitment Full time

    A fintech -based automated investment company that handles billions in client funds is hiring a Senior Data Engineer to join the team. In this role you will excel if you have a software background and can develop APIs with python while building out new ETL pipelines to support key trading and portfolio investment systems. The main tech stack for this role...


  • Los Angeles, United States Metropolis Full time

    Job DescriptionJob DescriptionThe CompanyMetropolis develops advanced computer vision and machine learning technology that makes mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in opportunity. We're building the digital pipes through which the future of mobile commerce will...


  • Los Angeles, United States Tri-Force Consulting Services, Inc. Full time

    Job DescriptionJob DescriptionTitle : Senior Data Engineer/Developer Location : Superior Court of California, County of Los Angeles`Client : Superior Court of CaliforniaNote : This is a remote position; however, they may have to travel on site or to other courts or conferences on rare occasions.Job Description : The Los Angeles Superior Court is seeking a...


  • Los Angeles, United States Brxio Inc Full time

    ************** Please only Citizen or GC applicants only **************** ************** 10+ years exp in maintaining and support for Analytical software, RStudio, Stata, MATLAB, R **************** The Data Engineering System Administrator primary responsibility includes supporting, maintaining, administering, and upgrading the database appliances,...

  • Senior ETL DEV

    4 weeks ago


    Los Angeles, United States Gold Coast Health Plan Full time

    Senior ETL DEV-Data Engineer Requisition ID: 1493 Salary Range: $100,406.00 To 167,344.00 Annually ( Mid-Range: $133,875 ) CA salary range posted. Please note: Salary range will vary for out of state remote work. The pay range above represents the minimum and maximum rate for this position in California. Factors that may be used to determine where newly...