Palantir Data Engineer

2 weeks ago


Irvine, United States CTC Global Full time

Job Title: Palantir Data Engineer (On-Site, Irvine, CA)


Reports To: Principal Engineer Manager R&D       


Location: Irvine, CA, On-Site                                                              


Department: Engineering and Product Development  


Salary: $100,000 to $130,000 a year       


Shift: Day, Monday to Friday, 8 AM to 5 PM


SUMMARY

 

Data engineers work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate Foundry with external systems containing the data. Data engineers also need to provide guidance and support on how to access and leverage the data foundation to create new workflows or analyze data.


ESSENTIAL DUTIES AND RESPONSIBILITIES:


•          Integrate new data sources to Foundry using Data Connection

•          Implement 2-way integrations between Foundry and external systems

•          Develop pipelines transforming tabular or unstructured data

•          Implement data transformations in PySpark or Pipeline Builder

           to derive new datasets or create ontology objects.

•          Set up support structures for pipelines running in production

•          Monitor and debug critical issues such as data staleness or data quality

•          Improve performance of data pipelines (latency, resource usage)

•          Design and implement an ontology based on business requirements and available data

•          Provide data engineering context for application development

•          Identify opportunities for turning exploratory or analytical

           applications into interactive operational workflows to drive business value.

•          Maintain applications as usage grows and requirements change


 

PREFERRED QUALIFICATIONS:

 

•          Between 1 and 3 years of experience, ideally in a customer-facing role

•          Experience in Python/PySpark, or experienced in another programming

           language and willing to learn Python and PySpark on their own.

•          Experience in TypeScript, or experienced in another

           programming language and willing to learn TypeScript on their own.

•          Data engineering experience preferred over data science

•          Programming experience requiring collaborative software development

•          Python – complete language proficiency

SQL – proficiency in querying language (join types, filtering,

           aggregation) and data modeling (relationship types, constraints)

•          PySpark – basic familiarity (Data Frame operations, PySpark SQL

           functions) and differences with other Data Frame implementations

           (Pandas)

•          Typescript – experience in TypeScript or experienced in another

           programming language and willing to learn TypeScript on their own.

•          Distributed compute – conceptual knowledge of Hadoop and Spark (driver,

           executors, partitions)

•          Databases – general familiarity with common relational database models

           and proprietary instantiations, such as SAP, Salesforce, etc.

•          Git – knowledge of version control/collaboration workflows and

           best practices

•          Iterative working – familiarity with an agile and iterative working methodology

           and rapid user feedback gathering concepts.

•          UX design – knowledge of best practices and applications

•          Data quality – best practices

•          Data literacy – data analysis and statistical basics to ensure correctness in

           data aggregation and visualization


Benefits for all full-time employees include:

  • Medical (HMO/PPO Plan Options)
  • Dental
  • Vision
  • Group Term Life Insurance (CTC pays 100% of the premium)
  • Short-Term Disability and Long-Term Disability (CTC pays 100% of the premium)
  • Flexible Spending Account
  • 401K
  • 15 paid vacation days (more after 5 years)
  • 9 paid holidays
  • 3 paid sick leave days


  • Irvine, United States CTC Global Full time

    Job Title: Palantir Data Engineer (On-Site, Irvine, CA)Reports To: Principal Engineer Manager R&D       Location: Irvine, CA, On-Site                                                              Department: Engineering and Product Development  Salary: $100,000 to $130,000 a...


  • Irvine, United States CTC Global Full time

    Job Title: Palantir Data Engineer (On-Site, Irvine, CA)Reports To: Principal Engineer Manager R&D       Location: Irvine, CA, On-Site                                                              Department: Engineering and Product Development  Salary: $100,000 to $130,000 a...

  • Data Engineer

    1 week ago


    Irvine, United States Motion Recruitment Full time

    An AdTech is hiring a Senior Data Engineer to join their team. Requirements  This role is fully remote from Southern California, so it will be PST time. To be considered you must currently reside in CA, NY, NJ, FL, TX, WY, AZ, or CO as they need someone to begin asap Required Skills & Experience 5+ years professional Data Engineering Experience 5 years of...

  • Senior Data Engineer

    2 weeks ago


    Irvine, United States Convertible Full time

    Job DescriptionJob DescriptionAt Convertible, we leverage data to drive intelligent decision-making and optimize operations across various industries. Our Senior Data Engineers play a crucial role in designing and implementing robust data infrastructure that enables organizations to harness the full potential of their data assets.About the RoleWe are seeking...

  • AWS Data Engineer

    2 weeks ago


    Irvine, United States NextXap, Inc. Full time

    Role: AWS Data EngineerLocation: Irvine, CA (Onsite)Requirements:7+ years of experience as a Senior Data Engineer AWS, including designing and implementing complex Cloud applications5+ years of experience working with AWS - RDS, S3, Step Functions, Glue, Lambda, Athena, IAM, Codepipeline, Cloudformation, SNS, SQSShould be proficient in followingPostgreSql,...

  • Data Engineer II

    4 days ago


    Irvine, California, United States Amazon Full time

    We are in the business of building data solutions that allow us, and our partner teams, to apply data in order to improve experiences for our players. This role will directly be responsible for contributing to our data ecosystem, and ensuring that we are building the right solutions for all our partners.Key job responsibilitiesAmazon is all-in on games, and...


  • Irvine, Kentucky, United States AbbVie Full time

    Company DescriptionAbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas immunology, oncology, neuroscience, and eye care and products and services in our...


  • Irvine, United States Finfare Inc. Full time

    Job DescriptionJob DescriptionAbout FinfareFinfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense tracking, personalized spend controls, seamless accounting integration, powerful...


  • Irvine, California, United States Johnson & Johnson Full time

    At Johnson & Johnson, we are revolutionizing healthcare by leveraging technology, data, and the power of teamwork to overcome the world's most significant healthcare challenges. We are looking for passionate and driven Biostatistics, Programming, and Data Management (BPDM) interns to join our J&J MedTech - Cardiovascular & Specialty Solution Group (CSS) team...


  • Irvine, United States Allergan Data Labs Full time

    Allergan Data Labs is on a mission to transform the Allergan Aesthetics beauty business at AbbVie, one of the largest pharmaceutical companies in the world. Our iconic brands include BOTOX Cosmetic, CoolSculpting, JUVÉDERM and more. The medical aesthetics business is ripe for rapid growth and disruption, and we are looking to add to our high performing team...

  • Data Entry Specialist

    3 weeks ago


    Irvine, United States EKN Engineering Full time

    Data Entry Specialist - Data Solutions EKN Engineering is a fast-growing civil engineering and technology consulting company located in Irvine, CA. We are currently looking to add a Data Entry Specialist to our outstanding team. At EKN, Data Entry Specialists are responsible for analyzing handwritten tables, documents, and images and converting the...

  • Data Entry Specialist

    4 weeks ago


    Irvine, United States EKN Engineering Full time

    Data Entry Specialist - Data Solutions EKN Engineering is a fast-growing civil engineering and technology consulting company located in Irvine, CA. We are currently looking to add a Data Entry Specialist to our outstanding team. At EKN, Data Entry Specialists are responsible for analyzing handwritten tables, documents, and images and converting the...


  • Irvine, United States Logix Shapers Full time

    Job DescriptionJob DescriptionPlease find the JD below!!Title: AWS Data Engineer Location: Irvine, CAJob Description Client is looking for seasoned AWS technologists. You will lead and deliver technical solutions for cloud migration of existing and as well as build out of new projects in AWS. Your Impact: Lead, design, develop and deliver large-scale data...


  • Irvine, United States EKN Engineering Full time

    Data Entry Specialist - DSDD EKN Engineering is a fast-growing civil engineering and technology consulting company in Irvine, CA. In order to hit our growth goals, we are now hiring a Data Entry Specialist to our outstanding team. Unlike traditional data entry roles, this role requires more analysis than typing speed or simple manual data entry. At EKN, Data...

  • Big Data SDET

    5 days ago


    Irvine, United States ASCENDING Full time

    Job DescriptionJob DescriptionBig Data SDET - BlockchainLocation: Remote anywhere in the continental US (lower 48 states). Cannot work outside of the U.S.Job Description:We are supporting a Senior Director in the Quality Assurance space, who is looking for a talented, Big Data SDET.Our client works in a Big Data department that processes north of 250 Billion...

  • Data Analyst

    4 days ago


    Irvine, California, United States Viant Technology Full time

    WHAT YOU'LL DOYou will have the opportunity to work on the design and implementation of big data systems, working with petabytes of data and billions of transactions in real-time. Our platform uses advanced machine learning techniques and the newest big data processing technologies and is deployed in a distributed, multi-region, cloud-based...


  • Irvine, United States Jnd Corp Full time

    Position OverviewJob Title: Engineering - Quality Engineer 3 Job Type: Regular Full-Time, HourlyBachelor's degree and related experience preferred LocationIrvine, CA BenefitsMedical Insurance (Health, Dental & Vision)401(k) with Company MatchPaid Time OffH1B/Green Card Sponsorship for qualified employeeHands-on experience at global industry leader...

  • Data Analyst

    3 days ago


    Irvine, United States Finfare Inc. Full time

    Job DescriptionJob DescriptionAbout FinfareFinfare is dedicated to empowering SMBs, by providing the ultimate expense management solution for growing businesses seeking to streamline their financial operations and maximize cash back rewards. Finfare offers easy expense tracking, personalized spend controls, seamless accounting integration, powerful...


  • Irvine, United States Jnd Corp Full time

    Position OverviewJob Title: Engineering - Quality Engineer 3 Job Type: Regular Full-Time, Hourly Bachelor's degree and related experience preferred Location Irvine, CA Benefits Medical Insurance (Health, Dental & Vision) 401(k) with Company Match Paid Time Off H1B/Green Card Sponsorship for qualified employee Hands-on experience at global industry...


  • Irvine, United States JND Full time

    Position Overview Job Title: Engineering - Quality Engineer 3 Job Type: Regular Full-Time, Hourly Bachelor's degree and related experience preferred Location Irvine, CA Benefits Medical Insurance (Health, Dental & Vision) 401(k) with Company Match Paid Time Off H1B/Green Card Sponsorship for qualified employee Hands-on experience at global industry...