Palantir Data Engineer

Found in: Appcast US C2 - 2 weeks ago

Irvine, United States CTC Global Full time

Job Title: Palantir Data Engineer (On-Site, Irvine, CA)


Reports To: Principal Engineer Manager R&D       


Location: Irvine, CA, On-Site                                                              


Department: Engineering and Product Development  


Salary: $100,000 to $130,000 a year       


Shift: Day, Monday to Friday, 8 AM to 5 PM


SUMMARY

 

Data engineers work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate Foundry with external systems containing the data. Data engineers also need to provide guidance and support on how to access and leverage the data foundation to create new workflows or analyze data.


ESSENTIAL DUTIES AND RESPONSIBILITIES:


•          Integrate new data sources to Foundry using Data Connection

•          Implement 2-way integrations between Foundry and external systems

•          Develop pipelines transforming tabular or unstructured data

•          Implement data transformations in PySpark or Pipeline Builder

           to derive new datasets or create ontology objects.

•          Set up support structures for pipelines running in production

•          Monitor and debug critical issues such as data staleness or data quality

•          Improve performance of data pipelines (latency, resource usage)

•          Design and implement an ontology based on business requirements and available data

•          Provide data engineering context for application development

•          Identify opportunities for turning exploratory or analytical

           applications into interactive operational workflows to drive business value.

•          Maintain applications as usage grows and requirements change


 

PREFERRED QUALIFICATIONS:

 

•          Between 1 and 3 years of experience, ideally in a customer-facing role

•          Experience in Python/PySpark, or experienced in another programming

           language and willing to learn Python and PySpark on their own.

•          Experience in TypeScript, or experienced in another

           programming language and willing to learn TypeScript on their own.

•          Data engineering experience preferred over data science

•          Programming experience requiring collaborative software development

•          Python – complete language proficiency

SQL – proficiency in querying language (join types, filtering,

           aggregation) and data modeling (relationship types, constraints)

•          PySpark – basic familiarity (Data Frame operations, PySpark SQL

           functions) and differences with other Data Frame implementations

           (Pandas)

•          Typescript – experience in TypeScript or experienced in another

           programming language and willing to learn TypeScript on their own.

•          Distributed compute – conceptual knowledge of Hadoop and Spark (driver,

           executors, partitions)

•          Databases – general familiarity with common relational database models

           and proprietary instantiations, such as SAP, Salesforce, etc.

•          Git – knowledge of version control/collaboration workflows and

           best practices

•          Iterative working – familiarity with an agile and iterative working methodology

           and rapid user feedback gathering concepts.

•          UX design – knowledge of best practices and applications

•          Data quality – best practices

•          Data literacy – data analysis and statistical basics to ensure correctness in

           data aggregation and visualization


Benefits for all full-time employees include:

  • Medical (HMO/PPO Plan Options)
  • Dental
  • Vision
  • Group Term Life Insurance (CTC pays 100% of the premium)
  • Short-Term Disability and Long-Term Disability (CTC pays 100% of the premium)
  • Flexible Spending Account
  • 401K
  • 15 paid vacation days (more after 5 years)
  • 9 paid holidays
  • 3 paid sick leave days

  • Palantir Data Engineer

    1 week ago

    Irvine, United States CTC Global Corporation Full time

    Job Title: Palantir Data Engineer(On-Site, Irvine, CA) Reports To: Principal Engineer Manager R&D Location: Irvine, CA, On-Site Department: Engineering and Product Development Salary: $100,000 to $130,000a year Shift: Day, Monday to Friday, 8 AM to 5 PM SUMMARY Data engineers work closely with Subject Matter Experts (SMEs) to design the ontology (data...

  • Lead Data engineer

    1 week ago

    Irvine, United States LTIMindtree Full time

    Role- Lead Data Engineer Location Irvine, CA ( need local or open to relocate candidates , as this is 3-4 days work from office ). * Engineering Lead Job Description: Engineering leader, with strong hands-on Python/ PySpark/ Platform background Ability to design Python/ Pyspark/ logging/ troubleshooting/ observability/ resilience/ pipeline...

  • Lead Data engineer

    Found in: Appcast US C2 - 2 weeks ago

    Irvine, United States LTIMindtree Full time

    Role- Lead Data Engineer Location – Irvine, CA ( need local or open to relocate candidates , as this is 3-4 days’ work from office ). * Engineering Lead Job Description: Engineering leader, with strong hands-on Python/ PySpark/ Platform backgroundAbility to design Python/ Pyspark/ logging/ troubleshooting/ observability/ resilience/ pipeline...

  • Lead Data engineer

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago

    Irvine, United States LTIMindtree Full time

    Role- Lead Data Engineer Location – Irvine, CA ( need local or open to relocate candidates , as this is 3-4 days’ work from office ). * Engineering Lead Job Description: Engineering leader, with strong hands-on Python/ PySpark/ Platform backgroundAbility to design Python/ Pyspark/ logging/ troubleshooting/ observability/ resilience/ pipeline...

  • Lead Data engineer

    2 weeks ago

    Irvine, United States LTIMindtree Full time

    Role- Lead Data Engineer Location – Irvine, CA ( need local or open to relocate candidates , as this is 3-4 days’ work from office ). * Engineering Lead Job Description: Engineering leader, with strong hands-on Python/ PySpark/ Platform backgroundAbility to design Python/ Pyspark/ logging/ troubleshooting/ observability/ resilience/ pipeline...

  • Data Engineering intern

    Found in: beBee S US - 1 week ago

    Irvine, United States Johnson & Johnson Full time

    At Johnson & Johnson, we are revolutionizing healthcare by leveraging technology, data, and the power of teamwork to overcome the world's most significant healthcare challenges. We are looking for passionate and driven Biostatistics, Programming, and Data Management (BPDM) interns to join our J&J MedTech - Cardiovascular & Specialty Solution Group (CSS) team...

  • Senior Architect

    Found in: Talent US C2 - 2 weeks ago

    Irvine, United States Publicis Sapient Full time

    Job Description Sr Manager, Data Engineering Publicis Sapient is looking for a Sr Manager of Data Engineering to lead top-notch technologists to enable real business outcomes for our enterprise clients. You will create impact for some of the world’s biggest brands, by translating their needs into transformative solutions that provide valuable...

  • Data Engineering intern

    Found in: beBee jobs US - 6 days ago

    Irvine, California, United States Johnson & Johnson Full time

    At Johnson & Johnson, we are revolutionizing healthcare by leveraging technology, data, and the power of teamwork to overcome the world's most significant healthcare challenges. We are looking for passionate and driven Biostatistics, Programming, and Data Management (BPDM) interns to join our J&J MedTech - Cardiovascular & Specialty Solution Group (CSS) team...

  • Senior Data Engineer

    1 week ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Senior Data Engineer

    2 weeks ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Senior Data Engineer

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Senior Data Engineer

    Found in: Appcast US C2 - 2 weeks ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Data Engineer, Allergan Aesthetics,

    Found in: Resume Library US A2 - 1 week ago

    Irvine, California, United States Allergan Aesthetics Full time

    Job Description Overview: We are seeking a Data Engineer with experience in ETL, Snowflake, ThoughtSpot, and/or Power BI datasets to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and systems that enable our internal stakeholders to make data-driven decisions. This Data Engineer will...

  • Senior Architect

    Found in: Resume Library US A2 - 1 week ago

    Irvine, California, United States Publicis Sapient Full time

    Job Description Sr Manager, Data Engineering Publicis Sapient is looking for a Sr Manager of Data Engineering to lead top-notch technologists to enable real business outcomes for our enterprise clients. You will create impact for some of the world’s biggest brands, by translating their needs into transformative solutions that provide valuable insight....

  • Data Engineer

    22 hours ago

    Irvine, United States JobRialto Full time

    Job Description: Looking for Data expert with Advisory, consulting , GenAI, AI/ML , Data Bricks, Python and Pyspark experience . Senior data engineering leader with industry knowledge and strong understanding of GenAI. The job involves Advisory and consulting, thought leadership, interact with customer through workshops to understand pain points/business...

  • Data Entry Specialist

    8 hours ago

    Irvine, United States EKN Engineering Full time

    Data Entry Specialist - Data Solutions EKN Engineering is a fast-growing civil engineering and technology consulting company located in Irvine, CA. We are currently looking to add a Data Entry Specialist to our outstanding team. At EKN, Data Entry Specialists are responsible for analyzing handwritten tables, documents, and images and converting the...

  • Data Analytics

    3 days ago

    Irvine, United States Aditi Consulting Full time

    Summary: The Data & Analytics Hub team is part of the Consumer Groups (VCG) organization. As part of the Data & Analytics Hub team, you will be helping to create and deliver comprehensive tracking and measurement of the digital Consumer Group channel. In this role, you will develop and implement advanced reports and dashboard solutions to support business...

  • Data engineer

    18 hours ago

    Irvine, United States Avance Consulting Full time

    Job DescriptionJob Description· Power BI and Data analytics expert· Works independently with limited direction· Performs DOEs and process characterization· Proficiency in Statistics, Gage R & R· Studies the existing processes to implement improvements on new products.· Continuously seeks opportunities of new and existing processes to reduce costs and...

  • Data Tech Lead

    6 hours ago

    Irvine, United States JobRialto Full time

    Description:lGood hands-on experience in Python and Pyspark used as part of data profiling, ETL data loading or data processing activities.Should be from Data Engineering/Data Management background.Good understanding of data flow, data profiling and should have experience in data analysis activities.Should be able to understand basic data model/entity...

  • Quality Data Analyst

    1 week ago

    Irvine, United States Edwards Lifesciences Full time

    Imagine how your ideas and expertise can change a patient’s life. Our Quality teams help shape the development of groundbreaking technologies to ensure each stage of our innovation process is held to the highest standards of integrity and safety. You’ll bring your passion for problem solving and partner with various teams to influence decision-making for...