Big Data Engineer

2 months ago

Rosemead, United States APR Consulting Full time
Big Data Engineer

  • Location: Rosemead , California
  • Type: Contract
  • Job #78718
An electric utility client is looking for a Big Data Engineer who is responsible for developing and maintaining data ingestion and consumption pipelines for Palantir, deriving data insights using platform capabilities towards the realization of analytics and data science use cases.

Location: Rosemead, CA 91770 (Hybrid)
Position: Big Data Engineer
Pay Rate: $60/hr. on W2 (Negotiable)
Duration: 18 months or longer
Schedule: M-F (8 am to 5 pm) with scheduled availability during non-working hours, weekends during PSPS activations (typically 4-5 instances of 2-5 days in a year)

***This is Hybrid - 2 days (Tue and Wed)***

RESPONSIBILITIES:
  • The job function includes understanding of business requirements, defining data requirements, identifying enterprise data sources, planning, designing, and building data acquisition from sources, defining data model, taxonomy, designing data ingestion pipelines, data normalization, data transformation, and consumption using Palantir.
  • The position is responsible for developing and maintaining data ingestion and consumption pipelines for Palantir, deriving data insights using platform capabilities towards the realization of analytics and data science use cases. The job function includes developing data insights, data mining, and support for AI/ML use cases training and deployment within the company's analytics landscape, specifically within Palantir platform.
Specifically, the job involves:
  • Manage PSPS activations - on call during activations fielding and managing communications, logging tickets, communicating and monitoring different channels
  • Development of design artifacts to describe technical components of solutions for long term maintenance and support
  • Development of comprehensive solutions using Palantir
  • Prioritize and implement solution enhancements and support production issues
  • Development of documentation for implemented solutions
  • Participation in daily scrum style meetings
  • Participation in sprint planning to provide estimates for assigned work
  • Support of End-to-End testing with the company's Systems interfacing with solutions in Palantir platform
SOFT SKILLS:
Proficiency with Palantir Foundry
  • Data Integration: Experience with integrating data from multiple sources into Palantir Foundry, including ETL processes and data transformation.
  • Foundry's Code Workbooks: Proficiency in using Foundry's Code Workbooks to write and execute Python, PySpark, or SQL scripts for data processing.
  • Ontology Development: Ability to model and organize data into an ontology within Foundry, creating logical structures that make data easy to access and use.
  • Pipeline Management: Experience in building, managing, and optimizing data pipelines in Foundry to ensure efficient data flow and processing.
Palantir Data Governance and Security
  • Data Lineage and Provenance: Understanding how to implement and utilize data lineage features within Palantir to track data origins, transformations, and usage.
  • Access Control Management: Knowledge of setting up and managing data access controls within Palantir, ensuring compliance with data governance policies.
  • Data Compliance: Experience ensuring data usage complies with organizational and regulatory requirements, leveraging Palantir's compliance tools.
Data Analytics and Visualization
  • Hands-on with Palantir's Visualization Tools: Proficiency in creating dashboards, reports, and other data visualizations using Palantir's in-built tools.
  • Analytical Functions: Experience using Palantir's analytical functions to conduct complex data analysis, including statistical and predictive modeling.
Collaboration and Workflow Automation
  • Knowledge of Palantir's Collaborative Features: Familiarity with Palantir's collaboration features to work with cross-functional teams, share insights, and integrate feedback into data solutions.
  • Workflow Automation: Ability to design and implement automated workflows within Palantir to streamline data processing tasks and ensure timely data delivery.
Python, SQL, and Big Data Technologies
  • Programming Skills: Proficiency in Python and SQL, essential for coding custom data processing tasks within Palantir.
  • Big Data Handling: Experience working with large datasets, including knowledge of distributed computing tools like Apache Spark, which can be integrated with Palantir Foundry.
Experience with Industry-Specific Applications
  • Domain Knowledge: Understanding of the electric utility data requirements
Troubleshooting and Optimization
  • Problem-Solving Skills: Strong problem-solving skills to troubleshoot and resolve issues that arise during data integration and analysis in Palantir.
  • Optimization Techniques: Knowledge of optimizing data pipelines and analytical workflows to improve performance and reduce costs.
REQUIRED QUALIFICATIONS:
  • Bachelor's Degree in Information Technology or related specialized field or an equivalent combination of education, training, and experience.
  • 5+ years of experience in architecting and designing information, integration, and analytics solutions
  • 3+ years' experience in data engineering, data mining, large scale data acquisition, transformation, and cleaning both structured and unstructured data
  • 2+ year's experience developing solutions using Palantir technology, Python, Pyspark, SQL.
  • 2+ years of Palantir Foundry in-depth hands-on experience

About our client:
Our client is one of the largest electric utilities and a longtime leader in renewable energy and energy efficiency in the United States providing electricity for much of Southern California.

About APR:
Since 1980 APR Consulting, Inc. has provided professional recruiting and contingent workforce solutions to a diverse mix of clients, industries, and skill sets nationwide.

Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

We are an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Don't miss out on this amazing opportunity If you feel your experience is the match for this position please apply today and join our team. We look forward to working with you

#SLA

  • Big Data Engineer

    1 month ago

    Rosemead, United States APR Consulting Full time

    Big Data Engineer Location: Rosemead , California Type: Contract Job 78718 An electric utility client is looking for a Big Data Engineer who is responsible for developing and maintaining data ingestion and consumption pipelines for Palantir, deriving data insights using platform capabilities towards the realization of analytics and data science use cases....

  • Palantir Big Data Engineer

    2 months ago

    Rosemead, United States APR Consulting Full time

    An electric utility client is looking for a Palantir Big Data Engineer who is responsible for developing and maintaining data ingestion and consumption pipelines for Palantir, deriving data insights using platform capabilities toward the realization of analytics and data science use cases.Location: Rosemead, CA 91770 (Hybrid)Position: Palantir Big Data...

  • Palantir Big Data Solutions Architect

    1 month ago

    Rosemead, California, United States APR Consulting Full time

    APR Consulting, Inc. is looking for a Palantir Big Data Solutions Architect to design and implement efficient data ingestion and consumption pipelines for Palantir Foundry.Estimated Salary: $120,000 per year ($60/hour)The successful candidate will have 3+ years' experience in data engineering, data mining, large-scale data acquisition, transformation, and...

  • Big Data Ingestion and Analytics Specialist

    1 month ago

    Rosemead, California, United States APR Consulting Full time

    APR Consulting, Inc. seeks a Big Data Ingestion and Analytics Specialist to join our team in Rosemead, CA.Salary Range: $120,000 - $180,000 per year ($60/hour - $90/hour)The ideal candidate will have 5+ years of experience in architecting and designing information, integration, and analytics solutions. They will be responsible for developing and maintaining...

  • Master Data Architect for Clean Energy Innovation

    4 weeks ago

    Rosemead, California, United States Southern California Edison Full time

    At Southern California Edison, we are committed to powering a cleaner energy future. As a Senior Information and Integration Architect, you will play a crucial role in driving this mission forward.Job DescriptionWe are seeking a highly skilled Master Data Architect to join our team. In this role, you will be responsible for designing and developing IT...

  • Data and Integration Architecture Lead

    4 days ago

    Rosemead, California, United States Southern California Edison Full time

    About the RoleSouthern California Edison (SCE) is seeking a highly experienced Senior Information and Integration Architect to join our team. As a Senior Information and Integration Architect, you will play a critical role in designing and developing innovative data solutions that power our Grid Operations, Generation, Transmission, and Distribution...

  • Information Architect

    1 week ago

    Rosemead, California, United States Southern California Edison Full time

    About the RoleWe are seeking a highly experienced Senior Information and Integration Architect to join our team at Southern California Edison (SCE). This individual will play a critical role in designing and developing innovative data solutions that power our Grid Operations, Generation, Transmission, and Distribution systems.As a Senior Information and...

  • Senior Cost Engineer

    1 month ago

    Rosemead, United States PM2CM Inc Full time

    Wednesday and Thursday working in Rosemead, CA. Key Responsibilities Cost Management: Oversee cost control functions for multiple large-scale projects, ensuring accuracy in the development and maintenance of project budgets, baselines, and expenditure plans for both short- and long-term project durations. Budget & Forecasting: Develop and manage cost...

  • Strategic Water Systems Engineer

    2 weeks ago

    Rosemead, California, United States American Water Full time

    About the Role: American Water is seeking a talented Planning Engineer to join its team of experts dedicated to ensuring safe, clean, and reliable drinking water and wastewater services for millions of people across the United States. As a key member of our infrastructure planning group, you will be responsible for analyzing data, identifying trends, and...

  • IT Architect Leader

    2 weeks ago

    Rosemead, California, United States Southern California Edison Full time

    Job OverviewIn the role of Senior Information and Integration Architect at Southern California Edison, you will be responsible for designing and implementing innovative data solutions that power our Grid Operations, Generation, Transmission and Distribution systems. With a focus on architecture, data engineering, and integration, your expertise will drive...

  • Edison- Brinqa System Administrator

    1 month ago

    Rosemead, United States First Tek Full time

    Open to remote - must work PST hours Hard requirement -must have been a Brinqa administrator "god rights " Highest level of Brinqa admin exp Architecture exp Ability to work independently - self-starter day to day:bring data in, validate, ensure its dashboard ready, dashboards, customize dashboards, SQL exp, Service Now, Roles and Responsibilities: ...

  • Brinqa System Administrator Lead

    2 weeks ago

    Rosemead, California, United States First Tek Full time

    We are seeking an experienced Platform Configuration Expert to join our team at First Tek. As a key member of our cybersecurity team, you will be responsible for configuring and customizing the Brinqa platform to meet the organization's needs. With at least 5 years of experience in IT systems, platform, or cloud engineering, you will have a strong...

  • Long-Term Infrastructure Planner

    2 weeks ago

    Rosemead, California, United States American Water Full time

    About the Opportunity: Are you passionate about creating sustainable solutions for water and wastewater systems? Do you want to work for a company that values innovation, collaboration, and customer satisfaction? As a Planning Engineer at American Water, you will have the opportunity to work on complex infrastructure projects, collaborate with...

  • Water Resource Planning Specialist

    2 weeks ago

    Rosemead, California, United States American Water Full time

    About the Job: As a Planning Engineer, you will play a crucial role in developing and implementing strategic plans for American Water's water and wastewater systems. With a focus on long-term infrastructure planning, you will work closely with cross-functional teams to analyze data, identify trends, and make recommendations to improve system performance and...

  • Continuous Improvement Consultant

    1 month ago

    Rosemead, United States The Judge Group Full time

    Our client is currently seeking a Continuous Improvement Consultant In line with the companys long term strategic goal of integrating Operational and Service Excellence (OpX) into our culture and business model through a systematic deployment of continuous improvement practices across the organization Strategy, Integrated Planning & Performance organization...

  • Continuous Improvement Consultant

    1 month ago

    Rosemead, United States eTeam Full time

    Job Title: Continuous Improvement ConsultantLocation: Rosemead, CAPay Rate: $40 to $45/hr on W2Duration: 12+ MonthsJob Description:In line with the company’s long-term strategic goal of integrating Operational and Service Excellence (OpX) into our culture and business model through a systematic deployment of continuous improvement practices across the...

  • Continuous Improvement Consultant

    4 weeks ago

    Rosemead, United States Vertisystem Full time

    Notes:Job Title: Continuous Improvement Consultant (SCE2JP00002802)Location: Rosemead, CA, 91770Employment Type: W2Duration: 18+ Months with potential for extensionDescription:• In line with the company’s long term strategic goal of integrating Operational and Service Excellence (OpX) into our culture and business model through a systematic deployment of...

  • Senior Digital Analyst

    4 weeks ago

    Rosemead, United States Aquent Full time

    Tag Manager and Testing SpecialistThis position offers the exciting opportunity to work at the intersection of tag management, analytics and personalization, providing valuable insights through data and leveraging cutting-edge technologies to create tailored user experiences. If you are passionate about digital experience, data accuracy, and innovative...

  • Process Improvement Lead

    4 weeks ago

    Rosemead, United States APR Consulting Full time

    An electric utility client is looking for a Process Improvement Lead who will manage a small team that will be focused on benchmarking and replication of best practices as well as data analytics, looking for improvement opportunities across the organization.Location: Rosemead, CA 91770Position: Process Improvement LeadPay Rate: $46.43/hr. on W2Duration: 18...

  • Master Black Belt

    1 month ago

    Rosemead, United States APR Consulting Full time

    An electric utility client is looking for a Master Black Belt who will manage a small team that will be focused on benchmarking and replication of best practices as well as data analytics, looking for improvement opportunities across the organization.Location: Rosemead, CA 91770Position: Master Black BeltPay Rate: $46.43/hr. on W2Duration: 18 months or...