Lead Big Data Developer

2 weeks ago

Irvine, United States CareerBuilder Full time

Company Description

Role: Lead Big Data Developer/ArchitectLocation: Irvin CADuration: 12 Months Extension based on PerformanceRate : 80$ on C2CRequirements:We are seeking an experienced and dynamic Lead Big Data Developer/Architect to join our team at [Company Name]. The ideal candidate will have a strong background in Big Data technologies, Data Warehousing, and related tools. As a Lead Big Data Developer/Architect, you will play a crucial role in designing, developing, and implementing innovative solutions on a Hadoop-based platform.Key Responsibilities:- Design, develop, and implement Big Data analytic solutions on a Hadoop-based platform.

- Refine data processing pipelines focused on unstructured and semi-structured data.

- Create custom analytic and data mining algorithms to extract knowledge and meaning from vast data stores.

- Configure data flows from different sources (relational databases, XML, JSON) and orchestrate them using Nifi.

- Develop Spark Frameworks using PySpark and Java for Raw/Analytical Layers in Big Data.

- Utilize Jenkins for Continuous Integration and Git for Version Control.

- Write shell scripts and job management scripts to invoke and manage Data Ingestion steps.

- Design HIVE tables for better performance and apply partitions where needed.

- Review HDFS data organization and provide mechanisms to support Multi-Tenant features.

- Work on AWS Services like S3, EMR, Lambda, Glue Jobs, Athena as part of the Open data initiative.

- Build and maintain QlikView dashboards using data from various sources.

- Collaborate with cross-functional teams and stakeholders to gather requirements and provide technical expertise.

- Mentor and guide junior team members.Job Description

We are seeking an experienced and dynamic Lead Big Data Developer/Architect to join our team at [Company Name]. The ideal candidate will have a strong background in Big Data technologies, Data Warehousing, and related tools. As a Lead Big Data Developer/Architect, you will play a crucial role in designing, developing, and implementing innovative solutions on a Hadoop-based platform.Qualifications

- Bachelors or Masters degree in Computer Science, Information Technology, or related field.

- 15+ years of total IT experience with a focus on Big Data and Data Warehousing technologies.

- Strong proficiency in Python, Java, SQL, PL/SQL, Unix Shell Scripting.

- Extensive hands-on development experience with Hadoop technologies including Spark using Python and Java, Hive, Impala, Sqoop, AWS EMR.

- In-depth knowledge of Spark distributed Framework involving RDD and Data Frames using Python, Java8, Scala.

- Experience with AWS services such as S3, EMR, Lambda, Glue, Athena.

- Proficiency in building and maintaining QlikView dashboards.

- Excellent understanding of Data Warehousing concepts, Dimensional data modeling, and ETL processes.

- Certification in relevant technologies, such as Oracle Certified Associate.Additional Information

All your information will be kept confidential according to EEO guidelines.
#J-18808-Ljbffr

  • Senior Architect

    Found in: Talent US C2 - 2 weeks ago

    Irvine, United States Publicis Sapient Full time

    Job Description Sr Manager, Data Engineering Publicis Sapient is looking for a Sr Manager of Data Engineering to lead top-notch technologists to enable real business outcomes for our enterprise clients. You will create impact for some of the world’s biggest brands, by translating their needs into transformative solutions that provide valuable...

  • Data Tech Lead

    2 days ago

    Irvine, United States JobRialto Full time

    Description:lGood hands-on experience in Python and Pyspark used as part of data profiling, ETL data loading or data processing activities.Should be from Data Engineering/Data Management background.Good understanding of data flow, data profiling and should have experience in data analysis activities.Should be able to understand basic data model/entity...

  • Senior Data Engineer

    2 weeks ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Dotnet Developer

    Found in: Appcast Linkedin GBL C2 - 3 weeks ago

    Irvine, United States People Tech Group Inc Full time

    Hi,Please find the below Job Description.Job Description:Title : .Net DeveloperClient: Ingram MicroVendor: Innova solutionsCity: Irvine, CA, 2-3 days onsite Needs to be self-sufficient, individual contributor and have .Net, AWS or GCB, React or Angular - Restful API huge plus Hybrid to Irvine - 2 days in office 3 days remote Day to day - field name,...

  • Dotnet Developer

    1 week ago

    Irvine, United States People Tech Group Full time

    Hi, Please find the below Job Description. Job Description: Title : .Net Developer Client: Ingram Micro Vendor: Innova solutions City: Irvine, CA, 2-3 days onsite Needs to be self-sufficient, individual contributor and have .Net, AWS or GCB, React or Angular - Restful API huge plus Hybrid to Irvine - 2 days in office 3 days remote Day to day - field name,...

  • Senior Data Engineer

    2 weeks ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Senior Data Engineer

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • Senior Data Engineer

    Found in: Appcast US C2 - 2 weeks ago

    Irvine, United States CivicMinds, Inc Full time

    Role Description: Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data, and integration tools to connect sources or other databases. Role Responsibility:...

  • .Net Developer

    2 weeks ago

    Irvine, United States RIT Solutions, Inc. Full time

    .Net Developer City: Irvine, CA, 2-3 days onsite Needs to be self sufficient, individual contributor and have .Net, AWS or GCB, React or Angular - Restful API huge plus Hybrid to Irvine - 2 days in office 3 days remote Likely to convert to perm role Day to day - field name, change adding fields and compliance for applications, bug fixes, meeting w Navish...

  • GoLang Lead Developer

    2 days ago

    Irvine, United States Compunnel Full time

    Job Title: GoLang Lead Developer Duration: Long Term Location: Irvine, CA Must Have: Lead Experiecne, Golang Description: LEAD EXPERIENCE IS A MUST 9+ years of experience of which minimum 6 years in Golang Knowledge on DevOps and AWS will make the resume stronger Must have the knowledge on Observability monitoring tool Strong in Networking concepts Onsite in...

  • GoLang Lead Developer

    Found in: Appcast Linkedin GBL C2 - 7 days ago

    Irvine, United States Compunnel Inc. Full time

    Job Title: GoLang Lead Developer Duration: Long Term Location: Irvine, CA Must Have: Lead Experiecne, Golang Description: • LEAD EXPERIENCE IS A MUST• 9+ years of experience of which minimum 6 years in Golang• Knowledge on DevOps and AWS will make the resume stronger• Must have the knowledge on Observability monitoring tool• Strong in...

  • GoLang Lead Developer

    7 days ago

    Irvine, United States Compunnel Inc. Full time

    Job Title: GoLang Lead Developer Duration: Long Term Location: Irvine, CA Must Have: Lead Experiecne, Golang Description: • LEAD EXPERIENCE IS A MUST• 9+ years of experience of which minimum 6 years in Golang• Knowledge on DevOps and AWS will make the resume stronger• Must have the knowledge on Observability monitoring tool• Strong in...

  • GoLang Lead Developer

    Found in: Appcast US C2 - 1 week ago

    Irvine, United States Compunnel Inc. Full time

    Job Title: GoLang Lead Developer Duration: Long Term Location: Irvine, CA Must Have: Lead Experiecne, Golang Description: • LEAD EXPERIENCE IS A MUST• 9+ years of experience of which minimum 6 years in Golang• Knowledge on DevOps and AWS will make the resume stronger• Must have the knowledge on Observability monitoring tool• Strong in...

  • Data Architect

    1 week ago

    Irvine, United States Oscar Full time

    We are seeking a talented Data Architect to join our team and collaborate closely with the Chief Enterprise Data Architect. In this role, you will enhance data architecture and management, support complex projects, and ensure alignment with business objectives. Leveraging your creativity and communication skills, you'll tackle intricate challenges and foster...

  • Data Analytics

    5 days ago

    Irvine, United States Aditi Consulting Full time

    Summary: The Data & Analytics Hub team is part of the Consumer Groups (VCG) organization. As part of the Data & Analytics Hub team, you will be helping to create and deliver comprehensive tracking and measurement of the digital Consumer Group channel. In this role, you will develop and implement advanced reports and dashboard solutions to support business...

  • QA Lead with Master data management

    1 day ago

    Irvine, United States ApTask Full time

    Job Title: QA Lead with Master data management (MDM) Experience Location: Irvine, CA (Hybrid) Duration: Full-time Job Description: Understand business data requirements and define the test case and conduct review with Business counterpart, and deliver prompt, efficient, quality service. Understand the data model used in global data MDM and...

  • QA Lead with Master data management

    Found in: Appcast Linkedin GBL C2 - 7 days ago

    Irvine, United States ApTask Full time

    Job Title: QA Lead with Master data management (MDM) ExperienceLocation: Irvine, CA (Hybrid)Duration: Full-time Job Description:•Understand business data requirements and define the test case and conduct review with Business counterpart, and deliver prompt, efficient, quality service.•Understand the data model used in global data MDM and...

  • QA Lead with Master data management

    5 days ago

    Irvine, United States ApTask Full time

    Job Title: QA Lead with Master data management (MDM) Experience Location: Irvine, CA (Hybrid) Duration: Full-time Job Description: Understand business data requirements and define the test case and conduct review with Business counterpart, and deliver prompt, efficient, quality service. Understand the data model used in global data MDM and solutions....

  • QA Lead with Master data management

    Found in: Appcast US C2 - 7 days ago

    Irvine, United States ApTask Full time

    Job Title: QA Lead with Master data management (MDM) ExperienceLocation: Irvine, CA (Hybrid)Duration: Full-time Job Description:•Understand business data requirements and define the test case and conduct review with Business counterpart, and deliver prompt, efficient, quality service.•Understand the data model used in global data MDM and...

  • Golang Lead Developer

    7 days ago

    Irvine, United States Compunnel Full time

    Must Have: Lead Experience, Golang Description: LEAD EXPERIENCE IS A MUST 9 years of experience of which minimum 6 years in Golang Knowledge on DevOps and AWS will make the resume stronger Must have the knowledge on Observability monitoring tool Strong in Networking concepts Onsite in Irvine CA - Relocation on Day 1 is mandatory Education: Bachelors Degree