Big Data Developer

3 weeks ago

Plano, United States The AES Group Full time

Title: Big Data Developer

Location: Plano/Irving, TX (Must be local)

Duration: Contract to Hire


Note: We reviewed multiple resumes in Q1 and every candidate we received was either a Data Engineer or an Analytics consultant. We need someone in a Hybrid role with superior programming skills


Job Description:

As a Big Data Developer, you will play a crucial role in designing, developing, and maintaining our big data infrastructure. You will work with a variety of tools and technologies within the AWS stack, Data Lake, and Data Bricks, and will utilize PySpark extensively. Your expertise in Python, Java/J2EE, and modern front-end frameworks such as React.JS and Angular will be critical in building scalable data solutions that meet the needs of our business.


Key Responsibilities:

  • Design, develop, and optimize big data solutions using AWS stack (e.g., S3, EMR, Redshift, Lambda).
  • Develop and manage data pipelines in Data Lake and Data Bricks environments.
  • Write efficient and maintainable code in PySpark for data transformation and processing tasks.
  • Utilize Python for scripting and automation of data workflows.
  • Implement Java/J2EE components for integrating big data solutions with other enterprise applications.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Perform data modeling, ETL development, and data integration from various data sources.
  • Ensure data quality, integrity, and security across all data platforms.
  • Monitor and troubleshoot data processing workflows and optimize performance.
  • Stay up-to-date with the latest big data technologies and industry trends to continuously improve our data infrastructure.


Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • Proven experience as a Big Data Developer or similar role.
  • Extensive experience with AWS services related to big data (e.g., S3, EMR, Redshift, Lambda).
  • Proficiency in Data Lake and Data Bricks for data storage and processing.
  • Strong expertise in PySpark and Spark for big data processing.
  • Solid programming skills in Python and Java/J2EE.
  • Develop and maintain interactive front-end applications using React.JS and Angular to provide users with access to data insights and analytics.
  • Experience with data modeling, ETL development, and data integration.
  • Knowledge of SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and practices.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.


Preferred Qualifications:

  • AWS Certified Big Data – Specialty or similar certification.
  • Experience with machine learning frameworks and libraries.
  • Understanding of data governance and compliance requirements.

  • Big Data Developer

    3 weeks ago

    Plano, United States The AES Group Full time

    Absolute W2 RoleJob Title: Big Data DeveloperLocation: Plano/Irving, TX (Must be local)C2H roleOnly GC EADs, GC, and USC are acceptableWe need someone in a Hybrid role with superior programming skillsJob Description:As a Big Data Developer, you will play a crucial role in designing, developing, and maintaining our big data infrastructure. You will work with...

  • Big Data Developer

    3 weeks ago

    Plano, United States The AES Group Full time

    Absolute W2 RoleJob Title: Big Data DeveloperLocation: Plano/Irving, TX (Must be local)C2H roleOnly GC EADs, GC, and USC are acceptableWe need someone in a Hybrid role with superior programming skillsJob Description:As a Big Data Developer, you will play a crucial role in designing, developing, and maintaining our big data infrastructure. You will work with...

  • Big Data Developer

    2 weeks ago

    Plano, United States The AES Group Full time

    Absolute W2 RoleJob Title: Big Data DeveloperLocation: Plano/Irving, TX (Must be local)C2H roleOnly GC EADs, GC, and USC are acceptableWe need someone in a Hybrid role with superior programming skillsJob Description:As a Big Data Developer, you will play a crucial role in designing, developing, and maintaining our big data infrastructure. You will work with...

  • Big Data Developer

    3 weeks ago

    Plano, United States The AES Group Full time

    Absolute W2 RoleJob Title: Big Data DeveloperLocation: Plano/Irving, TX (Must be local)C2H roleOnly GC EADs, GC, and USC are acceptableWe need someone in a Hybrid role with superior programming skillsJob Description:As a Big Data Developer, you will play a crucial role in designing, developing, and maintaining our big data infrastructure. You will work with...

  • Big Data Developer

    1 week ago

    Plano, United States The AES Group Full time

    Absolute W2 RoleJob Title: Big Data DeveloperLocation: Plano/Irving, TX (Must be local)C2H roleOnly GC EADs, GC, and USC are acceptableWe need someone in a Hybrid role with superior programming skillsJob Description:As a Big Data Developer, you will play a crucial role in designing, developing, and maintaining our big data infrastructure. You will work with...

  • DevOps Big Data

    1 month ago

    Plano, United States Infinity Consulting Solutions Full time

    We have partnered with our clients in their search for a DevOps Engineer for one of our clients in Plano, TX. Overview: This role is in a co-located agile development team which forms part of a larger global development group. You will be responsible for all aspects of software development and delivery with a particular focus on high quality maintainable...

  • DevOps Big Data

    3 weeks ago

    Plano, United States Infinity Consulting Solutions Full time

    We have partnered with our clients in their search for a DevOps Engineer for one of our clients in Plano, TX. Overview: This role is in a co-located agile development team which forms part of a larger global development group. You will be responsible for all aspects of software development and delivery with a particular focus on high quality maintainable...

  • Sr. Big Data Engineer

    1 week ago

    Plano, United States STIAOS Technologies Full time

    Hi, We are looking for Sr. Big Data Engineer Roles, with the required skills are 1. Big Data Engineer 2. Comfortable with Data Warehousing & Data Lake architecture 3. Spark | Strong Python 4. Strong Snowflake 5. Hadoop experience desired

  • Sr. Big Data Engineer

    5 days ago

    Plano, United States STIAOS Technologies Full time

    Hi, We are looking for Sr. Big Data Engineer Roles, with the required skills are 1. Big Data Engineer 2. Comfortable with Data Warehousing & Data Lake architecture 3. Spark | Strong Python 4. Strong Snowflake 5. Hadoop experience desired

  • Big Data Engineer

    2 weeks ago

    Plano, United States The AES Group Full time

    Job title: Big Data EngineerLocations: Plano, TXDuration: 12 MonthsNeed only USC & GC as this is C2HJob Family Description: Expert in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be...

  • Big Data Engineer

    4 days ago

    Plano, United States The AES Group Full time

    Job title: Big Data EngineerLocations: Plano, TXDuration: 12 MonthsNeed only USC & GC as this is C2HJob Family Description: Expert in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be...

  • Big Data Engineer

    2 weeks ago

    Plano, United States The AES Group Full time

    Job title: Big Data Engineer Locations: Plano, TX Duration: 12 Months Need only USC & GC as this is C2H Job Family Description: Expert in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be...

  • Big Data Engineer

    2 weeks ago

    Plano, United States The AES Group Full time

    Job title: Big Data EngineerLocations: Plano, TXDuration: 12 MonthsNeed only USC & GC as this is C2HJob Family Description: Expert in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be...

  • Big Data Engineer

    1 week ago

    Plano, United States The AES Group Full time

    Job title: Big Data EngineerLocations: Plano, TXDuration: 12 MonthsNeed only USC & GC as this is C2HJob Family Description: Expert in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be...

  • Big Data Engineer

    1 week ago

    Plano, United States The AES Group Full time

    Job title: Big Data EngineerLocations: Plano, TXDuration: 12 MonthsNeed only USC & GC as this is C2HJob Family Description: Expert in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be...

  • Senior Big Data Full Stack Engineer

    2 days ago

    Plano, United States Toyota Full time

    Excited to grow your career at Toyota? We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position you see is right for you, we encourage you to apply! Our people make all the difference in our success. Who We’re Looking...

  • Lead Software Engineer

    2 weeks ago

    Plano, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Enterprise Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products...

  • Big Data Lead

    3 weeks ago

    Plano, United States CapLeo Global Full time

    Must have 6-9 years of experience in Data warehouse, ETL, BI projects Must have strong hold in Python Must have experience in Snowflake Data Base. Must have experience implementing complex stored Procedures and standard DWH and ETL concepts Proficient in Oracle database, complex PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot Must have...

  • Big Data Lead

    1 month ago

    Plano, United States CapLeo Global Full time

    Must have 6-9 years of experience in Data warehouse, ETL, BI projects Must have strong hold in Python Must have experience in Snowflake Data Base. Must have experience implementing complex stored Procedures and standard DWH and ETL concepts Proficient in Oracle database, complex PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot Must have...

  • Big Data Lead

    7 hours ago

    Plano, United States CapLeo Global Full time

    Must have 6-9 years of experience in Data warehouse, ETL, BI projects Must have strong hold in Python Must have experience in Snowflake Data Base. Must have experience implementing complex stored Procedures and standard DWH and ETL concepts Proficient in Oracle database, complex PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot Must have...