Big Data Engineer

1 month ago


Charlotte, United States Diverse Lynx Full time
Role-Big Data Engineer
Location-Charlotte, NC
Type- Contract


Role Description:
Data Engineer - Bigdata, Hadoop, Spark, Scala, PySpark, Strong SQL, Cloudera Data Platform (CDP),
Primary Skills:
  • Big Data: Spark, Scala, Pyspark, HDFS
  • Microsoft Stack: MS-SQL with strong knowledge in RDBMS concepts
  • Hadoop (Hortonworks) and Hiveo Cloudera Data platform (CDP)
  • Scripting Languages: Batch Script, Shell Script, Python
  • Additional Skills:
  • Agile, Scrum, Jira, Git, SVN, Liquibase
  • Work on Pyspark Framework to ingest data from different sources system to Hadoop and SQL Server regions.
  • Sound knowledge in Python and Good to have enough knowledge in Scala.
  • Strong experience in database migration to MS SQL Server/Hadoop
  • Extensive experience in database query tuning, performance tuning, and troubleshooting application issues on OLTP/OLAP systems.
  • RDBMS Architecture, T-SQL query and Query Optimization knowledge and work experience
  • Provide support to team members and helping them to understand the projects and requirements and guiding them to create the optimized solution of it.
  • team player and proven track record of working in various team sizes performing cross-functional roles.
  • Setup CICD pipeline for database changes using GitHub, Jenkin & Liquibase)
  • Good to have experience data migration from Hadoop to CDP


Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • Big Data Engineer

    3 weeks ago


    Charlotte, United States Diverse Lynx Full time

    Big Data Engineer with mapreduce , spark , hive , sql skillset" Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is must Strong Hands on experience with one or more programming languages ( Python or Java). Hands-on...


  • Charlotte, North Carolina, United States Motion Recruitment Full time

    We are seeking a highly skilled Big Data Engineering Lead to join our team at Motion Recruitment in Charlotte, NC. This full-time consulting assignment will be a long-term opportunity for the right candidate.The ideal candidate should have a strong understanding of big data development and experience working with Hadoop, Spark, Python, Scala, Unix, and SQL.A...

  • Big Data Engineer

    2 weeks ago


    Charlotte, North Carolina, United States Atlantis IT group Full time

    About the RoleAt Atlantis IT group, we are seeking an experienced Big Data Engineer to join our team in Charlottte. This is a full-time W2 position that requires US citizenship or a Green Card.We need someone with expertise in Hadoop, Python, and Spark, as well as Pyspark and custom-built Spark SQL. MapR experience is preferred, but Hortonworks and Cloudera...


  • Charlotte, North Carolina, United States The Hartford Full time

    About The RoleThe Hartford is seeking a highly experienced Senior Big Data Engineer to join its team. As a Senior Big Data Engineer, you will design and implement large-scale data products that meet the company's needs.This is an exciting opportunity for individuals who want to shape the future of data engineering and drive innovation. You will work closely...


  • Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...


  • Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...


  • Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...


  • Charlotte, North Carolina, United States eTek IT Services, Inc. Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at eTek IT Services, Inc.Job SummaryThe successful candidate will be responsible for designing and implementing data pipelines using technologies such as Apache Spark, Python, and AWS services. They will also work closely with cross-functional teams to understand data requirements...

  • Senior Data Engineer

    2 weeks ago


    Charlotte, North Carolina, United States ApTask Full time

    About This Role:Candidates for the Senior Data Engineer - Big Data Hadoop position at ApTask will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data Hadoop. The ideal candidate will have experience working with big data technologies, including Hadoop, PySpark, and Teradata, and will be able to...


  • Charlotte, North Carolina, United States Diverse Lynx Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering group, you will design, build, and maintain large-scale data processing systems using big data technologies such as Spark, Scala, and PySpark.The ideal candidate will have a strong background in big data, including...

  • Big Data Engineer 4

    4 days ago


    Charlotte, United States TEKsystems Full time

    Description The Big Data Engineer is responsible for owning and driving the technical innovation along with big data technologies. The individual is a subject matter expert technologist with strong Python experience and deep hands-on experience building data pipelines for the Hadoop platform as well as Google cloud. This person will be part of successful Big...


  • Charlotte, United States TEKsystems Full time

    *Description* The Big Data Engineer is responsible for owning and driving the technical innovation along with big data technologies. The individual is a subject matter expert technologist with strong Python experience and deep hands-on experience building data pipelines for the Hadoop platform as well as Google cloud. This person will be part of successful...


  • Charlotte, North Carolina, United States Global Channel Management Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team and lead our efforts in developing and maintaining our big data platform.Job Summary:This is an exciting opportunity to leverage your skills and experience in Big Data technologies to drive business growth and innovation.Key Responsibilities:Design, develop, and maintain high-quality...

  • Big Data Engineer

    2 weeks ago


    Charlotte, United States Innova Full time

    Innova Solutions has a client that is immediately hiring for a Big Data Engineer.   Position Type: Full-time (Contract) Duration: 12+ Months Location: Charlotte, NC 28202 (Hybrid)   As a Big Data Engineer, you will:  Consult on complex initiatives with broad impact and large-scale planning for Software Engineering.Review and analyse complex...


  • Charlotte, North Carolina, United States TechnoGen Full time

    Job Title: Big Data Systems ManagerLocation: Charlotte, NCWe are seeking a highly skilled Big Data Systems Manager to join our team at TechnoGen. The ideal candidate will have strong experience with big data technologies such as Hadoop, Spark, and Kafka, and a solid understanding of data modeling concepts and data management best...

  • Data Science Engineer

    2 weeks ago


    Charlotte, North Carolina, United States NTT DATA Full time

    About NTT DATA ServicesNTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications. As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications...


  • Charlotte, North Carolina, United States Genesis10 Full time

    Job OverviewGenesis10 is currently seeking a highly skilled Python/Big Data Engineer to join our client in the financial industry in Charlotte, NC. This 12+ month contract position offers an exciting opportunity to leverage your expertise in developing innovative data solutions.About the RoleAs a Data Engineering Specialist, you will be responsible for...


  • Charlotte, United States Genesis10 Full time

    Genesis10 is currently seeking a Python/ Big Data Engineer with our client in the financial industry located in Charlotte, NC. This is a 12+ month contract position. Responsibilities: Consult as an expert to develop or influence initiatives and resources for highly complex business and technical needs across Engineering Consult on the strategy and...


  • Charlotte, North Carolina, United States American Homes 4 Rent Full time

    Job Title: Senior Big Data ArchitectWe are seeking an experienced Senior Big Data Architect to lead our big data initiatives and design scalable data architectures. The ideal candidate will have a strong background in big data technologies and experience with data warehousing, ETL processes, and data visualization tools.The estimated salary for this position...


  • Charlotte, North Carolina, United States ApTask Full time

    About UsApTask is a leading global provider of workforce solutions and talent acquisition services. We offer a comprehensive suite of services, including staffing, recruitment, managed services, IT consulting, and project management. Our mission is to shape the future of work and empower organizations to thrive while fostering a diverse and inclusive work...