Big Data Engineer 4

2 days ago

Charlotte, United States TEKsystems Full time

*Description*
The Big Data Engineer is responsible for owning and driving the technical innovation along with big data technologies. The individual is a subject matter expert technologist with strong Python experience and deep hands-on experience building data pipelines for the Hadoop platform as well as Google cloud. This person will be part of successful Big Data implementations for large data integration initiatives. The candidates for this role must be willing to push the limits of traditional development paradigms typically found in a data-centric organization while embracing the opportunity to gain subject matter expertise in the cyber security domain.
In this role you will
*Lead the design and development of sophisticated, resilient, and secure engineering solutions for modernizing our data ecosystem that typically involve multiple disciplines, including big data architecture, data pipelines, data management, and data modeling specific to consumer use cases.
*Provide technical expertise for the design, implementation, maintenance, and control of data management services - especially end-to-end, scale-out data pipelines.
*Develop self-service, multitenant capabilities on the cyber security data lake including custom/of the shelf services integrated with the Hadoop platform and Google cloud, use API and messaging to communicate across services, integrate with distributed data processing frameworks and data access engines built on the cluster, integrate with enterprise services for security, data governance and automated data controls, and implement policies to enforce fine-grained data access
*Build, certify and deploy highly automated services and features for data management (registering, classifying, collecting, loading, formatting, cleansing, structuring, transforming, reformatting, distributing, and archiving/purging) through Data Ingestion, Processing, and Consumption stages of the analytical data lifecycle.
*Provide the highest technical leadership in terms of design, engineering, deployment and maintenance of solutions through collaborative efforts with the team and third-party vendors.
*Design, code, test, debug, and document programs using Agile development practices.
*Review and analyze complex data management technologies that require in depth evaluation of multiple factors including intangibles or unprecedented factors.
*Assist in production deployments, including troubleshooting and problem resolution.
*Collaborate with enterprise, data platform, data delivery, and other product teams to provide strategic solutions, influencing long range internal and enterprise level data architecture and change management strategies.
*Provide technical leadership and recommendation into the future direction of data management technology and custom engineering designs.
*Collaborate and consult with peers, colleagues, and managers to resolve issues and achieve goals.
*Top Skills Details*
Data, Spark, Data warehouse, Hadoop, Kafka, pyspark, airflow, cloudera
*Additional Skills & Qualifications*
Additional skills to look for in any/all the above candidates as a plus: GCP, Kafka/Kafka Connect, Hive DB development
Experience with Google cloud data services such as cloud storage, cloud proc, cloud flow, and Big Query. Google Cloud Big Data Specialty - hands on experience ideally not just a certification
*Pay and Benefits*
The pay range for this position is $81.88 - $95.00
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
* Medical, dental & vision
* Critical Illness, Accident, and Hospital
* 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available
* Life Insurance (Voluntary Life & AD&D for the employee and dependents)
* Short and long-term disability
* Health Spending Account (HSA)
* Transportation benefits
* Employee Assistance Program
* Time Off/Leave (PTO, Vacation or Sick Leave)
*Workplace Type*
This is a hybrid position in Charlotte,NC.
*Application Deadline*
This position will be accepting applications until Dec 30, 2024.

About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

  • Senior Big Data Architect

    20 hours ago

    Charlotte, North Carolina, United States American Homes 4 Rent Full time

    Job Title: Senior Big Data ArchitectWe are seeking an experienced Senior Big Data Architect to lead our big data initiatives and design scalable data architectures. The ideal candidate will have a strong background in big data technologies and experience with data warehousing, ETL processes, and data visualization tools.The estimated salary for this position...

  • Big Data Hadoop Engineer

    2 weeks ago

    Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...

  • Big Data Hadoop Engineer

    3 weeks ago

    Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...

  • Big Data Hadoop Engineer

    1 month ago

    Charlotte, United States Aloden, Inc. Full time

    Technology and Data - Software Engineer 4 - Contingent (Big Data Hadoop Engineer) Location:Charlotte, NC - 28202 - Hybrid Roles (3 Days Onsite/2 DaysWFH) Job Descriptions: In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex...

  • Big Data Engineer

    3 weeks ago

    Charlotte, United States Diverse Lynx Full time

    Big Data Engineer with mapreduce , spark , hive , sql skillset" Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have. MapR experience is must Strong Hands on experience with one or more programming languages ( Python or Java). Hands-on...

  • Big Data Engineering Lead

    2 weeks ago

    Charlotte, North Carolina, United States Motion Recruitment Full time

    We are seeking a highly skilled Big Data Engineering Lead to join our team at Motion Recruitment in Charlotte, NC. This full-time consulting assignment will be a long-term opportunity for the right candidate.The ideal candidate should have a strong understanding of big data development and experience working with Hadoop, Spark, Python, Scala, Unix, and SQL.A...

  • Big Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Atlantis IT group Full time

    About the RoleAt Atlantis IT group, we are seeking an experienced Big Data Engineer to join our team in Charlottte. This is a full-time W2 position that requires US citizenship or a Green Card.We need someone with expertise in Hadoop, Python, and Spark, as well as Pyspark and custom-built Spark SQL. MapR experience is preferred, but Hortonworks and Cloudera...

  • Big Data Engineer

    1 month ago

    Charlotte, United States Diverse Lynx Full time

    Role-Big Data Engineer Location-Charlotte, NC Type- ContractRole Description: Data Engineer - Bigdata, Hadoop, Spark, Scala, PySpark, Strong SQL, Cloudera Data Platform (CDP), Primary Skills: Big Data: Spark, Scala, Pyspark, HDFS Microsoft Stack: MS-SQL with strong knowledge in RDBMS concepts Hadoop (Hortonworks) and Hiveo Cloudera Data platform (CDP)...

  • Senior Big Data Engineer

    23 hours ago

    Charlotte, North Carolina, United States The Hartford Full time

    About The RoleThe Hartford is seeking a highly experienced Senior Big Data Engineer to join its team. As a Senior Big Data Engineer, you will design and implement large-scale data products that meet the company's needs.This is an exciting opportunity for individuals who want to shape the future of data engineering and drive innovation. You will work closely...

  • Big Data Engineering Expert

    2 weeks ago

    Charlotte, North Carolina, United States eTek IT Services, Inc. Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at eTek IT Services, Inc.Job SummaryThe successful candidate will be responsible for designing and implementing data pipelines using technologies such as Apache Spark, Python, and AWS services. They will also work closely with cross-functional teams to understand data requirements...

  • Senior Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States ApTask Full time

    About This Role:Candidates for the Senior Data Engineer - Big Data Hadoop position at ApTask will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data Hadoop. The ideal candidate will have experience working with big data technologies, including Hadoop, PySpark, and Teradata, and will be able to...

  • Senior Big Data Engineer

    2 weeks ago

    Charlotte, North Carolina, United States Diverse Lynx Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering group, you will design, build, and maintain large-scale data processing systems using big data technologies such as Spark, Scala, and PySpark.The ideal candidate will have a strong background in big data, including...

  • Big Data Engineer with AWS Experience

    1 day ago

    Charlotte, North Carolina, United States Global Channel Management Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team and lead our efforts in developing and maintaining our big data platform.Job Summary:This is an exciting opportunity to leverage your skills and experience in Big Data technologies to drive business growth and innovation.Key Responsibilities:Design, develop, and maintain high-quality...

  • Big Data Engineer

    2 weeks ago

    Charlotte, United States Innova Full time

    Innova Solutions has a client that is immediately hiring for a Big Data Engineer.   Position Type: Full-time (Contract) Duration: 12+ Months Location: Charlotte, NC 28202 (Hybrid)   As a Big Data Engineer, you will:  Consult on complex initiatives with broad impact and large-scale planning for Software Engineering.Review and analyse complex...

  • Big Data Systems Manager

    22 hours ago

    Charlotte, North Carolina, United States TechnoGen Full time

    Job Title: Big Data Systems ManagerLocation: Charlotte, NCWe are seeking a highly skilled Big Data Systems Manager to join our team at TechnoGen. The ideal candidate will have strong experience with big data technologies such as Hadoop, Spark, and Kafka, and a solid understanding of data modeling concepts and data management best...

  • Data Science Engineer

    2 weeks ago

    Charlotte, North Carolina, United States NTT DATA Full time

    About NTT DATA ServicesNTT DATA Services is a recognized leader in IT and business services, including cloud, data and applications. As part of NTT DATA, a $30 billion trusted global innovator with a combined global reach of over 80 countries, we help clients transform through business and technology consulting, industry and digital solutions, applications...

  • Data Engineering Specialist for Complex Big Data Solutions

    2 weeks ago

    Charlotte, North Carolina, United States Genesis10 Full time

    Job OverviewGenesis10 is currently seeking a highly skilled Python/Big Data Engineer to join our client in the financial industry in Charlotte, NC. This 12+ month contract position offers an exciting opportunity to leverage your expertise in developing innovative data solutions.About the RoleAs a Data Engineering Specialist, you will be responsible for...

  • Python/Big Data Engineer

    1 month ago

    Charlotte, United States Genesis10 Full time

    Genesis10 is currently seeking a Python/ Big Data Engineer with our client in the financial industry located in Charlotte, NC. This is a 12+ month contract position. Responsibilities: Consult as an expert to develop or influence initiatives and resources for highly complex business and technical needs across Engineering Consult on the strategy and...

  • SQL Server Lead

    3 weeks ago

    Charlotte, United States Motion Recruitment Partners LLC Full time

    SQL Server Lead / Azure Cloud / Big Data Engineer Charlotte, NC Hybrid Contract $69.5/hr - $78.31/hr Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Lead Engineer in Charlotte, NC (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term...

  • Senior Big Data Developer

    21 hours ago

    Charlotte, North Carolina, United States ApTask Full time

    About UsApTask is a leading global provider of workforce solutions and talent acquisition services. We offer a comprehensive suite of services, including staffing, recruitment, managed services, IT consulting, and project management. Our mission is to shape the future of work and empower organizations to thrive while fostering a diverse and inclusive work...