Big Data Administrator Lead

2 weeks ago


Reston, United States Ageatia Global Solutions Full time
PURPOSE
This is a Big Data Administrator Lead position and not a developer position.

The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise
infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using Hadoop or equivalent.) with emphasis on high availability, reliability, automation and performance. This role will focus on leading the migration and set up of the Enterprise Data Platform on Cloud using a combination of Cloudera CDP public cloud and other AWS services.

Advanced (expert preferred) level experience in administrating and engineering relational databases (ex. MySQL, PostgreSQL), Big Data systems (ex. Cloudera Data Platform Private Cloud and Public Cloud), Apache Solr as SME, ETL (ex. Ab Initio), BI (ex. MicroStrategy), automation tools (ex. Ansible, Terraform, Bit Bucket) and experience working cloud solutions (specifically data products on AWS) are necessary.

At least 10 years of Experienced with all the tasks involved in administration of big data and Meta Data Hub such as Cloudera. Solr experience is a MUST.

Experience with Ab Initio, EMR, S3, Dynamo DB, Mongo DB, ProgreSQL, RDS, DB2 is a Plus.

DevOps (CI/CD Pipeline) is a Plus.

Experience with Advance knowledge of UNIX and SQL

Experience with manage metadata hub-MDH, Operational Console and troubleshoot environmental issues which affect these components

Require prior experience with migration from on-premise to AWS Cloud.

Represents team in all architectural and design discussions. Knowledgeable in the end-to-end process and able to act as an SME providing credible feedback and input in all impacted areas. Require tracking and monitoring projects and tasks as the lead.

ESSENTIAL FUNCTIONS
Weight Essential Functions
20% Represents team in all architectural and design discussions. Knowledgeable in the end-to-end process and able to act as an SME providing credible feedback and input in all impacted areas.
Require project tracking and task monitoring. the lead position ensures an overall successful implementation especially where team members all are working on multiple efforts at the same time. Lead the team to design, configure, implement, monitor, and manage all aspects of Data Integration Framework. Defines and develop the Data Integration best practices for the data management environment of optimal performance and reliability. Plan, develop and lead administrators with project and efforts, achieve milestones and objectives. Oversees the delivery of engineering data initiatives and projects including hands on with install, configure, automation script, and deploy.

20% Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using Hadoop or equivalent MapReduce platform.

15% Develop and implement techniques to prevent system problems, troubleshoots incidents to recover services, and support the root cause analysis. Develops and follows standard operating procedures (SOPs) for common tasks to ensure quality of service.

15% Manages customer and stakeholder needs, generates and develops requirements, and performs functional analysis. Fulfills business objectives by collaborating with network staff to ensure reliable software and systems. Enforces the implementation of best practices for data auditing, scalability, reliability, high availability and application performance. Develop and apply data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.

15% Acts as a mentor for junior and senior team members.

10% Installs, tunes, upgrades, troubleshoots, and maintains all computer systems relevant to the supported applications including all necessary tasks to perform operating system administration, user account management, disaster recovery strategy and networking configuration.

5% Expands engineering job knowledge and leading technologies by reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; educational opportunities and participating in professional societies.

Problem Complexity and Problem Solving Timeframes
Works on significant and unique issues where analysis of situations or data requires and evaluation of intangibles. Aware and responds to changing and interconnected variables. Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results. Problem/Task resolution timeframe: Inclusive of shorter timeframes, but typically twelve months or more to resolve.

Level of Supervision Received
Establishes personal standards of performance within broad framework of policy and objectives as set by senior management.

Impact
Erroneous decisions or recommendations would normally result in failure to reach goals crucial to significant organizational objectives and would profoundly effect the image of the organization.

Contact with Others
Acts as prime consultant on significant tasks that affect the organization's long-term goals and objectives. Interacts with senior management and senior value-chain partners both internally and externally on matters requiring coordination and decision-making across organizational lines.

QUALIFICATIONS
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Education Level: Bachelor's Degree
Education Details: Information Technology, Computer Science or related field
Experience: 8 years of relevant engineering experience.

In Lieu of Education

In lieu of a Master's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.

Knowledge, Skills and Abilities (KSAs) Proficiency
Knowledge of programming languages and web based technologies. Expert
Experience with Cloudera CDP on-prem and public cloud; Solr SME. Expert
Ability to collaborate to solve technical problems across teams. Expert
Excellent communication skills both written and verbal. Expert

  • Reston, United States Ageatia Global Solutions Full time

    PURPOSE This is a Big Data Administrator Lead position and not a developer position. The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using...


  • Reston, United States Ageatia Global Solutions Full time

    PURPOSE: This is a Big Data Administrator position and not a developer position.The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and...


  • Reston, United States Resource Informatics Group Full time

    Client Company CareFirst Client FEPOC Job Description Position Title: Cloudera Big Data administratorLocation: Reston VADuration : 12 months of contract with possibility of extensionExperience Summary: This is a Cloudera Big Data administrator position and not a developer position. Experience with building Cloudera cluster, setting up Nifi, Solr, HBase,...


  • Reston, United States Resource Informatics Group Full time

    Client CompanyCareFirst Client FEPOCJob DescriptionPosition Title: Cloudera Big Data administrator Location: Reston VA Duration : 12 months of contract with possibility of extension Experience Summary: This is a Cloudera Big Data administrator position and not a developer position. Experience with building Cloudera cluster, setting up Nifi, Solr, HBase,...


  • Reston, United States Atechstar Full time

    Key ResponsibilitiesThe right candidate will be expected to be a significant player in the project evolution & deployment shouldering the following responsibilitiesContribute to full development life cycle including requirements analysis functional design technical design programming testing documentation implementation and on-going technical...


  • Reston, United States GSSR Inc Full time

    Job DescriptionJob DescriptionVaccination:Need Fully vaccinated candidates against Covid-19DescriptionSummary: Our client is seeking a Lead Big Data Administrator to supportits existing Cloudera / AWS data platform while the existing team supports theongoing enterprise migration to AWS. This resource will be responsible forconfiguring, troubleshooting, and...


  • Reston, Virginia, United States Atechstar Full time

    Key ResponsibilitiesThe right candidate will be expected to be a significant player in the project evolution & deployment shouldering the following responsibilitiesContribute to full development life cycle including requirements analysis functional design technical design programming testing documentation implementation and on-going technical support Analyse...

  • Big Data Lead

    2 weeks ago


    Reston, United States Diverse Lynx Full time

    Location: Stamford, Connecticut -Weekly Thrice(Hybrid) Job Description Senior Data Engineer (8+ yrs of exp) Responsibilities - Experienced Data engineer responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. • Responsible for Cloud migrations for data pipelines using AWS and Snowflake • Participate in all...


  • Reston, United States Atos Full time

    Preferred Skills• Good knowledge of cybersecurity principles, tools and devices, and a real passion for a career in cyber security.• Insanely curious, analytical, and loves solving problems.• Demonstrate leadership and adaptability, with willingness to take ownership of any given task or project.• Ability to understand and assimilate different points...


  • Reston, United States Atos Full time

    Preferred Skills• Good knowledge of cybersecurity principles, tools and devices, and a real passion for a career in cyber security.• Insanely curious, analytical, and loves solving problems.• Demonstrate leadership and adaptability, with willingness to take ownership of any given task or project.• Ability to understand and assimilate different points...

  • Big Data Engineer

    1 month ago


    Reston, United States Atechstar Full time

    Job descriptionRequired SkillsBachelors degree in Computer Science and 5+ years of experience or equivalent industry experience Deep knowledge of two or more functional or scripting programming languages Java Python Scala or R 3+ years of Hadoop Hive Spark or related MapReduce framework development experience Extensive experience with distributed SQL...

  • Data Administrator

    2 months ago


    Reston, United States Wipro Limited Full time

    Job ResponsibilitiesDatabase Administration Architect and implement database applications/infrastructures typical of those required to support a large organization and capable of adapting to database structure changes in a dynamic business setting. Perform activities related to administration of LSU enterprise databases and other project-based databases ...

  • Big Data Engineer

    2 months ago


    Reston, Virginia, United States Atechstar Full time

    Job descriptionRequired SkillsBachelors degree in Computer Science and 5+ years of experience or equivalent industry experience Deep knowledge of two or more functional or scripting programming languages Java Python Scala or R 3+ years of Hadoop Hive Spark or related MapReduce framework development experience Extensive experience with distributed SQL...

  • Data Administrator

    2 months ago


    Reston, Virginia, United States Wipro Limited Full time

    Job ResponsibilitiesDatabase Administration Architect and implement database applications/infrastructures typical of those required to support a large organization and capable of adapting to database structure changes in a dynamic business setting. Perform activities related to administration of LSU enterprise databases and other project-based databases...

  • LEAD Data Scientist

    1 week ago


    Reston, United States Soft source inc Full time

    Job DescriptionJob DescriptionLooking for a LEAD Data Scientist!! Candidates must have Heavily focus on Sagemaker, cloud and model deployment exp!! Minimum 10 years of relevant experience and Lead experience!!Client Location: Reston VA (Primarily a REMOTE ROLE, Highly prefer candidates local to the DMV area)Experienced data scientist, Senior level, building...


  • Reston, United States COBAR Resources, LLC Full time

    **Job Title**: IBM Master Data Management (MDM) Administrator **Customer**: Office of the Director of National Intelligence (ODNI) **Location**: Reston (100% onsite) **Clearance**: TS/SCI FSP **Engagement Length**: 40 hours per week through March 2025 with a one-option year. **Scope**: We are seeking a highly skilled IBM Master Data Management (MDM)...

  • Lead Data Scientist

    2 weeks ago


    Reston, United States Lumen Solutions Group Inc. Full time

    Lumen Solutions Group Inc. is a technology consulting Services Company based in Virginia. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in strategy development, portfolio management and enterprise architecture.Role: Lead Data ScientistLocation: Reston,...

  • Lead Data Scientist

    2 weeks ago


    Reston, United States Lumen Solutions Group Inc. Full time

    Lumen Solutions Group Inc. is a technology consulting Services Company based in Virginia. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in strategy development, portfolio management and enterprise architecture.Role: Lead Data ScientistLocation: Reston,...

  • Lead Data Scientist

    2 weeks ago


    Reston, United States Lumen Solutions Group Inc. Full time

    Lumen Solutions Group Inc. is a technology consulting Services Company based in Virginia. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in strategy development, portfolio management and enterprise architecture.Role: Lead Data ScientistLocation: Reston,...


  • Reston, United States Atechstar Full time

    Job description1-5 years of experience managing and delivering ETL/Hadoop/Bigdata Solutions in a large enterprise environment and would take a lead role in the design and analysis of a Big Data and Analytics solution in a variety of industries and computing environments. Provide data architecture solution design and architectural leadership that includes...