Big Data Platform Engineer

1 day ago

Charlotte, NC, United States Veracity Full time
Job Title: Big Data Platform Engineer
Duration: 12 Months
Location: Charlotte, NC - Hybrid Role

Job Summary:
We are seeking a highly skilled and motivated Tools Administration & Engineering Specialist to join our Data private cloud. This role involves working closely with other technical staff to manage, support, and engineer platform tools across various big data and cloud environments including Cloudera Data Platform (CDP), Hortonworks, and OpenShift Container Platform (OCP).

Key Responsibilities:
  1. Administer and support tools on the Data private cloud , Including CDP, HWX, MapR.
  2. Install, configure, and maintain data analytical and virtualization tools such as Dremio, JupyterHub and AtScale, across multiple clusters.
  3. Develop proof-of-concept solutions leveraging CDP and OCP technologies.
  4. Deploy tools and troubleshoot issues, perform root cause analysis, and remediate vulnerabilities.
  5. Act as a technical subject matter expert, supporting programming staff during development, testing, and implementation phases.
  6. Develop automation scripts for configuration and maintenance of data virtualization tools.
  7. Lead complex platform design, coding, and testing efforts.
  8. Drive advanced modeling, simulation, and analysis initiatives.
  9. Maintain comprehensive documentation of Hadoop cluster configurations, processes, and procedures.
  10. Generate reports on cluster usage, performance metrics, and capacity utilization.
  11. Work closely with data engineers, data scientists, and other stakeholders to understand their requirements and provide necessary support.
  12. Collaborate with IT infrastructure teams for integrating Dremio Tool, Hadoop clusters with existing systems and services.

Required Skills & Experience:
  1. Strong experience with big data platforms: MapR, Hortonworks, Cloudera Data Platform.
  2. Hands-on expertise with data virtualization tools: Dremio, JupyterHub, AtScale.
  3. Proficiency in deploying and managing tools in cloud and containerized environments (CDP, OCP).
  4. Solid understanding of platform engineering, automation scripting, and DevOps practices.
  5. Proven ability to troubleshoot complex issues and perform root cause analysis.
  6. Experience in leading technical efforts and mentoring team members.

Preferred Qualifications:
  1. Certifications in Cloudera, OpenShift, or related technologies.
  2. Experience with enterprise-level data lake architectures and governance.

  • Senior Data Platform Engineer

    6 days ago

    Charlotte, NC, United States The Hartford Full time

    Sr Cloud Engineer - IE07NE We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as we help shape the future. The Hartford is seeking a seasoned Senior Data...

  • Big Data engineer WITH Java

    7 days ago

    Charlotte, NC, United States RIT Solutions, Inc. Full time

    Title- Big Data engineer WITH Jav Location-Charlotte NC (2-3 days a week) Duration-6+ Months Must Haves: Hadoop Postgres Big dat Java (2 - 3 years ) ETL Kafk ny Cloud Experience CICD project will be worked on. The requirement is to redesign the data engineering jobs into Cloud based environment, maintain the current application ,...

  • Big Data engineer WITH Java

    2 weeks ago

    Charlotte, NC, United States RIT Solutions, Inc. Full time

    Title- Big Data engineer WITH Jav Location-Charlotte NC (2-3 days a week) Duration-6+ Months Must Haves: Hadoop Postgres Big dat Java (2 - 3 years ) ETL Kafk ny Cloud Experience CICD project will be worked on. The requirement is to redesign the data engineering jobs into Cloud based environment, maintain the current application ,...

  • Data Platform Engineer

    36 minutes ago

    Charlotte, NC, United States RIT Solutions, Inc. Full time

    Data Platform Engineer top choice is Charlotte, NC but will consider Malvern, PA as well - Hybrid These are Data Platform Engineer needs she is not looking for your average data engineers. We are seeking a highly skilled Data Platform Engineer to design, build, and optimize scalable data infrastructure that powers AI and advanced analytics initiatives. This...

  • Big Data Engineer

    4 days ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Big Data Engineer

    5 days ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Big Data Engineer

    1 day ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Big Data Engineer

    21 hours ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Big Data Engineer

    1 week ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Data Platforms Engineer

    2 weeks ago

    Charlotte, NC, United States Resideo Full time

    Job Description ADI is seeking a passionate Data Platforms Engineer to design, develop, and maintain our enterprise data platforms. As the Engineer of Data Platforms, you will be part of a talented engineering and operations team focused on building and supporting secure, performant, and scalable next gen data platforms that include Snowflake, Databricks, MS...