Data Engineer w/ Accumulo

3 days ago

San Antonio, Texas, United States Sandoval Technology Solutions Full time

The ideal candidate will have extensive experience with data integration, processing, and management, specifically utilizing Apache Nifi, RESTful APIs, Hadoop, Accumulo, and Elasticsearch.

Key Responsibilities:

  • Design, develop, and maintain data pipelines to support C2IE deployments.
  • Utilize Apache NiFi for data ingestion, transformation, and routing.
  • Develop and maintain RESTful APIs for seamless data exchange between systems.
  • Implement and manage data storage solutions, including Hadoop, Accumulo, and Elasticsearch.
  • Collaborate with cross-functional teams to understand data requirements and implement effective solutions.
  • Ensure data quality, integrity, and security throughout the data lifecycle.
  • Monitor and optimize data workflows to ensure high performance and reliability.
  • Troubleshoot and resolve issues related to data integration and processing.
  • Stay updated with the latest trends and technologies in data engineering and apply them to improve existing processes.

Required Skills and Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • Proven experience as a Data Engineer or similar role, with a focus on supporting complex data environments.
  • Strong proficiency in Apache NiFi for data integration and processing.
  • Experience in developing and managing RESTful APIs.
  • In-depth knowledge of data storage solutions, including Hadoop, Accumulo, and Elasticsearch.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong understanding of data security and compliance requirements.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

Preferred Qualifications:

  • Experience with Elastic Search and the Elastic Stack
  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) for data engineering.
  • Knowledge of DevOps practices and tools like Jenkins, Docker, and Kubernetes.
  • Experience with data visualization tools and techniques.
  • Relevant certifications in data engineering or related fields.

  • Quantitative Software Engineer

    1 week ago

    San Antonio, Texas, United States IAMUS Consulting Full time

    We are looking for a talented Software Engineer to support the analysis and validation of mission critical and mission support data sets. The preferred candidate will have a background in supporting cyber and/or network related missions within the military spaces, as either a developer, analyst or engineer. Essential Job ResponsibilitiesThe ideal candidate...

  • Data Engineer

    2 weeks ago

    San Antonio, Texas, United States Food Safety Net Services Full time $80,000 - $150,000 per year

    About The RoleWe are seeking an experienced Data Engineer / Database Administrator with a strong background in the healthcare or laboratory industry to design, build, and maintain secure, compliant, and high-performance data systems. This role requires expertise in the Microsoft technology stack, including Azure, Synapse Analytics, and SQL Server, as well as...

  • Environmental Data Engineer

    2 weeks ago

    San Antonio, Texas, United States Grassroots Carbon Full time

    Position: Environmental Data Engineer / Machine Learning EngineerPosition Type: Full-TimeReports to: Jay Weeks, Director of Data & Soil ScienceRole OverviewAs a Data Engineer / Machine Learning Engineer, you will play a pivotal role in bridging the gap between experimental prototypes and scalable, production-ready systems. You'll spend approximately 50% of...

  • Data Integration Engineer

    16 hours ago

    San Antonio, Texas, United States Bridgehead IT Full time

    Position Summary:The Data Integration Engineer will own the design, build, and operation of scalable data pipelines and warehouse models that power analytics and operational reporting. You'll integrate diverse sources (databases, APIs, SaaS apps, flat files), and engineer performant ELT/ETL in the cloud. You'll collaborate closely with analytics, app dev,...

  • Senior Project Engineer, NA

    2 weeks ago

    San Antonio, Texas, United States Vantage Data Centers Full time $104,000 - $130,878 per year

    About Vantage Data CentersVantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large enterprises. Developing and operating across North America, EMEA and Asia Pacific, Vantage has evolved data center design in innovative ways to deliver dramatic gains in reliability, efficiency...

  • Data Engineer – AI

    2 weeks ago

    San Antonio, Texas, United States Guidehouse Full time $120,000 - $180,000 per year

    Job FamilyData Science ConsultingTravel RequiredUp to 25%Clearance RequiredAbility to Obtain Public TrustWhat You Will DoWe are seeking an experiencedData Engineerto join our growing AI and Data practice, with a dedicated focus on the Federal Civilian Agencies (FCA) market within the Communities, Energy & Infrastructure (CEI) segment. This individual will be...

  • VP, Data Engineering and Architecture

    2 weeks ago

    San Antonio, Texas, United States TaskUs Full time

    About TaskUs: TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, TaskUs serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming...

  • Data Scientist

    3 days ago

    San Antonio, Texas, United States Northrop Grumman Full time $110,000 - $206,000

    RELOCATION ASSISTANCE: Relocation assistance may be availableCLEARANCE TYPE: Top SecretTRAVEL: Yes, 10% of the TimeDescriptionAt Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today, and for generations to come. Our pioneering and inventive spirit has enabled us to...

  • Cleared Data Center Electrical Engineer, Field Engineering

    1 week ago

    San Antonio, Texas, United States Amazon Web Services (AWS) Full time

    DescriptionWe have an immediate opening for a Field Engineer in the San Antonio, TX region.As An Amazon Field Engineer, You Will Provide Full Life-cycle Support To AWS Data Centers From Design Inception Through Site Improvement And Maintenance. You Will Be The 'go To' Engineering Resource For Your Region When Technical Advice Is Needed, And Will Use Your...

  • DevSecOps Engineer

    2 weeks ago

    San Antonio, Texas, United States Northrop Grumman Full time $100,000 - $187,300 per year

    RELOCATION ASSISTANCE: Relocation assistance may be availableCLEARANCE TYPE: SCITRAVEL: Yes, 10% of the TimeDescriptionAt Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact people's lives around the world today, and for generations to come. Our pioneering and inventive spirit has enabled us to be at the...