GenAI Data Automation Engineer

2 days ago

Washington, DC, United States Equiliem Full time
Job Summary
The GenAI Data Automation Engineer will design and implement AI-driven automation and data engineering solutions across AWS and Azure hybrid environments. This role focuses on building intelligent, scalable data pipelines that integrate cloud services, enterprise tools, and Generative AI to support analytics, reporting, and customer engagement platforms. The ideal candidate is analytical, innovative, and mission-driven, with the ability to translate complex technical requirements into effective automated systems. This position requires U.S. citizenship and the ability to obtain a Public Trust clearance. The role is primarily remote, with occasional onsite work in the Gaithersburg area approximately once per quarter.

Job Responsibilities
  • Design, develop, and maintain data pipelines using AWS services such as S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB, and Step Functions.
  • Build and optimize ETL/ELT processes to transfer data between multiple systems, including DynamoDB to SQL Server (AWS) and AWS to Azure SQL.
  • Integrate AWS Connect and Nice inContact CRM data into enterprise pipelines for analytics and operational reporting.
  • Enhance data ingestion pipelines using Apache Spark, Flume, and Kafka for both real-time and batch processing into Apache Solr and AWS OpenSearch.
  • Leverage Generative AI frameworks (AWS Bedrock, Amazon Q, Azure OpenAI, Hugging Face, LangChain) to automate vector generation, embedding, data quality checks, metadata tagging, and lineage tracking.
  • Implement LLM-assisted data transformation, anomaly detection, and conversational BI interfaces for natural language access to data sources.
  • Develop AI-powered copilots for pipeline monitoring, diagnostics, and automated troubleshooting.
  • Optimize SQL Server performance through stored procedures, indexing, and query tuning.
  • Apply CI/CD best practices using GitHub, Jenkins, or Azure DevOps for data pipelines and GenAI model deployment.
  • Ensure security and compliance through IAM, encryption, VPC isolation, RBAC, and firewall configurations.
  • Participate in Agile DevOps processes, delivering sprint-based enhancements and AI-enabled features.
Job Requirements
  • Bachelor's degree in Computer Science or related field.
  • Minimum of 2 years of experience in data engineering and automation.
  • Hands-on experience with Generative AI frameworks such as AWS Bedrock, Azure OpenAI, or open-source platforms.
  • Strong proficiency in SQL, SSIS, Python, Spark, Bash, PowerShell, and cloud CLI tools.
  • Experience with AWS services including S3, Glue, RDS/SQL Server, Lambda, EMR, and DynamoDB.
  • Familiarity with Apache Flume, Kafka, and Solr for large-scale data ingestion and search.
  • Experience integrating REST APIs into data workflows.
  • Proficiency with CI/CD tools such as GitHub, Azure DevOps, Jenkins, and JIRA.
  • Strong troubleshooting and performance optimization skills for SQL and Spark environments.
  • Experience operationalizing Generative AI pipelines, including model deployment, monitoring, and lifecycle management.
  • Excellent communication and presentation skills.
  • U.S. citizenship and eligibility to obtain a Public Trust clearance.
Preferred Qualifications
  • Certifications such as AWS Data Engineer, AWS AI/ML Specialty, Azure AI Engineer, or Databricks Certified Data Engineer.
  • Experience implementing RAG pipelines, embeddings, and vector search with Solr, OpenSearch, FAISS, Pinecone, or Pgvector.
  • Experience with multi-cloud data integration between AWS and Azure SQL environments.
  • Familiarity with Microsoft BizTalk, SSIS, and data governance tools (Purview, Unity Catalog, AWS Glue Catalog).
  • Experience using Infrastructure-as-Code tools such as Terraform, CloudFormation, or Bicep.
  • Understanding of compliance frameworks such as FedRAMP, PCI-DSS, and HIPAA.
Additional Job Details
  • This position is primarily remote with occasional onsite requirements in the Gaithersburg area (approximately once per quarter).
  • Must be able to obtain and maintain a Public Trust clearance.
  • U.S. citizenship is required for consideration.
#DICE #CJ

  • Data Automation Engineer

    2 weeks ago

    Washington, DC, United States System One Holdings, LLC Full time

    Data Automation EngineerREMOTE - Quarterly travel to Washington, DC Type: Contract Pay Rate: $45.50 - $53.00 hourly Security Clearance: Per government contract, must be US citizen and able to obtain a Public Trust clearance. We are seeking a customer experience focused Data Automation Engineer to work with a team of subject matter experts and developers...

  • Data Automation Engineer

    6 days ago

    Washington, DC, United States System One Holdings, LLC Full time

    Data Automation EngineerREMOTE - Quarterly travel to Washington, DC Type: Contract Pay Rate: $45.50 - $53.00 hourly Security Clearance: Per government contract, must be US citizen and able to obtain a Public Trust clearance. We are seeking a customer experience focused Data Automation Engineer to work with a team of subject matter experts and developers...

  • GenAI Product Engineer

    2 weeks ago

    Washington, DC, United States Experis Full time

    Our client, a leading organization in the technology and AI sector, is seeking a GenAI Product Engineer to join their innovative team. As a GenAI Product Engineer, you will be part of the AI Development Department supporting cutting-edge AI initiatives. The ideal candidate will demonstrate strong problem-solving skills, adaptability, and a collaborative...

  • GenAI Product Engineer

    1 week ago

    Washington, DC, United States Experis Full time

    Our client, a leading organization in the technology and AI sector, is seeking a GenAI Product Engineer to join their innovative team. As a GenAI Product Engineer, you will be part of the AI Development Department supporting cutting-edge AI initiatives. The ideal candidate will demonstrate strong problem-solving skills, adaptability, and a collaborative...

  • University, GenAI Engineer

    2 days ago

    Washington, DC, United States Booz Allen Hamilton Full time

    University, GenAI Engineer The Opportunity: Do you enjoy creating innovative solutions to complex challenges while working within a community of dynamic technology professionals? As an experienced data professional, you know that machine learning is critical to understanding and processing massive datasets. We need your technical expertise to support federal...

  • QA automation

    1 week ago

    Washington, DC, United States TechDigital Corporation Full time

    Job Title 10+ years of experience in QA automation, including substantial expertise in formulating and executing QA automation strategies. Proven track record with GenAI tools & technologies and their application in QA automation. Proficiency in automation tools and frameworks, with a comprehensive understanding of testing in Windows, iOS, cloud platforms,...

  • QA automation

    2 weeks ago

    Washington, DC, United States TechDigital Corporation Full time

    Job Title 10+ years of experience in QA automation, including substantial expertise in formulating and executing QA automation strategies. Proven track record with GenAI tools & technologies and their application in QA automation. Proficiency in automation tools and frameworks, with a comprehensive understanding of testing in Windows, iOS, cloud platforms,...

  • QA automation

    6 days ago

    Washington, DC, United States Omni Inclusive Full time

    10+ years of experience in QA automation, including substantial expertise in formulating and executing QA automation strategies. Proven track record with GenAI tools & technologies and their application in QA automation. Proficiency in automation tools and frameworks, with a comprehensive understanding of testing in Windows, iOS, cloud platforms, and...

  • QA automation

    1 week ago

    Washington, DC, United States Omni Inclusive Full time

    10+ years of experience in QA automation, including substantial expertise in formulating and executing QA automation strategies. Proven track record with GenAI tools & technologies and their application in QA automation. Proficiency in automation tools and frameworks, with a comprehensive understanding of testing in Windows, iOS, cloud platforms, and...

  • Data Engineer

    2 weeks ago

    Washington, DC, United States Logistics Management Institute Full time

    Overview LMI has an immediate need for a Data Engineer to work with our NASA client in Washington, DC. The ideal candidate will have strong data engineering expertise and can review human capital related information. We are looking for someone able to extract datasets from different sources, coordinate the cleaning process, maintain data integrity, and...