AWS ML Ops/Dev Ops Engineer

2 months ago


Plano, United States Mindteck Full time
Job Title: AWS DevOps/MLOps Engineer Job Description:
CLIENT is seeking a talented AWS DevOps/MLOps Lead to develop platforms for big data and data science on AWS. As models, apps, and data pipelines are created and operationalized, the bigdata and data science team requires engineers with understanding of cloud native technology to develop, manage, automate, and facilitate the operational capabilities of the big data and data science team.
Required Skills:
  • Experience in AWS system and network architecture design, with specific focus on AWS Sagemaker and AWS ECS
  • Experience developing and maintaining Client systems built with open source tools
  • Experience developing with containers and Kubernetes in cloud computing environments
  • Experience with one or more data-oriented workflow orchestration frameworks (KubeFlow, Airflow, Argo)
  • Design the data pipelines and engineering infrastructure to support our clients' enterprise machine learning systems at scale
  • Develop and deploy scalable tools and services for our clients to handle machine learning training and inference
  • Support model development, with an emphasis on auditability, versioning, and data security
  • Experience with data security and privacy solutions such as Denodo, Protegrity, and synthetic data generation.
  • Ability to develop applications using Python and deploy to AWS Lambda and API Gateway
  • Ability to develop Jenkins pipelines using the groovy scripting.
  • . Good understanding in testing frameworks like Py/Test.
  • Ability to work with AWS services like S3, DynamoDB, Glue, Redshift and RDS
  • Proficient understanding of Git and version control systems
  • Familiarity with continuous integration and continuous deployment.
  • Develop the terraform modules to deploy the standard infrastructure.
  • Ability to develop the deployment pipelines using the Jenkins, XL Release
  • Experience in Python boto3 to automate the cloud operations.
  • Experience in documenting technical solutions and solution diagrams
  • Good understanding of the simple python applications which can be deployed as a docker container.
  • Experiencing in creating workflows using AWS step functions
  • Create the docker images using the custom python libraries.
Required Skills:
  • AWS (experience mandatory): S3, KMS, IAM, EC2, ECS, BATCH, ECR, Lambda, Data Sync, EFS, IAM Roles, Policies, Cloud Trail, Cost Explorer, ACM, AWS Route53, SNS, SQS, ELB, CloudWatch, Lambda and VPC, Service Catalog
  • Automation (experience mandatory): Terraform, Python (boto3), serverless, Jenkins (Groovy), NodeJs
  • Bigdata (Knowledge): Redshift, DynamoDB, Databricks, Glue, and Athena.
  • Data science (Experience): Sagemaker, Athena, Glue, DynamoDB, Databricks, MWAA (Airflow),
  • DevOps (experience mandatory): Python, Terraform, Jenkins, GitHub, Make files, and Shell scripting.
  • Data Virtualization (Knowledge) : Denodo
  • Data Security (Knowledge): Protegrity

Qualifications:
  • Bachelor's degree from a reputed institution/university.
  • 10+ years of building end-to-end systems as a Platform Engineer, Client DevOps Engineer, or Data Engineer.
  • 4+ Years of experience in python, groovy, and java programming.
  • Experience working in the SCRUM Environment.

  • Pyspark ML Engineer

    1 month ago


    Plano, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Pyspark ML Engineer Location: Plano, TX [ (Day one Onsite) Job Description: PySpark ML Model development experience. The project includes conversion of some of our existing models from pure python to pyspark and deploying them. MUST HAVE: Hands on model building with pyspark ml AWS experience Databricks experience Have built and deployed models...

  • Pyspark ML Engineer

    2 months ago


    Plano, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Pyspark ML Engineer Location: Plano, TX [ (Day one Onsite) Job Description: PySpark ML Model development experience. The project includes conversion of some of our existing models from pure python to pyspark and deploying them. MUST HAVE: Hands on model building with pyspark ml AWS experience Databricks experience Have built and deployed models...


  • Plano, United States Futran Tech Solutions Pvt. Ltd. Full time

    ML Engineer with Py Spark Location Plano TX Onsite Longterm Contract JD The project includes conversion of some of our existing models from pure python to pyspark and deploying them. The ideal candidate MUST HAVE: Hands on model building with pyspark ml AWS experience Databricks experience Have built and deployed models in the past Experience with...


  • Plano, United States Futran Tech Solutions Pvt. Ltd. Full time

    ML Engineer with Py Spark Location Plano TX Onsite Longterm Contract JD The project includes conversion of some of our existing models from pure python to pyspark and deploying them. The ideal candidate MUST HAVE: Hands on model building with pyspark ml AWS experience Databricks experience Have built and deployed models in the past Experience with...


  • Plano, United States Capital One Full time

    Center 1 (19052), United States of America, McLean, VirginiaSenior Machine Learning Engineer (Python, SQL, AWS) - Dealer TechAs a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You'll participate in the detailed technical design, development, and...

  • Spark AWS Consultant

    1 month ago


    Plano, United States Resource Informatics Group Full time

    Role: Spark AWS Consultant Location: Plano, TX ,NY,NJ,DE,OH(Day 1 Onsite) Duration: Long Term contract Skills: Spark, Abinitio, AWSEssential: Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment. Develop/Upgrade Jules pipeline to deploy Spark job. Execute jules pipeline and deploy spark job to AWS Dev...

  • Spark AWS Consultant

    1 month ago


    Plano, United States Compunnel Inc. Full time

    Role: Spark AWS ConsultantLocation: - Plano, TX (Onsite)Duration: Contract *Need Local CandidatesSpark, Java, Abinitio, AWS, Terraform and Kubernetes.Job Description:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute Jules pipeline and deploy spark job...


  • Plano, Texas, United States eTek IT Services, Inc. Full time

    Company Overview">eTek IT Services, Inc. is a fast-paced organization that delivers high-quality AI/ML services to its clients.">Salary">The estimated salary for this position is around $120,000 - $180,000 per year, depending on experience and qualifications.">Job Description">As an AI/ML DevOps Engineer, your primary responsibility will be to ensure the...


  • Plano, United States Therapia Staffing Full time

    The Gifted Healthcare Experience\u00a0 Gifted Healthcare is an award-winning travel nursing agency that offers nursing contracts at premier healthcare facilities across the United States. Gifted Healthcare believes in the power one person has to make a difference in a patient\u2019s care, inspiring Gifted's mission to help nurses thrive and advance their...


  • Plano, Texas, United States Diverse Lynx Full time

    Job Title: Cloud WebSphere ExpertAbout the Role:We are seeking a highly experienced WebSphere expert to join our team at Diverse Lynx, LLC. As a Cloud WebSphere Expert, you will be responsible for deploying and managing WebSphere applications on cloud technologies like AWS. You should have in-depth knowledge of WebSphere Network deployment on Linux, AIX,...

  • Lead Software Engineer

    2 months ago


    Plano, United States JPMorganChase Full time

    Job DescriptionJOB DESCRIPTIONWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the CORPORATE & INVESTMENT BANK, Shared Services, you are an integral part of an agile team that works to enhance, build, and deliver trusted...


  • Plano, Texas, United States Tata Consultancy Services Full time

    About the Role:The successful candidate will work as a Mainframe Automation Engineer in Plano, TX. This is a full-time job.Job Description:We are looking for an expert with proficiency in IBM SA for z/OS and CA OPS/MVS system automation tools.Familiarity with migration projects, specifically CA-OPS/MVS to IBM System Automation, is highly valued.The ideal...

  • AWS Spark Consultant

    1 month ago


    Plano, United States Compunnel Inc. Full time

    Role: Spark AWS ConsultantLocation: Plano, TX (Day-1 Onsite)Duration: Contract (12+Months) Job Description:Skills: Spark, Java, Ab-initio, AWS, Terraform and Kubernetes.Minimum 8-10 years exp. required.Essential:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark...


  • plano, United States Compunnel Inc. Full time

    Role: Spark AWS ConsultantLocation: - Plano, TX (Onsite)Duration: Contract *Need Local CandidatesSpark, Java, Abinitio, AWS, Terraform and Kubernetes.Job Description:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute Jules pipeline and deploy spark job...


  • plano, United States Compunnel Inc. Full time

    Role: Spark AWS ConsultantLocation: - Plano, TX (Onsite)Duration: Contract *Need Local CandidatesSpark, Java, Abinitio, AWS, Terraform and Kubernetes.Job Description:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark job.Execute Jules pipeline and deploy spark job...


  • Plano, Texas, United States Diverse Lynx Full time

    Job Title: High-Touch WebSphere AdministratorAbout the Role:We are seeking a highly skilled WebSphere administrator to join our team at Diverse Lynx, LLC. As a High-Touch WebSphere Administrator, you will be responsible for providing high-quality support and maintenance services for our WebSphere applications. You should have extensive experience in...

  • Endevor Consultant

    2 months ago


    Plano, United States Insight Global Full time

    Insight Global is looking for a senior individual of the highest technical skill and experience in Dev/Ops Mainframe Operations Life Cycle Management. Displaying a broad range of disciplines, environments, and automation best practices within the automated operations practice or, the individual may possess skills and highly technical experience in Endevor...


  • plano, United States Compunnel Inc. Full time

    Role: Spark AWS ConsultantLocation: Plano, TX (Day-1 Onsite)Duration: Contract (12+Months) Job Description:Skills: Spark, Java, Ab-initio, AWS, Terraform and Kubernetes.Minimum 8-10 years exp. required.Essential:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark...


  • plano, United States Compunnel Inc. Full time

    Role: Spark AWS ConsultantLocation: Plano, TX (Day-1 Onsite)Duration: Contract (12+Months) Job Description:Skills: Spark, Java, Ab-initio, AWS, Terraform and Kubernetes.Minimum 8-10 years exp. required.Essential:Develop/upgrade spark Infrastructure scripts (EAC) for blue/green deployment on AWS Dev environment.Develop/Upgrade Jules pipeline to deploy Spark...


  • Plano, Texas, United States eTek IT Services, Inc. Full time

    We are seeking a highly skilled Cloud Engineering Solutions Expert to join our team at eTek IT Services, Inc.About the RoleThe primary responsibility of this position is to ensure the successful implementation and management of AI/ML services/components for USAA Enterprise. This includes AWS Sagemaker, AWS Neptune, and GCP Vertex AI.Key ResponsibilitiesWork...