Cloud Data Engineer-24-01182

1 week ago


Greenville, United States Datasoft Technologies, Inc. Full time

Cloud Data Engineer

Onsite


About the Job

  • Duration: Long-term renewable contract.
  • Location: Greenville, SC
  • Pay rate: Hourly
  • Job ID: 4972

This is a full-time W2 position, with no subcontracting or C2C.


Overview:

DataSoft Technologies, Inc. is seeking a Cloud Data Engineer to join our client in Greenville, SC. The Cloud Data Engineer provides complete application lifecycle development, deployment, and operations support for large-scale batch and real-time data processing pipelines using cloud technologies. Collaborates with product owners, data scientists, business analysts, and software engineers to design and build solutions to ingest, transform, store, and export data in a cloud environment while maintaining security, scalability, and personal data protection.


Responsibilities:

  • Implements and enhances complex data processing pipelines with a focus on collecting, parsing, cleaning, managing and analyzing large data sets that produce valuable business insights and discoveries.
  • Determines the required infrastructure, services, and software required to build advanced data ingestion & transformation pipelines and solutions in the cloud.
  • Assists data scientists and data analysts with data preparation, exploration and analysis activities.
  • Applies problem solving experience and knowledge of advanced algorithms to build high-performance, parallel, and distributed solutions.
  • Performs code and solution review activities and recommends enhancements that improve efficiency, performance, stability, and decreased support costs.
  • Applies the latest DevOps and Agile methodologies to improve delivery time.
  • Works with SCRUM teams in daily stand-up, providing progress updates on a frequent basis.
  • Supports application, including incident and problem management.
  • Performs debugging and triage of incident or problem and deployment of fix to restore services.
  • Documents requirements and configurations and clarifies ambiguous specs.
  • Performs other duties as assigned by management.


Qualifications:

  • BA/BS Degree in Business, Computer Science or Electrical Engineering preferred or the equivalent of 4 years professional IT related experience. MS degree (preferred).
  • 3+ years of enterprise software engineering experience with object oriented
  • design, coding and testing patterns, as well as, experience in engineering (commercial or open source) software platforms and large-scale data infrastructure solutions.
  • 3+ years of software engineering and architecture experience within a cloud environment (Azure, AWS).
  • 3+ years of enterprise data engineering experience within any "Big Data " environment (preferred).
  • 3+ years of software development experience using Python.
  • 2+ years of experience working in an Agile environment (Scrum, Lean or Kanban).
  • 3+ years of experience working in large-scale data integration and analytics projects, including using cloud (e.g. AWS Redshift, S3, EC2, Glue, Kinesis, EMR) and data-orchestration (e.g. Oozie, Apache Airflow) technologies
  • 3+ years of experience in implementing distributed data processing pipelines using Apache Spark
  • 3+ years of experience in designing relational/NoSQL databases and data warehouse solutions
  • 2+ years of experience in writing and optimizing SQL queries in a business environment with large-scale, complex datasets
  • 2+ years of Unix/Linux operating system knowledge (including shell programming).
  • 1+ years of experience in automation/configuration management tools such as Terraform, Puppet or Chef.
  • 1+ years of experience in container development and management using Docker.
  • Languages: SQL, Python, Spark
  • AWS/Azure cloud provider training/certifications (preferred)
  • Basic knowledge of continuous integration tools (e.g. Jenkins).
  • Basic knowledge of machine learning algorithms and data visualization tools such as Microsoft Power BI and Tableau
  • Nice to Haves: Snowflake, Terraform, Angular, Iceberg


About our Company

DataSoft Technologies is a highly recognized provider of professional IT Consulting services in the US. Founded in 1994, DataSoft Technologies, Inc. provides staff augmentation services for Information Technology and Automotive Services. Our team member benefits include:

  • Paid Holidays/Paid Time Off (PTO)
  • Medical/Dental Insurance Group
  • Accident/Critical Illness Insurance
  • Life Insurance
  • 401 (K)


  • Azure Cloud Engineer

    4 hours ago


    Greenville, North Carolina, United States InterEx Group Full time

    Job Title: Azure Cloud EngineerLocation: Hybrid RoleJob Type: Contract to HireIndustry: ManufacturingJob Description:As a key member of our team at InterEx Group, you will play a pivotal role in designing, implementing, and maintaining our cloud infrastructure and CI/CD pipelines. You will leverage your expertise in Azure services, Azure SQL, and networking...


  • Greenville, United States L3Harris Technologies Full time

    Job Title: Lead, Systems Engineering (GovCloud Engineer) Job Code: 15285 Job Location: Greenville, TX Job Schedule: 9/80 L3Harris is dedicated to recruiting and developing diverse, high-performing talent who are passionate about what they do. Our employees are unified in a shared dedication to our customers’ mission and quest for...

  • Lead, Systems Engineer

    39 minutes ago


    Greenville, United States L3Harris Technologies Full time

    Job Title: Lead, Systems Engineering (GovCloud Engineer) Job Code: 15285 Job Location: Greenville, TX Job Schedule: 9/80 L3Harris is dedicated to recruiting and developing diverse, high-performing talent who are passionate about what they do. Our employees are unified in a shared dedication to our customers’ mission and quest for...


  • Greenville, United States L3Harris Technologies Full time

    Job Title: Lead, Systems Engineering Job Code: 15285 Job Location: Greenville, TX Job Schedule: 9/80 L3Harris is dedicated to recruiting and developing diverse, high-performing talent who are passionate about what they do. Our employees are unified in a shared dedication to our customers’ mission and quest for professional growth. L3Harris...


  • Greenville, United States L3Harris Technologies Full time

    We are seeking a highly skilled and experienced Gov. Cloud Engineer to design and architect a customer asset tracking service hosted in the cloud. The Gov. Cloud Engineer will be responsible for designing a scalable, secure, and highly available clou Systems Engineer, Solutions Architect, Cloud Architect, Cloud Engineer, Cloud, Systems, Technology


  • greenville, United States L3Harris Technologies Full time

    Job Title: Lead, Systems Engineering Job Code: 15285 Job Location: Greenville, TX Job Schedule: 9/80 L3Harris is dedicated to recruiting and developing diverse, high-performing talent who are passionate about what they do. Our employees are unified in a shared dedication to our customers’ mission and quest for professional growth. L3Harris...


  • greenville, United States L3Harris Technologies Full time

    Job Title: Lead, Systems Engineering Job Code: 15285 Job Location: Greenville, TX Job Schedule: 9/80 L3Harris is dedicated to recruiting and developing diverse, high-performing talent who are passionate about what they do. Our employees are unified in a shared dedication to our customers’ mission and quest for professional growth. L3Harris...

  • Full Stack Engineer

    2 weeks ago


    Greenville, United States MP Cloud Technologies Full time

    About Us: At MP Cloud Technologies, we’re not just another tech company—we’re a small team with big dreams. We believe in creating a fun, engaging work environment where your contributions matter. Our mission is to deliver cutting-edge solutions that not only meet our clients’ needs but also push the boundaries of what’s possible in the tech...

  • Full Stack Engineer

    2 weeks ago


    Greenville, United States MP Cloud Technologies Full time

    About Us: At MP Cloud Technologies, we’re not just another tech company—we’re a small team with big dreams. We believe in creating a fun, engaging work environment where your contributions matter. Our mission is to deliver cutting-edge solutions that not only meet our clients’ needs but also push the boundaries of what’s possible in the tech...


  • Greenville, United States Datasoft Technologies, Inc. Full time

    Cloud Infrastructure ArchitectOnsiteAbout the JobDuration: Long-term renewable contractLocation: Greenville, SCPay rate: HourlyJob ID: 4976This is a Full Time W2 position, no subcontracting or C2C.Overview: Develops leading edge cloud architectures and technologies to support the company and local DEVOPS Hubs Americas' product teams. Identifies emerging...


  • Greenville, United States Datasoft Technologies, Inc. Full time

    Cloud Infrastructure ArchitectOnsiteAbout the JobDuration: Long-term renewable contractLocation: Greenville, SCPay rate: HourlyJob ID: 4976This is a Full Time W2 position, no subcontracting or C2C.Overview: Develops leading edge cloud architectures and technologies to support the company and local DEVOPS Hubs Americas' product teams. Identifies emerging...


  • Greenville, United States Datasoft Technologies, Inc. Full time

    Cloud Infrastructure ArchitectOnsiteOnsite Interview RequiredAbout the JobDuration: Long-term renewable contractLocation: Greenville, SCPay rate: HourlyJob ID: 4976This is a Full Time W2 position, no subcontracting or C2C.Overview: Develops leading edge cloud architectures and technologies to support the company and local DEVOPS Hubs Americas' product teams....

  • Azure Cloud Engineer

    2 months ago


    Greenville, United States Hyster-Yale Materials Handling Full time

    Job Title Azure Cloud Engineer Job Category Information Technology Job Description What starts with YOU, moves the world! Hyster-Yale Group, Inc. (HYG), a world-class manufacturer of industrial lift trucks, has an outstanding opportunity for an exceptional and talented Sr. Tech Specialist Lead based at our Greenville, NC location What you will do: Work...

  • Azure Cloud Engineer

    2 months ago


    Greenville, United States Hyster-Yale Group Full time

    Job Title Azure Cloud Engineer Job Category Information Technology Job Description What starts with YOU, moves the world! Hyster-Yale Group, Inc. (HYG), a world-class manufacturer of industrial lift trucks, has an outstanding opportunity for an exceptional and talented Sr. Tech Specialist Lead based at our Greenville, NC location . What you will do: Work...

  • Data Scientist

    1 month ago


    Greenville, United States Datasoft Technologies, Inc. Full time

    Data Scientist Hybrid (2 Days onsite)About the JobDuration: Long-term renewable contractLocation: Greenville, SCPay rate: HourlyJob ID: 4907This is a Full Time W2 position, no subcontracting or C2C.Overview: DataSoft Technologies, Inc. is seeking a Data Scientist to join our client in Greenville, SC. The Data Scientist accelerates and supports the ongoing...

  • Data Scientist

    1 month ago


    Greenville, United States Datasoft Technologies, Inc. Full time

    Data Scientist Hybrid (2 Days onsite)About the JobDuration: Long-term renewable contractLocation: Greenville, SCPay rate: HourlyJob ID: 4907This is a Full Time W2 position, no subcontracting or C2C.Overview: DataSoft Technologies, Inc. is seeking a Data Scientist to join our client in Greenville, SC. The Data Scientist accelerates and supports the ongoing...


  • Greenville, United States KYYBA Full time

    Job DescriptionJob DescriptionDay to Day responsibilities for this role:  ·       Maintain and operate framework that provides Guided Kubernetes (Kubernetes as a Service) solutions for customers.·       Troubleshoot cluster creation failure.·       Upgrade sub-components in preparing for overall KaaS quarterly upgrade using DevOps...


  • Greenville, South Carolina, United States KYYBA Full time

    Job OverviewWe are seeking a highly skilled Cloud Infrastructure Architect to join our team at Kyyba. As a key member of our organization, you will be responsible for designing and implementing leading-edge cloud architectures and technologies to support our product teams.Key Responsibilities:Develop and maintain cloud architectures for BMW product...


  • Greenville, United States HKA Enterprises Full time

    No relocation offered, No Corp to Corp offered, No 3rd party recruiter candidates accepted. Client Title: Cloud Infrastructure ArchitectPay Range: 64.03 - 88.04PTO, Sick Pay, and Holiday Pay Offered40% onsite 60 % remote â must be in located in SC Top Skills needed for this position:1. AWS Cloud Architecture (Certification Preferred (Associate or...

  • Project Engineer

    3 days ago


    Greenville, South Carolina, United States Courser Full time

    Job DescriptionAbout UsCourser is a leading Managed Services Provider (MSP) with a strong company culture built on values of Teamwork, Service, Growth-Minded, Trust, and Innovative. Our team dedicates their time working together to provide exceptional experience for our customers.Job SummaryWe are seeking a talented Project Engineer to join our team. This...