Cloud Data Engineer

4 weeks ago

Minneapolis, United States SPECTRAFORCE Full time

Job Title: Cloud Data Engineer

Location: Minneapolis, MN (Hybrid)

Duration: 6 months


Job Summary:

As a Cloud Data Engineer, you will play a crucial role in Clients Technologies’ organization, in processing and analyzing IoT data from our connected products to drive value for our customers. You will be responsible for delivering analytical data solutions for both internal and external customers. The Cloud Data Engineer plays an active role in designing, developing, deploying, and monitoring data pipelines as part of our connected product solution. The ideal candidate will have a strong background in data pipelines, data warehouses, data streaming, data quality, databases, and other business intelligence patterns and tooling.


Responsibilities:

  • Develop and implement strategies for processing and analyzing large volumes of IoT data, ensuring scalability and performance.
  • Design, develop, and maintain streaming and batch data pipelines in our AWS cloud environment
  • Participate in the planning and prioritization of development tasks, ensuring efficient use of resources and timely delivery of projects
  • Collaborate with data analysts and data scientists to understand their data requirements and develop solutions to meet their needs.
  • Optimize and tune data pipelines for performance and scalability.
  • Develop and maintain monitoring and alerting solutions to ensure data quality and availability.
  • Collaborate with our Platform team to ensure data analytics infrastructure is secure, reliable, and highly available.
  • Continuously research and evaluate new tools and technologies to improve data processing and analytics capabilities.
  • Conduct code reviews to ensure adherence to coding standards and best practices.
  • Capture and document data lineage, metadata, and data dictionaries to ensure comprehensive data governance.

Key Competencies:

  • Advanced knowledge of cloud technologies and services, specifically around Amazon Web Services (AWS) Data Analytics tools (ex: Glue, Redshift, Lambda, Kinesis)
  • Broad understanding of data engineering methodologies and tools, including data warehousing, DevOps/DataOps, data ingestion, ELT/ETL, and data visualization tools
  • Knowledge of database management systems, data modeling, and data warehousing best practices
  • Strong coding skills in languages such as Pyspark, Scala, and SQL
  • Experience in data streaming technologies such as Kafka, Kinesis, or Pub/Sub
  • Experience in handling unstructured streaming data is highly desired
  • Experience in software development on a team using Agile methodology
  • Knowledge of Business Intelligence Dimensional Modelling, Star Schemas, Slowly Changing Dimensions
  • Knowledge of DevOps tools and techniques (Ex: CI/CD, Azure DevOps, etc.)
  • Knowledge of data governance and security practices

Qualifications:

  • Bachelor’s degree in computer science, Information Technology, or a related field.
  • 8+ years’ experience with cloud data and analytics platforms such as AWS, Azure, or GCP
  • 5+ years of experience working with data & analytics concepts such as SQL, ETL, ELT, reporting and report building, data visualization, data lineage, data importing & exporting, and data warehousing
  • 3+ years of experience working with general IT concepts such as integrations, encryption, authentication & authorization, batch processing, real-time processing, CI/CD, automation



About Us: Established in 2004, SPECTRAFORCE® is one of the largest and fastest-growing diversity-owned staffing firms in the US. The growth of our company is a direct result of our global client service delivery model that is powered by our state-of-the-art A.I. proprietary talent acquisition platform, robust ISO 9001:2015/ISO 27001 certified processes, and strong and passionate client engaged teams. We have built our business by providing talent and project-based solutions, including Contingent, Permanent, and Statement of Work (SOW) services to over 140 clients in the US, Canada, Puerto Rico, Costa Rica, and India. Key industries that we service include Technology, Financial Services, Life Sciences, Healthcare, Telecom, Retail, Utilities and Transportation. SPECTRAFORCE is built on a concept of “human connection,” defined by our branding attitude of NEWJOBPHORIA®, which is the excitement of bringing joy and freedom to the work lifestyle so our people and clients can reach their highest potential. Learn more at:


Benefits: SPECTRAFORCE offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE provides unpaid leave as well as paid sick leave when required by law.


Equal Opportunity Employer: SPECTRAFORCE is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.


California Applicant Notice: SPECTRAFORCE is committed to complying with the California Privacy Rights Act (“CPRA”) effective January 1, 2023; and all data privacy laws in the jurisdictions in which it recruits and hires employees. A Notice to California Job Applicants Regarding the Collection of Personal Information can be located on our website. Applicants with disabilities may access this notice in an alternative format by contacting NAHR@spectraforce.com.


LA County, CA Applicant Notice: If you are selected for this position with SPECTRAFORCE, your offer is contingent upon the satisfactory completion of several requirements, including but not limited to, a criminal background check. We consider qualified applicants with arrest or conviction records for employment in accordance with all local ordinances and state laws, including the Los Angeles County Fair Chance Ordinance for Employers (FCO) and the California Fair Chance Act (FCA). The background check assessment will consider whether a criminal history could reasonably have a direct, adverse impact on the job-related safety, security, trust, regulatory compliance, or suitability for this role. Such findings may result in withdrawal of a conditional job offer.

  • Cloud Data Engineer

    5 days ago

    Minneapolis, Minnesota, United States Innova Solutions Full time

    Job Summary:Innova Solutions is seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on cloud platforms such as AWS, Azure, or GCP.Key Responsibilities:Design and implement data pipelines using AWS services such as Glue, Redshift,...

  • Sr. Cloud Data Engineer

    4 weeks ago

    Minneapolis, United States AdvantEdge Full time

    Position: Sr. Cloud Data EngineerLocation: Minneapolis, MNDuration: 6 Months to ExtendJob Type: Contract Work Type: Hybrid Weekly thrice onsitePay Rate: $63.00/h to $65.00/h Job Summary: As a Cloud Data Engineer, you will play a crucial role in the client organization, in processing and analysing IoT data from our connected products to drive value for our...

  • Sr. Cloud Data Engineer

    4 weeks ago

    Minneapolis, United States AdvantEdge Full time

    Position: Sr. Cloud Data EngineerLocation: Minneapolis, MNDuration: 6 Months to ExtendJob Type: Contract Work Type: Hybrid Weekly thrice onsitePay Rate: $63.00/h to $65.00/h Job Summary: As a Cloud Data Engineer, you will play a crucial role in the client organization, in processing and analysing IoT data from our connected products to drive value for our...

  • Sr. Cloud Data Engineer

    4 weeks ago

    Minneapolis, United States TekWissen LLC Full time

    Job DescriptionJob DescriptionOverview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client is a company that specializes in global climate technologies. It operates in the Climate segment that delivers energy efficient products and energy services. The company offers the client and American...

  • Cloud Data Engineer

    3 weeks ago

    Minneapolis, United States Entegee Full time

    W2 Contract Onsite in Minneapolis, MN Sr Cloud Data Engineer 55-60/HR Keys: **BSCS & 8+ years of AWS**Building Data Pipelines**SQL (read/write), ELT/ETL, data lineage, data pipeline building**Experience with Glue, Redshift, Lambda or Kinesis**Python- Writing and maintaining scripts- writing for data processing.50% building new data pipelines, 30% revisiting...

  • Cloud FinOps Engineer

    2 months ago

    Minneapolis, United States ACL Digital Full time

    Title:: Senior Cloud EngineerLocation:: Minneapolis, MN (Hybrid role, 3x days onsite/week) Type of Hire:: Contract (c2c/w2)Duration:: 12 months with possible extension Qualifications:• 2+ years of proven experience as a FinOps engineer, or as a software engineer with significant cost optimizations projects• 4+ years of experience working with AWS cloud...

  • Senior Cloud Engineer

    2 months ago

    Minneapolis, Minnesota, United States Horizontal Talent Full time

    Our client is seeking a dedicated Senior Cloud Engineer to join their dynamic team. This role is ideal for a professional with a strong background in FinOps engineering or software engineering, with a focus on cost optimization projects. Key Responsibilities: Manage data and processes in thirdparty and internally developed cost management tools Investigate...

  • Senior Data Engineer

    5 days ago

    Minneapolis, Minnesota, United States IDeaS Full time

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our dynamic team at IDeaS. As a key member of our team, you will play a vital role in building a next-generation data platform with Amazon Web Services (AWS).Key ResponsibilitiesTechnical Ownership: Own the technology selection for ETL/ELT pipelines and define the standards...

  • Cloud Engineer

    1 week ago

    Minneapolis, United States Motion Recruitment Full time

    Job-Senior Cloud Developer Location-Minneapolis, MN (hybrid).Contract Duration: 12 MonthsRequired Skills & ExperienceExperience working with multiple disparate systems.Experience in Cloud Technologies (AWS / Azure / Google).Proficiency with Python, Java, shell scripting (Bash and Poweshell) & SQLExperience working with streaming data and data extraction from...

  • Cloud Engineer

    1 week ago

    Minneapolis, United States Motion Recruitment Full time

    Job-Senior Cloud Developer Location-Minneapolis, MN (hybrid).Contract Duration: 12 MonthsRequired Skills & ExperienceExperience working with multiple disparate systems.Experience in Cloud Technologies (AWS / Azure / Google).Proficiency with Python, Java, shell scripting (Bash and Poweshell) & SQLExperience working with streaming data and data extraction from...

  • Cloud Engineer

    1 week ago

    minneapolis, United States Motion Recruitment Full time

    Job-Senior Cloud Developer Location-Minneapolis, MN (hybrid).Contract Duration: 12 MonthsRequired Skills & ExperienceExperience working with multiple disparate systems.Experience in Cloud Technologies (AWS / Azure / Google).Proficiency with Python, Java, shell scripting (Bash and Poweshell) & SQLExperience working with streaming data and data extraction from...

  • Customer Metrics Engineer

    3 months ago

    Minneapolis, United States Cloud Analytics Technologies LLC Full time

    Work Authorization: US Citizen, Green Card, H-1B, GC-EAD, OPT-EAD, L2-EAD, TN Visa US citizens (USC) and Permanent Residents (GC) are encouraged to apply. We are unable to offer any sort of Visa sponsorship for this position. Local Candidates Preferred. Non-local candidates must be willing to pay for your own interview travel expenses and relocation...

  • Senior Cloud Engineer

    1 month ago

    Minneapolis, United States Motion Recruitment Full time

    Every year, nearly 200 million travelers trust our client to get them where they're going. Take your career to new heights by working for this longstanding leader in air travel that services more worldwide destinations than any other airline. We are looking for a Senior Cloud Engineer to join our team for a 12 month contract in Minneapolis, MN.  Contract...

  • Data Engineer

    3 weeks ago

    Minneapolis, United States SPECTRAFORCE Full time

    Job Title: Sr. Cloud Data EngineerLocation: Minneapolis, MNDuration: 6 monthsNOTE: Only W2Job Summary:As a Cloud Data Engineer, you will play a crucial role in organization, in processing and analyzing IoT data from our connected products to drive value for our customers. You will be responsible for delivering analytical data solutions for both internal and...

  • Senior Cloud Engineer

    1 month ago

    Minneapolis, United States Genesis10 Full time

    Genesis10 is currently seeking a Senior Cloud Engineer with our client in the transportation industry in their Atlanta, GA and Minneapolis, MN locations. This is a 12 month + contract position. Description: Seeking a Senior Cloud Engineer Our client is on a journey to becoming the best IT organization in the airline industry, a journey of...

  • Senior Cloud Engineer

    2 months ago

    Minneapolis, Minnesota, United States Genesis10 Full time

    Genesis10 is currently seeking a Senior Cloud Engineer with our client in the transportation industry in their Atlanta, GA and Minneapolis, MN locations. This is a 12 month + contract position.Description:Seeking a Senior Cloud EngineerOur client is on a journey to becoming the best IT organization in the airline industry, a journey of transformation. They...

  • Cloud Engineer

    4 weeks ago

    Minneapolis, United States Entegee Full time

    MUST WORK ON W-2 NO CORP/CORP Cloud Data Engineer**BSCS Degree 8+ years of AWS**Building Data Pipelines**SQL (read/write), ELT/ETL, data lineage, data pipeline building**Experience with Glue, Redshift, Lambda or Kinesis**Python- Writing and maintaining scripts- writing for data processing.50% building new data pipelines, 30% revisiting existing pipelines...

  • Cloud/Dev Ops Engineer

    1 month ago

    Minneapolis, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Cloud/Dev Ops Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Minneapolis, MN (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-35472Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance...

  • Cloud/Dev Ops Engineer

    2 months ago

    Minneapolis, United States Pyramid Consulting, Inc Full time

    Immediate need for a talented Cloud/Dev Ops Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Minneapolis, MN (Hybrid). Please review the job description below and contact me ASAP if you are interested.Job ID:24-35472Pay Range: $60 - $65/hour. Employee benefits include, but are not limited to, health insurance...

  • Data Engineer III

    2 months ago

    Minneapolis, United States Chewy Full time

    Our Opportunity: We are looking for a Data Engineer III at our facility in Minneapolis, Minnesota, to own/contribute towards data platform on AWS cloud. What You’ll Do:  Contribute towards the architecture and build/maintain infrastructure using Cloud computing technology. Build and maintain scheduling/workflow orchestration applications. Build...