Data Engineer

4 weeks ago

Minneapolis, United States SPECTRAFORCE Full time

Job Title: Sr. Cloud Data Engineer

Location: Minneapolis, MN

Duration: 6 months


NOTE: Only W2


Job Summary:

As a Cloud Data Engineer, you will play a crucial role in organization, in processing and analyzing IoT data from our connected products to drive value for our customers. You will be responsible for delivering analytical data solutions for both internal and external customers. The Cloud Data Engineer plays an active role in designing, developing, deploying, and monitoring data pipelines as part of our connected product solution. The ideal candidate will have a strong background in data pipelines, data warehouses, data streaming, data quality, databases, and other business intelligence patterns and tooling.


Responsibilities:

Develop and implement strategies for processing and analyzing large volumes of IoT data, ensuring scalability and performance.

Design, develop, and maintain streaming and batch data pipelines in our AWS cloud environment

Participate in the planning and prioritization of development tasks, ensuring efficient use of resources and timely delivery of projects

Collaborate with data analysts and data scientists to understand their data requirements and develop solutions to meet their needs.

Optimize and tune data pipelines for performance and scalability.

Develop and maintain monitoring and alerting solutions to ensure data quality and availability.

Collaborate with our Platform team to ensure data analytics infrastructure is secure, reliable, and highly available.

Continuously research and evaluate new tools and technologies to improve data processing and analytics capabilities.

Conduct code reviews to ensure adherence to coding standards and best practices.

Capture and document data lineage, metadata, and data dictionaries to ensure comprehensive data governance.


Key Competencies:

Advanced knowledge of cloud technologies and services, specifically around Amazon Web Services (AWS) Data Analytics tools (ex: Glue, Redshift, Lambda, Kinesis)

Broad understanding of data engineering methodologies and tools, including data warehousing, DevOps/DataOps, data ingestion, ELT/ETL, and data visualization tools

Knowledge of database management systems, data modeling, and data warehousing best practices

Strong coding skills in languages such as Pyspark, Scala, and SQL

Experience in data streaming technologies such as Kafka, Kinesis, or Pub/Sub

Experience in handling unstructured streaming data is highly desired

Experience in software development on a team using Agile methodology

Knowledge of Business Intelligence Dimensional Modelling, Star Schemas, Slowly Changing Dimensions

Knowledge of DevOps tools and techniques (Ex: CI/CD, Azure DevOps, etc.)

Knowledge of data governance and security practices


Qualifications

Bachelor’s degree in computer science, Information Technology, or a related field.

8+ years’ experience with cloud data and analytics platforms such as AWS, Azure, or GCP

5+ years of experience working with data & analytics concepts such as SQL, ETL, ELT, reporting and report building, data visualization, data lineage, data importing & exporting, and data warehousing

3+ years of experience working with general IT concepts such as integrations, encryption, authentication & authorization, batch processing, real-time processing, CI/CD, automation

About Us

Established in 2004, SPECTRAFORCE® is one of the largest and fastest-growing diversity-owned staffing firms in the US. The growth of our company is a direct result of our global client service delivery model that is powered by our state-of-the-art A.I. proprietary talent acquisition platform, robust ISO 9001:2015/ISO 27001 certified processes, and strong and passionate client engaged teams. We have built our business by providing talent and project-based solutions, including Contingent, Permanent, and Statement of Work (SOW) services to over 140 clients in the US, Canada, Puerto Rico, Costa Rica, and India. Key industries that we service include Technology, Financial Services, Life Sciences, Healthcare, Telecom, Retail, Utilities and Transportation. SPECTRAFORCE® is built on a concept of “human connection,” defined by our branding attitude of NEWJOBPHORIA®, which is the excitement of bringing joy and freedom to the work lifestyle so our people and clients can reach their highest potential.

Learn more at:

Benefits

SPECTRAFORCE® offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE® provides unpaid leave as well as paid sick leave when required by law.

SPECTRAFORCE® is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.

  • Data Center Technician

    2 weeks ago

    Minneapolis, United States Atomic Data Full time

    Job DescriptionJob DescriptionData Center TechnicianDepartments:  Infrastructure Engineering      Reports to: Manager of Infrastructure EngineeringCareer Path: Infrastructure Engineer IJob SummaryThe Data Center Technician is responsible for the operation, implementation, and maintenance work in a data center and/ or Atomic Data facility. The position...

  • Data Center Technician

    7 days ago

    Minneapolis, United States Atomic Data Full time

    Job DescriptionJob DescriptionData Center TechnicianDepartments:  Infrastructure Engineering      Reports to: Manager of Infrastructure EngineeringCareer Path: Infrastructure Engineer IJob SummaryThe Data Center Technician is responsible for the operation, implementation, and maintenance work in a data center and/ or Atomic Data facility. The position...

  • Manager of Infrastructure Engineering

    2 weeks ago

    Minneapolis, United States Atomic Data Full time

    Job DescriptionJob DescriptionManager of Infrastructure EngineeringDepartment: Infrastructure EngineeringReports to:  Director of EngineeringJob SummaryThe Manager of Infrastructure Engineering is responsible for developing, leading, and motivating a team of Datacenter, and Infrastructure Engineers to deliver excellent technical/non-technical support with...

  • Data Engineer

    2 months ago

    Minneapolis, United States Mortenson Construction Full time

    ABOUT MORTENSON As a Top 25 builder, developer, and EPC, our expertise spans markets like sports, renewable energy, data centers, healthcare, and more. We are builders at heart, working to ensure the built environment has a lasting positive impact. Let's Redefine Possible SUMMARY As a member of the Data Solutions team, you will contribute to developing...

  • Professional Services Engineer II

    6 days ago

    Minneapolis, United States Atomic Data Full time

    Job DescriptionJob DescriptionProfessional Services Engineer IIDepartment: Professional Services EngineeringReports to: Manager of Professional ServicesDepartment Growth Path: Professional Services Engineer IIIJob SummaryThe Professional Services Engineer II is responsible for maintaining on-premises and cloud applications, servers, storage, and network...

  • Data Engineer

    4 weeks ago

    Minneapolis, United States Artius Solutions Full time

    Job DescriptionJob DescriptionJob Title: Data EngineerEmployment Type: Long-Term Contract (1+ Year)Primary Skillset: Big Data Engineering with Spark and ScalaSecondary Skillset: JavaExperience Level: Senior EngineerJob Overview:We are seeking a highly skilled Data Engineer to join the Client's Digital Analytics platform team. This role is ideal for a...

  • Data Engineer

    5 months ago

    Minneapolis, Minnesota, United States Constellation Full time

    About UsCuri is a full-service advisory firm that serves physicians and medical practices. Equal parts fierce physician advocates, smart business leaders, and thoughtful partners, Curi's advisory, capital, and insurance offerings deliver valued advice that is grounded in client priorities and elevated by their outcomes. From data-driven advisory services to...

  • Data Engineer

    5 months ago

    Minneapolis, United States Constellation Full time

    Description About Us Curi is a full-service advisory firm that serves physicians and medical practices. Equal parts fierce physician advocates, smart business leaders, and thoughtful partners, Curi's advisory, capital, and insurance offerings deliver valued advice that is grounded in client priorities and elevated by their outcomes. From data-driven advisory...

  • Data Engineer

    3 days ago

    Minneapolis, United States Delta System and Software Inc. Full time

    Role: Data Engineer Location: Onsite in Minneapolis MN (relocation is acceptable) 3 year contract Job Description: must be a consultant type of resource managing client project owner key business stakeholders technical handson technical expertise in the order of below preference: PowerBI Power Platform Data engineering. Snowflake Oracle SQL Airflow...

  • Data Software Engineer

    1 week ago

    Minneapolis, United States IRIS Consulting Corporation Full time

    We are seeking a talented and experienced Data Software Engineer to join our dynamic team in Minneapolis. This hybrid role offers the flexibility of both remote and on-site work. As a Data Software Engineer, you will be responsible for building, maintaining, and optimizing our data infrastructure, with a strong emphasis on data modeling, data pipelines, and...

  • Data Software Engineer

    1 week ago

    Minneapolis, United States IRIS Consulting Corporation Full time

    We are seeking a talented and experienced Data Software Engineer to join our dynamic team in Minneapolis. This hybrid role offers the flexibility of both remote and on-site work. As a Data Software Engineer, you will be responsible for building, maintaining, and optimizing our data infrastructure, with a strong emphasis on data modeling, data pipelines, and...

  • Data Engineering Manager

    2 weeks ago

    Minneapolis, United States DataSite Full time

    Datasite is where deals are made. We provide the data rooms and SaaS technology used in M&A and other high-value transactions, to deliver projects in more than 170 countries. Carrying that success into the future is all about you. Your useful skills, your unusual experience, your unique ideas. Everyone here brings something unexpected. What's yours? Invest...

  • Infrastructure Engineer III

    4 days ago

    Minneapolis, Minnesota, United States Atomic Data Full time

    Job DescriptionJob SummaryThe Infrastructure Engineer III is a critical role within Atomic Data's IT team, responsible for the operation, implementation, and maintenance of our existing service provider network. This individual will work on a team performing both new customer activations, customer network architecture design and integration.Key...

  • Senior Data Engineer

    1 month ago

    Minneapolis, Minnesota, United States CliftonLarsonAllen Full time

    CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and...

  • Data Engineer III

    2 months ago

    Minneapolis, Minnesota, United States Chewy Full time

    Our Opportunity:Chewy's Merch Analytics Team is looking for a Senior Data Engineer (Data Engingeer III), to join the pack. In this role, you will leverage your extensive expertise in data engineering will be integral in building and maintaining high-quality data pipelines that enable development of insights, data visualization, models and other analytical...

  • Cloud Data Engineer

    6 days ago

    Minneapolis, Minnesota, United States Innova Solutions Full time

    Job Summary:Innova Solutions is seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on cloud platforms such as AWS, Azure, or GCP.Key Responsibilities:Design and implement data pipelines using AWS services such as Glue, Redshift,...

  • Data & Software Engineer

    7 hours ago

    Minneapolis, United States Luminous Talent Full time

    We are seeking a Data & Software Engineer for a Permanent, Direct Hire position for a dynamic company in Minneapolis. The client approach and culture is super creative, smart, and fun. In person connection is valued so this is a hybrid position with the expectation of 2-3 days/week in office. Sorry, no sponsorship is available and no C2C as this is direct...

  • Data Engineer II

    1 week ago

    Minneapolis, United States Chewy Full time

    Our Opportunity: We are looking for a Data Engineer II at our facility in Minneapolis, Minnesota, to work as the member of the Pethealth Prescription Platform team. What You’ll Do:  Participate in system and data tier architecture, performance tuning and help with database development of performance-critical SQL code and data storage configuration...

  • Senior Data Governance Engineer

    4 weeks ago

    Minneapolis, United States ITR Group Full time

    Senior Data Governance Engineer / Data ModelerMust be Local to MinnesotaHybrid schedule 3 days a week on-siteUS Citizen or GC onlyOverview: We are seeking a Senior Data Governance Engineer / Data Modeler to join our team, where you will be instrumental in shaping our data architecture and driving data modeling best practices. This role involves technical...

  • Data Engineer III

    2 months ago

    Minneapolis, United States Chewy Full time

    Our Opportunity: We are looking for a Data Engineer III at our facility in Minneapolis, Minnesota, to own/contribute towards data platform on AWS cloud. What You’ll Do:  Contribute towards the architecture and build/maintain infrastructure using Cloud computing technology. Build and maintain scheduling/workflow orchestration applications. Build...