Big Data Pipelines Expert

2 days ago


Minneapolis, Minnesota, United States Eateam Full time
About the Role: Eateam is seeking a seasoned Data Engineer to lead the development of complex data pipelines in the Azure cloud. As a Sr. Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Azure Data Factory and Azure Databricks, automating data quality tests using Great Expectations, and collaborating with cross-functional teams to drive business growth.

The ideal candidate will have a strong background in cloud technologies, including Azure, Snowflake, SQL Server, and GitHub. You will also be expected to develop and maintain technical documentation using Confluence and contribute to the development of data-driven solutions that meet business requirements.

Key Skills and Qualifications:
  • 5+ years of experience in data engineering with a focus on cloud technologies.
  • Expertise in Azure Data Factory, Azure Databricks, and Great Expectations.
  • Familiarity with Terraform or other Infrastructure as Code software.
  • Strong understanding of data quality and data governance principles.

  • Big Data Expert

    2 weeks ago


    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Big Data ConsultantLocation: RemoteDuration: ContractMandatory Skills:Good Knowledge on Basic Big Data - Hive, SQL etcGood Knowledge on Spark - Scala or PySpark; Should be Hands-onGood Unix knowledge - Should be able to work with Shell scripts with easeBasic Cloud skills in at least one environment - AWS or GCP or Azure (Azure preferable)Job...


  • Minneapolis, Minnesota, United States Saxon Global Full time

    Job Description: Big Data Platform ArchitectWe are looking for a talented Big Data Platform Architect to lead the design and implementation of our company's big data platform. This is a senior-level position that requires a deep understanding of big data technologies and experience in leading large-scale data engineering projects.Responsibilities:Lead the...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is seeking a skilled Cloud Big Data Tech Lead to lead our team in designing, implementing, and maintaining large-scale cloud-based data engineering solutions.The ideal candidate will have hands-on experience with Pyspark, Spark SQL programming, and expertise in Azure services such as ADLS Gen2, AZ copy, Synapse, Kubernetes,...


  • Minneapolis, Minnesota, United States SysMind Tech Full time

    About the RoleWe are seeking an experienced Data Architect to lead our cloud data pipelines initiatives. As a key member of our team, you will be responsible for designing and developing scalable data pipelines using approved AWS technologies and services.Key ResponsibilitiesDesigning and implementing data pipelines using cloud-native services such as...


  • Minneapolis, Minnesota, United States Simplicity Group Holdings Full time

    Job OverviewThis role is a crucial part of our data engineering team, responsible for designing and maintaining scalable data pipelines to drive business decisions.We are seeking an experienced Data Engineer to join our team in Minneapolis, MN. The ideal candidate will have hands-on experience with cloud platforms like AWS and Azure, as well as proficiency...


  • Minneapolis, Minnesota, United States DataDrive Full time

    Job OverviewWe are seeking a talented Cloud Data Pipeline Architect to join our team at DataDrive, a fast-growing managed analytics service provider.

  • Data Engineer

    3 weeks ago


    Minneapolis, Minnesota, United States Entegee Full time

    **Job Summary**Design, develop, and deploy scalable data pipelines and data products in a cloud-based data warehouse environment using industry-leading technologies from Google Cloud Platform.**Key Responsibilities**Develop and execute comprehensive test cases for data pipelines and data products.Collaborate with cross-functional teams to ensure quality and...


  • Minneapolis, Minnesota, United States Tekfortune Inc Full time

    Job Details:Estimated Salary: $135,000/yearLocation: Remote (Work from Home)Duration: 6-12 Months ContractIn this role, you will be responsible for automating build/deploy pipelines for all components of our product, migrating from managing artifacts in GitHub to Artifactory, and deploying artifacts from Artifactory. To succeed in this position, you will...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    About Futran Tech Solutions Pvt. Ltd.Futran Tech Solutions Pvt. Ltd. is a leading provider of technology solutions, and we are seeking a seasoned Data Engineer to join our team in Minneapolis, MN. This role requires a minimum of 10 years of experience in big data skills and expertise in Apache Spark Scala development. The successful candidate will have...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Cloud Engineering Lead for Big Data IntegrationWe are seeking an experienced Cloud Engineering Lead to join our team at Futran Tech Solutions Pvt. Ltd. The ideal candidate will have hands-on experience in designing, implementing, and managing big data integration solutions using Azure and Apache Spark.The estimated salary for this role is...


  • Minneapolis, Minnesota, United States Scout Exchange Full time

    About Scout ExchangeScout Exchange is a leading organization in the industry, committed to delivering exceptional results.Salary and BenefitsWe offer a competitive salary range of $120,000 - $160,000 per year, depending on experience. Our benefits package includes comprehensive health insurance, retirement plan matching, and generous paid time off.Job...


  • Minneapolis, Minnesota, United States Saxon Global Full time

    Job Title: Senior Data Solutions EngineerDescription:We are seeking a highly skilled Senior Data Solutions Engineer to join our team at Saxon Global. As a key member of our data engineering team, you will design, build and operate high-performance data-centric solutions utilizing the comprehensive big data capabilities for our company's data platform...


  • Minneapolis, Minnesota, United States Eateam Full time

    Job Description: We are looking for an experienced Data Engineer to join our team at Eateam. As a Sr. Data Engineer, you will play a key role in designing and implementing data pipelines that drive business growth. Your primary responsibilities will include developing scalable data pipelines using Azure Data Factory and Azure Databricks, implementing data...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Description:Azure Data Engineer at Futran Tech Solutions Pvt. Ltd.About Us:Futran Tech Solutions Pvt. Ltd. is a leading provider of innovative data solutions, and we are currently seeking an experienced Azure Data Engineer to join our team.Key Responsibilities:Design and build complex data ingestion pipelines using ADF.Create efficient data processing...


  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    At Diverse Lynx LLC, we are committed to providing a fair and competitive compensation package to our employees.About the JobWe are seeking a highly skilled ETL Pipeline Developer to join our team. As a key member of our data integration team, you will be responsible for designing and maintaining ETL pipelines using Informatica PC/IDMC.Key...

  • Health Data Expert

    2 days ago


    Minneapolis, Minnesota, United States University of Minnesota Full time

    **Job Summary:**The University of Minnesota is seeking a full-time experienced data analyst to support multiple projects in the field of natural language processing (NLP), clinical artificial intelligence (AI), machine learning (ML), and statistics. The successful candidate will closely work with the faculty and team members on cutting-edge research projects...


  • Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    Futran Tech Solutions Pvt. Ltd. is seeking a highly skilled Data Engineer to join their team in Minneapolis, MN. This role requires at least 10 years of experience in big data skills and expertise in Apache Spark Scala development. The ideal candidate will have strong SQL concepts, Unix skills, and experience with ETL tools like Data Stage and Spark/Scala....


  • Minneapolis, Minnesota, United States Omni Inclusive Full time

    We are looking for a skilled Senior Data Engineer to join our team at Omni Inclusive. This role offers a competitive salary range of $220,000 - $280,000 per year and comes with various benefits.About the RoleThe successful candidate will have extensive experience in designing and implementing large-scale data engineering solutions using Azure services.Main...


  • Minneapolis, Minnesota, United States Diverse Lynx Full time

    We are an Equal Employment Opportunity employer and welcome applications from diverse candidates.Job DescriptionAs an Informatica PC Expert, you will be responsible for designing and implementing ETL pipelines using Informatica PC/IDMC.Key Responsibilities:Design and develop ETL pipelines for efficient data integration.Maintain and optimize existing ETL...

  • Master Data Architect

    3 weeks ago


    Minneapolis, Minnesota, United States Omni Inclusive Full time

    Job Summary:We're seeking an accomplished Senior Data Engineer to enhance our dynamic team. The ideal candidate will possess a strong background in developing and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB. This role involves coaching data engineers on topics like Azure Databricks, optimizing data...