Senior Data Engineer

1 week ago

Minneapolis, United States Omni Inclusive Full time

Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing, and delivering scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB. This role will involve coaching data engineers technically on topics like Azure databricks, optimizing data workflows, and collaborating with internal teams on various aspects.Responsibilities:1. Develop, and implement scalable data pipelines using Azure Databricks and Azure Data Lake.2. Create and maintain ETL workflows to ensure data quality, integrity, and availability.3. Optimize Azure Cosmos DB schemas and queries for high performance and cost-efficiency.4. Demonstrated ability to manage and analyze data at scale within the Azure ecosystem.5. Coach junior data engineers on technologies like Azure databricks, Azure Cosmos database so the candidate should be proficient in such topics with greater amount of hands-on experience. 6. Implement CICD pipelines using Azure DevOps to streamline deployment processes.7. Conduct code reviews, provide mentorship, and facilitate knowledge sharing sessions within the team.8. Integrate data from various sources into a centralized data lake, enabling unified access and analysis.9. Perform data cleansing, transformation, and migration tasks as required.10. Monitor and troubleshoot data pipelines and resolve any issues promptly.Requirements:1. Bachelor s or Master s degree in Computer Science, Information Technology, or a related field.2. 7+ years of experience in data engineering or related roles.3. 5+ years of experience in Azure Databricks, Azure Data Lake, and Azure Cosmos DB proven track record of building data engineering solutions4. Proficient in programming languages such as Python, SQL, and Scala.5. Experience with big data technologies including Apache Spark, Hadoop, and Hive.6. Hands-on experience with cloud platforms, particularly Microsoft Azure.7. Proficiency in ETL processes, data warehousing, and data modeling.8. Proficient in using Azure Cosmos DB for graph-based data analysis.9. Knowledge of tools and technologies such as Azure Data Factory, Azure Synapse Analytics, and Apache Kafka.10. Solid understanding of CICD pipelines and hands-on experience with DevOps tools such as Git for continuous integration and deployment.11. Excellent problem-solving skills and the ability to troubleshoot complex data issues.12. Strong coaching abilities, Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.Preferred Qualifications:Microsoft Certified: Azure Data Engineer Associate.Databricks Certified Associate Developer for Apache Spark.Experience with data governance and data security practices.Knowledge of Docker and Kubernetes for containerization and orchestration. (1.) To be responsible for providing technical guidance to a team of developers, enhancing their technical capabilities and increasing productivity. (2.) To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure succeful delivery of complex projects. (3.) To ensure process compliance in the assigned module, and participate in technical discussionsorreview as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations). (4.) To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure and closure of escalations.

  • Senior Data Engineer

    1 week ago

    Minneapolis, United States National Marrow Donor Program Full time

    Please apply online using a laptop or desktop computer.POSITION SUMMARY:The Senior Data Engineer is accountable for supporting the strategy, execution, and support of NMDP programs and business intelligence solutions. A Senior Data Engineer is a technical thought leader with an eye for how to apply BI capabilities to empower the organization to be data...

  • Senior Data Engineer

    1 week ago

    Minneapolis, United States JobRialto Full time

    Job Summary The Senior Data Engineer will play a key role in designing, developing, and maintaining scalable data pipelines and data warehouse solutions to support business intelligence and analytics needs. Collaborating closely with cross-functional teams, the engineer will focus on integrating data from various systems, optimizing reporting processes, and...

  • Senior Data Solutions Engineer

    6 days ago

    Minneapolis, Minnesota, United States Goli Tech Full time

    Job OverviewWe are seeking an experienced Senior Data Solutions Engineer to join our team at Goli Tech. This role will be responsible for designing, developing, and implementing scalable data pipelines for reporting teams from the data warehouse to our Business Intelligence tool.Key ResponsibilitiesArchitect all phases of software engineering including...

  • Senior IT Manager – Data Engineering

    2 months ago

    Minneapolis, United States Experis Full time

    Senior IT Manager - Data Engineering Location: · Minneapolis, MN (Hybrid) The Senior Manager of Data Engineering is responsible for day-to-day technical management and delivery of assigned functions, projects, or programs, data infrastructure and pipelines for a key financial system. The senior manager will also lead Technology Modernization, Capability...

  • Senior Data Architect

    6 days ago

    Minneapolis, Minnesota, United States Levi Ray & Shoup Inc Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Levi Ray & Shoup Inc.The successful candidate will be responsible for designing, developing, and maintaining our data infrastructure.Key Responsibilities:Lead the design and implementation of scalable data architectures and pipelines.Oversee data...

  • Senior Data Engineer

    4 weeks ago

    Minneapolis, United States Talent Groups Full time

    Job Description:We are looking for a highly skilled Lead Developer with expertise in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to design and manage robust ETL pipelines and data processing solutions for AI/ML initiatives. This role will be critical in building and optimizing data workflows, leveraging Azure cloud technologies,...

  • Senior Data Engineer

    4 weeks ago

    minneapolis, United States Talent Groups Full time

    Job Description:We are looking for a highly skilled Lead Developer with expertise in Python, Apache Spark, Azure Synapse, and Azure Data Engineering services to design and manage robust ETL pipelines and data processing solutions for AI/ML initiatives. This role will be critical in building and optimizing data workflows, leveraging Azure cloud technologies,...

  • Sr. Data Engineer

    2 months ago

    Minneapolis, United States On-Demand Group Full time

    On-Demand Group is currently seeking for a Senior Data Engineer for a 6-months contract engagement to start.Title: Senior Data EngineerDuration: 6-months contract to hire Location: RemoteJob SummaryThe Senior Data Engineer plays a key role in designing, building, and maintaining data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery....

  • Sr. Data Engineer

    1 month ago

    minneapolis, United States On-Demand Group Full time

    On-Demand Group is currently seeking for a Senior Data Engineer for a 6-months contract engagement to start.Title: Senior Data EngineerDuration: 6-months contract to hire Location: RemoteJob SummaryThe Senior Data Engineer plays a key role in designing, building, and maintaining data pipelines and infrastructure using Google Cloud Platform (GCP) BigQuery....

  • Senior Data Engineer

    2 days ago

    Minneapolis, Minnesota, United States Associated Bank National Full time

    About the Role:Associated Bank National seeks an experienced and skilled Senior Snowflake Engineer to join our team. As a key member of our data infrastructure team, you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Key Responsibilities:Design and develop streaming and batch ingestion methods and...

  • Senior Data Engineer

    1 week ago

    Minneapolis, United States Futran Tech Solutions Pvt. Ltd. Full time

    Role Data EngineerLocation Minneapolis, Minnesota, United States (Onsite)Roles & QualificationsTechnical: T-SQL / SQL, SSIS, Data anlaysis, health industry, ETL tools ( TWS, Informatica, etc), GitHub, Data Bricks, Data wherehouse,TFS, Soft Sklls:Good communicator, able to work with business parnters, familiar with Agile prodcut development, Inforamatica...

  • Data Engineering Manager

    1 week ago

    Minneapolis, United States DataSite Full time

    Datasite is where deals are made. We provide the data rooms and SaaS technology used in M&A and other high-value transactions, to deliver projects in more than 170 countries. Carrying that success into the future is all about you. Your useful skills, your unusual experience, your unique ideas. Everyone here brings something unexpected. What's yours? Invest...

  • Senior Data Engineer

    5 days ago

    Minneapolis, United States Allianz Full time

    At Allianz Life, we are guided by our mission - we secure your future - and by our common goal of caring for tomorrow. We care for our employees by promoting an inclusive culture where everyone has the opportunity to grow and be rewarded for their success. We care for our customers by creating new products that help them protect their families and pursue...

  • Senior Data Systems Architect

    6 days ago

    Minneapolis, Minnesota, United States Simplicity Group Holdings Full time

    Job Summary:We are seeking a skilled Senior Data Systems Architect to join our team at Simplicity Group Holdings. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support our business operations.About the Role:The Senior Data Systems Architect will...

  • Data Engineering Expert for Healthcare Solutions

    6 days ago

    Minneapolis, Minnesota, United States Futran Tech Solutions Pvt. Ltd. Full time

    We are seeking a highly skilled Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in Minneapolis, Minnesota. As a key member of our data engineering team, you will play a critical role in designing and developing scalable data pipelines using various ETL tools.The successful candidate will have extensive experience with T-SQL/SQL, SSIS, data...

  • Manager of Infrastructure Engineering

    3 weeks ago

    Minneapolis, United States Atomic Data Full time

    Manager of Infrastructure Engineering Department: Infrastructure Engineering Reports to: Director of Engineering Job Summary The Manager of Infrastructure Engineering is responsible for developing, leading, and motivating a team of Datacenter, and Infrastructure Engineers to deliver excellent technical/non-technical support with outstanding customer...

  • Senior Snowflake Engineer

    1 week ago

    Minneapolis, United States Associated Bank National Full time

    At Associated Bank we strive to create an inclusive culture where different perspectives are valued and recognized as strengths critical to our success. If you thrive in an environment where your growth and development are encouraged and supported, then Associated Bank may be the right place for you. The Data Engineer Senior will have a strong background in...

  • Data Engineer

    6 months ago

    Minneapolis, United States Saxon Global Full time

    Client: Cargill Job Title: Data Engineer Duration: 5/31/2024 Location: Remote Job Description: The Data Engineer III will design, build and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform environment. In this role, you will act as an authority for data access pathways...

  • Data Engineer

    3 weeks ago

    Minneapolis, United States Brooksource Full time

    Title: Data Engineer Location: Minneapolis, MN3-Month ContractAbout the Role Brooksource is seeking a skilled Data Engineer to support our client in delivering comprehensive technology solutions within the healthcare sector. This role is ideal for candidates with a strong background in data engineering and expertise in healthcare data management,...

  • Senior Data Architect

    1 week ago

    Minneapolis, United States National Marrow Donor Program Full time

    Please apply online using a laptop or desktop computer.POSITION SUMMARY:The Senior Application Development Data Architect is responsible for the data architecture solutions on various projects that support the organization in achieving its strategic goals. The architecture will cover data at rest stored in the databases, data in flight used for operational...