Data Engineer

19 hours ago

Saint Paul, Minnesota, United States Beacon Hill Staffing Group Full time
Job Title: Data Engineer

We are seeking a highly skilled Data Engineer to join our team at Beacon Hill Technologies. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support data-driven decision-making within the organization.

Key Responsibilities:
  • Data Pipeline Development:
    • Design, build, and maintain scalable and reliable data pipelines using Python and SQL.
    • Develop ETL (Extract, Transform, Load) processes to integrate data from various sources into data warehouses and databases.
    • Ensure data quality and consistency across different data sources and systems.
  • Cloud Data Infrastructure:
    • Implement and manage data storage and processing solutions on cloud platforms (e.g., AWS, Azure, Google Cloud).
    • Utilize cloud data services such as BigQuery, Snowflake, Redshift, or similar to store and analyze large datasets.
    • Configure and manage cloud resources for optimal performance and cost-efficiency.
  • Containerization and Orchestration:
    • Deploy and manage data applications and services using Docker and Kubernetes.
    • Develop and maintain Kubernetes manifests, Helm charts, and CI/CD pipelines to automate data workflows.
    • Monitor and troubleshoot containerized applications to ensure high availability and reliability.
  • Performance Optimization:
    • Optimize data processing pipelines for performance and scalability.
    • Tune SQL queries and data storage configurations to handle large volumes of data efficiently.
    • Implement monitoring and logging solutions to track data pipeline performance and identify issues.
  • Collaboration and Communication:
    • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide support.
    • Collaborate with DevOps and infrastructure teams to integrate data solutions with existing systems.
    • Document data processes, workflows, and configurations for transparency and knowledge sharing.
Qualifications:
  • Experience as a Data Engineer or in a similar role with a strong focus on Python, SQL, and cloud technologies.
  • Technical Skills:
    • Proficiency in Python for data engineering tasks, including scripting and automation.
    • Advanced SQL skills for querying and manipulating data.
    • Hands-on experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services.
    • Experience with containerization and orchestration technologies such as Docker and Kubernetes.

We are an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.

  • Data Engineer

    2 weeks ago

    Saint Paul, Minnesota, United States IP Corporation Full time

    {"h1": "Data Engineer", "h2": "Job Description", "p": "At IP Corporation, we are seeking a talented Data Engineer to join our team and help us build robust data solutions that power our business insights. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines that support our data-driven initiatives. You will work...

  • Data Engineer

    3 weeks ago

    Saint Paul, Minnesota, United States IP Corporation Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at IP Corporation. As a Data Engineer, you will play a pivotal role in evolving our data architecture to support data-intensive initiatives and technologies.Key Responsibilities:Design, build, and maintain data pipelines that support our data-driven initiatives.Work...

  • Data Engineer

    3 weeks ago

    Saint Paul, Minnesota, United States ABOUT HEALTHCARE INC Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at ABOUT HEALTHCARE INC. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure, ensuring the accuracy and integrity of our data.Key ResponsibilitiesDesign and implement scalable data models, tables, views, and ETL pipelines...

  • Data Engineer

    19 hours ago

    Saint Paul, Minnesota, United States IP Corporation Full time

    About UsIP Corporation is a leading manufacturer and distributor of composites, leveraging data to drive strategic decisions and enhance operations.Job DescriptionWe are seeking a talented Data Engineer to design, build, and maintain data pipelines that support our data-driven initiatives. As a key member of our team, you will work closely with technical and...

  • Data Solutions Engineer

    1 week ago

    Saint Paul, Minnesota, United States Highmark Health Full time

    Job SummaryThis role is responsible for designing and implementing data solutions for the enterprise, working closely with business, analytic, and IT stakeholders to develop and maintain these solutions. The incumbent will assist with the development and maintenance of data ingestion pipelines, transformations, and delivery programs/logic for people and...

  • Data Engineer II

    5 days ago

    Saint Paul, Minnesota, United States The Travelers Companies, Inc Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at The Travelers Companies, Inc. As a Data Engineer, you will play a key role in designing, building, and deploying data solutions that capture, explore, transform, and utilize data to support Artificial Intelligence, Machine Learning, and business intelligence/insights.Key...

  • Data Engineer II

    2 weeks ago

    Saint Paul, Minnesota, United States 020 Travelers Indemnity Co Full time

    Job Title: Data Engineer IIAt Travelers Indemnity Co, we are seeking a highly skilled Data Engineer II to join our team. As a Data Engineer II, you will play a key role in designing, building, and deploying data solutions that capture, explore, transform, and utilize data to support Artificial Intelligence, Machine Learning, and business...

  • Data Engineer I

    4 weeks ago

    Saint Paul, Minnesota, United States 020 Travelers Indemnity Co Full time

    About UsAt Travelers Indemnity Co, we're committed to delivering exceptional products and services to our customers. Our team is dedicated to innovation and collaboration, and we're looking for talented individuals to join us in our mission.Job SummaryWe're seeking a skilled Data Engineer to join our team. As a Data Engineer, you'll play a key role in...

  • Data Engineer I

    3 weeks ago

    Saint Paul, Minnesota, United States 020 Travelers Indemnity Co Full time

    Job Title: Data Engineer IAt Travelers Indemnity Co, we are seeking a highly skilled Data Engineer I to join our team. As a Data Engineer, you will play a key role in growing and transforming our analytics landscape.Job SummaryWe are looking for a talented Data Engineer to design, build, and deploy data solutions using cloud-based compute and warehouse...

  • Data Engineer

    3 weeks ago

    Saint Paul, Minnesota, United States General Motors Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Marketing Applied Sciences team at General Motors. As a Data Engineer, you will play a critical role in building analytical data sets in support of Advanced Analytics projects.Key ResponsibilitiesCollaborate with internal and external stakeholders to deliver on the portfolio.Drive the...

  • Data Engineering Director

    3 weeks ago

    Saint Paul, Minnesota, United States Travelers Full time

    Travelers Data Engineering TeamWe are seeking a highly skilled Data Engineering Director to join our team at Travelers. As a key member of our organization, you will play a critical role in accelerating the growth and transformation of our analytics landscape.Key ResponsibilitiesLead the development of analytic data products, including pilots and proof of...

  • Data Engineering Director

    1 month ago

    Saint Paul, Minnesota, United States Travelers Full time

    About the RoleWe are seeking a highly skilled Data Engineering Director to join our team at Travelers. As a key member of our organization, you will play a critical role in accelerating the growth and transformation of our analytics landscape.Key ResponsibilitiesLead the development of analytic data products, including pilots and proof of concepts.Execute...

  • Cloud Data Engineering Technical Lead

    53 minutes ago

    Saint Paul, Minnesota, United States Beacon Hill Staffing Group Full time

    Job Title: Cloud Data Engineering Technical LeadWe are seeking a skilled and experienced Technical Lead to oversee our cloud and data engineering projects.Key Responsibilities:Lead and mentor a team of engineers in the development and implementation of cloud-based data engineering solutions.Provide technical guidance and support in areas including cloud...

  • Data Architect

    2 weeks ago

    Saint Paul, Minnesota, United States Randstad Full time

    Job Title: Data Engineer/ArchitectWe are seeking a highly skilled and motivated Data Engineer to own our organization's data impact and architecture. This individual will play a pivotal role in designing, implementing, and maintaining robust data management systems and processes.Key Responsibilities:Implement and execute performance tuning strategies to...

  • Data Modeler

    2 weeks ago

    Saint Paul, Minnesota, United States Stride Full time

    Data Modeler Job DescriptionStride is seeking a skilled Data Modeler to join our team. As a Data Modeler, you will be responsible for designing, executing, and maintaining data models to support the development of AI data domains.Key Responsibilities:Design and create data models and relational databases using GitHub, DBT, and Snowflake.Collaborate with...

  • Data Modeler

    19 hours ago

    Saint Paul, Minnesota, United States Ecolab Full time

    Transformative Data Modeler Role at EcolabEcolab, a global sustainability leader, is seeking a skilled Data Modeler to join our innovative One Customer project. As a key member of our data engineering team, you will design and implement scalable and efficient data models within the Snowflake cloud data platform.Your expertise will contribute to optimizing...

  • Project Manager

    3 weeks ago

    Saint Paul, Minnesota, United States Tate, Inc. Full time

    Data Center Project ManagerTate, a global provider of innovative raised access flooring, structural ceilings, and modular prefabricated aisle containment systems, is seeking a skilled Data Center Project Manager to join our team in Russell County, Virginia.We're looking for a professional with a strong background in project management, who can help us...

  • Project Manager

    4 weeks ago

    Saint Paul, Minnesota, United States Tate, Inc. Full time

    About the RoleWe are seeking a highly skilled Project Manager to join our team at Tate, Inc. in Russell County, Virginia. As a Project Manager, you will be responsible for coordinating, implementing, and controlling data center projects from post-sales to completion.Key ResponsibilitiesDefine project scope, goals, and deliverables, involving all relevant...

  • Lead OT Systems Engineer

    4 weeks ago

    Saint Paul, Minnesota, United States 3M Full time

    Job Title: Lead OT Systems Engineer3M is seeking a highly skilled Lead OT Systems Engineer to join our team. As a key member of our organization, you will be responsible for providing technical leadership and expertise in the development and execution of sensing, data acquisition, and visualization technical strategies.Key Responsibilities:Provide technical...

  • Civil Engineer I

    3 hours ago

    Saint Paul, Minnesota, United States KLJ Full time

    Job Summary:The Civil Engineer I at KLJ will provide technical assistance for the design, development, and construction of transportation infrastructure projects. This role involves assisting with research, design, concept development, and construction of transportation engineering projects, as well as generating accurate documentation.This position requires...