Data Engineer

19 hours ago

Frankfort, Kentucky, United States Beacon Hill Staffing Group Full time
Job Summary

The Data Engineer will design, develop, and maintain data pipelines and infrastructure to support data-driven decision-making within the organization.

This role requires strong proficiency in Python, SQL, cloud technologies, and Kubernetes to ensure the efficient processing, storage, and retrieval of data.

Key Responsibilities
  • Data Pipeline Development:
    • Design, build, and maintain scalable and reliable data pipelines using Python and SQL.
    • Develop ETL processes to integrate data from various sources into data warehouses and databases.
    • Ensure data quality and consistency across different data sources and systems.
  • Cloud Data Infrastructure:
    • Implement and manage data storage and processing solutions on cloud platforms (e.g., AWS, Azure, Google Cloud).
    • Utilize cloud data services such as BigQuery, Snowflake, Redshift, or similar to store and analyze large datasets.
    • Configure and manage cloud resources for optimal performance and cost-efficiency.
  • Containerization and Orchestration:
    • Deploy and manage data applications and services using Docker and Kubernetes.
    • Develop and maintain Kubernetes manifests, Helm charts, and CI/CD pipelines to automate data workflows.
    • Monitor and troubleshoot containerized applications to ensure high availability and reliability.
  • Performance Optimization:
    • Optimize data processing pipelines for performance and scalability.
    • Tune SQL queries and data storage configurations to handle large volumes of data efficiently.
    • Implement monitoring and logging solutions to track data pipeline performance and identify issues.
  • Collaboration and Communication:
    • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide support.
    • Collaborate with DevOps and infrastructure teams to integrate data solutions with existing systems.
    • Document data processes, workflows, and configurations for transparency and knowledge sharing.
Qualifications
  • Experience:
    • Experience as a Data Engineer or in a similar role with a strong focus on Python, SQL, and cloud technologies.
  • Technical Skills:
    • Proficiency in Python for data engineering tasks, including scripting and automation.
    • Advanced SQL skills for querying and manipulating data.
    • Hands-on experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services.
    • Experience with containerization and orchestration technologies such as Docker and Kubernetes.
About Beacon Hill

Beacon Hill Technologies is a premier National Information Technology Staffing Group, providing world-class technology talent across all industries utilizing a complete suite of staffing services.

Our dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.

We cover a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support, and ERP roles.

  • Data Engineer 2

    3 days ago

    Frankfort, Kentucky, United States Humana Full time

    About the RoleWe are seeking a highly skilled Data Engineer 2 to join our team at Humana. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining data processing architectures and solutions that enable the efficient conversion of structured and unstructured data to insights at enterprise scale.Key...

  • Data Engineer 2

    6 hours ago

    Frankfort, Kentucky, United States Humana Full time

    About the RoleWe are seeking a highly skilled Data Engineer 2 to join our team at Humana. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining data processing architectures and solutions that enable the efficient conversion of structured and unstructured data to insights at enterprise scale.Key...

  • Health Data Architect

    3 weeks ago

    Frankfort, Kentucky, United States Oracle Full time

    About the RoleWe are seeking a highly skilled Health Data Architect to join our team at Oracle. As a key member of our software engineering organization, you will play a critical role in shaping the future of our Healthcare Data Analytics platform.Key ResponsibilitiesCollaborate with software engineering, product management, and customer success teams to...

  • Senior Software Engineer

    2 weeks ago

    Frankfort, Kentucky, United States Oracle Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Oracle, focusing on the development of high-performance data-planes for our Cloud Infrastructure. As a key member of our engineering team, you will be responsible for designing and implementing innovative solutions to optimize data-plane performance, scalability, and...

  • Data Architect

    1 week ago

    Frankfort, Kentucky, United States Oracle Full time

    Job DescriptionThe Oracle Cloud Infrastructure Compute team is seeking a highly skilled and experienced Data Architect to lead the design and implementation of scalable data solutions. As a key member of the team, you will be responsible for architecting, designing, and driving the implementation of complex data pipelines and databases, evolving existing...

  • Cloud Healthcare Data Architect

    3 weeks ago

    Frankfort, Kentucky, United States Oracle Full time

    About the RoleWe are seeking a highly skilled Health Data Architect to join our team at Oracle. As a key member of our cloud solutions team, you will play a critical role in shaping the future of healthcare data analytics.Key ResponsibilitiesCollaborate with software engineering, product management, and customer success organizations to develop technologies...

  • Principal Thermal Engineer

    3 hours ago

    Frankfort, Kentucky, United States Oracle Full time

    Job DescriptionAs a Principal Thermal Engineer at Oracle, you will play a key role in aligning thermal hardware design with data center physical infrastructure. This position requires a mix of technical breadth and depth to work cross-functionally with various disciplines, including Mechanical, Electrical, Thermal, and Software, to develop thermal solutions...

  • Solution and Data Architect

    2 weeks ago

    Frankfort, Kentucky, United States Marriott Full time

    About the RoleWe are seeking a highly skilled and experienced Solution and Data Architect to join our Global Technology - Enterprise Architecture team at Marriott International.This is a unique opportunity to work on a cutting-edge Loyalty platform, driving innovation and business growth. As a key member of our team, you will be responsible for defining,...

  • Senior Software Developer

    2 weeks ago

    Frankfort, Kentucky, United States Oracle Full time

    About the RoleWe are seeking a highly skilled Senior Software Developer to join our team at Oracle, where you will play a critical role in shaping the future of our cloud infrastructure. As a key member of our software engineering division, you will be responsible for designing and developing innovative solutions for our customers.Key ResponsibilitiesDesign...

  • Advanced Systems Security Engineer

    4 weeks ago

    Frankfort, Kentucky, United States Management Recruiters of Raleigh Full time

    We are currently seeking a highly skilled System Protection Engineer to join our esteemed client, a leader in their industry.This role demands a seasoned engineer with extensive technical knowledge and the capability to represent the organization in various public and corporate environments.Key Responsibilities:Generate comprehensive reports addressing...

  • Staff Systems Engineer

    3 days ago

    Frankfort, Kentucky, United States HealthEdge Full time

    Job Title: Staff Systems EngineerAt HealthEdge, we're seeking a highly skilled Staff Systems Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, maintaining, and adjusting our technical platforms to ensure maximum uptime, performance, and compliance.Key Responsibilities:Design and implement...

  • Transportation Engineer Specialist

    2 weeks ago

    Frankfort, Kentucky, United States Kentucky Personnel Cabinet Full time

    Job SummaryWe are seeking a highly skilled Transportation Engineer Specialist to join our team at the Kentucky Transportation Cabinet. As a key member of our Department of Highways/Office of Project Delivery & Preservation/Operations & Pavement Management, you will play a critical role in analyzing data to evaluate maintenance performance, pavement...

  • Senior Environmental Engineer

    4 weeks ago

    Frankfort, Kentucky, United States Weaver Consultants Group Full time

    Job OverviewLocationFrankfort, KYEmployment TypeFull TimePosition SummarySenior Environmental EngineerWeaver Consultants Group is seeking a Senior Environmental Engineer with 0 to 3 years of experience, passionate about environmental and civil engineering. This role focuses on the design, implementation, construction, monitoring, assessment, regulatory...

  • Software Engineer Intern

    2 days ago

    Frankfort, Kentucky, United States Oracle Full time

    Job DescriptionOracle is seeking highly skilled and motivated individuals to join our Database Technologies organization as Software Engineer Interns. This is an exciting opportunity to work on cutting-edge technologies and contribute to the development of our industry-leading database products.About the RoleAs a Software Engineer Intern, you will be...

  • Cloud Security Engineer

    2 weeks ago

    Frankfort, Kentucky, United States Public Consulting Group Full time

    About the RoleWe are seeking a highly skilled Cloud Security Engineer to join our team at Public Consulting Group. As a Cloud Security Engineer, you will play a critical role in safeguarding our organization's information, brand, digital assets, and people.Key ResponsibilitiesSecurity Architecture Review and Design: Evaluate existing cloud-based security...

  • Staff Systems Engineer

    6 days ago

    Frankfort, Kentucky, United States HealthEdge Full time

    Job SummaryWe are seeking a highly skilled Staff Systems Engineer to join our team at HealthEdge. As a key member of our engineering team, you will be responsible for designing, maintaining, and adjusting our technical platforms to ensure maximum uptime, performance, and compliance.Key ResponsibilitiesDesign and implement infrastructure platform strategies...

  • 3D Graphics Web Engineer

    6 days ago

    Frankfort, Kentucky, United States General Motors Full time

    Job DescriptionWe are seeking two highly experienced engineers to join our team as 3D Graphics Web Engineers. As a key member of our engineering team, you will be responsible for building visualization platforms to power all General Motors digital products and marketing needs.Key ResponsibilitiesDevelop high-quality software using our core web technologies...

  • Structural Design Engineer I

    1 week ago

    Frankfort, Kentucky, United States Calloway & Associates, Inc Full time

    About the RoleCalloway & Associates, Inc. is seeking a highly skilled Structural Design Engineer I to join our team in Frankfort, KY. As a key member of our engineering team, you will be responsible for designing and developing structural systems for highway structures, including bridges, culverts, and retaining walls.Key ResponsibilitiesPerform technical...

  • Environmental Field Engineer

    4 weeks ago

    Frankfort, Kentucky, United States Weaver Consultants Group Full time

    Position OverviewLevelEntry LevelLocationFrankfort, KYEmployment TypeFull-TimeJob CategoryEngineeringWeaver Consultants Group is seeking a dedicated Field Engineer to engage in the installation, construction, monitoring, evaluation, regulatory compliance, design, and maintenance of environmental control and monitoring systems. This role focuses on various...

  • Site Monitoring Engineer

    4 weeks ago

    Frankfort, Kentucky, United States Weaver Consultants Group Full time

    Position OverviewLevelEntry LevelJob LocationFrankfort, KYEmployment TypeFull-TimeJob CategoryEngineeringWeaver Consultants Group is seeking a dedicated Field Engineer to engage in the installation, construction, oversight, evaluation, regulatory adherence, design, and maintenance of environmental control and monitoring systems for various sites including...