Data Engineer

6 days ago

Cincinnati, Ohio, United States Compunnel Full time
Job Title: Databricks Engineer

Compunnel is seeking a highly skilled Databricks Engineer to join our team. As a Databricks Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines using Databricks to process and transform large volumes of data.

Responsibilities:
  • Design and develop data pipelines using Databricks to process and transform large volumes of data.
  • Implement ETL processes to integrate data from various sources into Databricks, ensuring data quality and integrity.
  • Integrate Databricks with other data storage solutions and data lakes, ensuring seamless data flow and accessibility.
  • Optimize data processing and query performance within Databricks to ensure efficient data retrieval and processing.
  • Utilize Databricks to perform complex data analysis and create visualizations to support data-driven decision-making.
  • Collaborate with data scientists and analysts to understand their requirements and provide the necessary infrastructure and tools within Databricks.
  • Ensure that data processing within Databricks complies with organizational security policies and industry regulations, implementing necessary security measures.
  • Monitor data pipelines and workflows for performance issues or errors, and troubleshoot any problems that arise to maintain smooth operations.
  • Manage the creation, configuration, and scaling of Databricks clusters to ensure optimal performance and cost-efficiency.
  • Implement and manage user access controls, ensuring that only authorized personnel have access to Databricks resources.
  • Develop and implement backup and disaster recovery plans for Databricks environments.
Requirements:
  • Hands-on experience with Databricks, including familiarity with its architecture, features, and services.
  • Strong knowledge of Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib.
  • Proficiency in programming languages commonly used in data engineering such as Python, Scala, SQL, and Java.
  • Experience with data warehousing concepts, ETL processes, and tools like Apache Airflow, Talend, or Informatica.
  • Knowledge of relational and NoSQL databases, data modeling, and query optimization.
  • Familiarity with big data technologies and ecosystems, including Hadoop, Hive, and Kafka.
  • Ability to perform complex data analysis and create data visualizations to support business decisions.
  • Strong analytical and problem-solving skills to troubleshoot and resolve issues in data pipelines and workflows.
  • Excellent verbal and written communication skills to collaborate with data scientists, analysts, and other stakeholders.
  • Ability to work effectively in a team environment and contribute to cross-functional projects.
Preferred Qualifications:
  • Certifications such as Databricks Certified Associate Developer for Apache Spark or Databricks Certified Professional Data Scientist.
  • Certifications from cloud providers (e.g., Azure Certified Solutions Architect, Azure Data Engineer).
Education:

Bachelor's degree in Computer Science, Information Technology, or related field.

Compunnel is an equal opportunity employer and welcomes applications from diverse candidates. We offer a competitive salary and benefits package, as well as opportunities for professional growth and development.

  • Azure Data Engineer

    3 weeks ago

    Cincinnati, Ohio, United States Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Azure Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems on the Azure platform.Key ResponsibilitiesData Engineering: Design and develop data pipelines, data...

  • Data Quality Engineer

    2 weeks ago

    Cincinnati, Ohio, United States Saxon Global Full time

    Data Quality Engineer OpportunityWe are seeking a skilled Data Quality Engineer to play a critical role in ensuring the reliability, accuracy, and consistency of data within our warehouse and manufacturing data platform in the Kroger supply chain space.This role requires a blend of data engineering and testing expertise, with a focus on implementing robust...

  • Data Quality Engineer

    2 weeks ago

    Cincinnati, Ohio, United States Saxon Global Full time

    Data Quality Engineer OpportunityWe are seeking a skilled Data Quality Engineer to play a critical role in ensuring the reliability, accuracy, and consistency of data within our warehouse and manufacturing data platform in the Kroger supply chain space.Key Responsibilities:Implement robust test frameworks to validate and verify data pipelines and...

  • Azure Data Engineer

    2 weeks ago

    Cincinnati, Ohio, United States JobRialto Full time

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at JobRialto. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data platforms on Azure.Key Responsibilities:Design and implement data models and architectures for medium to large-sized...

  • Senior Data Engineer

    17 minutes ago

    Cincinnati, Ohio, United States Agility Partners Full time

    About this OpportunityAgility Partners is seeking a skilled Datastage Engineer to collaborate with our Anti-Money Laundering team and contribute to key solutions in a dynamic and agile work environment. As a Datastage Systems Specialist, you will play a critical role in building and optimizing Datastage systems, providing technical leadership, and working...

  • Senior Data Engineer

    4 days ago

    Cincinnati, Ohio, United States Agility Partners Full time

    About this RoleWe are seeking a highly skilled Datastage Engineer to join our team at Agility Partners. As a key member of our Anti-Money Laundering team, you will play a critical role in building and optimizing Datastage systems, providing technical leadership, and collaborating closely with internal teams.Responsibilities:Design, construct, install, test,...

  • Azure Data Engineer

    2 weeks ago

    Cincinnati, Ohio, United States Tata Consultancy Services Full time

    Azure Data Engineer RoleAt Tata Consultancy Services, we are seeking a highly skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data...

  • Azure Data Engineer

    2 weeks ago

    Cincinnati, Ohio, United States InterSources Full time

    Job Title:Azure Data EngineerLocation:Cincinnati, OH (Hybrid)Duration:6 Months Only (C2H)About the Role:We are seeking an experienced Azure Data Engineer to join our team at InterSources Inc. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on Azure.Key...

  • Azure Data Engineer

    7 days ago

    Cincinnati, Ohio, United States InterSources Full time

    Job Title: Cloud Data EngineerLocation: Cincinnati, OH (Hybrid)Duration: 6 Months Only (C2H)Experience: 13+ yearsAbout the Role:We are seeking a highly skilled Cloud Data Engineer to join our team at InterSources Inc. As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data systems on cloud platforms.Key...

  • Senior Data Engineer

    3 weeks ago

    Cincinnati, Ohio, United States Ensemble Health Partners Full time

    About Ensemble Health PartnersWe are a leading provider of technology-enabled revenue cycle management solutions for health systems, including hospitals and affiliated physician groups.The OpportunityWe are seeking a highly skilled Sr Data Engineer to join our team. As a key member of our engineering team, you will be responsible for implementing the...

  • Azure Data Engineer

    2 weeks ago

    Cincinnati, Ohio, United States JobRialto Full time

    Job DescriptionJobRialto is seeking a highly skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data platforms on Azure.Key ResponsibilitiesDesign and implement data models and architectures for medium to large-sized enterprise data...

  • Data Engineer

    16 hours ago

    Cincinnati, Ohio, United States Saxon Global Full time

    Job Title: Data Engineer - Azure ExpertWe are seeking a highly skilled Data Engineer with extensive experience in Azure to join our team at Saxon Global. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure technologies.Key Responsibilities:Design and...

  • SAS Data Engineer

    2 weeks ago

    Cincinnati, Ohio, United States Saxon Global Full time

    About the RoleWe are seeking a highly skilled SAS Data Engineer to join our team at Saxon Global. As a key member of our data engineering team, you will be responsible for designing, developing, and supporting data solutions, APIs, tools, and processes to enable rapid delivery of business capabilities.Key ResponsibilitiesDesign and develop data solutions,...

  • Senior Data Engineer

    2 weeks ago

    Cincinnati, Ohio, United States Ensemble Health Partners Full time

    Job SummaryWe are seeking a highly skilled Sr Data Engineer to join our team at Ensemble Health Partners. As a key member of our engineering team, you will be responsible for implementing the technology strategy for our software delivery teams, with guidance from engineering leadership.Key ResponsibilitiesDevelop, test, deploy, monitor, maintain, and...

  • Azure Data Engineering Lead

    3 weeks ago

    Cincinnati, Ohio, United States LeadStack Inc. Full time

    Job Title: Lead Azure Data EngineerAt LeadStack Inc., we're seeking a highly skilled Lead Azure Data Engineer to join our dynamic team. As a key member of our data engineering team, you will play a critical role in designing and developing innovative data solutions using Azure technologies.Key Responsibilities:Develop and maintain high-quality data pipelines...

  • SAS Data Engineer

    18 hours ago

    Cincinnati, Ohio, United States Saxon Global Full time

    Job Title: SAS Data EngineerJoin Saxon Global as a SAS Data Engineer and be part of a team that converts SAS jobs to Snowflake. As a key member of our team, you will be responsible for production support of existing SAS jobs, troubleshooting, impact analysis, and data mapping. Your expertise in reading existing SAS code and understanding data sources,...

  • Senior Data Engineer

    4 weeks ago

    Cincinnati, Ohio, United States Ensemble Health Partners Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Ensemble Health Partners. As a key member of our engineering team, you will be responsible for implementing the technology strategy for our software delivery teams, with guidance from engineering leadership.Key ResponsibilitiesDevelop, test, deploy, monitor, maintain, and...

  • Data Engineer

    3 weeks ago

    Cincinnati, Ohio, United States Saxon Global Full time

    Job Title: Data Engineer - Azure ExpertWe are seeking a highly skilled Data Engineer with extensive experience in Azure to join our team at Saxon Global. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Azure technologies.Key Responsibilities:Design and...

  • Data Engineer

    4 days ago

    Cincinnati, Ohio, United States Flexton Inc. Full time

    Job Title: Databricks Certified Data EngineerWe are seeking a highly skilled Databricks Certified Data Engineer to join our team at Flexton Inc.Key Responsibilities:Design and implement data pipelines using Databricks and PythonDevelop and maintain ETL processes for scalability, quality, and performanceIdentify and resolve complex technical issues related to...

  • Azure Data Engineer

    4 days ago

    Cincinnati, Ohio, United States Flexton Inc. Full time

    Job Title: Azure Data EngineerLocation: RemoteDuration: 12 months, Contract to HireJob Description:We are seeking a highly skilled Senior Data Engineer to join our dynamic and fast-paced team. The ideal candidate should excel in development and pipeline orchestration, resolving complex connection issues, and solving production problems. The successful...