Compunnel Inc. | Advanced Data Engineer

6 days ago

cincinnati, United States Compunnel Inc. Full time

Job Title:- Advanced Data Engineer

Duration:- 12+ Months Contract

Location:- Hybrid (3 days/week onsite) at Cincinnati, OH


Job Description:


***Note from the hiring manager on the technical skillset here: This is very important to have GCP, BigQuery/BigTable and some understanding of development in Python. Kafka, Java, NoSQL are plusses***


As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will involve collaboration with cross-functional teams, leveraging cutting-edge technologies, and ensuring scalable, efficient, and secure data engineering practices. A strong emphasis will be placed on expertise in GCP, Vertex AI, and advanced feature engineering techniques.



Requirements:

  • 4+ years of professional Data Development experience.
  • 4+ years of experience with SQL and NoSQL technologies.
  • 3+ years of experience building and maintaining data pipelines and workflows.
  • 5+ years of experience developing with Java.
  • 2+ years of experience developing with Python.
  • 3+ years of experience developing Kafka solutions.
  • 2+ years of experience in feature engineering for machine learning pipelines.
  • Experience with GCP services such as BigQuery, Vertex AI Platform, Cloud Storage, AutoMLOps, and Dataflow.
  • Experience with CI/CD pipelines and processes.
  • Experience with automated unit, integration, and performance testing.
  • Experience with version control software such as Git.
  • Full understanding of ETL and Data Warehousing concepts.
  • Strong understanding of Agile principles (Scrum).



Additional Qualifications:

  • Knowledge of Structured Streaming (Spark, Kafka, EventHub, or similar technologies).
  • Experience with GitHub SaaS/GitHub Actions.
  • Experience understanding Databricks concepts.
  • Experience with PySpark and Spark development.


Key Responsibilities:

  • Provide Technical Leadership: Offer technical leadership to ensure clarity between ongoing projects and facilitate collaboration across teams to solve complex data engineering challenges.
  • Build and Maintain Data Pipelines: Design, build, and maintain scalable, efficient, and reliable data pipelines to support data ingestion, transformation, and integration across diverse sources and destinations, using tools such as Kafka, Databricks, and similar toolsets.
  • Drive Digital Innovation: Leverage innovative technologies and approaches to modernize and extend core data assets, including SQL-based, NoSQL-based, cloud-based, and real-time streaming data platforms.
  • Implement Feature Engineering: Develop and manage feature engineering pipelines for machine learning workflows, utilizing tools like Vertex AI, BigQuery ML, and custom Python libraries.
  • Implement Automated Testing: Design and implement automated unit, integration, and performance testing frameworks to ensure data quality, reliability, and compliance with organizational standards.
  • Optimize Data Workflows: Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments.
  • Mentor Team Members: Mentor team members in data principles, patterns, processes, and practices to promote best practices and improve team capabilities.
  • Draft and Review Documentation: Draft and review architectural diagrams, interface specifications, and other design documents to ensure clear communication of data solutions and technical requirements.
  • Cost/Benefit Analysis: Present opportunities with cost/benefit analysis to leadership, guiding sound architectural decisions for scalable and efficient data solutions.

  • Compunnel Inc. | Advanced Data Engineer

    6 days ago

    cincinnati, United States Compunnel Inc. Full time

    Job Title:- Advanced Data EngineerDuration:- 12+ Months ContractLocation:- Hybrid (3 days/week onsite) at Cincinnati, OHJob Description:***Note from the hiring manager on the technical skillset here: This is very important to have GCP, BigQuery/BigTable and some understanding of development in Python. Kafka, Java, NoSQL are plusses***As an Advanced Data...

  • Advanced Data Engineer

    5 days ago

    Cincinnati, United States Compunnel Inc. Full time

    Job Title:- Advanced Data EngineerDuration:- 12+ Months ContractLocation:- Hybrid (3 days/week onsite) at Cincinnati, OHJob Description:***Note from the hiring manager on the technical skillset here: This is very important to have GCP, BigQuery/BigTable and some understanding of development in Python. Kafka, Java, NoSQL are plusses***As an Advanced Data...

  • Advanced Data Engineer

    6 days ago

    Cincinnati, United States Compunnel Inc. Full time

    Job Title:- Advanced Data EngineerDuration:- 12+ Months ContractLocation:- Hybrid (3 days/week onsite) at Cincinnati, OHJob Description:***Note from the hiring manager on the technical skillset here: This is very important to have GCP, BigQuery/BigTable and some understanding of development in Python. Kafka, Java, NoSQL are plusses***As an Advanced Data...

  • Data Engineer | Data Engineer

    3 weeks ago

    cincinnati, United States Data Engineer Full time

    • 6+ years of software product development and delivery experience.• 5+ years of ETL testing/SQL experience.• 3+ years of Informatica Power Center, IDQ, IICS/IDMC experience.• 3+ years’ experience overseeing the development of data test plans, test scenarios, test cases, execution of test case and documentation of test results• 2+ years of...

  • Data Engineer

    3 weeks ago

    Cincinnati, United States Data Engineer Full time

    • 6+ years of software product development and delivery experience.• 5+ years of ETL testing/SQL experience.• 3+ years of Informatica Power Center, IDQ, IICS/IDMC experience.• 3+ years’ experience overseeing the development of data test plans, test scenarios, test cases, execution of test case and documentation of test results• 2+ years of...

  • Flexton Inc. | Senior Data Engineer

    6 days ago

    cincinnati, United States Flexton Inc. Full time

    As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will...

  • Flexton Inc. | Senior Data Engineer

    6 days ago

    cincinnati, United States Flexton Inc. Full time

    As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will...

  • Senior Mobile Software Engineer

    2 weeks ago

    Cincinnati, Ohio, United States Compunnel Full time

    Job Description:We are seeking an experienced Senior Mobile Software Engineer to join our agile squad at Compunnel. As a key member of the team, you will be responsible for implementing new features and ensuring the overall quality of software while working with modern software engineering tools and practices.You will share responsibility and accountability...

  • Data Engineer with Advanced Data Architecture

    7 days ago

    Cincinnati, Ohio, United States eTek IT Services, Inc. Full time

    Job DescriptionWe are seeking a skilled Data Engineer with strong expertise in mortgage banking to join our IT team. As a key member of our data engineering team, you will be responsible for designing, constructing, and maintaining highly scalable data management systems that support data analysis and decision-making processes.Key Responsibilities:Design and...

  • Mobile App Developer for Agile Squad

    1 month ago

    Cincinnati, Ohio, United States Compunnel Full time

    About the RoleWe are seeking a skilled Mobile App Developer to join our agile squad at Compunnel. As a key member of our team, you will be responsible for implementing new features and ensuring the overall quality of our software.Key ResponsibilitiesDesign, develop, and test mobile apps using modern software engineering tools and practices.Contribute to a...

  • Data Engineering Lead

    4 weeks ago

    Cincinnati, Ohio, United States eTek IT Services, Inc. Full time

    Job OvervieweTek IT Services, Inc. is seeking a skilled Data Engineering Lead to join our Data Science team.

  • Senior Data Engineering Specialist

    1 week ago

    Cincinnati, Ohio, United States eTek IT Services, Inc. Full time

    Job OvervieweTek IT Services, Inc. is seeking an experienced Senior Data Engineer to join our team in Cincinnati, OH.Estimated Salary Range:$110,000 - $140,000 per yearJob DescriptionWe are looking for a skilled Data Engineer to design and implement large-scale data pipelines from scratch. The ideal candidate will have expertise in building data domains in...

  • Senior Data Solutions Engineer

    1 month ago

    Cincinnati, Ohio, United States Perfict Global, Inc. Full time

    About Perfict Global, Inc.: A leading IT consulting services provider focused on delivering innovative and successful business workforce solutions to Fortune 500 companies. We offer an excellent compensation package that includes a salary of $125,000 - $170,000 per year, depending on experience, plus medical, dental, vision benefits, and a fun work...

  • Senior Data Engineer

    6 days ago

    Cincinnati, United States Flexton Inc. Full time

    As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will...

  • Senior Data Engineer

    5 days ago

    Cincinnati, United States Flexton Inc. Full time

    As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will...

  • AWS Cloud Data Solutions Engineer

    1 month ago

    Cincinnati, Ohio, United States Indus River Technologies Inc Full time

    Indus River Technologies Inc is seeking a highly skilled AWS Cloud Data Solutions Engineer to join our team.Estimated Salary: $140,000 - $180,000 per yearAbout the Role:We are looking for a talented engineer to lead the development of robust and scalable data solutions on AWS. The ideal candidate will have strong proficiency in standing up and running data...

  • Android Application Developer

    2 weeks ago

    Cincinnati, Ohio, United States Compunnel Full time

    About This Role:We are looking for a skilled Android Application Developer to join our agile squad at Compunnel. The ideal candidate will have experience in designing and developing mobile applications using modern software engineering tools and practices.This role involves implementing new features, ensuring the overall quality of software, and adhering to...

  • Data Engineering Specialist

    2 weeks ago

    Cincinnati, Ohio, United States InterSources Full time

    Job Description:Azure Data Solutions Architect is required for a 6-month project. The successful candidate will have experience in data modeling, advanced SQL techniques, and cloud migration methodologies. They will also be proficient in tools like Databricks, Azure Data Factory, and Azure Functions.Responsibilities:- Develop data models and implement...

  • Headway Tek Inc | Azure Data Engineer

    4 days ago

    cincinnati, United States Headway Tek Inc Full time

    Proficiency in Python, SQL, Databricks, Snowflake Data Modeling, ETL process, Apache Spark and PySpark, data integration and workflow orchestration, real time data processing experience/frameworks, Cloud experience (Azure preferred)Job DescriptionMinimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building...

  • Senior Data Engineer

    2 months ago

    Cincinnati, United States LeadStack Inc. Full time

    LeadStack Inc. is an award-winning, one of the nation’s fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we’re proud to partner with some of the most admired Fortune 500 brands in the world.TITLE:...