Data Engineer Level 3

3 weeks ago

Blue Ash, United States Aditi Consulting Full time
Payrate: $75 - $80/hr.

Summary:
As an Advanced Data Engineer, you will have the opportunity to lead the development of innovative data solutions, enabling the effective use of data across the organization. You will be responsible for designing, building, and maintaining robust data pipelines and platforms to meet business objectives, focusing on data as a strategic asset. Your role will involve collaboration with cross-functional teams, leveraging cutting-edge technologies, and ensuring scalable, efficient, and secure data engineering practices. A strong emphasis will be placed on expertise in GCP, Vertex AI, and advanced feature engineering techniques.

Key Responsibilities:
  • Provide Technical Leadership: Offer technical leadership to ensure clarity between ongoing projects and facilitate collaboration across teams to solve complex data engineering challenges.
  • Build and Maintain Data Pipelines: Design, build, and maintain scalable, efficient, and reliable data pipelines to support data ingestion, transformation, and integration across diverse sources and destinations, using tools such as Kafka, Databricks, and similar toolsets.
  • Drive Digital Innovation: Leverage innovative technologies and approaches to modernize and extend core data assets, including SQL-based, NoSQL-based, cloud-based, and real-time streaming data platforms.
  • Implement Feature Engineering: Develop and manage feature engineering pipelines for machine learning workflows, utilizing tools like Vertex AI, BigQuery ML, and custom Python libraries.
  • Implement Automated Testing: Design and implement automated unit, integration, and performance testing frameworks to ensure data quality, reliability, and compliance with organizational standards.
  • Optimize Data Workflows: Optimize data workflows for performance, cost efficiency, and scalability across large datasets and complex environments.
  • Mentor Team Members: Mentor team members in data principles, patterns, processes, and practices to promote best practices and improve team capabilities.
  • Draft and Review Documentation: Draft and review architectural diagrams, interface specifications, and other design documents to ensure clear communication of data solutions and technical requirements.
  • Cost/Benefit Analysis: Present opportunities with cost/benefit analysis to leadership, guiding sound architectural decisions for scalable and efficient data solutions.

Requirements:
  • 4+ years of professional Data Development experience.
  • 4+ years of experience with SQL and NoSQL technologies.
  • 3+ years of experience building and maintaining data pipelines and workflows.
  • 5+ years of experience developing with Java.
  • 2+ years of experience developing with Python.
  • 3+ years of experience developing Kafka solutions.
  • 2+ years of experience in feature engineering for machine learning pipelines.
  • Experience with GCP services such as BigQuery, Vertex AI Platform, Cloud Storage, AutoMLOps, and Dataflow.
  • Experience with CI/CD pipelines and processes.
  • Experience with automated unit, integration, and performance testing.
  • Experience with version control software such as Git.
  • Full understanding of ETL and Data Warehousing concepts.
  • Strong understanding of Agile principles (Scrum).

Additional Qualifications:
  • Knowledge of Structured Streaming (Spark, Kafka, EventHub, or similar technologies).
  • Experience with GitHub SaaS/GitHub Actions.
  • Experience understanding Databricks concepts.
  • Experience with PySpark and Spark development.

Compensation:
The pay rate range above is the base hourly pay range that Aditi Consulting reasonably expects to pay someone for this position (compensation may vary outside of this range depending on several factors, including but not limited to, a candidate's qualifications, skills, competencies, experience, location and end client requirements).

Benefits and Ancillaries:
Medical, dental, vision, PTO benefits and ancillaries may be available for eligible Aditi Consulting employees and vary based on the plan options selected by the employee.

Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions.

#AditiConsulting

  • Data Engineer Level 3

    7 days ago

    Blue Ash, United States LeadStack Inc. Full time

    Job Description LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the...

  • Data Engineer Level 3 Specialist

    4 weeks ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    LeadStack Inc. OverviewLeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in...

  • Quality Engineer Level 3

    2 months ago

    Blue Ash, United States Omega Solutions Inc Full time

    7+ years of QA experience 3+ years of experience testing mobile applications. Experience with QA processes and deliverables in an Agile/Scrum environment Proficient in defect tracking and analyzing root cause utilizing tools (Jira, Rally etc.) Strong understanding of automation and performance concepts and approaches Understand and utilize risk-based testing...

  • Data Scientist Level 2

    2 months ago

    Blue Ash, United States Experis Full time

    Our Retail domain client is seeking a Data Scientist to join their team. As a Data Scientist you will be part of the client supporting Team. The ideal candidate will have skills Machine Learning (ML) /Data Scientist OR Data Scientist, Python & Cloud (Azure) which will align successfully in the organization. Job Title: Data Scientist Location: Hybrid from...

  • Engineer Level 2

    1 week ago

    Blue Ash, United States LeadStack Inc. Full time

    Hello Lead Stack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world....

  • Data Architect and AI Engineer

    4 weeks ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    Job Title: Data Architect and AI EngineerAre you a seasoned professional with a passion for designing and implementing scalable cloud-based solution architectures? Do you have experience working with machine learning frameworks, data structures, and software architecture? LeadStack Inc., an award-winning and certified minority-owned staffing services...

  • Senior Data Engineer on W2

    2 months ago

    Blue Ash, United States ACL Digital Full time

    Job Title: Data Engineer Location: Blue Ash, OH, 45242, USAJob Duration: 6 Month(s) – contract to hireThey will be working a hybrid schedule, in the office 2-3 day/week.Soft Skills Needed - Self-starter, good communicator, willing to take ownership Project person will be supporting - SeamlessTeam details i.e. size, dynamics, locations - Majority of this...

  • Data Scientist/ ML Engineer

    1 week ago

    Blue Ash, United States LeadStack Inc. Full time

    LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world. Job...

  • Data Engineer

    2 months ago

    Blue Ash, United States Tata Consultancy Services Full time

    Job Description6+ plus years of experience in solutioning data pipeline for large enterprise data Warehouse applications using Azure Data Factory, Data bricks, Data Ingestion, Data Transformation /Computation, Orchestration, Reporting & Data AnalyticsKnowledge of Azure Services such as ADF, Databricks, Event Hub, Delta Lake, Data LakeStrong command on...

  • CoStrategix | Data Validation Engineer | blue ash, oh

    1 month ago

    blue ash, United States CoStrategix Full time

    SummaryWe are seeking an experienced Data Quality Assurance Professional to join our dynamic team. The ideal candidate will be responsible for ensuring the accuracy, consistency, and reliability of our organization's data assets. As a Data Quality Assurance Professional, you will play a critical role in developing and implementing data quality standards,...

  • Developer Level 3

    2 months ago

    Blue Ash, United States Aditi Consulting Full time

    Summary: We are seeking a Sr. Developer who need to join our dynamic and fast-paced team. The ideal candidate should excel in front-end development, particularly with React, and possess a good back-end development experience. The successful candidate will play a critical role in leading the development and design of Traceability solutions, maintaining high...

  • Cloud Data Architect

    3 weeks ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    Job Title:Cloud Data Architect About the Role:We are seeking a skilled Cloud Data Architect to join our team at LeadStack Inc. As a Cloud Data Architect, you will play a critical role in designing and implementing scalable cloud-based solution architectures that meet the needs of our clients. Responsibilities:Collaborate with solution architects, data...

  • ACL Digital | Senior Data Engineer on W2 | blue ash, oh

    2 months ago

    blue ash, United States ACL Digital Full time

    Job Title: Data Engineer Location: Blue Ash, OH, 45242, USAJob Duration: 6 Month(s) – contract to hireThey will be working a hybrid schedule, in the office 2-3 day/week.Soft Skills Needed - Self-starter, good communicator, willing to take ownership Project person will be supporting - SeamlessTeam details i.e. size, dynamics, locations - Majority of this...

  • Data Engineer

    2 months ago

    Blue Ash, United States Tata Consultancy Services Full time

    Job Description6+ plus years of experience in solutioning data pipeline for large enterprise data Warehouse applications using Azure Data Factory, Data bricks, Data Ingestion, Data Transformation /Computation, Orchestration, Reporting & Data AnalyticsKnowledge of Azure Services such as ADF, Databricks, Event Hub, Delta Lake, Data LakeStrong command on...

  • Fulfillment Services Data Strategist

    3 weeks ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    Job Summary:Fulfillment Services Data Strategist Needed at LeadStack Inc. About the Company:LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. We partner with some of the most admired Fortune 500 brands in the world. Key Responsibilities:This role will...

  • Tata Consultancy Services | Data Engineer

    4 weeks ago

    blue ash, United States Tata Consultancy Services Full time

    Job Description6+ plus years of experience in solutioning data pipeline for large enterprise data Warehouse applications using Azure Data Factory, Data bricks, Data Ingestion, Data Transformation /Computation, Orchestration, Reporting & Data AnalyticsKnowledge of Azure Services such as ADF, Databricks, Event Hub, Delta Lake, Data LakeStrong command on...

  • Data Scientist Expert

    3 weeks ago

    Blue Ash, Ohio, United States Eliassen Group Full time

    Overview\Eliassen Group is a leading strategic consulting company providing human-powered solutions. For over 30 years, the company has helped thousands of companies achieve more with their technology solutions, financial, risk & compliance, and clinical solutions.\\Salary\$57 - $67 per hour\\Job Description\As a Data Scientist at Eliassen Group, you will...

  • Strategic Data Specialist

    1 month ago

    Blue Ash, Ohio, United States LeadStack Inc. Full time

    Fulfillment Services Data Strategist PositionLeadStack Inc. is a leading provider of contingent workforce solutions, partnering with top Fortune 500 brands.As a Fulfillment Services Data Strategist, you will collaborate with our team to design and implement a robust data strategy for our Fulfillment Services Platform. Your expertise in machine learning,...

  • Eliassen Group | Data Scientist | blue ash, oh

    2 months ago

    blue ash, United States Eliassen Group Full time

    You will join an innovative, distributed Software Delivery team within the US's largest grocery retailer with a scale that reaches millions of people every day. Our teams are truly agile and empowered to own all aspects of their domain comprehensively. We encourage a culture of quality software practices and respect for the human spirit. We are committed to...

  • Eliassen Group | Data Scientist | blue ash, oh

    2 months ago

    blue ash, United States Eliassen Group Full time

    You will join an innovative, distributed Software Delivery team within the US's largest grocery retailer with a scale that reaches millions of people every day. Our teams are truly agile and empowered to own all aspects of their domain comprehensively. We encourage a culture of quality software practices and respect for the human spirit. We are committed to...