Lead Data Engineer

1 week ago

Montvale, United States Orion Innovation Full time

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Lead Data Engineer

A large-scale project that would process 100s TB of ERP data and other relevant data. Auditors would use this processed information to opine on the client engagements and provide value-added services to their clients. The project currently uses Azure data technologies and Databricks.

About the Job: We are looking for an experienced professional with at least 6+ years of hands-on experience with Databricks technology.

What Candidates Will Do:

  • Design, build, and manage scalable data architectures using Databricks and Azure data technologies.
  • Architect and implement modern data lakehouse solutions, ensuring seamless data integration, storage, and processing.
  • Collaborate with cross-functional teams to gather and translate business requirements into effective technical designs.
  • Ensure data quality and governance practices are implemented throughout the data lifecycle.
  • Optimize data workflows for performance, reliability, and security using Azure Synapse, Data Factory, and Databricks.
  • Develop and enforce best practices in data modeling, pipeline design, and storage architecture.
  • Conduct regular assessments of data systems to identify and address performance bottlenecks or areas for improvement.
Must-Have:
  • 10+ Years of total IT experience in Data engineering and Data warehouse project development.
  • 6+ years of hands-on experience with Azure Databricks and expertise in PySpark & Python development.
  • Proven expertise in designing and managing scalable data architectures.
  • 6+ years' experience with Azure Synapse, Data Factory, and other Azure data technologies.
  • 8+ years' experience in data modeling,
  • 6+ Years experience with Data pipelines design and implementation, and cloud storage architecture.
  • Deep understanding of data quality and governance practices, and hands-on with Data quality and governance using Unity catalog or azure purview.
  • Ability to collaborate with cross-functional teams and translate business requirements into technical designs.
Nice-to-Have:
  • Familiarity with other modern data processing tools and technologies.
  • Previous experience in a similar role working with large-scale data systems.
Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, "Orion," "we" or "us") are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) ("Notice") explains:
  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.

  • Lead Data Engineer

    1 week ago

    Montvale, United States Orion Innovation Full time

    Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • Lead Data Engineer

    1 week ago

    Montvale, United States Orion Innovation Full time

    Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • Highly Skilled Data Engineering Professional

    2 days ago

    Montvale, New Jersey, United States EmpiRx Health Full time

    Job DescriptionCompany Overview: EmpiRx Health is a leading clinically-driven pharmacy benefits management company that prioritizes member care and health outcomes. With our innovative AI-powered pharmacy care platform, ClinicallyTM, we provide tailored strategies for clients and deliver high-quality pharmacy care.Estimated Salary: $120,000 - $180,000 per...

  • Data Engineer

    1 week ago

    Montvale, United States Diverse Lynx Full time

    Data Analysis - Able to participate in business discussions and assist rchitect with gathering data requirements. Good analytical and problem-solving skills to help address data challenges.Advanced SQL Skills - Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and...

  • Data Engineer

    1 week ago

    Montvale, United States Diverse Lynx Full time

    Data Analysis - Able to participate in business discussions and assist rchitect with gathering data requirements. Good analytical and problem-solving skills to help address data challenges.Advanced SQL Skills - Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and...

  • Software Engineer

    7 days ago

    Montvale, New Jersey, United States The Computer Merchant, LTD. Full time

    The Computer Merchant, LTD. is seeking a highly skilled Software Engineer to join our team.SalaryExpected salary for this position is $62.50 per hour, based on national averages for similar positions in Montvale NJ.Job DescriptionWe are looking for a talented engineer who can design, develop, and test software applications according to computer engineering...

  • Data Scientist

    6 days ago

    Montvale, New Jersey, United States Diverse Lynx Full time

    Data EngineerAbout the RoleDiverse Lynx seeks a highly skilled Data Engineer to join our team. The ideal candidate will have advanced SQL skills and experience with Azure Data Factory. They will participate in business discussions and collaborate with architects to gather data requirements.Key ResponsibilitiesDevelop complex SQL queries for data extraction,...

  • Data Security Engineer

    3 days ago

    Montvale, United States Consumer Products Company Full time

    Job DescriptionJob DescriptionMy client needs you! If you have experience in data loss prevention software such as Microsoft Percview and Varonis, security of data loss prevention a relevant degree and 4 plus years of experience, let me know.My client is growing and needs your expertise. Great company, benefits and future growth. 

  • AI Solution Lead/Architect

    1 week ago

    Montvale, United States Orion Innovation Full time

    Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries...

  • Developer - Cloud / Big Data

    2 weeks ago

    Montvale, United States The Computer Merchant, LTD. Full time

    JOB TITLE: Developer-Cloud/Big Data JOB LOCATION: Montvale NJ WAGE RANGE*: 55-60 JOB NUMBER: 34199398 REQUIRED EXPERIENCE:Experience preferred in cloud/big data environment. Experience with SQL and non-SQL environments (Spark preferred). Understanding of Object Oriented Design, Design Patterns, Service Oriented, Microservices, and Containers. Expert...

  • Senior .NET Software Engineer

    5 days ago

    Montvale, New Jersey, United States Motion Recruitment Full time

    **Job Title:** Senior .NET Software EngineerMotion Recruitment is seeking a highly skilled Senior Dotnet Developer to join our team in a contract-to-hire position, working 2 days a week in Montvale, NJ.**Estimated Salary:** $130,000 - $190,000 per yearJob DescriptionWe are looking for a seasoned professional with extensive experience in .NET development,...

  • Senior Mechanical Engineer

    1 week ago

    Montvale, United States PENTAX Medical Full time

    Position: Senior Mechanical EngineerLocation:Montvale, NJJob Id: 07262024# of Openings: 1About PENTAX Medical Our mission is to improve the standard of patient care and quality of healthcare delivery by providing the best endoscopic products and services with a focus on QUALITY, CLINICALLY RELEVANT INNOVATION, and SIMPLICITY. Through leading edge R&D and...

  • SQL Database Engineer

    6 days ago

    Montvale, New Jersey, United States KPMG Full time

    Job Summary:KPMG is currently seeking an experienced SQL Database Developer to join our Tax Ignition Team. As a key member of our team, you will be responsible for designing databases and schemas tailored to corporate needs, ensuring they operate efficiently and securely.Responsibilities:Design databases and schemas tailored to corporate needs and ensure...

  • Senior Cloud Software Engineer

    6 days ago

    Montvale, New Jersey, United States The Computer Merchant, LTD. Full time

    Job DescriptionWe are seeking a skilled Sr. Cloud Software Engineer to join our team at The Computer Merchant, LTD.About the Role:Coding, testing and debugging programs according to computer engineering specificationsModifying, expanding and updating applicationsCommunicating with a team that includes analysts, engineers and quality assurance testers in...

  • AI Solutions Architect: Strategic Innovator

    6 days ago

    Montvale, New Jersey, United States Orion Innovation Full time

    Job DescriptionWe are seeking a highly skilled AI Architect to join our dynamic IT innovation department at Orion Innovation. The ideal candidate will drive the integration of AI capabilities across our IT systems, transforming business processes using artificial intelligence and Azure cloud technologies.About UsOrion Innovation is a premier, award-winning...

  • Chemistry Expert Lead for Product Development and Quality Assurance

    7 days ago

    Montvale, New Jersey, United States Joulé Full time

    **Job Overview**Joulé is seeking a highly experienced Chemistry Expert to lead our product development and quality assurance team. As Senior R&D Manager, you will be responsible for directing the development of products in various industries, including healthcare, medical devices, and consumer goods.**Key Responsibilities**Lead a team of scientists and...

  • Software Engineering Manager C#.net SQL Server+PowerBI Healthcare Apps

    3 weeks ago

    Montvale, United States Hospital Network with Accreditation and Stability Full time

    Job DescriptionJob DescriptionNewly Created Role with a Stable value added Essential Industry Type Firm.Bright and Collaborative Team New and Interesting Projects.Company History of using the best available technology to improve real-world outcomes.Desired Skills/Experience:Experience working in a similar Department Manager and Key Go-To-Person role for web...

  • Digital Marketing Solutions Manager

    7 days ago

    Montvale, New Jersey, United States NYLON Search - Recruitment and Executive Search Full time

    NYLON Search - Recruitment and Executive Search is seeking a Digital Marketing Solutions Manager to join our team. In this role, you will be responsible for leading digital media and marketing technology product innovation projects/initiatives, with a focus on enhancing the digital marketing capabilities across our SEO/Search, Social Media, and Programmatic...

  • .NET Software Developer

    1 week ago

    Montvale, United States Motion Recruitment Full time

    Montvale, NJ based client is seeking a .NET Developer for a contract, hybrid role.Contract Duration: 10 Months Required Skills & Experience Experience preferred in cloud/big data environment. Experience with SQL and non-SQL environments (Spark preferred). Understanding of Object Oriented Design, Design Patterns, Service Oriented, Microservices, and...

  • SAP BODS Consultant

    4 days ago

    Montvale, United States Amtex Systems Inc. Full time

    SAP BODS Production Support Administrator cum DeveloperClient: Benjamin Moore3 days a week onsite in Montvale, NJDescription The SAP BODS Consultant is responsible for keeping the SAP BODS system running smoothly and building and supporting data integration solutions. They should have experience with SAP HANA modeling, which involves creating and managing...