Senior Data Engineer

4 weeks ago

Columbus, Ohio, United States BD (Becton, Dickinson and Company) Full time
Job Description Summary

Sr. Data Engineer (Databricks)

Job Description

We are the makers of possible

BD is one of the largest global medical technology companies in the world. Advancing the world of healthTM is our Purpose, and it's no small feat.

It takes the imagination and passion of all of us—from design and engineering to the manufacturing and marketing of our billions of MedTech products per year—to look at the impossible and find transformative solutions that turn dreams into possibilities.

We believe that the human element, across our global teams, is what allows us to continually evolve. Join us and discover an environment in which you'll be supported to learn, grow and become your best self. Become a maker of possible with us.


As an Azure Databricks Developer, you will be responsible for designing, implementing, and optimizing data solutions using Azure Databricks, Azure Data Factory, LogicApp etc.

You will collaborate closely with multi-functional teams to ensure the efficient management, processing, and analysis of large-scale datasets. Your expertise will play a crucial role in enhancing our data-driven decision-making processes. Additionally, you'll take the lead in guiding other developers to deliver high-quality projects end to end.

Responsibilities:
  • Design, develop, and implement scalable data pipelines using Azure Databricks to ingest, transform, and store structured and unstructured data.
  • Analyze, optimize, and tune existing data pipelines for performance, reliability, and efficiency.
  • Collaborate with data scientists, analysts, functional consultant, and other collaborators to understand business requirements and translate them into technical solutions.
  • Provide expertise and guidance in selecting appropriate Azure services and tools to build robust data solutions.
  • Implement security measures and standard processes to ensure data privacy and compliance with regulatory standards.
  • Solve issues related to data processing, performance, and system failures.
  • Stay updated with the latest Azure Databricks features, tools, and best practices and provide recommendations for improvements.
Requirements:
  • Bachelor's degree in computer science or engineering, or equivalent work experience within Data Engineering.
  • Proven experience working with Azure Databricks in large-scale data environments, 6-8 years of experience with Databricks or similar technologies.
  • Must be well versed with Databricks Lakehouse, Unity Catalog concept and its implementation in enterprise environments.
  • Must have strong understanding of Data warehousing and various governance and security standards around Databricks.
  • Prior experience handling ERP data like SAP, JD Edwards and high-level understanding of different functional modules is required.
  • In-depth knowledge of data engineering concepts, ETL processes, and data architecture principles. Strong understanding of cloud computing principles, particularly within the Azure ecosystem.
  • Proficiency in programming languages such as Python /PySpark and query languages like SQL.
  • Experience with Databricks Unity Catalog, Databricks Workflow, Delta Sharing, Auto Loader, Delta Live Table, Overwatch, Databricks Volume etc.
  • Good to have knowledge of RESTful API and its implementation.
  • Experience with data modeling, data warehousing, and working with both structured and unstructured data.
  • Excellent problem-solving skills and the ability to work in a collaborative team environment.
  • Strong communication skills to convey complex technical concepts to non-technical partners.
Preferred Qualifications:
  • Master's Degree or higher
  • 8+ years of rigorous experience developing in Databricks, PySpark, SQL (any flavor)
  • Databricks Data Engineer Associate certification will be preferred.
  • Experience with other Azure services such as Azure SQL Database, Azure Data Lake Storage, LogicApp, Azure Data Factory etc.
  • Knowledge of machine learning and GenAI concepts is an added advantage.

For certain roles at BD, employment is contingent upon the Company's receipt of sufficient proof that you are fully vaccinated against COVID-19.

In some locations, testing for COVID-19 may be available and/or required. Consistent with BD's Workplace Accommodations Policy, requests for accommodation will be considered pursuant to applicable law.

Why Join Us?

A career at BD means being part of a team that values your opinions and contributions and that encourages you to bring your authentic self to work.

It's also a place where we help each other be great, we do what's right, we hold each other accountable, and learn and improve every day.

To find purpose in the possibilities, we need people who can see the bigger picture, who understand the human story that underpins everything we do.

We welcome people with the imagination and drive to help us reinvent the future of health. At BD, you'll discover a culture in which you can learn, grow, and thrive. And find satisfaction in doing your part to make the world a better place.

To learn more about BD visit

Becton, Dickinson and Company is an Equal Opportunity/Affirmative Action Employer.

We do not unlawfully discriminate on the basis of race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, or any other protected status.

#earlycareer

Primary Work Location

USA NJ - Franklin Lakes

Additional Locations

Work Shift

Becton, Dickinson and Company is an Equal Opportunity/Affirmative Action Employer.

We do not unlawfully discriminate on the basis of race, color, religion, age, sex, creed, national origin, ancestry, citizenship status, marital or domestic or civil union status, familial status, affectional or sexual orientation, gender identity or expression, genetics, disability, military eligibility or veteran status, or any other protected status.

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Vaco Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Vaco. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:Design and implement data warehouses and data lakesDevelop and maintain ETL processes and...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Insight Global Full time

    Job SummaryThe Senior Data Engineer is responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. This role collaborates closely with analysts and IT professionals to ensure efficient data modeling, ETL processes, and overall data architecture that supports business needs. The Senior Data Engineer...

  • Senior Data Engineer

    3 weeks ago

    Columbus, Ohio, United States Virtual Full time

    Job Title: Senior Data EngineerJob Summary:Virtual is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have experience with enterprise data warehouse, integrations, and reporting visualizations. This is a direct-hire position with a salary range of $118,000 - $125,000.Key Responsibilities: Heavy on legacy programs, the...

  • Senior Data Engineer

    3 weeks ago

    Columbus, Ohio, United States Zodiac Solutions, Inc Full time

    About Zodiac Solutions, Inc.We are a leading IT recruitment agency connecting talented professionals with exciting opportunities that match their career goals.About the RoleJob Title: Senior Data EngineerLocation: Remote (Columbus, OH preferred)Employment Type: ContractKey Responsibilities:Collaborate with the team to design and implement data platforms and...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Ohio State University Wexner Medical Center Full time

    Job SummaryContribute to the development of strategic data initiatives and serve as a top-level technical expert for complex data and analytics projects. Collaborate with cross-functional teams to align IT solutions with business objectives and drive innovation in data-driven solutions.As a Senior Data Engineer, you will be responsible for designing,...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Virtual Full time

    Job Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Virtual. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our enterprise data warehouse. This is a direct-hire position with a salary range of $118,000 - $125,000.Key Responsibilities:Design and implement ETL...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Pinnacle Group Full time

    Job Summary:As a Senior Data Engineer at Pinnacle Group, you will be responsible for designing and developing data ingestion pipelines using AWS services and Databricks platform. This will enable downstream applications and Tableau Dashboards that drive business value across different parts of Employee Platform functions.Key Responsibilities:- Design and...

  • Senior Civil Infrastructure Design Director at Amazon Data Services

    3 weeks ago

    Columbus, Ohio, United States Amazon Data Services, Inc. Full time

    At Amazon Data Services, Inc., we're on a mission to deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. As a key member of our team, you'll collaborate with people across Amazon to help us achieve this vision.Job SummaryWe're seeking a Senior Civil Infrastructure...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Centraprise Full time

    Job Overview:Centraprise is seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have 14-16 years of experience in big data tools, infrastructure, and related technologies. The successful candidate will be responsible for analyzing and finding impacts of technical changes on migration efforts or business needs, performing...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Hispanic Technology Executive Council Full time

    Job DescriptionWe are the Advanced Technology Centers (ATCs), the engine for reinvention in our clients' transformation journey. With over 255,000 people across 24 countries, we provide seamless access to industry insights and innovative technology solutions.As a Senior Data Engineer, you will be part of a highly collaborative and growing network of...

  • Senior Data Architect

    4 weeks ago

    Columbus, Ohio, United States Revel IT Full time

    Job DescriptionA Senior Data Engineer is needed for a contract-to-hire opportunity with Revel IT. The ideal candidate should have proficiency in data engineering for Azure Data Engineers. Mastery in designing robust, scalable, and secure data solutions on Azure is essential. This includes understanding Azure's data services ecosystem, such as Azure Data...

  • Senior Data Engineer

    3 weeks ago

    Columbus, Ohio, United States altafiber Full time

    Job SummaryThe Data Engineer III role is a technical lead position on the Analytics - Insights team at altafiber. This individual will be responsible for designing, building, and maintaining the CBTS Data Lake, as well as leading the data engineering team to build and maintain critical ETL processes that support the CBTS Data Strategy.Key...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States g2o Full time

    Unlock Your Potential as a Cloud Data EngineerAt g2o, we're on a mission to revolutionize the way our clients interact with their customers. As a Senior Data Engineer, you'll play a crucial role in helping us achieve this vision.Key Responsibilities:Collaborate with our technical team to design, develop, and deploy data engineering jobs and pipelines using...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Hispanic Technology Executive Council Full time

    Unlock the Power of Data with Our TeamWe are the Hispanic Technology Executive Council, and we are seeking a highly skilled Data Engineer to join our team. As a key member of our Advanced Technology Centers, you will play a critical role in helping our clients transform their businesses through innovative data solutions.About the RoleThis is a unique...

  • Senior Data Engineer

    3 weeks ago

    Columbus, Ohio, United States Worldpay Full time

    Unlocking the Potential of Data EngineeringAt Worldpay, we're on a mission to revolutionize the way we work with data. As a Senior Data Engineer - Python Airflow, you'll play a pivotal role in shaping our Cloud Data Platform team's vision and strategy.Key Responsibilities:Develop and implement data engineering initiatives using Python, AWS, Airflow, and...

  • Senior Data Engineer

    3 weeks ago

    Columbus, Ohio, United States Worldpay Full time

    About The RoleWorldpay is seeking a skilled Senior Data Engineer to join our Cloud Data Platform team. As a key member of our team, you will be responsible for designing, developing, and maintaining scalable workflows and orchestration systems using Astronomer and Airflow. Your expertise in cloud platforms, particularly AWS, and experience with data...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States Zodiac Solutions, Inc Full time

    About Zodiac Solutions, Inc.We are a leading IT staffing agency that connects talented professionals with exciting opportunities. Currently, we are hiring a Data Engineer for our client, a multinational finance company.About the RoleJob Title: Data EngineerLocation: Remote (with occasional on-site visits)Employment Type: ContractKey...

  • Senior Data Engineer

    4 weeks ago

    Columbus, Ohio, United States CapTech Full time

    Job DescriptionAt CapTech, we're passionate about empowering our clients to achieve their goals through innovative data engineering solutions. As a Cloud Data Architect, you'll play a crucial role in designing and implementing modern data pipelines that deliver optimal results.Key Responsibilities:Design and implement cloud-based data engineering...

  • Data Center Civil Engineering Manager

    4 weeks ago

    Columbus, Ohio, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking a highly experienced Civil Engineering Manager to lead our Data Center design team at Amazon Web Services. As a key member of our Americas Design Engineering team, you will be responsible for leading a team of civil engineers in the design of data center critical infrastructure systems.Your primary focus will be on facilitating...

  • Senior Data Engineer

    3 weeks ago

    Columbus, Ohio, United States Zodiac Solutions, Inc Full time

    About Zodiac Solutions, Inc.We are a leading IT staffing agency connecting talented professionals with exciting opportunities that align with their career goals. Currently, we are hiring a Data Engineer for our client, an American multinational finance company.About the RoleWe are seeking a highly skilled Data Engineer with expertise in Python, AWS, and...