Principal Data Engineer

1 month ago


Buffalo, New York, United States Delaware North Full time
The Opportunity

Delaware North is hiring a Lead Databricks Engineer to join our IT team in Buffalo, New York. As a Lead Databricks Engineer, you will be responsible for leading the development and optimization of our Databricks-based data processing and analytics platform. You will work closely with business stakeholders to design, implement, and maintain scalable and efficient data pipelines, as well as to advance our capabilities in data analysis, machine learning and AI-driven applications.

Buffalo, New York location, hybrid in office 2-3 days/week onsite.

Relocation assistance available.

Pay

Minimum – Anticipated Maximum Base Salary: $ $129400 / year

In addition to base salary, we offer an annual bonus plan based on company and individual performance, or a role-based, uncapped sales incentive plan. The advertised pay range represents what we believe at the time of this job posting, that we would be willing to pay for this position. Only in special circumstances, where a candidate has education, training, or experience that far exceeds the requirements for the position, would we consider paying higher than the stated range. Information on our comprehensive benefits package can be found at

Benefits

At Delaware North, we care about our team members' personal and professional journeys. These are just some of the benefits we offer:

  • Medical, dental, and vision insurance
  • 401(k) with up to 4% company match
  • Annual performance bonus based on level, as well as individual, company, and location performance
  • Paid vacation days and holidays
  • Paid parental bonding leave
  • Tuition and/or professional certification reimbursement
  • Generous friends-and-family discounts at many of our hotels and resorts
Responsibilities
  • Architect and optimize data pipelines for performance and cost-efficiency within the Databricks environment
  • Design and implement ETL processes using Databricks jobs to process and transform raw data into a usable format for analysis
  • Develop and optimize Spark jobs for data processing, analysis, and machine learning tasks
  • Pinpoint and resolve efficiency issues, enhancing the speed of data processing and optimizing the use of resources
  • Establish and uphold security protocols to safeguard confidential data, aligning with applicable Legal and CyberSecurity standards
Qualifications
  • Bachelor's degree in computer science, engineering, or a similar STEM related field
  • Minimum of 5 years of experience in data engineering with a strong focus on Databricks
  • Experience designing and implenting ETL processes using Databricks.
  • Deep understanding of Apache Spark, Delta Lake, and related big data technologies, and proficiency in modern programming languages such as Python and Scala
  • Strong knowledge of SQL and experience with relational, NoSQL, Data Warehouse, and Data Lake methodologies
  • Experience with version control systems, SDLC best practices, Agile methodologies, and cloud architecture, AWS preferred
  • Experience with Spark jobs for data processing, analysis, and machine learning tasks using Databricks.
  • Must be legally authorized to work in the US without sponsorship.

    #LI-Hybrid
Who We Are

At Delaware North, you'll love where you work, who you work with, and how your day unfolds. Whether it's in sporting venues, casinos, airports, national parks, iconic hotels, or premier restaurants, there's no telling where your career can ultimately take you. We empower you to do great work in a company with 100 years of success, stability and growth. If you have drive and enjoy the thrill of making things happen - share our vision and grow with us.

Delaware North Companies, Incorporated and its subsidiaries consider applicants for all positions without regard to race, color, religion, creed, gender, national origin, age, disability, marital or veteran status, sexual orientation, or any other legally protected status. Delaware North is an equal opportunity employer.



  • Buffalo, New York, United States Imagine Staffing Technology, An Imagine Company Full time

    Principal Infrastructure EngineerLocation: Buffalo, NYHire Type: ContingentHourly Rate: $74.35 - $110.00Work Model: HybridNo C2C or Sponsorship AvailablePosition OverviewAre you an experienced Technical Engineer seeking a new opportunity? Our client, a leader in technology solutions, is looking for a dedicated professional to contribute to innovative...


  • Buffalo, New York, United States ME Engineering Full time

    Job OverviewM/E Engineering is seeking a skilled Mechanical Design Engineer to join our team in Buffalo, NY. As a Mechanical Design Engineer, you will play a crucial role in creating built environments that support a sustainable future for the communities we serve.Key ResponsibilitiesDevelop Project Designs: Utilize engineering principles and standard...


  • Buffalo, New York, United States LaBella Associates Full time

    Senior Electrical Engineer - Building SystemsLaBella Associates is seeking a highly skilled Senior Electrical Engineer with expertise in Building Systems to enhance our engineering team.This position requires collaboration with various engineering professionals on building projects, guiding them from initial concept through to completion, while functioning...


  • Buffalo, New York, United States Imagine Staffing Technology, An Imagine Company Full time

    Principal Infrastructure EngineerLocation: Buffalo, NYHire Type: ContingentHourly Rate: $74.35 - $110.00Work Model: HybridNote: No C2C or Sponsorship availablePosition OverviewAre you an experienced Technical Engineer eager for a new opportunity? Our client is seeking a skilled professional to become an integral part of their innovative team, where...


  • Buffalo, New York, United States ME Engineering Full time

    About M/E EngineeringM/E Engineering is a leading MEP engineering firm providing design and technology services to our clients. Our team of nearly 200 engineers and design professionals work to create built environments that support a sustainable future for the communities we live in, work in, and care deeply about.Our CommitmentWe are committed to...

  • First Class Engineer

    3 hours ago


    Buffalo, New York, United States Buffalo School District Full time

    Job SummaryWe are seeking a highly skilled and experienced First Class Engineer - Custodian to join our team at the Buffalo School District. This is a critical role that requires a strong background in plant operations, maintenance, and supervision.Key ResponsibilitiesPlan and direct the work of subordinate employees in the operation and maintenance of...


  • Buffalo, New York, United States Delaware North Full time

    The Opportunity Delaware North is searching for a Lead Data Governance Analyst, Data Quality to join our Enterprise Data team in Buffalo, New York. This new role serves as a thought leader and an influencer who understands the business needs and can translate those requirements to IT thereby increasing the capacity of the analytics competency across the...


  • Buffalo, New York, United States National Grid USA Full time

    About UsNational Grid is seeking a Distribution Senior Engineer to join our Distribution Planning & Asset Management (DPAM) team. We are committed to delivering safe and reliable energy to our communities and businesses, ensuring that we are there when our customers need us the most. The energy landscape is evolving rapidly, and our expertise positions us...


  • Buffalo, New York, United States National Grid USA Full time

    About UsNational Grid is seeking a Distribution Lead Engineer to join our Distribution Planning & Asset Management (DPAM) team. We are committed to delivering safe and reliable energy to our customers, ensuring that we meet their needs efficiently and effectively.Our MissionAs the energy landscape evolves, we strive to stay ahead of the curve, leveraging our...


  • Buffalo, New York, United States ME Engineering Full time

    About the RoleM/E Engineering is seeking a highly skilled Senior Mechanical Engineer to join our team in Buffalo, NY. As a leading MEP engineering firm, we provide design and technology services to our clients, creating built environments that support a sustainable future.Key ResponsibilitiesLead project design teams in the development of mechanical...


  • Buffalo, New York, United States Rich Products Full time

    About the RoleRich Products Corporation, a leading food company, is seeking a highly motivated and detail-oriented Data and Analytics Intern to join our Demand Creation Analytics Team. As a key member of our team, you will play a critical role in supporting and developing data ingestion and modeling processes, leveraging the Azure platform to develop machine...


  • Buffalo, New York, United States Mackinnon Bruce International Full time

    Position OverviewMackinnon Bruce International, a premier Executive Search Consultancy specializing in the global Civil Infrastructure, Transportation, Water, and Wastewater sectors, is collaborating with a distinguished leader in multi-disciplinary civil engineering. We are seeking a Principal Engineer specializing in Wastewater to enhance their dynamic...


  • Buffalo, New York, United States Delaware North Full time

    The Opportunity Delaware North is searching for a Lead Data Governance Analyst, Data Quality to join our Enterprise Data team in Buffalo, New York. This new role serves as a thought leader and an influencer who understands the business needs and can translate those requirements to IT thereby increasing the capacity of the analytics competency across the...


  • Buffalo, New York, United States Rich Products Full time

    About Rich'sRich's, a family-owned food company, is dedicated to inspiring possibilities. Our portfolio includes creative solutions for food industry professionals, helping them compete in various markets. With annual sales exceeding $3.8 billion, Rich's is a global leader in the food industry.About the RoleThe Data and Analytics Intern will be part of the...


  • Buffalo, New York, United States Bayforce Full time

    Job DescriptionBayforce's Quantitative Modeling SpecialistContract (with potential for conversion to hire)Duration: Until end of the yearPreferred Location: Remote EST (occasional travel with expenses paid)Role Overview:We are seeking a highly skilled Data Scientist/Quantitative Model with CECL & CCAR expertise to join our team on a contractual basis with a...


  • Buffalo, New York, United States Actalent Full time

    Job Title: Civil Project Manager Job Overview As a Civil Project Manager, you will oversee and coordinate the efforts of various professionals, delivering innovative and practical designs for a diverse range of infrastructure projects. These projects may include water treatment and distribution systems, wastewater management, stormwater solutions, and small...


  • Buffalo, New York, United States Actalent Full time

    Job Title: Civil Project Manager Job Overview As a Civil Project Manager, you will oversee and coordinate the efforts of various professionals, delivering innovative and practical designs for a range of infrastructure initiatives. These projects may include water treatment systems, wastewater management, stormwater solutions, and site development tasks. You...


  • Buffalo, New York, United States WSP Full time

    Job Overview WSP is embarking on a search for a Senior Civil Engineer to join our team. This role will involve engaging in projects with our Highway Transportation Team, contributing to a dynamic organization that addresses client needs and resolves challenges. Your Contributions As a Senior Civil Engineer, you will provide expert technical support and...


  • Buffalo, New York, United States RCM Engineering Group Full time

    STRUCTURAL DESIGN ENGINEER RCM Engineering Group Location: Buffalo, NY RCM Engineering Group is seeking a skilled Structural Design Engineer to join our dynamic team in the Buffalo, NY area. Key Responsibilities: Conduct comprehensive Civil and Structural design tasks, including the modeling and engineering of steel frameworks, concrete bases, reinforcement...


  • Buffalo, New York, United States Jobot Full time

    SCADA Engineer OpportunityJobot, a prominent player in the automation and control systems sector, is seeking a talented SCADA Engineer to enhance our team. This role presents a unique chance to engage in innovative projects and elevate your professional journey within a vibrant industry.Why Join Jobot?We provide a robust benefits package that encompasses...