Databricks Data Engineer

Technology Data And Decision Science Data Engineering Manager At EY, we are all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. The Opportunity In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions. Key responsibilities include: Understanding and analyzing business requirements to translate them into technical requirements. Designing, building, and operating scalable data architecture and modeling solutions. Staying up to date with the latest trends and emerging technologies to maintain a competitive edge. Key Responsibilities As a Data Engineering Manager, you will play a crucial role in managing and delivering complex technical initiatives. Your time will be spent across various responsibilities, including: Leading workstream delivery and ensuring quality in all processes. Engaging with clients on a daily basis, actively participating in working sessions, and identifying opportunities for additional services. Implementing resource plans and budgets while managing engagement economics. This role offers the opportunity to work in a dynamic environment where you will face challenges that require innovative solutions. You will learn and grow as you guide others and interpret internal and external issues to recommend quality solutions. Travel may be required regularly based on client needs. Skills And Attributes For Success To thrive in this role, you should possess a blend of technical and interpersonal skills. The following attributes will make a significant impact: Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices. Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement. Collaborate with clients to understand their analytics needs and deliver tailored solutions that drive business value. Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance. Drive end-to-end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services. Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts and project progress. Manage client relationships and expectations, ensuring high levels of satisfaction and engagement. Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics. Strong analytical and problem-solving abilities. Excellent communication skills, with the ability to convey complex information clearly. Proven experience in managing and delivering projects effectively. Ability to build and manage relationships with clients and stakeholders. To Qualify For The Role, You Must Have: Bachelor's degree in computer science, Engineering, or a related field required; Master's degree preferred. Typically, no less than 4 - 6 years relevant experience in data engineering, with a focus on cloud data solutions and analytics. Proven expertise in Databricks and experience with Spark for big data processing. Strong background in data architecture and design, with experience in building complex cloud analytics solutions. Experience in leading and managing teams, with a focus on mentoring and developing talent. Strong programming skills in languages such as Python, Scala, or SQL. Excellent problem-solving skills and the ability to work independently and as part of a team. Strong communication and interpersonal skills, with a focus on client management. Required Expertise For Managerial Role: Strategic leadership, project management, stakeholder engagement, change management, risk management, technical leadership, and documentation and reporting. Large-Scale Implementation Programs: 1. Enterprise Data Lake Implementation: Led the design and deployment of a cloud-based data lake solution for a Fortune 500 retail client. 2. Real-Time Analytics Platform: Managed the development of a real-time analytics platform using Databricks for a financial services organization. 3. Data Warehouse Modernization: Oversaw the modernization of a legacy data warehouse to a cloud-native architecture for a healthcare provider. What We Look For: We seek individuals who are not only technically proficient but also possess the qualities of top performers, including a strong sense of collaboration, adaptability, and a passion for continuous learning. What We Offer You: We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $125,500 to $230,200. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $150,700 to $261,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client-serving roles to work together in person 40-60% of the time over the course of an engagement, project or year. Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. Are you ready to shape your future with confidence? Apply today. EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information. EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.