Senior Data Engineer in Azure using Databricks for Scala/Python

1 week ago

Eatontown, United States UBS Full time
Your role

Do you like building complex, secure platforms with a touch of a button? Are passionate about developing automated infrastructure as code that is successfully rolled out across a global implementation? Do you have what it takes to build robust solution that aide data engineers in delivering their data pipelines?
UBS , the Group Compliance & Regulatory Governance (GCRG) Technology team is looking for a hands-on Data Engineer on Azure leveraging Databricks for Scala/Python to:
• engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using Databricks and Airflow
• craft complex transformation pipelines on multiple datasets producing valuable insights that inform business decisions, making use of our internal data platforms and educate others about Best Practices for analytics big data
• develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems and ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements
• build observability into our solutions, monitor production health, help to resolve incidents, and remediate the root cause of risks and issues
• leverage Airflow to build complex branching Data Driven pipelines and leverage Databricks to build the spark layer of data pipelines
• leverage Python and Scala for low level complex data operations, codify best practices, methodology and share knowledge with other engineers in UBS

Your team

You will be working as part of the Group Compliance Regulatory Governance Technology stream that focuses on Data Analytics and Reporting. Our crew is using the latest data platforms to further the group's data strategy to realize the true potential of data as an asset through utilizing data lakes, data virtualization, for use with advanced analytics, AI/ML. The crew also ensure the data is managed with strategic sourcing and data quality tooling. Your team will be responsible for building the central GCRG data lake, developing data pipelines to strategically source data from master and authoritative source, creating data virtualization layer, building connectivity for advanced analytics and elastic search capabilities with the aid of cloud computing.

Diversity helps us grow, together. That's why we are committed to fostering and advancing diversity, equity, and inclusion. It strengthens our business and brings value to our clients.

Your expertise

• Bachelor's or master's degree in computer science or any similar engineering is highly desired
• ideally 5+ years of total IT experience in SWD or engineering and ideally 3+ years of hand-on experience designing and building scalable data pipelines for large datasets on cloud data platforms
• ideally 3+ years of hand-on experience in distributed processing using Databricks, Apache Python/Spark, Kafka & leveraging Airflow scheduler/executor framework
• ideally 2+ years of hand-on experience programming experience in Scala (must have), Python & Java (preferred)
• experience with monitoring solutions such as Spark Cluster Logs, Azure Logs, AppInsights, Graphana to optimize pipelines and knowledge in Azure capable languages, Python, Scala or Java
• proficiency at working with large and complex code base management systems like: Github/Gitlab, Gitflow as a project commiter at both command-line and IDEs levels using: tools like: IntelliJ/AzureStudio
• experience working with Agile development methodologies and delivering within Azure DevOps, automated testing on tools used to support CI and release management
• expertise in optimized dataset structures in Parquet and Delta Lake formats, with ability to design and implement complex transformations between datasets
• expertise in optimized Airflow DAGS and branching logic for Tasks to implement complex pipelines and outcomes and expertise in both traditional SQL and NO-SQL authorship

About us

UBS is the world's largest and the only truly global wealth manager. We operate through four business divisions: Global Wealth Management, Personal & Corporate Banking, Asset Management and the Investment Bank. Our global reach and the breadth of our expertise set us apart from our competitors..

We have a presence in all major financial centers in more than 50 countries.

Join us

At UBS, we embrace flexible ways of working when the role permits. We offer different working arrangements like part-time, job-sharing and hybrid (office and home) working. Our purpose-led culture and global infrastructure help us connect, collaborate, and work together in agile ways to meet all our business needs.

From gaining new experiences in different roles to acquiring fresh knowledge and skills, we know that great work is never done alone. We know that it's our people, with their unique backgrounds, skills, experience levels and interests, who drive our ongoing success. Together we're more than ourselves. Ready to be part of #teamUBS and make an impact?

  • Senior Network Consulting Engineer

    2 months ago

    eatontown, United States Aspire Technology Partners Full time

    POSITION SUMMARY: The Digital Architecture Senior Consulting Engineer (SCE) will lead projects and assist in development and mentorship of mid and junior level engineers. SCE’s have primarily responsibility for post-sale project technical leadership, execution and completion of project deliverables, and ongoing support engagements. SCE’s may also assist...

  • Senior Network Consulting Engineer

    2 months ago

    eatontown, United States Aspire Technology Partners Full time

    POSITION SUMMARY: The Digital Architecture Senior Consulting Engineer (SCE) will lead projects and assist in development and mentorship of mid and junior level engineers. SCE’s have primarily responsibility for post-sale project technical leadership, execution and completion of project deliverables, and ongoing support engagements. SCE’s may also assist...

  • Senior Network Consulting Engineer

    6 months ago

    Eatontown, United States Aspire Technology Partners Full time

    POSITION SUMMARY: The Digital Architecture Senior Consulting Engineer (SCE) will lead projects and assist in development and mentorship of mid and junior level engineers. SCE’s have primarily responsibility for post-sale project technical leadership, execution and completion of project deliverables, and ongoing support engagements. SCE’s may also assist...

  • Automation Engineer, Periodic KYC Reviews PKRs

    2 days ago

    Eatontown, United States UBS Full time

    Your role Do you want to design and build attractive digital products and services? Do you want to play a key role in transforming our firm into an agile organization? At UBS, we re-imagine the way we work, the way we connect with each other - our colleagues, clients and partners - and the way we deliver value. Being agile will make us more responsive, more...

  • Caregiving Professional

    1 week ago

    Eatontown, New Jersey, United States Brightview Senior Living Full time

    **Brightview Senior Living: Where Compassion Meets Expertise**We are seeking a dedicated and compassionate Caregiving Professional - Medication Administration to join our team at Brightview Senior Living. As a trusted member of our community, you will play a vital role in delivering exceptional care and support to our residents. **About Us**Brightview...

  • Office Administrative Specialist

    7 days ago

    Eatontown, New Jersey, United States Cyril Senior Care Full time

    Job OverviewCyril Senior Care is seeking a detail-oriented and organized Front Desk Coordinator to join our team. This role is perfect for someone who enjoys working in a fast-paced office setting and has excellent communication skills.CompensationThe hourly wage for this position starts at $17.00, with the potential for upward compensation based on...

  • Housekeeper

    3 months ago

    Eatontown, United States Brightview Senior Living Full time

    About Us: We are honored that Brightview Senior Living has been recognized as one of Fortune Magazine's 100 Best Companies to Work For in 2023!! We're in the top 100 across all industries, and all companies no matter how large or small...and we're the ONLY Senior Living company on the prestigious list! Overview: Do you love to organize and maintain a...

  • Memory Care

    22 hours ago

    Eatontown, United States Brightview Senior Living Full time

    Job DescriptionOverviewAbout UsDoes being kind and compassionate come naturally to you?Do you thrive on the ability to help others and make a difference in the lives of others?If this sounds like you, then Brightview Senior Living is for you!ResponsibilitiesUse your compassion to provide warm, engaging personal care services, support and companionship....

  • Memory Care

    2 days ago

    Eatontown, United States Brightview Senior Living Full time

    Job DescriptionOverviewAbout UsDoes being kind and compassionate come naturally to you?Do you thrive on the ability to help others and make a difference in the lives of others?If this sounds like you, then Brightview Senior Living is for you!ResponsibilitiesUse your compassion to provide warm, engaging personal care services, support and companionship....

  • Compassionate Home Healthcare RN Opportunity

    1 week ago

    Eatontown, New Jersey, United States Erickson Senior Living Full time

    About the Role:We are seeking a skilled and compassionate Registered Nurse (RN) to provide exceptional home healthcare services in our community. As a key member of our care team, you will play a vital role in delivering personalized nursing care to our residents.Job Summary:The RN in Home Care provides professional nursing care according to established...

  • Certified Medication Aide

    2 days ago

    Eatontown, United States Brightview Senior Living Full time

    Job DescriptionOverviewAbout UsAre you the person who double checks your work as you go through your day?Do you love getting to know seniors and feel good about your work at the end of the day?If you do - you have found your next career!Healthcare, Hospitality, Nursing, Aide, Certified Medication Aide, Licensed Medication Aide, Med Tech, Medication...

  • Certified Medication Aide

    4 weeks ago

    Eatontown, United States Brightview Senior Living Full time

    Job DescriptionOverviewAbout UsAre you the person who double checks your work as you go through your day?Do you love getting to know seniors and feel good about your work at the end of the day?If you do - you have found your next career!Healthcare, Hospitality, Nursing, Aide, Certified Medication Aide, Licensed Medication Aide, Med Tech, Medication...

  • Nurse Care Specialist, Senior Living Community

    7 days ago

    Eatontown, New Jersey, United States Erickson Living Full time

    We are seeking a compassionate and skilled Licensed Practical Nurse (LPN) to join our team at Seabrook Village by Erickson Senior Living. As a member of our nursing staff, you will play a vital role in providing high-quality care to our residents.About UsSeabrook Village is a beautiful 98-acre continuing care retirement community located in the picturesque...

  • Senior Clinical Specimen Collector

    7 days ago

    Eatontown, New Jersey, United States Centers Laboratory Full time

    About UsCenters Laboratory is a leading medical laboratory in New Jersey, dedicated to providing high-quality diagnostic services. We are currently seeking a Senior Clinical Specimen Collector to join our team of experienced professionals.Job SummaryAs a Senior Clinical Specimen Collector, you will be responsible for collecting and processing blood samples...

  • Nursing Professional

    6 days ago

    Eatontown, New Jersey, United States Atria Senior Living Group, Inc. Full time

    OverviewWe strive to create supportive environments where our residents and employees thrive.Atria Senior Living Group, Inc. has immediate openings for LPNs/LVNs who are passionate about delivering exceptional care to older adults. Our team members enjoy competitive pay, outstanding benefits, and opportunities for career growth and advancement.Salary: The...

  • Senior Tax Accounting Specialist

    7 days ago

    Eatontown, New Jersey, United States ADDEO POLACCO & PENTA LLC Full time

    Job OverviewAt Addeo, Polacco & Penta, LLC, a progressive public accounting firm in Monmouth County, NJ, we have provided quality accounting and consulting services to our clients for over 25 years. Our commitment to excellence has earned us a rating as Best in Monmouth County by the Asbury Park Press.We are currently seeking an experienced Senior Tax...

  • Pharmacy Data Entry Specialist

    3 weeks ago

    Eatontown, United States Hackensack Meridian Health Full time

    Overview: Our team members are the heart of what makes us better. At Hackensack Meridian Health we help our patients live better, healthier lives and we help one another to succeed. With a culture rooted in connection and collaboration, our employees are team members. Here, competitive benefits are just the beginning. Its also about how we support one...

  • Pharmacy Data Entry Specialist

    1 month ago

    Eatontown, United States Hackensack Meridian Health Full time

    Overview: Our team members are the heart of what makes us better. At Hackensack Meridian Health we help our patients live better, healthier lives and we help one another to succeed. With a culture rooted in connection and collaboration, our employees are team members. Here, competitive benefits are just the beginning. Its also about how we support one...

  • Pharmacy Data Entry Specialist

    1 month ago

    Eatontown, United States Hackensack Meridian Health Full time

    Overview Our team members are the heart of what makes us better. At Hackensack Meridian Health we help our patients live better, healthier lives - and we help one another to succeed. With a culture rooted in connection and collaboration, our employees are team members. Here, competitive benefits are just the beginning. It's also about how we support one...

  • Pharmacy Data Entry Specialist

    1 month ago

    Eatontown, United States Hackensack Meridian Health Full time

    Overview Our team members are the heart of what makes us better. At Hackensack Meridian Health we help our patients live better, healthier lives - and we help one another to succeed. With a culture rooted in connection and collaboration, our employees are team members. Here, competitive benefits are just the beginning. It's also about how we support one...