Senior Data Engineer
6 days ago
Location: Minneapolis, MN/Remote
Duration: 1 year
Job DescriptionAI Dojo Databricks SRE/Support Engineer. As Databricks SRE and Support Engineer, you will work on operations related to AI Dojo (AI/ML upskilling program developed by Optum/UHG) on Databricks. This individual contributor () role requires experience working on large?scale AI/ML platforms, guaranteeing stability, reliability, scalability, and performance. Experience with modern Infrastructure and DevOps tools and paradigms, as well as proven hands?on knowledge with Databricks is a must.
Primary Responsibilities- Continuous support: Provide continuous SRE support to thousands of geographically distributed users on the AI Dojo Databricks platform: respond to tickets, triage support, liaise with customers.
- Automation & DevOps: Improve existing Infrastructure as Code (IaC) according to best DevOps practices.
- Systems Monitoring: Develop and maintain monitoring frameworks to timely respond to outages and other service interruptions.
- Bachelor's degree in computer science, information technology, or a related field.
- 6+ years of infrastructure experience: Proven experience working on large?scale, cloud?based, enterprise?level software platforms and deep understanding of Databricks environment.
- Experience building GitHub Actions pipelines (including composite actions, OIDC federation for cloud provider identity acquisition, and use of environments and deployment controls).
- Experience building Databricks Asset Bundle and Terraform pipelines to manage and deploy Databricks Platform and Workspace resources.
- Fluency in Python, experience with the Databricks Python SDK to perform Workspace operations, and familiarity with PySpark and Delta Lake.
- Deep familiarity with Databricks APIs and use of the Databricks CLI for provisioning Workspace identities, filesystem resources, and querying account and workspace level users, groups, and service principals.
- Strong understanding of security best practices and experience ensuring compliance with relevant regulatory frameworks.
- 3+ years of practical experience in Infrastructure?as?Code and CI/CD tools like Terraform, GitHub Actions, and alike.
- 3+ years of experience working in support teams that are geographically distributed.
Seniority Level
Mid?Senior level
Employment TypeFull?time
Job FunctionInformation Technology
#J-18808-Ljbffr-
Senior Data Engineer
13 hours ago
Washington, DC, United States IPG DXTRA Full timeSenior Data Engineer Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists, and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design,...
-
Senior Data Engineer
13 hours ago
Washington, DC, United States Children's National Hospital Full timeSenior Data Engineer at Children's National Hospital Children's National Hospital provided pay range This range is provided by Children's National Hospital. Your actual pay will be based on your skills and experience talk with your recruiter to learn more. Base pay range $109,116.80/yr - $181,854.40/yr The Senior Data Engineer is responsible for designing,...
-
Senior Data Engineer
2 days ago
Washington, DC, United States Galileo Financial Technologies Full timeSenior Data Engineer We're looking for a Senior Data Engineer who can own complex data products end-to-end, shape engineering standards, and elevate how data is modeled, orchestrated, and delivered across Galileo. This role sits at the core of our cloud-native platform which powers real financial experiences for both internal teams and external clients....
-
Senior Data Engineer
7 days ago
Washington, DC, United States Circa - IPG DXTRA Full timeAbout the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...
-
Senior Data Engineer
6 days ago
Washington, DC, United States Circa - IPG DXTRA Full timeAbout the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...
-
Senior Data Engineer
4 days ago
Washington, DC, United States Circa - IPG DXTRA Full timeAbout the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...
-
Senior Data Engineer
2 days ago
Washington, DC, United States Circa - IPG DXTRA Full timeAbout the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...
-
Senior Data Engineer
2 weeks ago
Washington, DC, United States Circa - IPG DXTRA Full timeAbout the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...
-
Senior Data Engineer
2 weeks ago
Washington, DC, United States Circa - IPG DXTRA Full timeAbout the Role Weber Shandwick is seeking a talented Senior Data Engineer to join our team in Washington, DC. You will be joining a team of business strategists, data scientists and data engineers to build innovative data solutions and would work at the intersection of Data Engineering and Applied Generative AI. The Senior Data Engineer will design, build,...
-
Senior Data Engineer
2 weeks ago
Washington, DC, United States Children's National Hospital Full timeThe Senior Data Engineer is responsible for designing, developing, and operationalizing advanced cloud data pipelines to facilitate seamless data consumption for reports, advanced analytics, and AI initiatives. This role involves overseeing the entire data lifecycle, including data ingestion, transformation, validation, and quality assurance. The Senior Data...
