Lead Databricks Engineer
1 week ago
Work on Finance data related to Collaterals, ETD, OTD, Settlement market, Cash product, Repo, Duos repo
Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Demonstrated proficiency with Data Analytics, Data Insights
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
Azure Synapse/Bigquery/Redshift is good to have.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
5+ years' - Strong experience in Finance / Banking industry - Capital markets, investment banking - Collaterals, ETD, OTD, Settlement market, Cash product, Repo, Duos repo
10+ years - Enterprise Data Management
10+ years - SQL Server based development of large datasets
5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding.
Azure Synapse/Bigquery/Redshift experience is good to have
3+ years Python(numpy, pandas) coding experience
Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
Capable of discussing enterprise level services independent of technology stack
Experience with Cloud based data architectures, messaging, and analytics
Superior communication skills
Cloud certification(s)
Any experience with Regulatory Reporting is a Plus
-
Director, Engineering
1 week ago
New York, NY, United States Databricks Full timeP-1283 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...
-
Databricks Data Engineer
3 days ago
New York, NY, United States Inizio Partners Full timeAbout the job Databricks Data Engineer OUR CLIENT Our client provides data-driven, action-oriented solutions to business problems through statistical data mining, cutting-edge analytics techniques, and a consultative approach. Leveraging proprietary methodology and best-of-breed technology, our client's analytics team takes an industry-specific approach to...
-
Sr. Software Engineer- Backend
2 weeks ago
New York, NY, United States Databricks Full timeP-1591 At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...
-
Sr. Solutions Architect
1 week ago
New York, NY, United States Databricks Full timeFEQ127R13 While candidates in the listed location(s) are encouraged to apply for this role, exceptionally well-qualified candidates in other East Coast locations will also be considered. Mission Solutions Architects at Databricks lead the growth of the Databricks Data Intelligence Platform. As a team, we have expertise in cloud platforms, data engineering,...
-
Solutions Architect
1 week ago
New York, NY, United States Databricks Full timeP-212 While candidates in the listed location(s) are encouraged for this role, other EST locations will be considered. Mission Solutions Architects at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science, machine learning, and generative...
-
Sr. Solutions Architect
2 weeks ago
New York, NY, United States Databricks Full timeFEQ127R13 While candidates in the listed location(s) are encouraged to apply for this role, exceptionally well-qualified candidates in other East Coast locations will also be considered. Mission Solutions Architects at Databricks lead the growth of the Databricks Data Intelligence Platform. As a team, we have expertise in cloud platforms, data engineering,...
-
Solutions Architect
2 weeks ago
New York, NY, United States Databricks Full timeP-212 While candidates in the listed location(s) are encouraged for this role, other EST locations will be considered. Mission Solutions Architects at Databricks lead the growth of the Databricks Unified Analytics Platform. As a team, we have expertise in cloud platforms, data engineering, data analytics, and data science, machine learning, and generative...
-
Databricks Engineer
1 week ago
New York, NY, United States Treliant Full timeOverview Treliant is a global consulting firm serving banks, mortgage originators and servicers, FinTechs, and other companies providing financial services. We are led by practitioners from the industry and the regulatory community who bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory,...
-
Databricks Engineer
2 weeks ago
New York, NY, United States Treliant Full timeOverview Treliant is a global consulting firm serving banks, mortgage originators and servicers, FinTechs, and other companies providing financial services. We are led by practitioners from the industry and the regulatory community who bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory,...
-
Databricks Engineer
1 week ago
New York, NY, United States Saxon Global Full timeTop skills (holistically): Databricks + Starburst, Python, PySpark, R, SparklyR, AWS Databricks is going to be required for all roles, Python is typically inherent within the Databricks environment. Databricks + Python/PySpark + R/SparklyR (Databricks relies heavily on Python, need R to convert code from R to Python native code or SparklyR to connect R to...
