Databricks Architect

2 days ago

San Francisco, CA, United States Danta Technologies Full time
Role: Databricks Architect (Architects, please, not developers or engineers)
Location: Remote work

Rate - $50/hr on W2 AND 63/hr on C2C

**Skills Needed:**
- 8+ years of experience in data engineering, with at least 3 years on Databricks.
- Strong proficiency in PySpark, SQL, and Delta Lake.
- Hands-on experience with GCP Dataproc.

**Responsibilities:**
1. **Administration**:
- Lead the installation and configuration of Databricks on GCP cloud platforms.
- Monitor platform health, performance, and cost optimization.
- Implement governance, logging, and auditing mechanisms.

2. **Development / Enhancements**:
- Design and develop scalable ETL/ELT pipelines using PySpark, SQL, and Delta Lake.
- Collaborate with data engineers and analysts to enhance data workflows and models.
- Optimize existing notebooks and jobs for performance and reliability.

3. **Operations, Support & Troubleshooting**:
- Provide L2/L3 support for Databricks-related issues and incidents.
- Troubleshoot cluster failures, job errors, and performance bottlenecks.
- Maintain technical documentation for platform setup, operations, and development standards.

Best Regards,
Rahul Thakur
Phone: 760-349-0078
Email: rahul@dantatechnologies.net

Notes:- All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Benefits: Danta offers a compensation package to all W2 employees that are competitive in the industry. It consists of competitive pay, the option to elect healthcare insurance (Dental, Medical, Vision), Major holidays and Paid sick leave as per state law.

The rate/ Salary range is dependent on numerous factors including Qualification, Experience and Location.

  • Senior Software Engineer

    7 days ago

    San Francisco, CA, United States Databricks Full time

    While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and...

  • Senior Software Engineer

    1 week ago

    San Francisco, CA, United States Databricks Full time

    P-78 While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building...

  • Senior Software Engineer

    22 hours ago

    San Francisco, CA, United States Databricks Full time

    P-78 While candidates in the listed locations are encouraged for this role, candidates in other locations will be considered. At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building...

  • Sr. Engineering Manager

    1 week ago

    San Francisco, CA, United States Databricks Full time

    At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best Data and AI infrastructure platform so our customers can use deep data insights to improve their...

  • Sr. Engineering Manager

    2 weeks ago

    San Francisco, CA, United States Databricks Full time

    At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best Data and AI infrastructure platform so our customers can use deep data insights to improve their...

  • Staff Designated Support Engineer

    1 week ago

    San Francisco, CA, United States Databricks Full time

    P-1011 Job Location: San Francisco Bay Area, CA office with 50% travel to client location in San Francisco As a Sr. Staff Technical Solutions Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Databricks' largest and most...

  • Staff Designated Support Engineer

    3 days ago

    San Francisco, CA, United States Databricks Full time

    P-1011 Job Location: San Francisco Bay Area, CA office with 50% travel to client location in San Francisco As a Sr. Staff Technical Solutions Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Databricks' largest and most...

  • Staff Designated Support Engineer

    2 weeks ago

    San Francisco, CA, United States Databricks Full time

    P-1011 Job Location: San Francisco Bay Area, CA office with 50% travel to client location in San Francisco As a Sr. Staff Technical Solutions Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Databricks' largest and most...

  • Sr. Staff Designated Support Engineer

    1 week ago

    San Francisco, CA, United States Databricks Full time

    Job Location: San Francisco Bay Area, CA office with 50% travel to client location in San Francisco As a Sr. Staff Technical Solutions Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Databricks' largest and most strategic...

  • Sr. Staff Designated Support Engineer

    3 days ago

    San Francisco, CA, United States Databricks Full time

    Job Location: San Francisco Bay Area, CA office with 50% travel to client location in San Francisco As a Sr. Staff Technical Solutions Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Databricks' largest and most strategic...