Databricks Architect

2 weeks ago


San Jose, United States QSS Full time

**Job Title: Databricks Architect**

**Location: San Jose, CA (Onsite day 1 )**

**Duration: Full time hire**

**Requirements**:
Key Responsibilities:

- Work on client projects to deliver Microsoft Azure based Data engineering & Analytics solutions
- Provide hands on technical leadership for relevant technical skills, in multiple projects if required
- Design and implement high performing scalable analytics solutions on Azure following well-architected framework guidelines
- Design pipelines to ingest & integrate structured/unstructured data from heterogeneous sources
- Collaborate with delivery leadership to deliver projects on time adhering to the quality standards

Mandatory Skills
- In-depth knowledge Data processing techniques and handling large data sets
- Hands on experience using different storage services on Azure for storing data, like ADLS, SQL DB, SYnapse, Delta tables, Hive
- Expert level hands on experience using Databricks in at least 4 projects, creating notebooks using Scala/Python
- Expertise using Pyspark and Spark SQL for processing data for various use cases
- Expertise in code/performance optimization, and troubleshooting PySpark notebooks
- Good understanding of Delta lake and how it can be used in conjunction with ADLS and other storage
- Experience working with atleast 1 big data project using map-reduce
- Experience with Databricks scheduling features to automate Databricks jobs
- Problem-solving skills along with good interpersonal & communication skills
- Self-starter who can pick up any other relevant Azure Services in the Analytics space

Good-to-Have Skills
- Databricks Certified Data Engineer
- Knowledge of HDInsight, and Azure DevOps is a big plus
- DP 203 - Microsoft Certified Azure Data Engineer
- Knowledge in Power BI
- Exposure to Databricks on AWS

Pay: $170,000.00 - $180,000.00 per year

**Benefits**:

- 401(k)
- Dental insurance
- Health insurance

Schedule:

- 8 hour shift

Ability to Relocate:

- San Jose, CA: Relocate before starting work (required)

Work Location: On the road



  • San Francisco, United States Databricks Full time

    RDQ424R175 Our mission at Databricks is to be the generational Data and AI company. Databricks has created a new market category of the Data Lakehouse (CIDR 2021 paper), an open platform that unifies data warehousing, ELT, advanced analytics, and AI. The Lakehouse architecture addresses several major challenges, including data staleness, reliability, total...


  • San Francisco, CA, United States DataBricks Full time

    RDQ123R351At Databricks, we are passionate about helping data teams solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...


  • San Francisco, CA, United States DataBricks Full time

    RDQ224R256Product Security Mission:The Product Security Team's mission is to Left-shift SDLC (Security Development Lifecycle) processes for ALL code written in Databricks (for Customer Use or Supporting Customer internally) to reduce the likelihood of introducing new vulnerabilities in production and minimize the count and effect of externally identified...


  • San Jose, United States PSR Associates Full time

    PSR Associates is a consulting and talent solutions firm that connects qualified IT professionals with great opportunities. Whether you're looking for a contract or permanent position, we can help you find the right fit for your skills and experience. We have a team of experienced recruiters who know the IT industry inside and out, and we work with you every...


  • San Francisco, United States CEDENT Full time

    ??????Hi , Urgently need Azure cloud architect - Architect and lead the build-out of platform on Azure & migration from on-prem systems. - Understand the existing on-prem technology landscape & implementations and recommend the best strategy & solutions to deliver on cloud. - Design and build large scale data storage, compute and distribution systems -...

  • Data Architect I

    2 weeks ago


    San Francisco, United States eTeam Inc. Full time

    Job Title: Data Architect Duration: 3 Months Location: CAPay Rate - $65/hr. - $70/hr. on W2 Job Description: Minimum 8 years of recent experience in database development, relational databases, data lakes, data analytics solutions, and data warehousing, including cloud-native databases and modern cloud-based data warehouse systems. Strong hands-on experience...


  • San Francisco, United States eTeam Inc. Full time

    Looking for a Strong Infrastructure Cloud Architect with Expertise in Data Lake Deployment. POSITION SUMMARY STATEMENT: The Cloud Principal prepares overall design of the solutions to adhere to the cloud architecture and data standards; Identify landscape req. and changes; Works on planning, configuration and implementation tasks as required. The main...


  • San Jose, United States LatentView Analytics Full time

    Hiring Mode: Full-time with LatentView AnalyticsStart Date: ASAPExperience: 5 to 10 yearsLocation: San Jose, California, USANote: C2C or C2H is not an option.Job Description:We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data...

  • Senior Data Engineer

    2 weeks ago


    San Jose, United States LatentView Analytics Full time

    Hiring Mode: Full-time with LatentView AnalyticsStart Date: ASAPExperience: 5 to 10 yearsLocation: San Jose, California, USANote: C2C or C2H is not an option.Job Description:We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data...

  • Senior Data Engineer

    2 weeks ago


    San Jose, United States LatentView Analytics Full time

    Hiring Mode: Full-time with LatentView AnalyticsStart Date: ASAPExperience: 5 to 10 yearsLocation: San Jose, California, USANote: C2C or C2H is not an option.Job Description:We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

  • Back End Developer

    3 weeks ago


    San Rafael, United States The Bison Group Full time

    ResponsibilitiesRead and understand existing data processes implemented in Databricks and efficiently rebuild and optimize them.Collaborate closely with the engineering team to integrate data solutions seamlessly into our platform.Take ownership of translating basic product requirements into robust and scalable back-end systems.Demonstrate a proactive...

  • Back End Developer

    3 weeks ago


    San Rafael, United States The Bison Group Full time

    ResponsibilitiesRead and understand existing data processes implemented in Databricks and efficiently rebuild and optimize them.Collaborate closely with the engineering team to integrate data solutions seamlessly into our platform.Take ownership of translating basic product requirements into robust and scalable back-end systems.Demonstrate a proactive...

  • Back End Developer

    3 days ago


    San Rafael, United States The Bison Group Full time

    Responsibilities Read and understand existing data processes implemented in Databricks and efficiently rebuild and optimize them. Collaborate closely with the engineering team to integrate data solutions seamlessly into our platform. Take ownership of translating basic product requirements into robust and scalable back-end systems. Demonstrate a proactive...

  • Azure Data Engineer

    2 weeks ago


    San Francisco, United States eTeam Inc. Full time

    Should have 10+ Years of experience and at least 5-7 years of experience in cloud environment with required skills. Skills Required: Ability to blueprint, design and deploy scalable, high-availability and fault tolerant systems on Azure, GCP or similar cloud environments Knowledge on Data Lake and Data Factory solutioning Knowledge and experience with...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, United States UpRecruit Full time

    Job Details:  Title: Sr. Data Engineer Salary: $180-$230K  Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area)  Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role in...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, California, United States UpRecruit Full time

    Job Details:  Title: Sr. Data Engineer Salary: $180-$230K  Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area)  Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role...


  • San Diego, United States Analysis Studio Full time

    Job DescriptionJob Description Job Description: We are seeking a highly skilled and experienced BI Architect/Tableau Architect Specialist to join our dynamic team. The ideal candidate will possess a diverse skill set in data analytics, visualization tools, and database management. Key Responsibilities: Develop and maintain interactive and insightful...