Databricks Architect
2 weeks ago
**Job Title: Databricks Architect**
**Location: San Jose, CA (Onsite day 1 )**
**Duration: Full time hire**
**Requirements**:
Key Responsibilities:
- Work on client projects to deliver Microsoft Azure based Data engineering & Analytics solutions
- Provide hands on technical leadership for relevant technical skills, in multiple projects if required
- Design and implement high performing scalable analytics solutions on Azure following well-architected framework guidelines
- Design pipelines to ingest & integrate structured/unstructured data from heterogeneous sources
- Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
Mandatory Skills
- In-depth knowledge Data processing techniques and handling large data sets
- Hands on experience using different storage services on Azure for storing data, like ADLS, SQL DB, SYnapse, Delta tables, Hive
- Expert level hands on experience using Databricks in at least 4 projects, creating notebooks using Scala/Python
- Expertise using Pyspark and Spark SQL for processing data for various use cases
- Expertise in code/performance optimization, and troubleshooting PySpark notebooks
- Good understanding of Delta lake and how it can be used in conjunction with ADLS and other storage
- Experience working with atleast 1 big data project using map-reduce
- Experience with Databricks scheduling features to automate Databricks jobs
- Problem-solving skills along with good interpersonal & communication skills
- Self-starter who can pick up any other relevant Azure Services in the Analytics space
Good-to-Have Skills
- Databricks Certified Data Engineer
- Knowledge of HDInsight, and Azure DevOps is a big plus
- DP 203 - Microsoft Certified Azure Data Engineer
- Knowledge in Power BI
- Exposure to Databricks on AWS
Pay: $170,000.00 - $180,000.00 per year
**Benefits**:
- 401(k)
- Dental insurance
- Health insurance
Schedule:
- 8 hour shift
Ability to Relocate:
- San Jose, CA: Relocate before starting work (required)
Work Location: On the road
-
Staff Product Manager, New Product
4 weeks ago
San Francisco, United States Databricks Full timeRDQ424R175 Our mission at Databricks is to be the generational Data and AI company. Databricks has created a new market category of the Data Lakehouse (CIDR 2021 paper), an open platform that unifies data warehousing, ELT, advanced analytics, and AI. The Lakehouse architecture addresses several major challenges, including data staleness, reliability, total...
-
Staff Product Manager, Security
19 hours ago
San Francisco, CA, United States DataBricks Full timeRDQ123R351At Databricks, we are passionate about helping data teams solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...
-
Sr. Staff Security Engineer
7 days ago
San Francisco, CA, United States DataBricks Full timeRDQ224R256Product Security Mission:The Product Security Team's mission is to Left-shift SDLC (Security Development Lifecycle) processes for ALL code written in Databricks (for Customer Use or Supporting Customer internally) to reduce the likelihood of introducing new vulnerabilities in production and minimize the count and effect of externally identified...
-
Cloud Data Architect
7 days ago
San Jose, United States PSR Associates Full timePSR Associates is a consulting and talent solutions firm that connects qualified IT professionals with great opportunities. Whether you're looking for a contract or permanent position, we can help you find the right fit for your skills and experience. We have a team of experienced recruiters who know the IT industry inside and out, and we work with you every...
-
Azure Cloud Data Architect-director
5 days ago
San Francisco, United States CEDENT Full time??????Hi , Urgently need Azure cloud architect - Architect and lead the build-out of platform on Azure & migration from on-prem systems. - Understand the existing on-prem technology landscape & implementations and recommend the best strategy & solutions to deliver on cloud. - Design and build large scale data storage, compute and distribution systems -...
-
Data Architect I
2 weeks ago
San Francisco, United States eTeam Inc. Full timeJob Title: Data Architect Duration: 3 Months Location: CAPay Rate - $65/hr. - $70/hr. on W2 Job Description: Minimum 8 years of recent experience in database development, relational databases, data lakes, data analytics solutions, and data warehousing, including cloud-native databases and modern cloud-based data warehouse systems. Strong hands-on experience...
-
Infrastructure Cloud Architect
2 weeks ago
San Francisco, United States eTeam Inc. Full timeLooking for a Strong Infrastructure Cloud Architect with Expertise in Data Lake Deployment. POSITION SUMMARY STATEMENT: The Cloud Principal prepares overall design of the solutions to adhere to the cloud architecture and data standards; Identify landscape req. and changes; Works on planning, configuration and implementation tasks as required. The main...
-
Senior Data Engineer
2 days ago
San Jose, United States LatentView Analytics Full timeHiring Mode: Full-time with LatentView AnalyticsStart Date: ASAPExperience: 5 to 10 yearsLocation: San Jose, California, USANote: C2C or C2H is not an option.Job Description:We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data...
-
Senior Data Engineer
2 weeks ago
San Jose, United States LatentView Analytics Full timeHiring Mode: Full-time with LatentView AnalyticsStart Date: ASAPExperience: 5 to 10 yearsLocation: San Jose, California, USANote: C2C or C2H is not an option.Job Description:We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data...
-
Senior Data Engineer
2 weeks ago
San Jose, United States LatentView Analytics Full timeHiring Mode: Full-time with LatentView AnalyticsStart Date: ASAPExperience: 5 to 10 yearsLocation: San Jose, California, USANote: C2C or C2H is not an option.Job Description:We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data...
-
Lead Azure Data Engineer/ Architect
2 days ago
San Francisco, United States GSPANN Technologies, Inc Full timeAbout the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...
-
Lead Azure Data Engineer/ Architect
1 day ago
San Francisco, United States GSPANN Technologies, Inc Full timeAbout the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...
-
Back End Developer
3 weeks ago
San Rafael, United States The Bison Group Full timeResponsibilitiesRead and understand existing data processes implemented in Databricks and efficiently rebuild and optimize them.Collaborate closely with the engineering team to integrate data solutions seamlessly into our platform.Take ownership of translating basic product requirements into robust and scalable back-end systems.Demonstrate a proactive...
-
Back End Developer
3 weeks ago
San Rafael, United States The Bison Group Full timeResponsibilitiesRead and understand existing data processes implemented in Databricks and efficiently rebuild and optimize them.Collaborate closely with the engineering team to integrate data solutions seamlessly into our platform.Take ownership of translating basic product requirements into robust and scalable back-end systems.Demonstrate a proactive...
-
Back End Developer
3 days ago
San Rafael, United States The Bison Group Full timeResponsibilities Read and understand existing data processes implemented in Databricks and efficiently rebuild and optimize them. Collaborate closely with the engineering team to integrate data solutions seamlessly into our platform. Take ownership of translating basic product requirements into robust and scalable back-end systems. Demonstrate a proactive...
-
Azure Data Engineer
2 weeks ago
San Francisco, United States eTeam Inc. Full timeShould have 10+ Years of experience and at least 5-7 years of experience in cloud environment with required skills. Skills Required: Ability to blueprint, design and deploy scalable, high-availability and fault tolerant systems on Azure, GCP or similar cloud environments Knowledge on Data Lake and Data Factory solutioning Knowledge and experience with...
-
Senior Data Engineer
2 weeks ago
San Francisco, United States UpRecruit Full timeJob Details: Title: Sr. Data Engineer Salary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role in...
-
Senior Data Engineer
2 weeks ago
San Francisco, United States UpRecruit Full timeJob DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...
-
Senior Data Engineer
2 weeks ago
San Francisco, California, United States UpRecruit Full timeJob Details: Title: Sr. Data Engineer Salary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role...
-
Power BI/ Tableau Expert
3 days ago
San Diego, United States Analysis Studio Full timeJob DescriptionJob Description Job Description: We are seeking a highly skilled and experienced BI Architect/Tableau Architect Specialist to join our dynamic team. The ideal candidate will possess a diverse skill set in data analytics, visualization tools, and database management. Key Responsibilities: Develop and maintain interactive and insightful...