Azure Data Engineer

1 week ago


Palo Alto, United States Beacon Hill Staffing Group Full time
This position is no longer open for applications

Salary: USD170000 - USD172000 per year

One of our clients in Palo Alto is looking for Azure Data Engineer with the following skills and experience:

NOTE: This is a DIRECT HIRE position. Candidates will be working 3 days onsite in Palo Alto, CA

Must-Haves:

  • Expertise in Azure Cloud platform services.
  • Proficient in SQL with a focus on Azure SQL.
  • Heavy experience with RESTful API development.
  • Familiarity with Azure Data Factory (ADF).
  • Experience working with Prophecy and Purview for data pipeline design and data governance.

Responsibilities:

  • Design and develop end-to-end data pipelines across various data sources and systems, ensuring data quality and integrity.
  • Develop data models, structures, and ETL jobs for efficient data acquisition and transformation.
  • Work closely with cloud service providers to align solutions with platform offerings.
  • Manage and maintain cloud-based data and analytics platforms, including performing quick proof of concepts for data solutions.
  • Implement Unified Data governance and Data Quality Management solutions for enterprise data governance.
  • Interact with business stakeholders to understand requirements and translate them into technology solutions.

Qualifications:

  • Bachelor’s degree in computer science, computer engineering, or related field with 10+ years of experience.
  • Strong expertise in Azure SQL, including complex SQL queries and performance tuning.
  • Experience with Azure API Management Service and RESTful API development.
  • Proficiency in real-time data processing using Azure Event Hubs, Service Bus, and Stream Analytics.
  • Knowledge of data transformation languages like .Net/C#, Python, Java, R, or Scala, preferably with Databricks/Spark.
  • Experience with NoSQL Databases and Azure CosmosDB.
  • Familiarity with Azure Purview for data cataloging and metadata management.
  • Experience with Azure Data Lake Storage Gen2 and Azure BLOB storage.
  • Understanding of different data formats such as Parquet, Avro, CSV, ORC, etc.
  • Experience in creating, scheduling, and monitoring Azure Data Factory (ADF) pipelines.
  • Previous experience in a fast-paced, agile environment.
  • Ability to work with on-shore/off-shore teams.
#J-18808-Ljbffr

  • Palo Alto, United States Coretek, Inc. Full time

    Coretek is seeking a Senior Azure Infrastructure Consultant to join our team. This position is the opportunity for continued growth and support to reach Architect level. Coretek Services is an industry leading consulting and managed solutions provider based in Southeastern Michigan built on a foundation of passionate technology professionals that embody our...


  • Palo Alto, United States Assistianindia Full time

    Required Skills & Qualifications: Experience: 7+ years in network engineering, with at least 2 years of hands-on experience withAzure networking services. Education: Bachelor’s degree in computer science, Information Technology, or a related field (orequivalent experience). Certifications: Azure certifications (such as Azure Network Engineer Associate)...


  • Palo Alto, United States AiDash Full time

    About AiDash AiDash is making critical infrastructure industries climate-resilient and sustainable with satellites and AI. Using our full-stack SaaS solutions, customers in electric, gas, water utilities, transportation, and construction are transforming asset inspection and maintenance - and complying with biodiversity net gain mandates and carbon capture...


  • Palo Alto, United States AiDash AiDash Inc. Full time

    About AiDashAiDash is making critical infrastructure industries climate-resilient and sustainable with satellites and AI. Using our full-stack SaaS solutions, customers in electric, gas, water utilities, transportation, and construction are transforming asset inspection and maintenance - and complying with biodiversity net gain mandates and carbon capture...

  • Network Engineer

    3 weeks ago


    palo alto, United States Quantum World Technologies Inc. Full time

    The Network Engineering team is responsible for architecting, building, automating, and managing our Global Network Infrastructure in Datacenter and all three major public cloud providers. As a Senior Network Engineer, you will work with talented colleagues on challenging projects within the TechOps Infrastructure. You’ll enjoy this team if you like...

  • Network Engineer

    3 weeks ago


    palo alto, United States Quantum World Technologies Inc. Full time

    The Network Engineering team is responsible for architecting, building, automating, and managing our Global Network Infrastructure in Datacenter and all three major public cloud providers. As a Senior Network Engineer, you will work with talented colleagues on challenging projects within the TechOps Infrastructure. You’ll enjoy this team if you like...

  • Network Engineer

    3 weeks ago


    Palo Alto, United States Quantum World Technologies Inc. Full time

    The Network Engineering team is responsible for architecting, building, automating, and managing our Global Network Infrastructure in Datacenter and all three major public cloud providers. As a Senior Network Engineer, you will work with talented colleagues on challenging projects within the TechOps Infrastructure. You’ll enjoy this team if you like...


  • Palo Alto, United States ZipRecruiter Full time

    Job DescriptionJob DescriptionWe offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)Our Mission:To actively connect people to their next great opportunity. Who We Are: ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart...


  • Palo Alto, United States Inficare Full time

    Role : Cloud Security Engineer Duration : 6 - 8 Months Location : Palo Alto, CA (PST Time Zone). JOB DESCRIPTION Minimum years of 8-10 Years The Cloud Ops & Engineering team is responsible for reviewing user requirements and guiding stakeholders in their Cloud onboarding in All Public Clouds (AWS, GCP, Azure). As a Senior Cloud Engineer, you will be part of...

  • Cloud Devops Engineer

    3 weeks ago


    Palo Alto, United States Quantum World Technologies Inc. Full time

    Looking for US Citizen onlyThe Cloud Ops & Engineering team is responsible for reviewing user requirements and guiding stakeholders in their Cloud onboarding in All Public Clouds (AWS, GCP, Azure). As a Senior Cloud Engineer, you will be part of the Cloud Ops & Engineering team within TechOps Infrastructure. The person in this role will be mainly responsible...

  • Cloud Devops Engineer

    3 weeks ago


    palo alto, United States Quantum World Technologies Inc. Full time

    Looking for US Citizen onlyThe Cloud Ops & Engineering team is responsible for reviewing user requirements and guiding stakeholders in their Cloud onboarding in All Public Clouds (AWS, GCP, Azure). As a Senior Cloud Engineer, you will be part of the Cloud Ops & Engineering team within TechOps Infrastructure. The person in this role will be mainly responsible...

  • Product Data Engineer

    3 weeks ago


    Palo Alto, United States xAI Full time

    Job DescriptionJob DescriptionAbout xAIxAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. Engineers are...


  • Palo Alto, United States Obsidian Security Full time

    Job DescriptionJob DescriptionAbout Us:Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization....

  • Data/ML Architect

    3 weeks ago


    Palo Alto, United States Purgo Full time

    The Data Architect role offers the successful candidate the opportunity to pioneer the adoption of generative AI in design, development, and migration of data applications. This is a hands-on technical role involving deep collaboration with both Purgo AI’s product/engineering team and its customers/partners. The role drives the maturation and adoption of...


  • Palo Alto, United States Cozen Technology Solutions Inc Full time

    Government Cloud Security Engineer-L3 Duration- Long Term Contract Minimum years of 10-12 Years Location - Palo Alto, CA The person in this role will be mainly responsible for managing and supporting IAM Org Policies, SSO and security policies in AWS, Azure & GCP Gov Clouds Responsibilities Include: Develop and Maintain Cloud Operations and Optimization...

  • Software Engineer

    4 weeks ago


    Palo Alto, United States Gauss Labs Full time

    As a Gaussian Software & Platform Engineer, you will be responsible for leading the architecture, design, development and launch of some of the core software products. You will be working with other passionate and talented Software Engineers and Applied Scientists and have opportunities to learn various machine learning algorithms and gain insights around...

  • Software Engineer

    2 weeks ago


    Palo Alto, United States Gauss Labs Full time

    In this role, you will lead the architecture, design, development, and launch of core software products, working alongside talented Software Engineers and AI Scientists. You'll have the opportunity to deepen your knowledge of machine learning and AI while shaping our overall strategy through defining product features, driving system architecture, and...

  • Network Engineer

    3 weeks ago


    Palo Alto, United States The Juno Group, Inc. Full time

    This is a remote position. We are looking for three (3) Network Engineers to provide support for an ongoing project with a tech company in Silicon Valley. Job Title: Network Engineer (3 Positions Open)Location: 100% REMOTEJob Type: Contract 3 Months with potential for extension ***Independent/Direct Contractors only...

  • Software Engineer

    1 month ago


    palo alto, United States Acceler8 Talent Full time

    Software Engineer - AI Training DataIntroductionWe are seeking a Software Engineer - AI Training Data to tackle complex challenges in data management. This role is ideal for an engineer passionate about building innovative systems and optimizing large-scale datasets for advanced AI applications.About the CompanyThis organization is dedicated to reshaping the...

  • Software Engineer

    1 month ago


    Palo Alto, United States Acceler8 Talent Full time

    Software Engineer - AI Training DataIntroductionWe are seeking a Software Engineer - AI Training Data to tackle complex challenges in data management. This role is ideal for an engineer passionate about building innovative systems and optimizing large-scale datasets for advanced AI applications.About the CompanyThis organization is dedicated to reshaping the...