Solution Architect DataOps Azure Data Factory

6 days ago

San Francisco, CA, United States Danta Technologies Full time
Role/Responsibilitie s
We are seeking a highly skilled (Solution Architect) Azure Data/Ops Architect to lead the design and implementation of scalable, automated data operations on Microsoft Azure. This role bridges data engineering, cloud architecture, and DevOps practices to ensure efficient, secure, and reliable data workflows across the organization.

Must Haves for this Opportunity :
  • Experience as Solutions Architect
  • Experience with Data Opps Azure Architect
  • Experience managing End to End Data specific tower
  • Experience with Automation / Optimization (must have)
  • Experience with Azure Databricks
  • Experience with Azure Data Factory
  • Experience with PySpark
  • Experience Leading a team of 10 to 15 people onshore/ offshore mix (Leading, Mentoring, Managing)
  • Experience working within Retail environment.

Key Responsibilities :
  • Architect Azure-Based Data/Ops Solutions:
  • Design and implement end-to-end data pipelines using Azure Data Factory, Synapse Analytics, Azure Databricks, and other Azure services.
  • Develop CI/CD pipelines for data workflows using Azure DevOps and GitHub Actions.
  • Automation & Orchestration:
  • Automate data ingestion, transformation, and delivery processes.
  • Implement workflow orchestration using tools like Apache Airflow or Azure Logic Apps.
  • Monitoring & Optimization:
  • Set up monitoring and alerting for data pipelines using Azure Monitor and Log Analytics.
  • Optimize performance, cost, and scalability of data solutions.
  • Governance & Security:
  • Ensure data governance, lineage, and compliance using Azure Purview and role-based access control (RBAC).
  • Implement data security best practices including encryption, masking, and secure data sharing.
  • Collaboration & Leadership:
  • Work closely with data engineers, analysts, and business stakeholders to align data operations with business goals.
  • Promote Data/Ops culture and best practices across teams.

Required Qualifications :
  • Bachelor's or master's degree in computer science, Data Engineering, or related field.
  • 7+ years of experience in data engineering or cloud architecture.
  • Deep expertise in Azure services: Data Factory, Synapse, Databricks, Blob Storage, Azure SQL, Cosmos DB.
  • Strong understanding of DevOps principles and CI/CD tools.


Notes:- All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Benefits: Danta offers a compensation package to all W2 employees that are competitive in the industry. It consists of competitive pay, the option to elect healthcare insurance (Dental, Medical, Vision), Major holidays and Paid sick leave as per state law.

The rate/ Salary range is dependent on numerous factors including Qualification, Experience and Location.

  • Azure Data Factory(ADF) Lead

    2 weeks ago

    San Francisco, CA, United States Artech Full time

    Job Description: GBAMS: 10173286 Location: San Francisco "? Develop & maintain Azure Data Factory(ADF) Pipelines and Azure Data Bricks(ADB) notebooks (using PySpark)? Migrate RDBMS/traditional ETL workloads into Data Lake/ELT workloads? Analyze, design and implement pertaining to Azure Data Lake and data mart solutions? Able to work directly with client...

  • Azure Data Factory(ADF) Lead

    2 weeks ago

    San Francisco, CA, United States Artech Full time

    Job Description: GBAMS: 10173286 Location: San Francisco "? Develop & maintain Azure Data Factory(ADF) Pipelines and Azure Data Bricks(ADB) notebooks (using PySpark)? Migrate RDBMS/traditional ETL workloads into Data Lake/ELT workloads? Analyze, design and implement pertaining to Azure Data Lake and data mart solutions? Able to work directly with client...

  • Azure Data Factory(ADF) Lead

    6 days ago

    San Francisco, CA, United States Artech Full time

    Job Description: GBAMS: 10173286 Location: San Francisco "? Develop & maintain Azure Data Factory(ADF) Pipelines and Azure Data Bricks(ADB) notebooks (using PySpark)? Migrate RDBMS/traditional ETL workloads into Data Lake/ELT workloads? Analyze, design and implement pertaining to Azure Data Lake and data mart solutions? Able to work directly with client...

  • Solution Data Architect

    2 weeks ago

    San Diego, CA, United States Fusemachines Full time

    Solution Data Architect Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400 full-time...

  • Solution Data Architect

    2 weeks ago

    San Diego, CA, United States Fusemachines Full time

    Solution Data Architect Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400 full-time...

  • Solution Data Architect

    4 days ago

    San Diego, CA, United States Fusemachines Full time

    Solution Data Architect Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400 full-time...

  • Solution Data Architect

    6 days ago

    San Diego, CA, United States Fusemachines Full time

    Solution Data Architect Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400 full-time...

  • Data Architect

    1 week ago

    San Jose, CA, United States Winaxis LLC Full time

    Job Title Data Architect (13-18 Years) Location San Jose, CA (Onsite) Duration Long term contract Key Skills Databricks with ETL and SQL Educational Qualification Bachelors degree in Computer Science, Information Systems, or a related field. Overview We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data...

  • Data Architect

    1 week ago

    San Jose, CA, United States Winaxis LLC Full time

    Job Title Data Architect (13-18 Years) Location San Jose, CA (Onsite) Duration Long term contract Key Skills Databricks with ETL and SQL Educational Qualification Bachelors degree in Computer Science, Information Systems, or a related field. Overview We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data...

  • Data Architect

    1 week ago

    San Jose, CA, United States Winaxis LLC Full time

    Job Title Data Architect (13-18 Years) Location San Jose, CA (Onsite) Duration Long term contract Key Skills Databricks with ETL and SQL Educational Qualification Bachelors degree in Computer Science, Information Systems, or a related field. Overview We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data...