AWS Architect
3 days ago
We are seeking a highly skilled AWS Architect with expertise in cloud architecture, cost optimization, CI/CD frameworks, and data engineering, especially in integrating AWS Glue with Databricks Unity Catalog. This role requires a hands-on architect capable of designing and managing data workflows, orchestration pipelines, and ensuring efficient, scalable, and cost-effective cloud solutions.
Key Responsibilities:
- Design and implement a scalable cloud architecture on AWS with a focus on orchestration and storage efficiency.
- 12+ years of overall experience.
- Build and maintain CI/CD pipelines for data and infrastructure automation.
- Optimize cloud usage and cost across multiple AWS services.
- Develop and manage Databricks notebooks for data pipelines, analytics, and ETL processes.
- Implement and optimize AWS DAGs (Airflow/MWAA) for workflow orchestration.
- Sync and maintain metadata between AWS Glue Data Catalog and Unity Catalog (Databricks).
- Drive performance tuning across data pipelines and compute/storage infrastructure.
- Collaborate with data engineers, analysts, and DevOps teams.
- Proven experience as an AWS Architect (certification preferred).
- Strong knowledge of Databricks and Unity Catalog.
- Hands-on with AWS Glue, S3, Lambda, Step Functions, MWAA/Airflow.
- Experience with Databricks notebooks and Spark performance tuning.
- Proficient in building CI/CD pipelines using tools like GitHub Actions, Code Pipeline, Jenkins, etc.
- Deep understanding of cloud cost optimization strategies.
- Strong scripting/coding skills in Python, SQL, or Scala.
Work Type: Hybrid
-
DICOM Architect with AWS(Fulltime)
1 week ago
San Francisco, CA, United States E-Solutions Full timeHi Professionals, Title: DICOM Architect with AWS(Fulltime) Location: SFO,CA(Onsite) Duration: Fulltime JD: What is in it for you? Experienced enterprise architect with deep understanding of AWS cloud stack, with Dicom / Medical Imaging AI/ML technologies, and regulated environments (GxP/SaMD), responsible for full-stack architecture design across Clinical...
-
DICOM Architect with AWS(Fulltime)
10 hours ago
San Francisco, CA, United States E-Solutions Full timeHi Professionals, Title: DICOM Architect with AWS(Fulltime) Location: SFO,CA(Onsite) Duration: Fulltime JD: What is in it for you? Experienced enterprise architect with deep understanding of AWS cloud stack, with Dicom / Medical Imaging AI/ML technologies, and regulated environments (GxP/SaMD), responsible for full-stack architecture design across Clinical...
-
AWS DevOps Engineer/Architect
5 days ago
San Francisco, CA, United States Diverse Lynx Full timeCloud Operations Manage and optimize AWS infrastructure (EC2, VPC, IAM, S3, RDS, EKS) for performance, availability, and cost efficiency. Automation Infrastructure as Code Implement and maintain IaC solutions (e.g., Terraform, AWS CloudFormation) for repeatable and auditable deployments. CICD Enablement Build and maintain automated pipelines for application...
-
AWS DevOps Engineer/Architect
2 weeks ago
San Francisco, CA, United States Diverse Lynx Full timeCloud Operations Manage and optimize AWS infrastructure (EC2, VPC, IAM, S3, RDS, EKS) for performance, availability, and cost efficiency. Automation Infrastructure as Code Implement and maintain IaC solutions (e.g., Terraform, AWS CloudFormation) for repeatable and auditable deployments. CICD Enablement Build and maintain automated pipelines for application...
-
AWS DevOps Engineer/Architect
13 hours ago
San Francisco, CA, United States Diverse Lynx Full timeCloud Operations Manage and optimize AWS infrastructure (EC2, VPC, IAM, S3, RDS, EKS) for performance, availability, and cost efficiency. Automation Infrastructure as Code Implement and maintain IaC solutions (e.g., Terraform, AWS CloudFormation) for repeatable and auditable deployments. CICD Enablement Build and maintain automated pipelines for application...
-
AWS DevOps Engineer/Architect
2 weeks ago
San Francisco, CA, United States Diverse Lynx Full timeCloud Operations Manage and optimize AWS infrastructure (EC2, VPC, IAM, S3, RDS, EKS) for performance, availability, and cost efficiency. Automation Infrastructure as Code Implement and maintain IaC solutions (e.g., Terraform, AWS CloudFormation) for repeatable and auditable deployments. CICD Enablement Build and maintain automated pipelines for application...
-
AWS DevOps Engineer/Architect
2 weeks ago
San Francisco, CA, United States Diverse Lynx Full timeCloud Operations Manage and optimize AWS infrastructure (EC2, VPC, IAM, S3, RDS, EKS) for performance, availability, and cost efficiency. Automation Infrastructure as Code Implement and maintain IaC solutions (e.g., Terraform, AWS CloudFormation) for repeatable and auditable deployments. CICD Enablement Build and maintain automated pipelines for application...
-
AWS DevOps Engineer/Architect
1 week ago
San Francisco, CA, United States Diverse Lynx Full timeCloud Operations Manage and optimize AWS infrastructure (EC2, VPC, IAM, S3, RDS, EKS) for performance, availability, and cost efficiency. Automation Infrastructure as Code Implement and maintain IaC solutions (e.g., Terraform, AWS CloudFormation) for repeatable and auditable deployments. CICD Enablement Build and maintain automated pipelines for application...
-
Senior Startup Solutions Architect, AWS Startups
2 weeks ago
San Francisco, CA, United States Amazon Full timeJoin us to apply for the Senior Startup Solutions Architect, AWS Startups role at Amazon Web Services (AWS) Description Amazon Web Services (AWS) is committed to making cloud computing accessible for startups of all stages by providing the same technology that powers the world's largest companies. With our extensive experience helping numerous startups, we...
-
Cloud Solutions Architect
1 week ago
San Francisco, CA, United States eTeam Inc. Full timeDeploying large-scale SIL (Software-in-the-Loop) & ML experiments on AWS is a challenging problem. it requires a highly skilled Architect who can provide technical direction to the team and drive successful experiment deployment. Key Responsibilities: Collaborate within Incubation Team's software framework. Generate autonomy requirements and design...