AWS Tech Lead with Databricks

1 month ago

Raritan, United States Birlasoft Full time

About Birlasoft


Birlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. Its consultative and design thinking approach makes societies more productive by helping customers run businesses. As part of the multibillion-dollar diversified CK Birla Group, Birlasoft with its 12,500+ professionals, is committed to continuing the Group’s 162-year heritage of building sustainable communities.


Overview:

An AWS Tech Lead with Databricks SME (Subject Matter Expert) knowledge is responsible for designing, deploying, and managing cloud-based infrastructure on AWS and supporting data solutions using Databricks. The role involves leading a team to ensure scalable, secure, and cost-efficient cloud services while integrating data pipelines and analytics solutions.


Roles and Responsibilities:

  • Cloud Infrastructure Management:
  1. Design, implement, and maintain AWS cloud solutions, including VPCs, EC2 instances, S3 storage, RDS, and networking configurations.
  2. Ensure high availability, disaster recovery, and backup solutions for cloud environments.
  3. Implement Infrastructure as Code (IaC) using tools like Terraform, AWS CloudFormation, or CDK.


  • Data Solutions with Databricks:
  1. Serve as a Databricks SME, guiding the architecture and implementation of ETL pipelines, data lakes, and machine learning workflows using Databricks on AWS.
  2. Optimize Databricks clusters for performance, cost, and security.
  3. Integrate Databricks with other AWS services like S3, Redshift, and Glue for seamless data processing.


  • Leadership and Team Collaboration:
  1. Lead a team of cloud engineers, providing mentorship and technical guidance.
  2. Collaborate with cross-functional teams including data scientists, analysts, and developers to understand requirements and translate them into scalable cloud and data architectures.
  3. Manage project timelines, ensuring timely delivery of cloud and data solutions.


  • Security and Compliance:
  1. Implement best practices for cloud security, including identity and access management (IAM), encryption, and VPC security.
  2. Ensure compliance with industry standards (e.g., GDPR, HIPAA) and internal security policies.
  3. Conduct regular security audits and optimize cloud configurations to reduce risk.


  • Performance Optimization and Monitoring:
  1. Set up monitoring, logging, and alerting using AWS CloudWatch, Datadog, or similar tools.
  2. Analyze system performance and provide recommendations for improvement.
  3. Troubleshoot complex issues related to cloud infrastructure, data pipelines, and Databricks clusters.

Minimum Skills and Qualifications:

  • Technical Skills:
  1. Strong expertise in AWS services (EC2, S3, Lambda, RDS, VPC, CloudFormation, IAM, etc.).
  2. Proficiency with Databricks, including building and managing data pipelines, data lakes, and machine learning models.
  3. Experience with Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation.
  4. Knowledge of big data technologies like Apache Spark, Hadoop, or Delta Lake.
  5. Proficient in programming and scripting languages (e.g., Python, SQL, Scala).
  6. Experience with CI/CD pipelines for deploying cloud infrastructure.


  1. Soft Skills:Strong leadership and project management skills.
  2. Excellent problem-solving and analytical skills.
  3. Ability to work collaboratively with diverse teams.
  4. Strong communication skills, with the ability to explain technical concepts to non-technical stakeholders.

Certifications:

  1. Required:AWS Certified Solutions Architect (Associate or Professional)
  2. Databricks Certified Associate Developer for Apache Spark


  1. Preferred:AWS Certified DevOps Engineer – Professional
  2. AWS Certified Big Data – Specialty or AWS Certified Data Analytics – Specialty
  3. Databricks Certified Professional Data Engineer

  • AWS Databricks Architect

    2 months ago

    Raritan, United States Birlasoft Full time

    About the jobAbout BirlasoftBirlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. Its consultative and design thinking approach makes societies more productive by helping customers run businesses. As part of the multibillion-dollar diversified CK Birla Group, Birlasoft...

  • AWS Databricks Architect

    2 months ago

    Raritan, United States Birlasoft Full time

    The Possibilities are Endless When You ChallengeTheNormBirlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. Its consultative and design thinking approach makes societies more productive by helping customers run businesses. As part of the multibillion-dollar diversified...

  • AWS Databricks Solutions Architect

    4 weeks ago

    Raritan, New Jersey, United States Birlasoft Full time

    About the roleAbout BirlasoftBirlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. Its consultative and design thinking approach makes societies more productive by helping customers run businesses. As part of the multibillion-dollar diversified CK Birla Group, Birlasoft...

  • AWS Databricks Solutions Architect

    4 weeks ago

    Raritan, New Jersey, United States Birlasoft Full time

    The Possibilities are Endless When You ChallengeTheNormBirlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. Its consultative and design thinking approach makes societies more productive by helping customers run businesses. As part of the multibillion-dollar diversified...

  • AWS Cloud Architect with Databricks Expertise

    1 month ago

    Raritan, New Jersey, United States The Dignify Solutions LLC Full time

    Key Responsibilities:As a seasoned AWS Cloud Architect with Databricks expertise, you will be responsible for designing and deploying scalable and secure cloud infrastructure for Databricks workloads. Your expertise in AWS components, including VPC, Subnets, PrivateLink, Security Groups, Kinesis, STS, API Gateway, Lambda, Storage Configuration, Workspace...

  • Databricks Architecture Specialist

    4 weeks ago

    Raritan, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title:Databricks Architecture SpecialistWork Location: Raritan NJJob Description:As a Databricks Architecture Specialist at Futran Tech Solutions Pvt. Ltd., you will be responsible for designing and implementing production-grade Databricks clusters. Your expertise in Shell scripting, Perl, Python, Hive, and SQL will be crucial in deploying and managing...

  • Databricks Architect

    2 months ago

    Raritan, United States Birlasoft Full time

    The Possibilities are Endless When You ChallengeTheNorm Birlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. Its consultative and design thinking approach makes societies more productive by helping customers run businesses. As part of the multibillion-dollar...

  • AWS Cloud Data Engineering Lead

    4 weeks ago

    Raritan, New Jersey, United States Birlasoft Full time

    We are seeking a seasoned AWS Databricks Architect to join our team at Birlasoft.With at least 10 years of experience in data engineering and architecture, you will be responsible for designing and managing comprehensive data solutions on AWS, utilizing Databricks for data engineering, machine learning, and advanced analytics.You will integrate AWS services...

  • AWS Data Architect

    2 months ago

    Raritan, United States Birlasoft Full time

    We are looking for AWS Databricks Architect who can work at 5 days onsite at Raritan NJ.At least 10 years of experience in Data engineering and architectureProven experience in AWS architecture and Databricks.Strong expertise in data engineering, cloud services (AWS), and analytics.Key Responsibilities:Architect and manage comprehensive data solutions on...

  • AWS Data Architect

    1 month ago

    raritan, United States Birlasoft Full time

    We are looking for AWS Databricks Architect who can work at 5 days onsite at Raritan NJ.At least 10 years of experience in Data engineering and architectureProven experience in AWS architecture and Databricks.Strong expertise in data engineering, cloud services (AWS), and analytics.Key Responsibilities:Architect and manage comprehensive data solutions on...

  • Data Architect

    4 weeks ago

    Raritan, New Jersey, United States Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Databricks ArchitectJob Summary: We are seeking a highly skilled Databricks Architect to join our team at Futran Tech Solutions Pvt. Ltd.. As a key member of our data engineering team, you will be responsible for designing and implementing scalable and secure data architectures using Databricks.Key Responsibilities:Design and deploy...

  • Databricks Solutions Architect

    1 month ago

    Raritan, New Jersey, United States QualRec Solutions LLC Full time

    Job OverviewAs a seasoned Databricks Architect, you will play a key role in designing and implementing data governance and data warehousing solutions for our clients. With a strong background in cloud data lakes and big data workloads, you will be responsible for architecting scalable and cost-effective solutions that meet the needs of our enterprise...

  • Cloud Architect Position

    4 weeks ago

    Raritan, New Jersey, United States Birlasoft Full time

    We are seeking an AWS Technical Architect with experience in AWS data services such as Glue, Athena, Lake Formation, Data Sync, Data Brew, and Macie.This role requires expertise in working with Snowflake and Databricks.Birlasoft is looking for a skilled professional to fill this position.AWS certified solution architect - professionalExperience working with...

  • GenAI Technical Lead

    4 weeks ago

    Raritan, New Jersey, United States Pozent Corporation Full time

    Key Responsibilities:As a GenAI Solution Architect at Pozent Corporation, you will be responsible for defining target state technology architecture and roadmaps. You will have the opportunity to work with big data platforms such as Snowflake and Databricks, and expertly navigate cloud compute environments (GCP/AWS/Azure) along with cloud-native...

  • Cloud Architect

    3 weeks ago

    raritan, United States Birlasoft Full time

    We are looking for AWS Technical Architect with below exp.AWS Technical ArchitectRaritan, NJ AWS certified solution architect - professional⁠Experience working with AWS data services such as Glue, Athena, lakeformation, data sync, data brew, Macie etc⁠Experience working with Snowflake, Databricks

  • Cloud Architect

    3 months ago

    Raritan, United States Birlasoft Full time

    We are looking for AWS Technical Architect with below exp.AWS Technical ArchitectRaritan, NJ AWS certified solution architect - professional⁠Experience working with AWS data services such as Glue, Athena, lakeformation, data sync, data brew, Macie etc⁠Experience working with Snowflake, Databricks

  • Lead Data Platform Engineer

    4 weeks ago

    Raritan, New Jersey, United States J&J Family of Companies Full time

    About the Role:We are seeking a highly skilled Data Platform Engineer to lead our team in developing and maintaining our AI/ML platform. As a Lead Data Platform Engineer, you will be responsible for guiding critical aspects of the team's charter and strategy, collaborating with Data Scientists and Applied ML teams, and defining standard methodologies and...

  • Senior Data Governance Architect

    3 weeks ago

    Raritan, New Jersey, United States QualRec Solutions LLC Full time

    Job DescriptionWe are seeking a highly skilled Databricks Architect to join our team at QualRec Solutions LLC. As a key member of our technical team, you will be responsible for designing and implementing data governance solutions using Databricks as a Service model. Your expertise in data governance, data warehousing, and cloud data lakes will help our...

  • AWS Cloud Architect with Python Expertise

    1 month ago

    Raritan, New Jersey, United States The Dignify Solutions LLC Full time

    Key Responsibilities: Design and develop scalable cloud infrastructure using AWS services, particularly EC2. Develop and deploy Python applications on AWS, leveraging Flask for web applications and APIs. Collaborate with cross-functional teams to design and manage databases using SQL. Utilize JavaScript for front-end development and integration with AWS...

  • Big data Architect with Snowflake

    6 months ago

    Raritan, United States The Dignify Solutions LLC Full time

    Must Have: Strong Snowflake, migration from data lake to Snowflake, strong in data integration like snowpipe, informatica, python, spark, AWS. Strong Architect profile. Minimum 12years of experience as technical architect and should have designed big data solutions on Hadoop based technologies specially Cloudera Should have strong hands on experience Hadoop...