AWS Data Engineer

1 week ago

San Francisco, United States Norconsulting Global Recruitment Full time

In Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San Francisco


AWS Data Engineer

Location: San Francisco ( 3 days onsite 2 days remote)

look for nearby Candidates only ( Only w2 Required)


Rate: 70 USD per hour


Must Have Skills : Spark, AWS, data lake, data pipelining, python


Job Description:


As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will be responsible for onboarding data sources into our data lake, building robust data pipelines, and ensuring data quality and governance. Your expertise in AWS services and data engineering best practices will be essential in driving our data initiatives forward.


Key Responsibilities:

• Data Onboarding: Onboard various data sources into the data lake, ensuring seamless integration and data consistency.

• Data Pipeline Development: Design, develop, and maintain scalable and efficient data pipelines using AWS services such as Lambda, Step Functions, and EMR.

• Data Registration: Register data sources and manage metadata to ensure data discoverability and accessibility.

• Data Quality Management: Implement data quality checks and transformations to ensure the accuracy and reliability of data.

• Data Governance: Comply with data governance principles and best practices to ensure data security, privacy, and compliance.

• Infrastructure as Code: Utilize Terraform scripting to manage and automate AWS infrastructure.

• Data Processing: Leverage Spark and other big data technologies to process and analyze large datasets.

• Orchestration: Use Airflow and Step Functions to orchestrate complex data workflows.

• Data Modeling: Work with Snowflake, Iceberg table formats, and other data modeling tools to design and optimize data storage solutions.

• Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

Required Skills and Qualifications:

• AWS Services: Proficiency in AWS Lake Formation, Step Functions, Lambda (serverless), EC2, EMR, and EKS.

• Scripting and Programming: Strong experience with Python and Terraform scripting.

• Data Tools: Experience with Jupyter Notebook, RDS, Snowflake, and Iceberg table formats.

• Big Data Technologies: Expertise in Spark and data pipeline orchestration tools like Airflow and dbt.

• Data Engineering: Solid understanding of data engineering principles, including ETL processes, data warehousing, and data modeling.

• Data Governance: Knowledge of data governance principles and best practices.

• Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data-related issues.

• Communication: Excellent communication skills with the ability to collaborate effectively with cross-functional teams.

Preferred Qualifications:

• Certifications: AWS Certified Data Engineer or Analytics – Specialty, AWS Certified Solutions Architect, or other relevant certifications.

• Experience: Previous experience in a similar role within a fast-paced, data-driven environment

  • AWS Data Engineer

    2 weeks ago

    San Francisco, California, United States Lorven technologies Full time

    Job Title: AWS Data EngineerJob Summary:Lorven technologies is seeking a highly skilled AWS Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our data infrastructure. Your expertise in AWS services and data engineering best practices will be essential in driving...

  • AWS Data Engineer

    1 week ago

    san francisco, United States Norconsulting Global Recruitment Full time

    In Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San FranciscoAWS Data EngineerLocation: San Francisco ( 3 days onsite 2 days remote)look for nearby Candidates only ( Only w2 Required)Rate: 70 USD per hourMust Have Skills : Spark, AWS, data lake, data pipelining, pythonJob Description:As an AWS Data Engineer, you...

  • AWS Data Engineer

    1 week ago

    San Francisco, United States Norconsulting Global Recruitment Full time

    In Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San FranciscoAWS Data EngineerLocation: San Francisco ( 3 days onsite 2 days remote)look for nearby Candidates only ( Only w2 Required)Rate: 70 USD per hourMust Have Skills : Spark, AWS, data lake, data pipelining, pythonJob Description:As an AWS Data Engineer, you...

  • AWS Data Engineer

    1 week ago

    san francisco, United States Aitek Group Full time

    -------------------------------------------------------------------------------------Hiring *** AWS Data Engineer *** Need to work on our W2------------------------------------------------------------------------------------Position: AWS Data Engineer Location: San Francisco, CA and Jersey City, NJ - HybridJob Description:As an AWS Data Engineer, you will be...

  • AWS Data Engineer

    2 weeks ago

    San Francisco, United States Aitek Group Full time

    -------------------------------------------------------------------------------------Hiring *** AWS Data Engineer *** Need to work on our W2------------------------------------------------------------------------------------Position: AWS Data Engineer Location: San Francisco, CA and Jersey City, NJ - HybridJob Description:As an AWS Data Engineer, you will be...

  • AWS Data Engineer

    1 week ago

    San Francisco, United States Aitek Group Full time

    -------------------------------------------------------------------------------------Hiring *** AWS Data Engineer *** Need to work on our W2------------------------------------------------------------------------------------Position: AWS Data Engineer Location: San Francisco, CA and Jersey City, NJ - HybridJob Description:As an AWS Data Engineer, you will be...

  • AWS Data Engineer

    4 days ago

    San Francisco, California, United States Norconsulting Global Recruitment Full time

    Job Title: AWS Data EngineerJob Summary:We are seeking an experienced AWS Data Engineer to join our team at Norconsulting Global Recruitment. The ideal candidate will have a strong background in designing, developing, and maintaining data infrastructure on AWS.Key Responsibilities:Data Onboarding: Onboard various data sources into the data lake, ensuring...

  • AWS Data Engineering Specialist

    2 weeks ago

    San Francisco, California, United States Sparktek Full time

    At Sparktek, we're seeking a seasoned professional to spearhead our data engineering efforts. The ideal candidate will have a strong background in AWS Data Engineering and Architecture, with a focus on Pharma Commercial domain expertise. Key responsibilities include:Key ResponsibilitiesDesigning and implementing data patterns and consumer domains using AWS...

  • AWS Data Infrastructure Specialist

    2 weeks ago

    San Francisco, California, United States Aitek Group Full time

    AWS Data EngineerWe are seeking a highly skilled AWS Data Engineer to join our team at Aitek Group.Job Summary:The AWS Data Engineer will be responsible for designing, developing, and managing our data infrastructure on AWS. This includes integrating various data sources into our data lake, developing robust data pipelines, and ensuring data quality and...

  • AWS Data Architect/Data Engineer Position

    1 week ago

    San Mateo, California, United States Technogen, Inc. Full time

    Job Title: AWS Data Architect/Data Engineer PositionJob Summary:We are seeking an experienced AWS Data Architect with a strong background in data engineering to join our team at Technogen, Inc. in Foster City, CA. As a key member of our data architecture team, you will be responsible for designing and implementing data patterns, establishing customer...

  • Cloud Data Engineer

    4 days ago

    San Francisco, California, United States Varite Full time

    Job Title: Cloud Data EngineerJob Summary:We are seeking a highly skilled Cloud Data Engineer to join our team at Varite. As a Cloud Data Engineer, you will be responsible for designing, developing, and implementing complex data warehouse and business intelligence solutions using AWS Cloud Data Warehousing Technologies.Key Responsibilities:* Design and...

  • Cloud Data Engineer

    5 months ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us and be part of a dynamic team...

  • Cloud Data Engineer

    4 weeks ago

    San Francisco, California, United States Stefanini North America and APAC Full time

    Job Title: Cloud Data EngineerJob Summary:We are seeking a highly skilled Cloud Data Engineer to join our team at Stefanini North America and APAC. As a Cloud Data Engineer, you will be responsible for designing, developing, and implementing complex data warehouse and business intelligence solutions using cloud-based technologies.Responsibilities:Design and...

  • Cloud Data Engineer

    4 days ago

    San Francisco, California, United States Software Guidance & Assistance Full time

    Job Title: Cloud Data Engineer - Data Warehouse SolutionsJob Summary:Software Guidance & Assistance, Inc. is seeking a Cloud Data Engineer to design, develop, and implement data warehouse solutions using AWS Cloud Data Warehousing Technologies. The ideal candidate will have expertise in developing and analyzing complex SQL, data modeling, and ETL tools, as...

  • Cloud Data Engineer

    1 week ago

    San Francisco, California, United States Saxon Global Full time

    Job Title: Cloud Data Engineer - Pharmaceutical IndustryWe are seeking a highly skilled Cloud Data Engineer to join our team at Saxon Global in the pharmaceutical industry. The successful candidate will have a strong background in data engineering, with expertise in data ingestion, ETL, analytics, and other data-related services, specifically using AWS...

  • Data Engineer

    5 days ago

    San Francisco, California, United States Trucksmarter Full time

    Transforming the Logistics Industry with DataAt TruckSmarter, we're revolutionizing the logistics industry by harnessing the power of data. As a Data Engineer, you'll play a critical role in designing and building scalable data pipelines that drive business growth and efficiency.Key Responsibilities:Design and implement data pipelines using DBT and AWS...

  • Data Engineer

    3 weeks ago

    San Francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...

  • Data Engineer

    1 week ago

    San Francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...

  • Data Engineer

    3 weeks ago

    San Francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...

  • Data Engineer

    1 week ago

    san francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...