AWS Data Engineer

1 month ago

San Francisco, United States Norconsulting Global Recruitment Full time

In Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San Francisco


AWS Data Engineer

Location: San Francisco ( 3 days onsite 2 days remote)

look for nearby Candidates only ( Only w2 Required)


Rate: 70 USD per hour


Must Have Skills : Spark, AWS, data lake, data pipelining, python


Job Description:


As an AWS Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will be responsible for onboarding data sources into our data lake, building robust data pipelines, and ensuring data quality and governance. Your expertise in AWS services and data engineering best practices will be essential in driving our data initiatives forward.


Key Responsibilities:

• Data Onboarding: Onboard various data sources into the data lake, ensuring seamless integration and data consistency.

• Data Pipeline Development: Design, develop, and maintain scalable and efficient data pipelines using AWS services such as Lambda, Step Functions, and EMR.

• Data Registration: Register data sources and manage metadata to ensure data discoverability and accessibility.

• Data Quality Management: Implement data quality checks and transformations to ensure the accuracy and reliability of data.

• Data Governance: Comply with data governance principles and best practices to ensure data security, privacy, and compliance.

• Infrastructure as Code: Utilize Terraform scripting to manage and automate AWS infrastructure.

• Data Processing: Leverage Spark and other big data technologies to process and analyze large datasets.

• Orchestration: Use Airflow and Step Functions to orchestrate complex data workflows.

• Data Modeling: Work with Snowflake, Iceberg table formats, and other data modeling tools to design and optimize data storage solutions.

• Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

Required Skills and Qualifications:

• AWS Services: Proficiency in AWS Lake Formation, Step Functions, Lambda (serverless), EC2, EMR, and EKS.

• Scripting and Programming: Strong experience with Python and Terraform scripting.

• Data Tools: Experience with Jupyter Notebook, RDS, Snowflake, and Iceberg table formats.

• Big Data Technologies: Expertise in Spark and data pipeline orchestration tools like Airflow and dbt.

• Data Engineering: Solid understanding of data engineering principles, including ETL processes, data warehousing, and data modeling.

• Data Governance: Knowledge of data governance principles and best practices.

• Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data-related issues.

• Communication: Excellent communication skills with the ability to collaborate effectively with cross-functional teams.

Preferred Qualifications:

• Certifications: AWS Certified Data Engineer or Analytics – Specialty, AWS Certified Solutions Architect, or other relevant certifications.

• Experience: Previous experience in a similar role within a fast-paced, data-driven environment

  • AWS Data Engineer

    1 month ago

    san francisco, United States Norconsulting Global Recruitment Full time

    In Norconsulting we are currently looking for AWS Data Engineer to join one of our clients in San FranciscoAWS Data EngineerLocation: San Francisco ( 3 days onsite 2 days remote)look for nearby Candidates only ( Only w2 Required)Rate: 70 USD per hourMust Have Skills : Spark, AWS, data lake, data pipelining, pythonJob Description:As an AWS Data Engineer, you...

  • AWS Data Engineer

    4 weeks ago

    San Francisco, California, United States Norconsulting Global Recruitment Full time

    Job Title: AWS Data EngineerJob Summary:We are seeking an experienced AWS Data Engineer to join our team at Norconsulting Global Recruitment. The ideal candidate will have a strong background in designing, developing, and maintaining data infrastructure on AWS.Key Responsibilities:Data Onboarding: Onboard various data sources into the data lake, ensuring...

  • AWS Data Engineer

    5 days ago

    South San Francisco, United States RICEFW Technologies Inc Full time

    (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...

  • Technical Lead AWS Data Engineer

    5 days ago

    South San Francisco, United States Agile Datapro Full time

    Job Title: (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite)Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:· Lead the design, implementation, and optimization of scalable data pipelines and architectures...

  • AWS Data Engineer

    2 weeks ago

    san francisco, United States Compunnel Inc. Full time

    Position: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...

  • AWS Data Engineer

    3 weeks ago

    San Francisco, United States Compunnel Inc. Full time

    Position: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...

  • AWS Data Engineer

    3 weeks ago

    san francisco, United States Compunnel Inc. Full time

    Position: AWS Data Engineer (Technical Lead) - W2 OnlyLocation: SFO, CA (Onsite)Duration: ContractJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:•Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing...

  • DC Design Manager for Region, Data Center Engineering

    7 days ago

    San Francisco, United States Amazon Data Services, Inc. Full time

    This unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...

  • AWS Data Architect

    3 weeks ago

    San Diego, United States Indotronix International Corporation Full time

    Job Title: AWS Data EngineerLocation: Remote (San Diego, CA 92130)Duration: 6 months (possibility of extension or conversion)Job Description:As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data...

  • AWS Data Architect

    3 weeks ago

    san diego, United States Indotronix International Corporation Full time

    Job Title: AWS Data EngineerLocation: Remote (San Diego, CA 92130)Duration: 6 months (possibility of extension or conversion)Job Description:As the Senior Software Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data...

  • RICEFW Technologies Inc | AWS Data Engineer | san francisco, ca

    5 days ago

    san francisco, United States RICEFW Technologies Inc Full time

    (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...

  • RICEFW Technologies Inc | AWS Data Engineer | san francisco, ca

    3 days ago

    san francisco, United States RICEFW Technologies Inc Full time

    (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite) Required Experience Level: 12 – 18 yearsJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services. Responsibilities:Lead the design, implementation, and optimization of scalable data...

  • Staff Engineer

    2 days ago

    San Francisco, United States Early Warning® Full time

    At Early Warning, we’ve powered and protected the U.S. financial system for over thirty years with cutting-edge solutions like Zelle, Paze℠, and so much more. As a trusted name in payments, we partner with thousands of institutions to increase access to financial services and protect transactions for hundreds of millions of consumers and small...

  • Agile Datapro | Technical Lead AWS Data Engineer | san francisco, ca

    5 days ago

    san francisco, United States Agile Datapro Full time

    Job Title: (Technical Lead) AWS Data EngineerLocation: South SFO, CA (Hybrid role – 3 days/week onsite)Job Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:· Lead the design, implementation, and optimization of scalable data pipelines and architectures...

  • Cloud Data Engineer

    4 weeks ago

    San Francisco, California, United States Varite Full time

    Job Title: Cloud Data EngineerJob Summary:We are seeking a highly skilled Cloud Data Engineer to join our team at Varite. As a Cloud Data Engineer, you will be responsible for designing, developing, and implementing complex data warehouse and business intelligence solutions using AWS Cloud Data Warehousing Technologies.Key Responsibilities:* Design and...

  • Cloud Data Engineer

    6 months ago

    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us and be part of a dynamic team...

  • Cloud Data Engineer

    4 weeks ago

    San Francisco, California, United States Software Guidance & Assistance Full time

    Job Title: Cloud Data Engineer - Data Warehouse SolutionsJob Summary:Software Guidance & Assistance, Inc. is seeking a Cloud Data Engineer to design, develop, and implement data warehouse solutions using AWS Cloud Data Warehousing Technologies. The ideal candidate will have expertise in developing and analyzing complex SQL, data modeling, and ETL tools, as...

  • Cloud Data Engineer

    1 month ago

    San Francisco, California, United States Saxon Global Full time

    Job Title: Cloud Data Engineer - Pharmaceutical IndustryWe are seeking a highly skilled Cloud Data Engineer to join our team at Saxon Global in the pharmaceutical industry. The successful candidate will have a strong background in data engineering, with expertise in data ingestion, ETL, analytics, and other data-related services, specifically using AWS...

  • Data Engineer

    1 month ago

    san francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...

  • Data Engineer

    4 weeks ago

    San Francisco, California, United States Trucksmarter Full time

    Transforming the Logistics Industry with DataAt TruckSmarter, we're revolutionizing the logistics industry by harnessing the power of data. As a Data Engineer, you'll play a critical role in designing and building scalable data pipelines that drive business growth and efficiency.Key Responsibilities:Design and implement data pipelines using DBT and AWS...