AWS Data Engineer

4 weeks ago

San Francisco, California, United States Lorven technologies Full time
Job Title: AWS Data Engineer

Job Summary:

Lorven technologies is seeking a highly skilled AWS Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our data infrastructure. Your expertise in AWS services and data engineering best practices will be essential in driving our data initiatives forward.

Key Responsibilities:

  • Data Onboarding: Onboard various data sources into the data lake, ensuring seamless integration and data consistency.
  • Data Pipeline Development: Design, develop, and maintain scalable and efficient data pipelines using AWS services such as Lambda, Step Functions, and EMR.
  • Data Registration: Register data sources and manage metadata to ensure data discoverability and accessibility.
  • Data Quality Management: Implement data quality checks and transformations to ensure the accuracy and reliability of data.
  • Data Governance: Comply with data governance principles and best practices to ensure data security, privacy, and compliance.
  • Infrastructure as Code: Utilize Terraform scripting to manage and automate AWS infrastructure.
  • Data Processing: Leverage Spark and other big data technologies to process and analyze large datasets.
  • Orchestration: Use Airflow and Step Functions to orchestrate complex data workflows.
  • Data Modeling: Work with Snowflake, Iceberg table formats, and other data modeling tools to design and optimize data storage solutions.

Requirements:

  • AWS Services: Proficiency in AWS Lake Formation, Step Functions, Lambda (serverless), EC2, EMR, and EKS.
  • Scripting and Programming: Strong experience with Python and Terraform scripting.
  • Data Tools: Experience with Jupyter Notebook, RDS, Snowflake, and Iceberg table formats.
  • Big Data Technologies: Expertise in Spark and data pipeline orchestration tools like Airflow and dbt.
  • Data Engineering: Solid understanding of data engineering principles, including ETL processes, data warehousing, and data modeling.
  • Data Governance: Knowledge of data governance principles and best practices.
  • Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data-related issues.
  • Communication: Excellent communication skills with the ability to collaborate effectively with cross-functional teams.

Preferred Qualifications:

  • Certifications: AWS Certified Data Engineer or Analytics Specialty, AWS Certified Solutions Architect, or other relevant certifications.
  • Experience: Previous experience in a similar role within a fast-paced, data-driven environment.

  • AWS Data Engineer

    3 weeks ago

    San Francisco, California, United States Norconsulting Global Recruitment Full time

    Job Title: AWS Data EngineerJob Summary:We are seeking an experienced AWS Data Engineer to join our team at Norconsulting Global Recruitment. The ideal candidate will have a strong background in designing, developing, and maintaining data infrastructure on AWS.Key Responsibilities:Data Onboarding: Onboard various data sources into the data lake, ensuring...

  • AWS Data Engineering Specialist

    4 weeks ago

    San Francisco, California, United States Sparktek Full time

    At Sparktek, we're seeking a seasoned professional to spearhead our data engineering efforts. The ideal candidate will have a strong background in AWS Data Engineering and Architecture, with a focus on Pharma Commercial domain expertise. Key responsibilities include:Key ResponsibilitiesDesigning and implementing data patterns and consumer domains using AWS...

  • AWS Data Infrastructure Specialist

    4 weeks ago

    San Francisco, California, United States Aitek Group Full time

    AWS Data EngineerWe are seeking a highly skilled AWS Data Engineer to join our team at Aitek Group.Job Summary:The AWS Data Engineer will be responsible for designing, developing, and managing our data infrastructure on AWS. This includes integrating various data sources into our data lake, developing robust data pipelines, and ensuring data quality and...

  • AWS Data Architect/Data Engineer Position

    4 weeks ago

    San Mateo, California, United States Technogen, Inc. Full time

    Job Title: AWS Data Architect/Data Engineer PositionJob Summary:We are seeking an experienced AWS Data Architect with a strong background in data engineering to join our team at Technogen, Inc. in Foster City, CA. As a key member of our data architecture team, you will be responsible for designing and implementing data patterns, establishing customer...

  • Cloud Data Engineer

    3 weeks ago

    San Francisco, California, United States Varite Full time

    Job Title: Cloud Data EngineerJob Summary:We are seeking a highly skilled Cloud Data Engineer to join our team at Varite. As a Cloud Data Engineer, you will be responsible for designing, developing, and implementing complex data warehouse and business intelligence solutions using AWS Cloud Data Warehousing Technologies.Key Responsibilities:* Design and...

  • Cloud Data Engineer

    3 weeks ago

    San Francisco, California, United States Software Guidance & Assistance Full time

    Job Title: Cloud Data Engineer - Data Warehouse SolutionsJob Summary:Software Guidance & Assistance, Inc. is seeking a Cloud Data Engineer to design, develop, and implement data warehouse solutions using AWS Cloud Data Warehousing Technologies. The ideal candidate will have expertise in developing and analyzing complex SQL, data modeling, and ETL tools, as...

  • Cloud Data Engineer

    4 weeks ago

    San Francisco, California, United States Saxon Global Full time

    Job Title: Cloud Data Engineer - Pharmaceutical IndustryWe are seeking a highly skilled Cloud Data Engineer to join our team at Saxon Global in the pharmaceutical industry. The successful candidate will have a strong background in data engineering, with expertise in data ingestion, ETL, analytics, and other data-related services, specifically using AWS...

  • Data Engineer

    3 weeks ago

    San Francisco, California, United States Trucksmarter Full time

    Transforming the Logistics Industry with DataAt TruckSmarter, we're revolutionizing the logistics industry by harnessing the power of data. As a Data Engineer, you'll play a critical role in designing and building scalable data pipelines that drive business growth and efficiency.Key Responsibilities:Design and implement data pipelines using DBT and AWS...

  • Senior Data Engineer

    4 weeks ago

    San Francisco, California, United States Crunchyroll Full time

    About the RoleCrunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The Data Engineering team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.As a Senior Data Engineer, you will play a pivotal role in designing,...

  • Data Engineer

    4 weeks ago

    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at REQ Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines using cloud-based technologies such as AWS.Develop...

  • Cloud Data Engineer

    4 weeks ago

    San Francisco, California, United States Stefanini Group Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at Stefanini Group. As a Cloud Data Engineer, you will be responsible for designing, developing, and implementing complex data warehouse and business intelligence solutions.Key Responsibilities:Contribute to the design and development of data warehouse and...

  • Cloud Data Engineer

    3 weeks ago

    San Francisco, California, United States Varite Full time

    Job SummaryVarite is seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have expertise in developing and analyzing complex SQL on various RDBMS, as well as experience with ETL tools and AWS Cloud Data Warehousing Technologies.Key Responsibilities Contributes to the design, development, testing, implementation, and review...

  • Cloud Data Engineer Position

    3 weeks ago

    San Francisco, California, United States Stefanini Full time

    Job DetailsStefanini is seeking a skilled Cloud Data Engineer to join our team in San Francisco, CA. As a Cloud Data Engineer, you will contribute to the design, development, and implementation of complex data warehouse and business intelligence solutions.Key ResponsibilitiesDesign and develop complex data warehouse applicationsDevelop software from...

  • Senior Data Engineer

    4 weeks ago

    San Francisco, California, United States Mindlance Full time

    Job Brief:We are seeking a Senior Data Engineer to join our Runtime Platform Group. In this role, you will build our FedRAMP-authorized environment for U.S. Federal Government projects.As a Senior Data Engineer, you'll be part of a team building a secure, compliant SaaS platform for Federal government-led construction projects. This will involve building...

  • Senior Data Engineer

    4 weeks ago

    San Francisco, California, United States Mindlance Full time

    Job Brief:We are seeking a highly skilled Senior Data Engineer to join our Runtime Platform Group. In this role, you will be responsible for building our FedRAMP-authorized environment for U.S. Federal Government projects.As a Senior Data Engineer, you will be part of a team building a secure, compliant SaaS platform for Federal government-led construction...

  • Data Center Operations Manager

    4 weeks ago

    San Francisco, California, United States Amazon Data Services, Inc. Full time

    About the RoleAmazon Web Services (AWS) is seeking a highly skilled Data Center Operations Manager to join our expanding Infrastructure Operations team. As a key member of our team, you will be responsible for ensuring the overall availability and reliability of our data center operations, meeting or exceeding defined service levels.The ideal candidate will...

  • Data Engineer-EDMIII

    3 weeks ago

    San Francisco, California, United States Accelon Inc Full time

    Data Engineer RoleWe are seeking a skilled Data Engineer to join our team at Accelon Inc. The ideal candidate will have a strong background in programming and SQL, with experience in cloud applications and data warehousing.Responsibilities Strong knowledge of marketing domain and data analytics Experience with cloud applications, preferably AWS Strong...

  • Data Engineer-EDMIII

    4 weeks ago

    San Francisco, California, United States Accelon Inc Full time

    Job Title: Data Engineer-EDMIIIAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Accelon Inc. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data infrastructure that powers batch and real-time data processing of millions of records.Key Responsibilities: Strong knowledge of...

  • Cloud Data Engineer

    3 weeks ago

    San Francisco, California, United States Stefanini Group Full time

    Job Summary:Stefanini Group is seeking a skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, developing, and implementing complex data warehouse and business intelligence solutions using AWS Cloud Data Warehousing Technologies.Key Responsibilities:• Contribute to the design, development, testing,...

  • AWS Cloud Engineer

    4 weeks ago

    San Diego, California, United States Saxon Global Full time

    Job Title: AWS Applications EngineerWe are seeking an experienced AWS Applications Engineer to join our team at Saxon Global. The ideal candidate will have a strong background in AWS services, with expertise in high availability, AWS Glue, AWS Fargate, AWS Analytics, and AWS Lambdas.Responsibilities:Collaborate with cross-functional teams to understand...