Data Engineer

2 days ago


san francisco, United States REQ Solutions Full time

Job Title: Data Engineer

Location: San Francisco, CA 94105 (Hybrid role)

Duration: 6 Months contract with possibility of extension


Must have skills:

  • Data Engineer, Python, SQL
  • Minimum years of experience: 5 years
  • Marketing background


Job Description:

  • Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL knowledge.
  • The prospective individual needs to have a good understanding of marketing Domain, Data warehousing, Analytics, Programming and Strong Database Experience.


Responsibilities:

  • Strong Knowledge on Marketing Domain
  • Working Experience on Cloud Application, Preferable AWS
  • Strong Hands-on experience with Programming skill, Preferable Python
  • Strong Hands-on experience with database programming SQL, Procedures and functions
  • Strong Hands-on experience with building and using APIs with huge data extraction
  • Strong Hands-on experience with AWS components lik API Gateway, Lambda, SQS, Experience working on any ETL tool.
  • Should have a product-focused mindset to understand business requirements and architect systems that will scale and extend to accommodate those needs
  • Build and scale data infrastructure that powers batch and real-time data processing of millions of records
  • Develop high-level designs and implement high scalable web and cloud solutions
  • Collaborate with architects, product designers, product managers, engineers to implement high-quality solutions
  • Proactively and continuously evaluate and address issues related to performance, stability, scalability, and extensibility of the systems.
  • Research and prototype new ideas, technologies and patterns relating to the task
  • Take full ownership of the initiative and deliver it end to end solution


Minimum Qualifications:

  • Familiar with workflow management tools, like Airflow and Oozie
  • Experience building code-driven infrastructure on public cloud platforms, preferably AWS
  • 3+ years’ experience in developing full-stack, web technology solutions utilizing: JavaScript, NODE JS, REST APIs, Amazon Web Services, microservices, serverless design/technologies
  • Hands-on experience with Relational database technologies like MySQL, etc. is highly preferred
  • Should have a very strong foundation in JavaScript, and must have a clear understanding of basic web fundamentals such as prototype-based inheritance, scopes, Event Loop, Memory Management in JS, etc
  • Should be good at developing micro front-end applications and is expected to have the knowledge to create good abstractions that can be reused
  • Should have a solid understanding of source code management using GIT.
  • Familiarity with the software development process, including specification, quality assurance, and documentation
  • Advanced interpersonal skills to effectively promote ideas, collaborate across teams and influence stakeholders to reach decisions
  • Detail-oriented with respect to software development process, communication and documentation
  • Capable of performing requirements gathering, analysis and documentation
  • Excellent verbal and written communication skills, with the ability to communicate with stakeholders at various levels
  • Bachelor’s degree in computer science, Information Systems or other equivalent experience in software development/IT


  • San Francisco, California, United States VAST Data Full time

    About the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry with its Universal Storage platform.As a key member of our team, you will play a crucial role in shaping the future of data...

  • Data Engineer

    1 week ago


    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerREQ Solutions is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business.Key Responsibilities:Design and implement data pipelines to extract, transform, and load data from various sources.Develop and...

  • Data Engineer

    4 days ago


    San Francisco, California, United States REQ Solutions Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at REQ Solutions. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data pipelines using cloud-based technologies such as AWS.Develop...

  • Data Engineer

    1 day ago


    San Francisco, California, United States Syntricate Technologies Full time

    Job Title: Data EngineerJob Description:We are seeking a skilled Data Engineer to join our team at Syntricate Technologies. As a Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Snowflake and SQL. You will work closely with our team to ensure the smooth operation of our data infrastructure...

  • Data Engineer

    4 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data EngineerAt Unreal Gigs, we're revolutionizing the way businesses harness data to drive insights and make informed decisions. As a Data Engineer, you'll play a pivotal role in designing, building, and maintaining the data infrastructure that powers our analytics and machine learning initiatives.Key Responsibilities:Data Pipeline Development:...

  • Data Engineer

    4 weeks ago


    San Francisco, California, United States Legalist Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Legalist, an institutional alternative asset management firm. As a Data Engineer, you will play a critical role in designing and developing scalable data pipelines to collect, process, and analyze large volumes of data efficiently.Key Responsibilities:Design and develop...

  • Data Engineer

    1 day ago


    San Francisco, California, United States Brex Full time

    Transforming Data into InsightsBrex is a leading AI-powered spend platform that helps companies spend with confidence. As a Data Engineer at Brex, you will play a critical role in transforming raw data into actionable insights for various departments across the organization.You will collaborate closely with Data Scientists, Software Engineers, and business...


  • San Francisco, California, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking a highly skilled Data Center Operations Specialist to join our team at Amazon Data Services, Inc. As a key member of our Data Center Engineering Operations team, you will play a critical role in maintaining and operating our critical infrastructure systems to ensure 99.999% uptime of our cloud computing portfolio.Key...

  • Data Engineer

    1 day ago


    San Francisco, California, United States Airbyte Full time

    Role OverviewAirbyte is seeking a highly skilled Data Engineer to join our Data Team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and analytics infrastructure to support our product development initiatives.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using...

  • Data Engineer

    3 weeks ago


    San Francisco, United States TEKsystems co Allegis Group Full time

    Description:The Data engineer will collaborate closely with the growth and data foundation teams to define and create foundational data tables, migrate test tables while adhering to EDW standards, and build self-serve ETL frameworks capable of handling streaming and batch processing. The engineer will also take ownership of ETL workflows, ensuring data...

  • Data Engineer

    1 day ago


    San Francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...

  • Data Engineer

    2 weeks ago


    San Francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...

  • Data Engineer

    2 weeks ago


    San Francisco, United States REQ Solutions Full time

    Job Title: Data EngineerLocation: San Francisco, CA 94105 (Hybrid role)Duration: 6 Months contract with possibility of extensionMust have skills:Data Engineer, Python, SQLMinimum years of experience: 5 yearsMarketing backgroundJob Description:Data and Analytics Engineer, this job posting is specific for a "Data Engineer" with Strong Programming and SQL...


  • San Francisco, California, United States Veterans Sourcing Group Full time

    {"h1": "Data Engineer - Hybrid Role", "p": "We are seeking a highly skilled Data Engineer to join our team at Veterans Sourcing Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that power our business. You will work closely with our product designers, product managers, and engineers to...

  • Lead Data Engineer

    4 weeks ago


    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Lead Big Data EngineerAt Unreal Gigs, we're seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, building, and maintaining our big data infrastructure and pipelines.Key Responsibilities:Lead a team of big data engineers, providing guidance, mentorship,...


  • San Francisco, California, United States STONE Resource Group Full time

    Unlock Your Potential as a Data Engineering ManagerWe are seeking a seasoned Data Engineering Manager to lead our data engineering team in designing, building, and maintaining scalable data infrastructure and pipelines. As a key member of our team, you will oversee the development of robust data solutions that support analytics, reporting, and business...


  • San Francisco, United States Freemind Solutions Full time

    Founding Data Engineer / Scientist Location: SF - Bay Area / Los Angeles Role type: Full time Experience: 5+ years Role We are seeking an exceptional Founding Data Engineer/Scientist to join our core team and shape the data-driven foundation of our company. This unique role will blend the responsibilities of data engineering and data science,...

  • Data Engineer II

    1 day ago


    San Francisco, California, United States Ross Full time

    Job SummaryWe are seeking a highly skilled Data Engineer II to join our team at Ross. The successful candidate will play a critical role in engineering data solutions that support Ross reporting and analytic needs.The ideal candidate will have at least 7 years of experience in data engineering, with a strong background in designing and modeling data...


  • San Francisco, California, United States Unreal Gigs Full time

    Unreal Gigs is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines.Key Responsibilities:* Design and implement scalable and efficient data pipelines for ingesting, processing, and transforming large...


  • San Francisco, California, United States Thumbtack Full time

    About ThumbtackThumbtack is a digital marketplace that connects homeowners with professionals for various services. We're building a platform that makes it easy for people to find and hire the right professionals for their home projects.The Data Platform TeamThe Data Platform team is a central team of software engineers who work on building and maintaining...