Data Engineer

7 days ago


San Francisco, United States Varite Full time
Title: Cloud Data Engineer
Location: San Francisco, CA
Position type: Hybrid (2+ days in office)
Pay Range: $80-$90/hour on W2

Job Description:
Responsibilities:
Designs, develops, modifies, tests and automation used to provide data warehouse and business intelligence applications solutions. This includes design, development, architecture recommendations, quality management, metadata and repository creation, trouble-shooting problems and tuning warehouse applications. Develops transition and implementation plans. Recommends changes in development, maintenance and standards.
  • dvanced analytical ability and technical skill as well as the ability to provide innovative solutions to technical needs and business requirements
  • bility to exercise independent judgment in making complex business decisions
  • cute attention to detail with a high level of data integrity and accuracy
  • Excellent verbal and written communication, with interpersonal skills to work with people at all levels of the organization
  • bility to translate highly technical information into non-technical terms
  • Excellent computer skills including Microsoft Office along with various other software applications as needed for the role
  • Broad knowledge of the programming tools, concepts, practices, and principles including design, implementation, and testing
  • Position requires continuous visual concentration and manual dexterity to operate PC
  • Requires prolonged sitting and minimal standing/walking
  • Minor lifting and carrying, not likely to exceed ten pounds (laptop + charger)
  • May require extended work hours and/or schedule flexibility as unexpected situations and/or workflow dictate
  • May require on-call status
  • Rare domestic travel including overnight stays may be necessary
  • 5 to 9+ years of relevant work experience
  • Bachelor's degree or equivalent experience.
  • Contributes to the design, development, testing, implementation, and review of complex data warehouse and business intelligence solutions
  • Develops all or part of complex data warehouse applications, develops software from established requirements, builds reports and dashboards, plans and coordinates work of lower level programmers to meet delivery commitments, creates prototypes; offers insight on the feasibility of system designs
  • Contributes to the design of technology infrastructure and configurations, recommends process improvements
  • Reviews complex patches and new versions of data warehouse applications. Implements complex software packages and deploys code
  • Key participant in cross-functional team initiatives and process improvement projects
Qualifications:
  • 5 to 9+ years of experience in data engineering, data science, and software engineering.
  • Bachelor's degree in computer science, Information Systems, or another related field
  • Must be a US Citizen or a Green Card holder.
  • Expert in developing and analyzing complex SQL on a variety of RDBMS (Microsoft SQL Server, Oracle)
  • Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases
  • Experience with ETL tools (Informatica)
  • bility to create quality ERD's (entity-relationship diagrams)
  • Excellent writing skills for writing user and system documentation
  • WS Cloud Data Warehousing Technologies
  • Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices (S3, DMS, Glue, Lambda)
  • Development/modeling experience with Amazon Redshift
  • Experience using the AWS service APIs, AWS CLI, and SDKs to build applications
  • Proficiency in developing, deploying, and debugging cloud-based applications using AWS
  • bility to use a CI/CD pipeline to deploy applications on AWS (GitLab, Terraform, DBMaestro)
  • bility to apply a basic understanding of cloud-native applications to write code
  • Proficiency writing code for serverless applications
  • bility to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)
  • bility to author, maintain, and debug code modules on AWS
  • Database: AWS Aurora Postgres
  • Data Access: AWS Athen
  • Data Analytics: AWS Quicksight
  • Familiarity working with or knowledge of Alteryx, Collibra, Immuta, Okt plus.
  • Experience with visualization tools (Tableau)
  • Experience creating scripts with Python
  • Experience working on an Agile team
  • Understanding of application lifecycle management
  • Understanding of the use of containers in the development process.


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • San Francisco, California, United States VAST Data Full time

    About VAST DataVAST Data is a pioneering company in the field of data management, revolutionizing the way enterprises capture, catalog, refine, enrich, and protect massive datasets. As a leader in enterprise software infrastructure, we empower real-time data analysis and AI training and inference.We are driven by innovation, customer-centricity, and a...


  • San Francisco, United States Amazon Data Services, Inc. Full time

    This unique vantage point allows the Design Managers to maintain a close connection with project details and drive project outcomes.You will have an impact on the design direction and ability to improve design delivery for an entire region, while establishing design procedures and protocols for the development of future systems.Responsibilities...

  • Staff Data Scientist

    4 weeks ago


    San Francisco, United States Data Masked Full time

    This range is provided by Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $200,000.00/yr - $250,000.00/yr Additional compensation types Annual Bonus and RSUs Data Science Focused Recruitment Consultant Title: Staff Data Scientist Location: Company based in SF, CA - willing to...


  • San Francisco, United States Data Masked Full time

    Experienced Data Scientist Machine Learning - Identity Verification We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions...

  • Data Engineer

    2 months ago


    San Francisco, United States Harnham Full time

    Data Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...

  • Data Engineer

    2 months ago


    san francisco, United States Harnham Full time

    Data Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...

  • Data Engineer

    2 months ago


    san francisco, United States Harnham Full time

    Data Engineer1 Year ContractHybrid (2 Days Onsite)$75-85/hrWe are partnered with a leading beauty retailer, delivering innovative and personalized beauty experiences to their customers. We are looking for a highly skilled Data Engineer to join the team and help enhance our data platforms and analytics capabilities. You will work with cutting-edge...

  • Data Engineer

    2 months ago


    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    7 days ago


    San Francisco, California, United States Databricks Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at Databricks. As a Data Engineer, you will play a critical role in designing and developing scalable data processing systems that meet the needs of our customers.The ideal candidate will have 3-5 years of experience in customer-facing roles, such as Technical Account Management or...

  • Data Engineer

    3 weeks ago


    San Francisco, California, United States Perplexity AI Full time

    Perplexity AI is rapidly scaling both in number of use cases and users. We're seeking an experienced Data Engineer to help build our end-to-end data stack and flywheel.The successful candidate will collaborate closely with Product, Backend, and Data Science teams to design, build, and maintain scalable data pipelines and infrastructure. Key responsibilities...

  • Data Engineer

    6 days ago


    San Francisco, United States Jacobs Full time

    Jacobs has acquired StreetLight Data, a mobility analytics solution provider - marking the company’s second strategic acquisition in recent months and building on its strong foundation of existing technology and #data capabilities. StreetLight pioneered the use of Big Data analytics to help transportation professionals and data analysts measure, analyze...

  • Data Architect

    1 week ago


    San Francisco, California, United States People Data Labs Full time

    Job OverviewWe are a leading provider of high-quality B2B people and company data. Our innovative, fast-growing team is backed by world-class investors.Key Responsibilities:Develop self-serve product offerings to attract new customers and drive revenue growth.Design and implement core tools for our customer success team.Translate business requirements into...

  • Data Engineer

    7 days ago


    San Francisco, California, United States Tbwa ChiatDay Inc Full time

    We are seeking a skilled Data Engineer to join our talented team of engineers who share a mission to make data easily accessible. As part of our growing engineering team, you will be responsible for building and delivering world-class technology.The ideal candidate will have strong Computer Science fundamentals and 5+ years of industry experience building...


  • San Francisco, California, United States Unreal Gigs Full time

    About the Role:We're seeking an experienced Data Engineering Director to join our team at Unreal Gigs. As a key member of our data engineering team, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines.Responsibilities:Lead Data Engineering Efforts:...

  • Data Engineer

    3 weeks ago


    San Francisco, United States Perplexity AI Full time

    Job DescriptionJob DescriptionPerplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel.Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable,...

  • Lead Data Engineer

    5 months ago


    San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us...


  • San Francisco, California, United States People Data Labs Full time

    Role OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.

  • Data Engineer

    7 days ago


    San Francisco, California, United States EPAM Full time

    At EPAM, we are seeking a skilled Data Engineer to join our team. With a salary range of $160K - $170K, this role is an excellent opportunity for those looking to excel in the field of machine learning.We are a global leader in digital platform engineering and development services, committed to making a positive impact on our customers, employees, and...

  • Data Engineer

    1 month ago


    San Francisco, United States Glocomms Full time

    As the Founding Data Engineer, you will play a pivotal role in establishing and building out the data organization within the Finance and Strategy department. Your primary responsibilities will include building a data warehouse, developing customer reporting systems, transforming data, and leveraging AI to solve business problems. This role requires a...