Current jobs related to Data Engineer, Engineering Data Management - San Francisco - Rose International

  • Senior Systems Engineer

    2 weeks ago

    San Francisco, California, United States VAST Data Full time

    About the RoleVAST Data is seeking a highly skilled Senior Systems Engineer to contribute to our innovative team.This is an exceptional opportunity to be part of a pioneering company that is revolutionizing the data storage industry with its Universal Storage platform.As a key member of our team, you will play a crucial role in shaping the future of data...

  • Data Architect II, Cloud Engineering

    3 weeks ago

    San Francisco, California, United States Aircon Engineering Inc Full time

    About the RoleWe are seeking a highly skilled Data Architect II, Cloud Engineering to join our team at Aircon Engineering Inc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust data architectures, models, and pipelines to ensure data integrity, scalability, and performance.Key...

  • Data Engineer

    1 month ago

    San Antonio, United States Global Channel Management, Inc Full time

    Data Engineer needs 9 years total relevant experience PLUS a BS in Engineering or Computer Science Data Engineer requires: Secret clearance Secret Security Clearance-Current active TS, SCI eligible 9 years total relevant experience plus the following: BS in Engineering, Computer Science, or technical degree or industry experience equivalent (+4 years...

  • Data Engineer

    3 weeks ago

    San Antonio, United States Global Channel Management, Inc Full time

    Data Engineer needs 9 years total relevant experience PLUS a BS in Engineering or Computer Science Data Engineer requires: Secret clearance Secret Security ClearanceCurrent active TS SCI eligible 9 years total relevant experience plus the following: BS in Engineering Computer Science or technical degree or industry experience equivalent (4 years relevant...

  • Data Engineer

    4 months ago

    San Francisco, United States Legalist Full time

    Job DescriptionJob DescriptionIntro description:Legalist is an institutional alternative asset management firm. Founded in 2016 and incubated at Y Combinator, the firm uses data-driven technology to invest in credit assets at scale. We are always looking for talented people to join our team.As a highly collaborative organization, our data engineers work...

  • Data Engineer

    4 months ago

    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! At our company, we're revolutionizing how businesses leverage data to drive insights and make informed decisions. Our mission is to develop scalable and robust data infrastructure that empowers organizations to unlock the full potential of their data. Join...

  • Data Engineer

    3 days ago

    San Francisco, California, United States Unreal Gigs Full time

    Job Title: Data EngineerAt Unreal Gigs, we're revolutionizing the way businesses harness data to drive insights and make informed decisions. As a Data Engineer, you'll play a pivotal role in designing, building, and maintaining the data infrastructure that powers our analytics and machine learning initiatives.Key Responsibilities:Data Pipeline Development:...

  • Data Center Operations Manager

    2 weeks ago

    San Francisco, California, United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking a highly skilled Data Center Manager to join our expanding Infrastructure Operations team at Amazon Web Services (AWS). As a key member of our team, you will be responsible for ensuring the overall availability and reliability of our data center operations, meeting or exceeding defined service levels.The ideal candidate will have...

  • Data Engineer

    4 weeks ago

    San Francisco, United States DynPro Inc. Full time

    Job Title: Data EngineerLocation: Downtown San Francisco, CA / RemoteType: Full-time/Contract Job Summary: We are seeking a highly skilled Data Engineer to join our client's team. This role involves designing, building, and maintaining robust data solutions. You will utilize a diverse set of technologies and tools to enhance our data infrastructure and...

  • Data Engineer

    4 weeks ago

    San Francisco, United States DynPro Inc. Full time

    Job Title: Data EngineerLocation: Downtown San Francisco, CA / RemoteType: Full-time/Contract Job Summary: We are seeking a highly skilled Data Engineer to join our client's team. This role involves designing, building, and maintaining robust data solutions. You will utilize a diverse set of technologies and tools to enhance our data infrastructure and...

  • Data Engineer

    3 days ago

    San Francisco, California, United States Legalist Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Legalist, an institutional alternative asset management firm. As a Data Engineer, you will play a critical role in designing and developing scalable data pipelines to collect, process, and analyze large volumes of data efficiently.Key Responsibilities:Design and develop...

  • Software Engineering Manager

    4 weeks ago

    San Francisco, California, United States People Data Labs Full time

    About the RoleWe are seeking an experienced Engineering Manager to lead our Web and Customer applications team at People Data Labs. As a key member of our engineering leadership team, you will be responsible for managing a team of Frontend and Fullstack software engineers, driving projects and initiatives through the team, and working closely with product...

  • Project Manager, Product Data Operations

    4 weeks ago

    San Francisco, United States ECF Data, LLC Full time

    Meta is looking for an experienced and motivated Project Manager to join the Product Data Operations (PDO) team. PDO provides data and insights that power machine learning and AI, at the core of all Meta products. As a Project Manager, you will play a pivotal role in driving the success of GenAI programs by providing leadership, strategic oversight, and...

  • Data Engineering Program Manager

    2 weeks ago

    San Francisco, California, United States Apple Full time

    About the RoleWe are seeking an experienced Program Manager to join our AIML Data EPM group at Apple. As a key member of our team, you will be responsible for delivering scalable, performant, and quality enterprise data services that power our products for hundreds of millions of users worldwide.Key ResponsibilitiesManage data collection and streamlining...

  • Data Engineer

    3 weeks ago

    San Francisco, United States Forsyth Barnes Full time

    Permanent Job Alert: Title: Data Engineer Location: San Francisco, California Salary: Up to $140,000 Industry: FinTech Contact: thomas.harris@forsythbarnes.com Brief Overview: As a Data Engineer at a start-up FinTech company in California, you will play a critical role in building and maintaining the data infrastructure that drives our innovative financial...

  • Data Engineer

    3 weeks ago

    San Francisco, United States Forsyth Barnes Full time

    Permanent Job Alert: Title: Data Engineer Location: San Francisco, California Salary: Up to $140,000 Industry: FinTech Contact: thomas.harris@forsythbarnes.com Brief Overview: As a Data Engineer at a start-up FinTech company in California, you will play a critical role in building and maintaining the data infrastructure that drives our innovative financial...

  • Data Engineer

    3 weeks ago

    San Francisco, United States mavinsys Full time

    Hello We are from Mavinsys Talent Acquisition team based on One World Trade Centre New York. We are specializing in IT services and staffing majorly in lateral hiring/contract. Below is one of our requirement to fill immediately if youre interested please share your candidature to Job Title: Data Engineer Location: San Francisco CA Duration: 12months Job...

  • Senior Data Engineering Manager

    2 weeks ago

    San Francisco, California, United States Atlassian Full time

    About AtlassianAtlassian is a company that empowers teams to unleash their potential. Our mission is to make every team successful, and we achieve this by developing innovative products like Jira, Confluence, and Trello. We believe in giving our employees the freedom to work from anywhere, whether it's an office, home, or a combination of both. This...

  • Engineering Manager, Full Stack

    2 days ago

    San Francisco, California, United States People Data Labs Full time

    Job OpportunityPeople Data Labs is seeking an experienced Engineering Manager to lead our Web and Customer applications team. As a key member of our engineering leadership team, you will be responsible for managing a team of software engineers, driving projects and initiatives, and working closely with product and design counterparts to deliver high-quality...

  • Data Engineer

    4 weeks ago

    San Francisco, United States Infactory Full time

    Job DescriptionJob DescriptionAbout InfactoryWe’re Infactory. Our mission is to further AI innovation through facts and trust. Our fact platform powers AI applications for businesses that depend on accuracy. Whether our customers are building chatbots, search tools, knowledge management systems, or bleeding-edge Gen AI technology, our solution ensures...

Data Engineer, Engineering Data Management

4 months ago

San Francisco, United States Rose International Full time

Date Posted: 06/07/2024

Hiring Organization: Rose International

Position Number: 465521

Job Title: Data Engineer, Engineering Data Management

Job Location: San Francisco, CA, USA, 94115

Work Model: Hybrid

Employment Type: Temporary

Estimated Duration (In months): 7

Min Hourly Rate($): 90.00

Max Hourly Rate($): 117.24

Must Have Skills/Attributes: AWS, PySpark, Python, SQL

Job Description


  • **Only those lawfully authorized to work in the designated country associated with the position will be considered.**


  • **Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.**


***Only qualified Data Engineer candidates located in the San Francisco, CA area will be considered due to the position requiring an onsite presence***


Education Requirement:

• A Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field


Minimum Qualifications:

• 9+ years of experience in a Data Engineering role

• 5+ years of hands-on experience in Snowflake

• Mandatory 5+ years of working in dbt with knowledge on advanced dbt concepts like macros and Jinja templating

• Minimum 4+ years of work experience in B2B Marketing Domain

• Advanced working SQL experience working with relational databases, query authoring (SQL) and working familiarity with a variety of databases

• Experience with scripting languages such as Python

• Experience with big data tools such as PySpark

• Experience with AWS cloud services used often for data engineering including S3, EC2, Glue, Lambda, RDS, or Redshift

• Experience working with APIs to pull and push data

• Experience optimizing ''big data'' data pipelines, architectures and data sets

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

• Able to read existing code to understand functionality and debug issues


Preferred Qualifications:

• Familiarity with Agile and SCRUM methodologies is a plus

• Experience working with PowerBI to develop dashboards is a plus

• Analytical skills related to working with unstructured datasets

• A successful history of processing value from large, disconnected datasets

• Experience working with agile, globally distributed teams


As a Lead Data Engineer, you will build the foundations that enable data driven marketing and the digital transformation journey at Client. You will work with data strategists to understand the business requirements and execute the tactical aspects of delivering on the vision. Your team will drive multiple tool selection initiatives, ingesting data from different source systems to the data lake, Data Wrangling to enable downstream data consumers, developing systems & processes to improve data reliability, developing a comprehensive data catalog and training downstream data consumers. You would also be responsible for leading the deliverables of your juniors as well as taking important decisions relevant to platform architecture and you will report to Sr. Manager, Software Development.


Data Engineer Responsibilities:

• Create and maintain optimal data pipeline architecture

• Assemble complex data sets that meet functional / non-functional requirements

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Dbt and AWS ''big data'' technologies

• Build analytics tools that utilize the data pipeline to provide actionable insights into employee experience, operational efficiency, and other key business performance metrics

• Work with stakeholders to assist with data-related technical issues and support associated data infrastructure needs

• Build processes supporting data transformation, data structures, metadata, dependency and workload management

• Keep up to date with the latest and greatest in feature-sets and capabilities from public cloud providers (such as AWS and Azure) and find ways to apply them back help their team

• Work with data scientists and analysts to strive for greater functionality in our data systems

• Lead a team of data engineers and provide technical guidance and mentorship


**Possibility of extension and/or contract to hire.


Benefits:

For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity:

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).