Big Data Engineer

4 weeks ago


San Francisco, United States CareerBuilder Full time

05 Jan 2023
Job Responsibilities:
Work with tech and product teams to develop new tools and systems to support the growth of the business
Create and optimize our data pipeline architecture
Build data access platform for our data science and tech teams
Design and implement modernized ETL through cloud-based solutions
Design and develop large-scale data structures for business intelligence analytics by using data mining tools
Write reliable software to ingest, transform and distribute data into our internal applications.
Support infrastructure and database processes
Add and improve logging and monitoring to current solutions
Provide ad-hoc queries and analysis as needed.

Job Skills:
Similar and 5+ years of professional experience, or MS and 3+ years
Strong experience with databases, SQL, writing and debugging
Professional experience with Python development
Experience working with MongoDB, Redis, and PostgreSQL
Experience with cloud-based data solutions (AWS preferred)
Experience with automation/configuration management/enterprise schedulers
System monitoring and alerting, dashboarding experience

#J-18808-Ljbffr


  • Big Data Engineer

    2 days ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of big data innovation! At our company, we're leading the charge in harnessing the power of big data to drive insights and innovation. Our mission is to develop scalable and robust big data solutions that empower organizations to extract value from their data at scale. Join us and...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...


  • San Francisco, United States Hireio, Inc. Full time

    Job DescriptionJob DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the...


  • San Francisco, California, United States Hireio, Inc. Full time

    Team Introduction The Data Platform team works on building data infrastructures and data products to support business engineering teams. As a Software Development Engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on...


  • San Diego, California, United States ServiceNow Full time

    Job Description You will be part of the ServiceNow Cloud Services Big Data Team.  The Big Data team is building the next-generation platform that collects, stores and provides real-time access to large amounts of data. You will also build real-time analytic tools and reporting capabilities for various purposes including: Monitoring, alerting and...


  • San Francisco, CA, United States Sonsoft Full time

    Company DescriptionSonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionPreferred• At least 5 years of experience in technology...


  • San Francisco, CA, United States Sonsoft Full time

    Company DescriptionSonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionAt least 5 years of experience in technology consulting,...


  • San Diego, California, United States ServiceNow Full time

    Job Description Please Note:  This position will include supporting our US Federal customers. “This position requires passing a ServiceNow background screening, USFedPASS (US Federal Personnel Authorization Screening Standards). This includes a credit check, criminal/misdemeanor check and taking a drug test. Any employment is contingent upon passing...


  • San Francisco, United States TuneIn Full time

    **Senior Data Warehouse Engineer** San Francisco / Engineering Platform / Full-time Regular **Location: San Francisco, Los Angeles, New York, or Remote** At TuneIn, we are reinventing radio for a connected world, with live sports, up-to-the-minute news, curated music, millions of podcasts, and over 120,000 streaming radio stationsstreamed to tens of...

  • Senior Data Engineer

    3 weeks ago


    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Sr. Data Engineer

    1 day ago


    San Francisco, United States BayOne Solutions Full time

    Title: Sr. Data EngineerLocation: San Francisco, CA (Hybrid)Duration: 12 Month/ContractSkills Required:Big Data: Scala, Databricks, Spark SQL, Spark Streaming, Python, PysparkCloud: Azure, ADFSystem Design: API Design, Event driven architecture.Microservice: Core Java 8 or above, SpringBoot, Azure FunctionsFront end: JavaScripting, React


  • San Francisco, California, United States Trace3, Inc Full time

    Our major field office locations include Denver, Indianapolis, Grand Rapids, Lexington, Los Angeles, Louisville, Texas, San Francisco.Juice - The "Stuff" it takes to be a Needle MoverWe look forward to the goal, mentallymapping outevery checkpoint on the pathway to success, and visualizing what the final destination looks and feels like.We're looking to add...

  • Sr. Data Engineer

    2 weeks ago


    San Francisco, United States SS&C Technologies Full time

    SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000 financial services and healthcare...

  • Senior Data Engineer

    3 weeks ago


    San Francisco, California, United States UpRecruit Full time

    Job Details:  Title: Sr. Data Engineer Salary: $180-$230K  Requirements: 8+ years of software dev exp (Large Data Sets or Big Data) Location: 100% onsite (San Francisco Bay Area)  Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a vital role...

  • Data Engineer

    2 days ago


    San Francisco, United States WPRO TALENTS Full time

    Job DescriptionJob DescriptionThis is a remote position. Our client is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering sub graphs set the industry standard and solidify The Graph as the premier solution for organizing and accessing blockchain data. At our clients, we...

  • Data Engineer

    2 days ago


    San Francisco, United States Sia Partners Full time

    Job DescriptionJob DescriptionCompany DescriptionSia Partners is a next-generation management consulting firm. We offer a unique blend of AI and design capabilities, augmenting traditional consulting to deliver superior value to our clients. Counting 3,000 consultants in 19 countries, we expect to achieve USD 420 million in turnover for the current fiscal...

  • Software Engineer

    2 days ago


    San Francisco, United States Equilibrium Energy Full time

    About our Company Equilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...


  • San Francisco, United States GSPANN Technologies, Inc Full time

    About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...