Senior Data Engineer

4 weeks ago


San Antonio, United States JobRialto Full time
Job Summary:

As part of the Data and Analytics team, the person will architect and deliver highly scalable, high-performance analytical and transformation platforms. The solutions will include cloud, hybrid, and legacy environments, requiring a broad and deep stack of data analytical, engineering, and architecture skills. This person would also engage in requirements and solution concept development, requiring strong analytic and communication skills.

Responsibilities:

Function as the solution lead for architecting and building the data pipelines and analytical repositories to support the development/enablement of Information Supply Chains - this could include building (1) data provisioning frameworks, (2) data integration into data warehouse, data marts, and other analytical repositories (3) integration of analytical results into operational systems, (4) development of data lakes and other data archival stores.

Build an end-to-end data solutions from understanding business requirements.

Optimally leverage the data management tool components for developing efficient solutions for data management, data storage, data packaging, and integration. Develop overall design and determine the division of labor across various architectural components.

Deploy and customize Standard Architecture components that can be reused.

Assist in the development of task plans including schedule and effort estimation.

Skills and Qualifications:

Bachelor's Degree or foreign equivalent in Computer Science, Electrical Engineering, Mathematics, Computer Applications, Information Systems, or Engineering is required.

Highly experienced in Data analytical functions.

Azure cloud experience (ADLS, ADF, Synapse, Logic Apps, Event Hub).

Strong data architecture & modeling skills.

10+ years' total experience in the data space, devising end-to-end data solutions.

6+ years' advanced distributed schema and SQL development skills including partitioning for performance of ingestion and consumption patterns.

2+ years' experience in data engineering, leveraging Python, Pyspark, etc.

Education: Bachelors Degree

Additional client information:

  • San Francisco, CA, United States Data Masked Full time

    Neighbors around the world turn to Nextdoor daily to receive trusted information, give and get help, get things done, and build real-world connections with those nearby — neighbors, businesses, and public services. At Nextdoor, our Growth Marketing team is charged with driving member growth and revenues from businesses advertising on the platform. This...


  • San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Antonio, United States H-E-B Full time

    Responsibilities: H-E-B Digital is seeking new team members (Partners)! Since our inception, we've been investing heavily in our customers' digital experience, reinventing how they find inspiration from food, how they make food decisions, and how they ultimately get food into their homes. This is an exciting time to join H-E-B Digital, and we're hiring...


  • San Antonio, United States Diverse Lynx Full time

    Job Title Senior Data Engineer Relevant Experience (in Yrs) 2 or more years experience developing, deploying and supporting high-quality, fault-tolerant data pipelines (leveraging distributed, data movement technologies and approaches, including but not limited to ETL and streaming ingestion and processing) 1 or more years experience in Snowflake & DBT...


  • San Antonio, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...


  • San Francisco, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of the fastest-growing infrastructure company in history. In just a few short years, we’ve shaken up the industry by challenging traditional architecture models and introduced a revolutionary set of storage possibilities through our...


  • San Antonio, United States Diverse Lynx Full time

    Job Description: Role : Senior data Engineer/ETL Developer Description :Job Description:? Analyze, develop, refactor, fix, test, review and deploy functionality, and bug fixes in ETL that moves data between Snowflake data layers.? Database and Query tuning, diagnosis, and resolution of performance issues leveraging ELT and push-down if required.? Use and...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning,...

  • Senior Data Engineer

    1 month ago


    San Francisco, United States UpRecruit Full time

    Job DescriptionJob DescriptionJob Details: Title: Sr. Data EngineerSalary: $180-$230K Requirements: 8+ years of software dev exp (Large Data Sets or Big Data)Location: 100% onsite (San Francisco Bay Area) Our client, a gaming startup, is seeking a Sr. Data Engineer to join their passionate team. The ideal candidate is an experienced engineer who will play a...

  • Senior Data Engineer

    2 months ago


    San Francisco, United States Sephora Full time

    At Sephora we inspire our customers, empower our teams, and help them become the best versions of themselves.  We create an environment where people are valued, and differences are celebrated. Every day, our teams across the world bring to life our purpose: to expand the way the world sees beauty by empowering the ExtraOrdinary in each of us. We are...


  • San Francisco, United States Siri InfoSolutions Inc Full time

    Job DescriptionJob DescriptionSenior Data Engineer 12 MonthsSFO, CA( Onsite)Need to be strong with object oriented programming languages Java, Scala, PythonNeed to have some frontend skills JavaScript or similar.Skill set Big Data: Scala, Databricks, Spark SQL, Spark Streaming ( Nice to Have ), Python ( Nice to Have ), PySpark ( Nice to Have )Cloud: Azure ,...


  • San Francisco, United States Social Finance Ltd Full time

    Who we are: Shape a brighter financial future with us. Together with our members, we're changing the way people think about and interact with personal finance. We're a next-generation fintech company using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting,...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis....


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of cloud platforms. Join us and be part...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that leverage the scalability, flexibility, and power of...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of data-driven innovation! Our company is committed to harnessing the power of big data to drive transformative change and solve complex problems across industries. We're dedicated to building scalable and efficient big data solutions that enable advanced analytics, machine...

  • Software Engineer

    2 months ago


    San Francisco, CA, United States Nova Credit Full time

    Full Time] Senior Software Engineer (Data) at Nova Credit (United States) | BEAMSTART Jobs Senior Software Engineer (Data) Nova Credit United States Full Time Remote Work Stock Options At Nova Credit, our mission is to power a more fair and inclusive financial system for the world. If you have no credit, it can take years to build that up, even...