Lead Data Engineer

4 weeks ago


Seattle, United States JobRialto Full time
Description:

Key projects:

Exploration of generative AI

Technology requirements:

Proficiency in Apache Spark, including Spark Core, Spark SQL and Spark Streaming.

Proficiency in languages such as Python for data processing and scripting.

Degree or certifications required:

Bachelor's degree in computer science, management information systems, or related discipline

Years experience:

5+

Required background? Skills?:

Experience in designing and implementing ETL processes using Databricks notebooks for efficient data extraction, transformation, and loading.

In-depth knowledge of the Databricks Unified Analytics Platform and its features for collaborative big data analytics.

Understanding of data modeling concepts for designing database structures.

Proficiency in working with both relational databases and NoSQL databases.

Integration of data from diverse sources, including APIs, databases, streaming data, and external data feeds.

Implementation of processes to ensure data quality, including data validation, cleansing, and error handling.

Knowledge of cluster management, optimization, and scaling for efficient data processing.

Optimization of Spark jobs and Databricks clusters for better performance.

Proficiency in cloud platforms such as Azure for building scalable and flexible data architectures.

Use of tools like Apache Airflow, ADF, or Databricks to orchestrate and schedule data workflows.

Nice-to-Haves:

Knowledge of data security best practices and the implementation of measures to ensure data privacy and compliance.

Implementation of monitoring and logging solutions to track the health and performance of pipelines.

Familiarity with monitoring platforms like DataDog and New Relic

Azure

Top 3:

Data Engineering 5+

Databricks 5+

Spark/DevOps practices 5+

Education: Bachelors Degree

Additional client information:

  • Seattle, United States Harnham Full time

    TITLE: Staff Data Engineer Lead COMPENSATION: $190k TO $220k Base plus bonus and equity LOCATION: Seattle, WashingtonHybrid- You must be available to come into office at least 2x per weekTHE COMPANY: You will join a company that is a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure, DevOps, data/metadata...


  • Seattle, United States Harnham Full time

    TITLE: Staff Data Engineer Lead COMPENSATION: $190k TO $220k Base plus bonus and equity LOCATION: Seattle, WashingtonHybrid- You must be available to come into office at least 2x per weekTHE COMPANY: You will join a company that is a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure, DevOps, data/metadata...


  • Seattle, United States Harnham Full time

    TITLE: Staff Data Engineer Lead COMPENSATION: $190k TO $220k Base plus bonus and equity LOCATION: Seattle, WashingtonHybrid- You must be available to come into office at least 2x per weekTHE COMPANY: You will join a company that is a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure, DevOps, data/metadata...

  • Solutions Engineer

    4 weeks ago


    Seattle, United States Data Skrive Full time

    Job DescriptionJob DescriptionFounded in Seattle, WA, Data Skrive has grown into the world's leading producer of automated sports content. Our clients include companies such as The Associated Press, ESPN, USA Today, Fox Sports, and other global sports brands. At Data Skrive, we strive to build an inclusive environment that encourages, supports, and...

  • Lead Data Scientist

    7 days ago


    Seattle, Washington, United States Logic2020 Inc. Full time

    Job Description As a Lead Data Scientist joining Logic20/20’s Advanced Analytics practice, you’ll transform data into powerful insights capable of driving enlightened decision making. You’ll work closely with the client to understand their business needs, then frame those needs as statistical problems and solve them with leading-edge methodologies....


  • Seattle, United States Amazon Data Services, Inc. Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Data Engineer

    4 weeks ago


    Seattle, United States Resource Informatics Group Inc Full time

    Job DescriptionJob DescriptionResponsibilities:  1. Work in big data. Take existing solutions, optimize and build high-performance algorithms. Scale algorithms on terabytes of data. Improve time complexity and space complexity of data pre-processing. Recommend ways to improve data reliability, efficiency and quality.2. Process structured and unstructured...

  • Sr Data Engineer

    6 days ago


    Seattle, United States Feuji Full time

    Feuji Inc is IT solutions company with operations in multiple geographies and specialization across domains. We believe in delivering solutions that will have a measurable positive impact on our client s business and bottom line. Feuji was born out of the desire to create a great company that would pave the way for greater good. We take pride in making Feuji...


  • Seattle, United States Hireio, Inc. Full time

    Job DescriptionJob DescriptionTeam IntroductionThe Data Platform team works on building data infrastructures and data products to support business engineering teams.As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain...

  • Sr. Data Engineer

    2 weeks ago


    Seattle, Washington, United States Blue Origin LLC Full time

    At Blue Origin, we envision millions of people living and working in space for the benefit of Earth. We're working to develop reusable, safe, and low-cost space vehicles and systems within a culture of safety, collaboration, and inclusion. Join our diverse team of problem solvers as we add new chapters to the history of spaceflightThis role is part of...


  • Seattle, United States Chateck Inc Full time

    Direct Client - Sr Lead Data Engineer Apache Spark, Spark Core, Spark SQL, Spark Streaming – Data Bricks Location: Hybrid (Seattle, WA) Length: 12+ Months Job description This position contributes to Client success by building enterprise data services for analytic solutions. This position is responsible for design, development, testing and support for...

  • Data Engineer

    3 days ago


    Seattle, United States Apex Systems Full time

    Data Engineer IIILocation: Seattle, WA 98109 (on-site 3 days per week)*No free parking on siteNumber of Openings: 2Estimated Start Date: 06/03/24Contract Duration: 11 monthsSchedule: 40 hrs/wk, Mon-Fri, 9am-6pm PST is idealPay Rate: $60 - $70/hr on W2Job Description:Enterprise client is looking for a Data Engineer to join the Infrastructure Automation team....

  • Data Engineer

    3 days ago


    Seattle, United States Apex Systems Full time

    Data Engineer IIILocation: Seattle, WA 98109 (on-site 3 days per week)*No free parking on siteNumber of Openings: 2Estimated Start Date: 06/03/24Contract Duration: 11 monthsSchedule: 40 hrs/wk, Mon-Fri, 9am-6pm PST is idealPay Rate: $60 - $70/hr on W2Job Description:Enterprise client is looking for a Data Engineer to join the Infrastructure Automation team....

  • Data Engineer

    2 weeks ago


    Seattle, United States Moorecroft Systems Full time

    An exciting opportunity to grow and advance your career awaits!Moorecroft Systems is hiring for a Data Engineer for a large, enterprise level client.This is a ON SITE position with a 12+ month contract.Candidates must be located in Orlando, FL, Burbank, CA, or Seattle, WA to be considered. Basic Qualifications3+ years of progressively complex experience in...

  • Data Engineer

    2 weeks ago


    Seattle, United States Moorecroft Systems Full time

    An exciting opportunity to grow and advance your career awaits!Moorecroft Systems is hiring for a Data Engineer for a large, enterprise level client.This is a ON SITE position with a 12+ month contract.Candidates must be located in Orlando, FL, Burbank, CA, or Seattle, WA to be considered. Basic Qualifications3+ years of progressively complex experience in...

  • Data Engineer

    2 weeks ago


    Seattle, United States Moorecroft Systems Full time

    An exciting opportunity to grow and advance your career awaits!Moorecroft Systems is hiring for a Data Engineer for a large, enterprise level client.This is a ON SITE position with a 12+ month contract.Candidates must be located in Orlando, FL, Burbank, CA, or Seattle, WA to be considered. Basic Qualifications3+ years of progressively complex experience in...

  • Lead Electrical

    1 month ago


    Seattle, United States Avalanche Fusion Full time

    Job DescriptionJob DescriptionAvalanche is a Seattle-based start-up developing fusion microreactors for clean, energy-dense power generation at a scale you can hold in your hands. Our unique approach allows us to build, test, break, learn and iterate on reactors in days to weeks. The modular design is designed to provide power to applications from austere...


  • Seattle, United States Amazon Data Services, Inc. Full time

    Help AWS customers by designing and delivering new products that accelerate network scaling projects within AWS data centers. The software you will own is critical to meeting customer demand for more datacenter network capacity. Our team to builds software systems that help builders in data centers complete technical cable and patching operations. Our...

  • Sr Data Engineer

    23 hours ago


    Seattle, WA, United States Feuji Full time

    Feuji Inc is IT solutions company with operations in multiple geographies and specialization across domains. We believe in delivering solutions that will have a measurable positive impact on our client s business and bottom line. Feuji was born out of the desire to create a great company that would pave the way for greater good. We take pride in making Feuji...


  • Seattle, United States Talis Consulting Group Full time

    Talis is hiring a Services Architect / Lead Software Engineer to develop live-ops features for an exciting early-stage game studio. Founded by industry veterans with a proven track record of success, this studio offers a unique opportunity to be part of a pioneering team that has launched a game that is already profitable with plenty of room to grow as a...