Direct Client

Found in: Jooble US O C2 - 3 weeks ago


Seattle WA, United States Chateck Inc Full time

Direct Client - Sr Lead Data Engineer Apache Spark, Spark Core, Spark SQL, Spark Streaming - Data Bricks
Location: Hybrid (Seattle, WA)
Length: 12+ Months

Job description
This position contributes to Client success by building enterprise data services for analytic solutions. This position is responsible for design, development, testing and support for data pipelines to enable continuous data processing for data exploration, data preparation and real-time business analytics. Models and acts in accordance with Client guiding principles.

Tops 3 Skills Needed

1

Data Engineering

5+ years

2

Data Bricks

5+ years

3

Sparks/ Dev ops practices

5+ years

Years of Experience:

5+ years

Technology requirements:

Proficiency in Apache Spark, including Spark Core, Spark SQL and Spark Streaming.
Proficiency in languages such as Python for data processing and scripting.

Basic Qualifications/ Experience:

Experience in designing and implementing ETL processes using Databricks notebooks for efficient data extraction, transformation, and loading.
In-depth knowledge of the Databricks Unified Analytics Platform and its features for collaborative big data analytics.
Understanding of data modeling concepts for designing database structures.
Proficiency in working with both relational databases and NoSQL databases.
Integration of data from diverse sources, including APIs, databases, streaming data, and external data feeds.
Implementation of processes to ensure data quality, including data validation, cleansing, and error handling.
Knowledge of cluster management, optimization, and scaling for efficient data processing.
Optimization of Spark jobs and Databricks clusters for better performance.
Proficiency in cloud platforms such as Azure for building scalable and flexible data architectures.
Use of tools like Apache Airflow, ADF, or Databricks to orchestrate and schedule data workflows.

Degree or certifications required:

Education (minimum education level, degree or certification necessary): Bachelor’s degree in computer science, management information systems, or related discipline

Skills (minimum skills required):

5-7+ years Architect and design large scale high performance distributed systems
5-7+ years SQL Platform
2+ years Exposure No-SQL Platform is a plus
5+ years Hadoop, YARN, MapReduce, Pig or Hive, Spark
2+ years Data platform implementation on Azure or AWS is a plus

Key Responsibilities:

Responsibilities and essential job functions include but are not limited to the following:
Demonstrate deep knowledge and ability to lead others in the data engineering team to build and support noninteractive (batch, distributed) & real-time, highly available data, data pipeline and technology capabilities
Translate strategic requirements into business requirements to ensure solutions meet business needs
Work with infrastructure provisioning & configuration tools to develop scripts to automate deployment of physical and virtual environments; to develop tools to monitor usage of virtual resources
Assist in the definition of architecture that ensure that solutions are built within a consistent framework
Lead resolution activities for complex data issues
Define & implement data retention policies and procedures
Define & implement data governance policies and procedures
Identify improvements in team coding standards and help in implementation of the improvements
Leverage subject matter expertise to coordinate issue resolution efforts across peer support groups, technical support teams, and vendors
Develop and maintain documentation relating to all assigned systems and projects
Perform systems and applications performance characterization and trade-off studies through analysis and simulation
Perform root cause analysis to identify permanent resolutions to software or business process issues
Lead by example by demonstrating the Client mission and value

Nice-to-Haves:

Knowledge of data security best practices and the implementation of measures to ensure data privacy and compliance.
Implementation of monitoring and logging solutions to track the health and performance of pipelines.
Familiarity with monitoring platforms like DataDog and New Relic
Azure


  • Direct Client

    2 days ago


    Seattle, United States The AES Group Full time

    Role: Packaging EngineerLocation: Hybrid, Seattle WA Duration: 9+ months As part of the Clients Packaging Solutions team, you will be part of a team creating the future of Client packaging. You will be primarily responsible for engineering and development of new packaging solutions related to Client packaging including, cups, lids, coffee, and food...

  • Direct Client

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago


    Seattle, United States The AES Group Full time

    Role: Packaging EngineerLocation: Hybrid, Seattle WA Duration: 9+ months As part of the Clients Packaging Solutions team, you will be part of a team creating the future of Client packaging. You will be primarily responsible for engineering and development of new packaging solutions related to Client packaging including, cups, lids, coffee, and food...

  • Direct Client

    Found in: Appcast US C2 - 2 weeks ago


    Seattle, United States The AES Group Full time

    Role: Packaging EngineerLocation: Hybrid, Seattle WA Duration: 9+ months As part of the Clients Packaging Solutions team, you will be part of a team creating the future of Client packaging. You will be primarily responsible for engineering and development of new packaging solutions related to Client packaging including, cups, lids, coffee, and food...

  • Direct Client

    5 days ago


    Seattle, United States The AES Group Full time

    Title: Direct Client - Data Engineer with Azure and AI/ML Expertise DataBricks Location: Hybrid (Seattle, WA) Length: 12+ Months Job description This job contributes to the Client's success by planning, organizing, and executing engineering assignments and projects that develop technology and methods innovations to enhance distribution, manufacturing, or...

  • International Patent Specialist

    Found in: Appcast US C2 - 3 days ago


    Seattle, United States Direct Counsel Full time

    Direct Counsel is seeking an IP International Patent Specialist (Annuities) to join the IP Practice Services team of a renowned law firm. The ideal candidate will have a minimum of 3+ years of foreign filing and annuities experience, preferably in a law firm environment. Candidates should predominantly have international work experience, strong knowledge of...

  • International Patent Specialist

    Found in: Appcast Linkedin GBL C2 - 3 days ago


    Seattle, United States Direct Counsel Full time

    Direct Counsel is seeking an IP International Patent Specialist (Annuities) to join the IP Practice Services team of a renowned law firm. The ideal candidate will have a minimum of 3+ years of foreign filing and annuities experience, preferably in a law firm environment. Candidates should predominantly have international work experience, strong knowledge of...


  • Seattle, United States Direct Counsel Full time

    Direct Counsel is seeking an IP International Patent Specialist (Annuities) to join the IP Practice Services team of a renowned law firm. The ideal candidate will have a minimum of 3+ years of foreign filing and annuities experience, preferably in a law firm environment. Candidates should predominantly have international work experience, strong knowledge of...

  • Direct Client

    2 weeks ago


    Seattle, United States The AES Group Full time

    Title: Direct Client - Data Engineer with Azure and AI/ML Expertise DataBricks Location: Hybrid (Seattle, WA) Length: 12+ Months Job description This job contributes to the Client's success by planning, organizing, and executing engineering assignments and projects that develop technology and methods innovations to enhance distribution, manufacturing, or...

  • Email Marketing Coordinator

    Found in: Appcast Linkedin GBL C2 - 1 week ago


    Seattle, United States Direct Resources Group, Inc. Full time

    Company DescriptionDirect Resources Group, Inc. is a direct marketing agency based in Seattle, WA. Since 1993, we have specialized in lead generation, customer acquisition and retention. We build campaigns that use meticulous measurement and tracking to gain deeper insights into customer behavior and motivations, resulting in higher sales, retention, and ROI...

  • Medical Science Liaison, Hematology/Oncology

    Found in: Jooble US O C2 - 3 weeks ago


    Seattle, WA, United States TMAC's Direct Hire (Executive Search) Service Full time

    Hematology Oncology MSL Expansion Premier Pharma Company Our client is a premier biopharmaceutical company based in the Northeast. It is an exciting time for them, and they are expanding their Hematology Oncology MSL team across the country. If you’re looking to join a stable company building a new team, then this could be for you! The Opportunity: The...

  • Direct Client

    2 weeks ago


    Seattle, United States The AES Group Inc Full time

    Job DescriptionJob DescriptionDirect Client – Sr. Azure Cloud Developer (C#/.Net, Azure -Servicebus, Functions, Storage etc.)Duration: 9+ monthsLocation: 100% RemoteYou will be responsible for being an active and important part of a multi-disciplinary team to design and develop custom leading-edge embedded device software products for coffee equipment like...

  • SENIOR CLIENT STRATEGY ADVISOR

    Found in: Careerbuilder One Red US C2 - 3 days ago


    Seattle, WA 98113, USA, United States Acosta, Inc. Full time

    RESPONSIBILITIESResponsibilities:1. Participate in implementing strategic innovation initiatives .2. Conduct research to collect data and background information for clients' businesses, internal teams or outside partners to translate data into actionable insights .3. Respond to Brand Manager submissions for strategic support orclient risk assessment, present...

  • Estimator II

    3 weeks ago


    Seattle, United States SST Direct Full time

    Job DescriptionJob DescriptionDIRECT HIRE: This opportunity is located in the Portland, OR. area.  Seeking an experienced Estimator.  This position works in the Estimating Department to plan and develop thorough bids. Estimates will range in value from $1k to $5mil in value and multiple estimates will be worked concurrently. Customers will include...


  • Seattle, United States Chateck Inc Full time

    Direct Client - Sr Lead Data Engineer Apache Spark, Spark Core, Spark SQL, Spark Streaming – Data Bricks Location: Hybrid (Seattle, WA) Length: 12+ Months Job description This position contributes to Client success by building enterprise data services for analytic solutions. This position is responsible for design, development, testing and support for...


  • Seattle, United States Insight Global Full time

    Systems Engineering Manager - Client Engineering is the leader of the Systems Engineering End-User Services team, accountable for all activities related to End-User Services Systems, including Configuration Standardization and Management, GPO Management (EU devices and servers), Application Packaging, Application Publishing, and Virtual Desktop Environments....

  • System Engineer Manager- Client Engineering

    Found in: Appcast US C2 - 2 weeks ago


    Seattle, United States Insight Global Full time

    Systems Engineering Manager - Client Engineering is the leader of the Systems Engineering End-User Services team, accountable for all activities related to End-User Services Systems, including Configuration Standardization and Management, GPO Management (EU devices and servers), Application Packaging, Application Publishing, and Virtual Desktop Environments....

  • System Engineer Manager- Client Engineering

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago


    Seattle, United States Insight Global Full time

    Systems Engineering Manager - Client Engineering is the leader of the Systems Engineering End-User Services team, accountable for all activities related to End-User Services Systems, including Configuration Standardization and Management, GPO Management (EU devices and servers), Application Packaging, Application Publishing, and Virtual Desktop Environments....

  • Direct Client

    1 day ago


    Seattle, United States The AES Group, Inc. Full time

    Duration: 9+ months (Extension possible) Location: 100% Remote (Seattle, WA/PST Hrs.) Establishing, sustaining, driving, and monitoring quality assurance processes, practices, and controls in support of application and system requirement, development and test activities throughout the software development and sustainment lifecycles. Provides leadership and...

  • Heads of Department, Policy

    Found in: Jooble US O C2 - 5 days ago


    Seattle, WA, United States Deacon Corp Full time

    Division Manager - Special Projects, WA Deacon Construction is seeking a senior-level Division Manager for their Special Projects group in WA, who can demonstrate a high degree of independent decision-making and professionalism. They are required to plan, manage, direct, and administer policies and goals for the Special Project Division with a strong focus...

  • Principal Electrical Engineer

    Found in: Jooble US O C2 - 3 weeks ago


    Redmond, WA, United States Invictus Direct Full time

    Company: Our client is a leader in optical semiconductor solutions that drive advanced sensing and perception capabilities across next-generation consumer, mobility, and industrial automation products. Description: Our client is seeking a talented and experienced Principal Electrical Engineer to join their dynamic team. As a Principal Electrical...