Data Engineer

4 days ago

Redmond, United States 3MD Inc. Full time
Job DescriptionJob Description

Benefits:

The company offers medical, dental, vision, short and long-term disability, life insurance, the ability to participate in 401K and paid time off as applicable.

Summary of Position:

The Data Engineer role will work closely with an agile development team to analyze and optimize ETL processes, tables, views, materialized views, and stored procedures to create a high-performance data warehouse solution for our client. This role will be working with a diverse set of technology including Amazon Redshift and S3 and Snowflake. The Data Engineer will focus on optimizing existing systems as well as developing designs and strategies for implementing new systems. This role will be responsible for requirements gathering, analysis, data categorization, interpreting requirements, and developing development tasks for sprint execution.

Essential Functions:

  • Design, implement, test, and deploy data processing infrastructure
  • Contribute to architecture of highly scalable and reliable data engineering solutions for moving large data efficiently across systems
  • Perform work in an Agile team setting
  • Break down, estimate, and provide just-in-time design for small increments of work
  • Work in a complex data infrastructure environment
  • Develop in-depth data pipeline using industry-standard data integration tools
  • Full development life cycle management, including gathering, analysis, architecture, design, implementation, testing, deployment, and technical support
  • Write test cases and test scripts for data quality assurance
  • Responsible for creating stored procedures and functions
  • Develop dimensional data model with the industry-standard tool
  • Interpret reporting requirements into actionable development tasks
  • Analyze and optimize SQL based stored procedures and jobs
  • Analyze table indices for performance
  • Design and implement Materialized Views and Views
  • Develop high-performance programs and procedures for ETL Processes
  • Analyze, categorize and document data sources and elements
  • Write and optimize queries and provide guidance to other developers accessing data
  • Agile development experience required, must be comfortable working with a distributed team

Competencies:

  1. Ensures Accountability
  2. Tech Savvy
  3. Communicates Effectively
  4. Values Differences
  5. Customer Focus
  6. Resourcefulness
  7. Drives Results
  8. Plans and Prioritizes
  9. Decision Quality
  10. Self-Development

Work Environment:

This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets, and fax machines.

Physical Demands:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job.

While performing the duties of this job, the employee in this position frequently communicates with other co-workers/clients who have inquiries about the various projects and other needs. Must be able to exchange accurate information in these situations. The employee must be able to remain in a stationary position 75% of the time. The employee in this position needs to occasionally move about inside the office to access file cabinets, office machinery, etc. Constantly operate a computer and office machinery such as a calculator, keyboard, copy machine, and printer. Frequently moves boxes with equipment weighing up to 25lbs across the building and/or to other offsite buildings for various project needs.

Required Education and Experience:

  • Bachelors Degree
  • 5 + years of Data Engineering Experience or equivalent experience

Qualifications:

  • Five + (5) years building out highly scalable, scaled-out architectures on large scale database platforms
  • Five + (5) years of experience in a senior data engineering role
  • Excellent SQL Skills
  • Deep knowledge of systems such as Redshift, Snowflake, Postgres, Redis
  • Experience with other programming languages such as Java and Ruby a plus
  • Strong understanding of different data access standards and including REST and SOAP data sourcesAdvanced competency in SQL with the ability to optimize and mentor others to perform query optimization in large scale database environments
  • Experience with any industry-standard tool for Source Control and Project Management
  • Experience with data visualization and/or dashboard development
  • Strong written and oral communication skills
  • Demonstrates critical thinking, analytical and problem-solving skills, and ability to think creatively
  • Exhibits a sense of ownership, urgency, accountability, and drive to learn new technologies
  • Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment

Preferred:

  • Familiarity with AGILE and API development
  • Familiarity with test-driven development methodology for analytic solutions
  • Apache NiFi
  • Redis

AAP/EEO Statement:

3MD Inc. is an equal opportunity employer and does not discriminate based on gender, sex, age, race and color, religion, marital status, national origin, disability, sexual orientation, gender identity or expression, veteran status, or any other category that is protected by applicable law.

Other Duties:

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

  • Data Engineer

    3 weeks ago

    Redmond, United States WaferWire Cloud Technologies Full time

    WaferWire is currently seeking a Data Engineer to join its innovative team.Role: Data EngineerLocation: Redmond, WAJob Description:Key Responsibilities:Design, develop, and maintain robust data pipelines using Microsoft SQL Server and Azure Data Factory.Implement ETL processes to consolidate data from various sources into a centralized data...

  • Data Engineer

    3 weeks ago

    Redmond, United States WaferWire Cloud Technologies Full time

    WaferWire is currently seeking a Data Engineer to join its innovative team.Role: Data EngineerLocation: Redmond, WAJob Description:Key Responsibilities:Design, develop, and maintain robust data pipelines using Microsoft SQL Server and Azure Data Factory.Implement ETL processes to consolidate data from various sources into a centralized data...

  • Data Engineer

    4 weeks ago

    Redmond, United States Vertisystem Full time

    Local and only W2 candidate required Summary: The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization’s data assets. Job...

  • Data Engineer

    3 weeks ago

    Redmond, United States Vertisystem Full time

    Local and only W2 candidate required Summary: The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization's data assets. Job...

  • Data Engineer

    2 weeks ago

    Redmond, United States Vertisystem Full time

    Local and only W2 candidate required Summary: The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization's data assets. Job...

  • Data Engineer

    4 weeks ago

    Redmond, United States Vertisystem Full time

    Local and only W2 candidate required Summary: The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization’s data assets. Job...

  • Data Engineer

    2 weeks ago

    Redmond, United States People Tech Group Full time

    Job Role: Data Engineer Location: Seattle, WA (onsite) Required Skills: AWS Glue / EMR, PySpark, SQLs Job Description: Experience in Data Engineering and SQL. Experience working with (AWS) including Redshift and S3. Deep experience in Python/R, Spark and Scala. Experience using databases in a business environment with big data technologies and large-scale,...

  • Data Engineer

    4 weeks ago

    Redmond, United States People Tech Group Inc Full time

    Job Role: Data EngineerLocation: Seattle, WASkills: AWS Glue / EMR, PySpark, SQLsJob Description:5+ years’ experience in Data Engineering and SQL.Experience working with Amazon Web Services (AWS) including Redshift and S3.Deep experience in Python/R, Spark and Scala.Experience using databases in a business environment with big data technologies and...

  • Data Engineer

    3 weeks ago

    Redmond, United States People Tech Group Inc Full time

    Job Role: Data EngineerLocation: Redmond, WA (onsite)Duration: Full timeSkills: AWS Glue / EMR, Pyspark, SQLsJob Description:5-10+ years’ experience in Data Engineering and SQL.Experience working with Amazon Web Services (AWS) including Redshift and S3.Deep experience in Python/R, Spark, and Scala.Experience using databases in a business environment with...

  • Data Engineer

    3 weeks ago

    Redmond, United States People Tech Group Inc Full time

    Job Role: Data EngineerLocation: Seattle, WA (onsite) Required Skills: AWS Glue / EMR, PySpark, SQLsJob Description:Experience in Data Engineering and SQL.Experience working with (AWS) including Redshift and S3.Deep experience in Python/R, Spark and Scala.Experience using databases in a business environment with big data technologies and large-scale, complex...

  • Data Engineer

    2 days ago

    Redmond, United States People Tech Group Inc Full time

    Job Role: Data EngineerLocation: Seattle, WA (onsite) Required Skills: AWS Glue / EMR, PySpark, SQLsJob Description:Experience in Data Engineering and SQL.Experience working with (AWS) including Redshift and S3.Deep experience in Python/R, Spark and Scala.Experience using databases in a business environment with big data technologies and large-scale, complex...

  • Sr Electrical/Systems Engineer

    1 week ago

    Redmond, United States Data IO Full time

    Are you looking for the opportunity to make a direct impact on next generation products with an industry leader? Do you have experience leading the design, development and enhancement of new and existing system technologies? Are you at ease working, collaborating and innovating in small, agile teams? Does your experience include working with embedded...

  • Data Engineer

    1 week ago

    Redmond, United States Tech Mahindra Full time

    We are looking for Strong Data Engineer with 6+ year's experience.Required Skills: ADF pipelines, SQL, Kusto, Power BI, Cosmos (Scope Scripts). Power Bi, ADX (Kusto), ADF, ADO, Python/C#.Good to have - Azure anomaly Alerting, App Insights, Azure Functions, Azure FabricQualifications for the role 5+ years experience building and optimizing big data' data...

  • Data Engineer

    4 weeks ago

    Redmond, United States Tech Mahindra Full time

    We are looking for Strong Data Engineer with 6+ year’s experience.Required Skills: ADF pipelines, SQL, Kusto, Power BI, Cosmos (Scope Scripts). Power Bi, ADX (Kusto), ADF, ADO, Python/C#.Good to have – Azure anomaly Alerting, App Insights, Azure Functions, Azure FabricQualifications for the role 5+ years experience building and optimizing ‘big data’...

  • Data Engineer

    4 weeks ago

    Redmond, United States Tech Mahindra Full time

    We are looking for Strong Data Engineer with 6+ year’s experience.Required Skills: ADF pipelines, SQL, Kusto, Power BI, Cosmos (Scope Scripts). Power Bi, ADX (Kusto), ADF, ADO, Python/C#.Good to have – Azure anomaly Alerting, App Insights, Azure Functions, Azure FabricQualifications for the role 5+ years experience building and optimizing ‘big data’...

  • Data Engineer

    3 weeks ago

    Redmond, United States Tech Mahindra Full time

    Description:As a member of the team, you will get to live on the front edge of modern technology by building on things like Azure Data Explorer and Azure Data Lake while building ETLs and process in Databricks and Data Factory. You will help build state of the art pipelines and data models. Your large-scale warehouses will be multi-source environments that...

  • Data Engineer

    2 weeks ago

    Redmond, United States Centific Full time

    About Centific:Centific expertly engineers platforms and curates multimodal, multilingual data to empower the ‘Magnificent Seven’ and enterprise clients with safe, scalable Artificial intelligence (AI) deployment. Our team includes over 150 PhDs and data scientists, along with more than 4,000 AI practitioners and engineers. We leverage an integrated...

  • Data Engineer

    4 weeks ago

    Redmond, United States 3MD Inc. Full time

    Job DescriptionJob DescriptionSummary of Position:The Data Engineer role will work closely with an agile development team to analyze and optimize ETL processes, tables, views, materialized views, and stored procedures to create a high-performance data warehouse solution for our client. This role will be working with a diverse set of technology including...

  • Sr Electrical/Systems Engineer

    3 weeks ago

    Redmond, United States Data IO Full time

    Are you looking for the opportunity to make a direct impact on next generation products with an industry leader? Do you have experience leading the design, development and enhancement of new and existing system technologies? Are you at ease working, collaborating and innovating in small, agile teams? Does your experience include working with embedded...

  • Data Engineer

    2 weeks ago

    Redmond, United States Denali Advanced Integration Full time

    Summary of Position: The Data Engineer role will work closely with an agile development team to analyze and optimize ETL processes, tables, views, materialized views, and stored procedures to create a high-performance data warehouse solution for our client. This role will be working....