Data Architect

1 week ago

Corvallis, Oregon, United States Diverse Lynx Full time
Job Title: Data Architect

We are seeking a highly skilled Data Architect to join our team at Diverse Lynx LLC. As a Data Architect, you will play a key role in designing and implementing distributed data processing pipelines using Spark, Python, SQL, and other tools and languages prevalent in the Big Data/Lakehouse ecosystem.

Responsibilities:
  • Architect, design, and implement distributed data processing pipelines using Spark, Python, SQL, and other tools and languages prevalent in the Big Data/Lakehouse ecosystem.
  • Drive work to completion with hands-on development responsibilities, and partner with Data Engineering leaders to implement data engineering pipelines to build solutions to help provide trusted and reliable data to customers.
  • Analyze design and determine coding, programming, and integration activities required based on general objectives.
  • Play the technical lead role representing deliverables from vendor team resources at onsite and offshore locations.
  • Lead the technical coordination and Business Knowledge transition activities to offshore teams.
  • Reviews and evaluates designs and project activities for compliance with architecture, security, and quality guidelines and standards.
  • Writes and executes complete testing plans, protocols, and documentation for assigned portions of data systems or components; identifies defects and creates solutions for issues with code and integration into data system architecture.
  • Collaborates and communicates with project teams regarding project progress and issue resolution.
  • Works with the data engineering team for all phases of larger and more-complex development projects and engages with external users on business and technical requirements.
Requirements:
  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.
  • 6+ years of relevant experience with detailed knowledge of data technical architectures, infrastructure components, ETL/ELT, and reporting/analytic tools.
  • 3+ years of experience with Cloud-based DW such as Redshift, Snowflake, etc.
  • 3+ years' experience in Big Data Distributed ecosystems (Hadoop, SPARK, Unity Catalog & Delta Lake).
  • 3+ years' experience in Workflow orchestration tools such as Airflow, etc.
  • 3+ years' experience in Big Data Distributed systems such as Databricks, AWS EMR, AWS Glue, etc.
  • Leverage monitoring tools/frameworks, like Splunk, Grafana, CloudWatch, etc.
  • Experience with container management frameworks such as Docker, Kubernetes, ECR, etc.
  • 3+ years' working with multiple Big Data file formats (Parquet, Delta Lake).
  • Experience working on CI/CD processes such as Jenkins, Codeway, etc., and source control tools such as GitHub, etc.
  • Strong experience in coding languages like Python, Scala, & Java.
Preferred Skills:
  • Fluent in relational-based systems and writing complex SQL.
  • Fluent in complex, distributed, and massively parallel systems.
  • Strong analytical and problem-solving skills with the ability to represent complex algorithms in software.
  • Strong understanding of database technologies and management systems.
  • Strong understanding of data structures and algorithms.
  • Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools.
  • Strong analytical and problem-solving skills.
About Diverse Lynx LLC:

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. We promote and support a diverse workforce across all levels in the company.

  • Data Architect

    4 weeks ago

    Corvallis, Oregon, United States RIT Solutions, Inc. Full time

    Enterprise Data Architect OpportunityWe are seeking a highly skilled Data Architect to join our team at RIT Solutions, Inc. and work on a challenging project for one of our Enterprise clients.Key Responsibilities:Implement data quality frameworks, including profiling, cleansing, deduplication, and monitoring.Design and implement data governance strategies to...

  • Data Architect

    3 weeks ago

    Corvallis, Oregon, United States RIT Solutions, Inc. Full time

    Enterprise Data Architect OpportunityWe are seeking a highly skilled Data Architect to join our team at RIT Solutions, Inc. and work on a challenging project for one of our Enterprise clients.This is a unique opportunity to leverage your expertise in data governance, platform design, and data integration to drive business growth and improvement.Key...

  • Data Architect

    1 month ago

    Corvallis, Oregon, United States ApTask Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at ApTask. As a Data Architect, you will be responsible for designing and developing data architectures that meet the needs of our clients.Key ResponsibilitiesDesign and develop data architectures that meet the needs of our clientsDevelop and maintain data governance policies and...

  • Data Architect

    3 days ago

    Corvallis, Oregon, United States ApTask Full time

    About the Role:The Data Architect Engineer will be responsible for designing, developing, and managing activities for the Print Data platform specifically around the Data lifecycle, Data Requirements & Definition, Data Quality, Data Storage and Retention keeping in mind availability, performance, privacy, security & cost.Key Responsibilities:Design and...

  • Data Architect

    16 hours ago

    Corvallis, Oregon, United States ApTask Full time

    About the Role:The Data Architect Engineer will be responsible for designing, developing, and managing activities for the Print Data platform specifically around the Data lifecycle, Data Requirements & Definition, Data Quality, Data Storage and Retention keeping in mind availability, performance, privacy, security & cost.Years of experience needed years of...

  • Data Architect

    3 weeks ago

    Corvallis, Oregon, United States ApTask Full time

    About the Role:The Data Architect Engineer will be responsible for designing, developing, and managing activities for the Print Data platform specifically around the Data lifecycle, Data Requirements & Definition, Data Quality, Data Storage and Retention keeping in mind availability, performance, privacy, security & cost.Key Responsibilities:Design and...

  • Data Architect

    2 weeks ago

    Corvallis, Oregon, United States ApTask Full time

    About the Role:The Data Architect Engineer will be responsible for designing, developing, and managing activities for the Print Data platform specifically around the Data lifecycle, Data Requirements & Definition, Data Quality, Data Storage and Retention keeping in mind availability, performance, privacy, security & cost.Years of experience needed years of...

  • Data Architect

    1 week ago

    Corvallis, Oregon, United States ApTask Full time

    About ApTask:ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work.As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management.With...

  • Data Engineer

    1 week ago

    Corvallis, United States ApTask Full time

    About Client: The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare,...

  • Entry Level Software Database Engineer

    1 week ago

    Corvallis, United States RLA Engineering Full time

    Job Title: Entry Level Software Database Engineer Expected Weekly Hours: 40 Department: MSP Location: Corvallis, Oregon (Hybrid) Reports to: Operations Manager Position Summary The is responsible for supporting the client's business unit in developing software applications/solutions, specifically database development. Duties and Responsibilities: Work with...

  • Entry Level Software Database Engineer

    5 days ago

    Corvallis, United States RLA Engineering Full time

    Job Title: Entry Level Software Database Engineer Expected Weekly Hours: 40 Department: MSP Location: Corvallis, Oregon (Hybrid) Reports to: Operations Manager Position Summary The Entry Level Software Database Engineer is responsible for supporting the client's business unit in developing software applications/solutions, specifically database development....

  • BioAnalytics Team Leader

    2 weeks ago

    Corvallis, United States NV5 Full time

    Overview: The Team Lead plays a pivotal leadership role within the Land Cover team. The Land Cover team is responsible for deriving a variety of land use land cover datasets from remotely sensed data sources, such as aerial imagery and LiDAR. These datasets are developed for various clients and are utilized in applications such as water resource management,...

  • Cost Estimator

    2 weeks ago

    Corvallis, United States NV5 Full time

    The Cost Estimator works in a dynamic fast paced environment and is responsible for the preparation, organization and presentation of project estimates. The Cost Estimator works with an identified team of subject matter experts, including: Technical and Domain Experts, Pre Sales Engineers, Team Leaders, Account Managers and Program Managers. The Cost...

  • Cost Estimator

    3 weeks ago

    Corvallis, United States NV5 Full time

    The Cost Estimator works in a dynamic fast paced environment and is responsible for the preparation, organization and presentation of project estimates. The Cost Estimator works with an identified team of subject matter experts, including: Technical and Domain Experts, Pre Sales Engineers, Team Leaders, Account Managers and Program Managers. The Cost...