Senior Big Data Engineer

21 hours ago

Remote, Oregon, United States IntegrateUs Services Full time $120,000 - $160,000 per year

The Worker is responsible for developing, maintaining, and optimizing big data solutions using the Databricks Unified Analytics Platform.

This role supports data engineering, machine learning, and analytics initiatives within this organization that relies on large-scale data processing.

Duties include:

  • Designing and developing scalable data pipelines
  • Implementing ETL/ELT workflows
  • Optimizing Spark jobs
  • Integrating with Azure Data Factory
  • Automating deployments
  • Collaborating with cross-functional teams

Ensuring data quality, governance, and security.

Implement ETL/ELT workflows for both structured and unstructured data

Automate deployments using CI/CD tools

Collaborate with cross-functional teams including data scientists, analysts, and stakeholders

Design and maintain data models, schemas, and database structures to support analytical and operational use cases

Evaluate and implement appropriate data storage solutions, including data lakes (Azure Data Lake Storage) and data warehouses

Implement data validation and quality checks to ensure accuracy and consistency

Contribute to data governance initiatives, including metadata management, data lineage, and data cataloging

Implement data security measures, including encryption, access controls, and auditing; ensure compliance with regulations and best practices

Proficiency in Python and R programming languages

Strong SQL querying and data manipulation skills

Experience with Azure cloud platform

Experience with DevOps, CI/CD pipelines, and version control systems

Working in agile, multicultural environments

Strong troubleshooting and debugging capabilities

Design and develop scalable data pipelines using Apache Spark on Databricks

Optimize Spark jobs for performance and cost-efficiency

Integrate Databricks solutions with cloud services (Azure Data Factory)

Ensure data quality, governance, and security using Unity Catalog or Delta Lake

Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL

Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake

Knowledge of ML libraries (MLflow, Scikit-learn, TensorFlow)

Databricks Certified Associate Developer for Apache Spark

Azure Data Engineer Associate

Job Type: Contract

Pay: $ $80.00 per hour

Work Location: Remote

  • Senior Data Engineer

    2 weeks ago

    Remote, Oregon, United States DLytica Inc. Full time $120,000 - $180,000 per year

    We're Hiring: Senior Data Engineer – Riyadh, Saudi ArabiaJoin DLYTICA and be part of a team driving innovation in Big Data, Real-Time Analytics, and AI/ML.Position: Senior Data Engineer (1 Position)Type: Full-Time | 1-Year Contract (with possible extension)Location: Riyadh, Saudi Arabia (Visa & accommodation provided)Experience: 7+ years in Data...

  • Data Engineer

    2 weeks ago

    Remote, Oregon, United States Datasage Technologies Full time $120,000 - $200,000 per year

    Job SummaryWe are seeking an experienced and motivated Senior Data Engineer to drive high standard technical solutions for the Data Products team within the SIPS (Spend, Invest, Protect, Save) division - supporting all Financial Services. The mission of the SIPS Data Engineering team is to support Data Engineering and reporting for client's Financial...

  • Senior Data Engineer

    3 days ago

    Remote, Oregon, United States Fabric Health Full time $140,000 - $150,000 per year

    Senior Data EngineerRemoteEngineeringRemoteFull-timeAbout Fabric HealthAt Fabric Health, we're not just building technology; we're fixing healthcare's capacity problem. Our mission is to power healthcare to move faster, work smarter, and deliver better care, creating seamless, intuitive experiences that simplify and unify virtual and in-person care for...

  • Senior Data Engineer

    2 weeks ago

    Remote, Oregon, United States Nearsure Full time $150,000 - $200,000 per year

    Explore the Nearsure experienceJoin our close-knit LATAM remote team: Connect through fun activities like coffee breaks, tech talks, and games with your team-mates and management.Say goodbye to micromanagement We champion autonomy, open communication, and respect for diversity as our core values.Your well-being matters: Our People Care team is here from day...

  • Senior Data Engineer

    2 days ago

    Remote, Oregon, United States Revecore Full time $120,000 - $200,000 per year

    About RevecoreRevecore is an innovative, technology-driven company that is committed to helping our clients, our employees, our company, and our communities thrive.With a 20+ year history, Revecore is the leading provider of revenue integrity and complex claims solutions for hospitals.We offer a dynamic and flexible work environment, full of opportunity for...

  • Senior Data Engineer

    8 hours ago

    Remote, Oregon, United States NEOGOV Full time $120,000 - $240,000 per year

    SalaryDepends on QualificationsLocationRemoteJob TypeFull-TimeJob Number00750DepartmentResearch & DevelopmentDivisionIndiaOpening Date11/20/2025What You Will doWe are looking for a Senior Data Engineer to join our data engineering team. The idealcandidate will be a hands-on technical expert with strong experience in Snowflake and dbt,capable of designing,...

  • Senior Software Engineer, ML Data Services

    2 days ago

    Remote, Oregon, United States Motional Full time $155,300 - $207,000 per year

    Mission SummaryWe are seeking a Senior Engineer to join our ML Data Services team and help us build and improve data infrastructure for Autonomy ML teams. As a Senior Engineer, you will be responsible for building scalable microservices, APIs, and tooling to support Autonomy labeling needs. You will also help architect and implement scalable pipelines to...

  • Senior Data Engineer

    3 days ago

    Remote, Oregon, United States Integra Partners Full time $124,000 per year

    Integra Partners is seeking an enthusiastic and motivated individual to join our data engineering team. As a Senior Data Engineer, you will play a key role in building and maintaining robust data pipelines and enabling advanced analytics and AI solutions across the organization. This position requires hands-on experience with modern data engineering tools...

  • Data Engineer

    22 hours ago

    Remote, Oregon, United States Lumin Digital Full time $120,000 - $180,000 per year

    About the Role: The Hybrid Site Reliability Engineer/Data Engineer at Lumin Digital will play a critical role in ensuring the reliability, scalability, and performance of the Lumin Analytics data platform, while also designing, implementing, and managing robust data pipelines. Lumin Analytics provides financial institutions with critical insights about...

  • Senior Data Engineer II

    2 days ago

    Remote, Oregon, United States dbt Labs Full time $172,000 - $207,900 per year

    About Us  dbt Labs is the pioneer of analytics engineering, helping data teams transform raw data into reliable, actionable insights. Since 2016, we've grown from an open source project into the leading analytics engineering platform, now used by over 50,000 teams every week. As of February 2025, we've surpassed $100 million in annual recurring revenue...