Platform Data Engineer

2 months ago

Remote, Oregon, United States Avint Full time


Description

Currently, Avint LLC is seeking a motivated, career and team-oriented platform data engineer in support of the U.S. Department of Homeland Security (DHS) Cybersecurity and Infrastructure Security Agency (CISA) Continuous Diagnostic & Mitigation (CDM) Data Services Program. The CDM Data Services Program is a critical component of CISA's national effort to ensure the defense and resilience of cyberspace. The platform data engineer is responsible for taking contractual obligations, requirements, and customer desires and directs data business rules and data transformations between the customer and the team of developers. Ownership of the data model will be needed to test and observe data quality issues. Dashboard creation will be utilized to communicate findings. The successful candidate will bring a consultative approach to business processes and will proactively collaborate with different stakeholders to define the data workflow of the solution. They will work closely with developers to instruct and validate the solution to ensure it fulfils its objectives. The candidate should have a business and data analysis mindset in addition to data engineering to support the clients' needs and understanding to make the best out of the developed solution.

Position Responsibilities:

  • Work with internal and external stakeholders to examine contractual data requirements in order to drive data modeling, pipelines, transformation, normalization, and quality for each solution release through a SAFe Agile Release Train (ART) to achieve business goals
  • Act as subject matter expert regarding data requirements, formats, types, lineage, and quality to brief internal and external stakeholders
  • Analyze raw data from different sources and define consistent and machine-readable formats for the data store
  • Work with stakeholders to track and obtain nonautomated data sources to maintain freshness
  • Develop, document, and communicate processes for seamless data ETL (extraction, transformation, and loading) through Cloud based data services
  • In charge of directing developers on how to join and convert raw data from multiple sources into usable information for analytics and reporting
  • Work collaboratively with cross-functional teams to design, implement, and maintain a scalable and secure data repository/lake that can support analyzing trends and patterns
  • Prepare options, levels of effort, and estimates when data requirements change
  • Suggest where automation can improve processes and gain efficiencies
  • Develop database objects and schemas that support extracting, transforming, loading, and storage of data based on a logical data model (LDM)
  • Participate in Agile ceremonies and track and document work in Jira and Confluence
  • Ensure data integrity, quality, and accessibility within the repository/lake
  • Conduct complex data analysis using SQL based searches and instruct developers on how to handle data quality issues
  • Explore and implement ways to enhance data quality and reliability and use tools to develop analytical dashboards
  • Work with Data Scientists to improve the quality and accuracy of the information enabling stakeholders to make more responsible cyber risk decisions
  • Prepare and maintaining datasets for testing and modeling
  • Develop and maintain the solution's data dictionary and data lineage
  • Define data retentions and governance for the solution


Requirements
  • Must be a U.S Citizen - No Green Card, No Visa
  • Degree in Computer Science, IT, or similar field
  • At least 5 years of proven experience as a Data Engineer or similar role
  • Solid understanding of relational databases and ETL processes
  • Proficiency in data transformation, normalization, and configuration
  • Technical expertise in data ingestion and manipulation
  • Knowledge of big data platforms and data source formats from APIs (JSON, csv, yaml)
  • Familiarity with API integration and data pipelines
  • Experience in creating dashboards (e.g., Tableau, PowerBI, or similar) for data visualization
  • Detail-oriented, strong analytical skills, and the ability to combine data from different sources
  • Experience with data abstraction, various data conditions including blank and NULL data, and detecting and handling data collisions, and filtering logic syntax
  • Experience with SQL/T-SQL, NoSQL, and data visualization tools design
  • Having been involved with data segmentation, cleansing, enrichment, and indexing
  • Familiarity with application administration, configuration, and integration
  • Experience with data security and segregation physically or logically. Know the use of role-based access and attribute-based access when limiting data.
  • Excellent communication skills, both written and oral
  • Ability to independently perform research on industry standards, regulatory requirements, and cutting-edge technological trends. Have passion for new technologies, software, and processes
  • Skilled and disciplined to work with a remote distributed team
  • Ability to multi-task in a fast-paced environment with multiple deadlines is essential
  • Familiarity with agile development methodologies
  • Expertise in the Microsoft Office / Google suite of software
  • Must be a US citizen and pass a background investigation.
  • Able to obtain and maintain a DHS Suitability/Entry on Duty (EOD)

Desired Qualifications:

  • Data engineering or data analyst certification
  • Scaled Agile Framework (SAFe) certification
  • Experience with Data Lakes, Data Warehouses, or Data Lakehouse
  • Experience with Data governance tools
  • Experience with Cloud services such as Azure, AWS or GCP
  • Understanding of cybersecurity tools such as vulnerability (CVE) scanners, software scanners, mobile and network host discovery scanners, and other tools in order to understand source data
  • Familiarity with federal cybersecurity concepts such as Vulnerabilities, DISA STIGs, NIST, FISMA, Risk Management Framework, and MITRE ATT&CK Framework
  • Experience working with government contracting
  • Knowledge of programming languages (e.g., Python, PowerShell)
  • Experience with data compression, data deduplication.
  • Experience with Elasticsearch with Kibana Dashboards.


Benefits

Joining Avint is a win-win proposition You will feel the personal touch of a small business and receive BIG business benefits. From competitive salaries, full health, to a new Open Time Off Policy and Federal Holidays. Additionally, we encourage every Avint employee to further their professional development. To assist you in achieving your goals, we offer reimbursement for courses, exams, and tuition. Interested in a class, conference, program, or degree? Avint will invest in YOU and your professional development

Avint is committed to hiring and retaining a diverse workforce. We are proud to be an Equal Opportunity and Affirmative Action Employer, making decisions without regard to race, color, religion, creed, sex, sexual orientation, gender identity, marital status, national origin, age, veteran status, disability, or any other protected class.


  • Senior Data Engineer, Platform

    1 month ago

    Remote, Oregon, United States SmarterDx Full time

    RoleWe are seeking a Senior Data Engineer to join our team. In this role, you will play a crucial role in implementing and integrating client data into SmarterDx products, ensuring the seamless transformation and validation of data according to our standards. This position offers the opportunity to work on cutting-edge ETL pipelines, enhance system...

  • Senior Platform Engineer

    2 months ago

    Remote, Oregon, United States Glide (glideapps) Full time

    Glide is looking for a Senior Platform Engineer to help evolve our data sources strategy, become more efficient with our infrastructure utilization as we scale, and achieve a high level of operational excellence for availability, security, and performance.The ideal candidate has a specialty in provisioning and managing large-scale, persistent, data sources...

  • Staff Software Engineer

    2 months ago

    Remote, Oregon, United States Pattern Data Full time

    Who We AreThe Pattern Data platform was created for the rapid analysis of thousands of medical records. Fueled by AI, our platform efficiently reviews and categorizes documents in minutes, significantly reducing validation time by highlighting pertinent information crucial for litigation in medical analysis and personal injury cases. Our platform has been...

  • Platform Engineer

    3 days ago

    Remote, Oregon, United States 0x Full time

    About 0xAt 0x, our mission is to Eliminate the Complexity of Accessing Tokens and Liquidity. We're a mission-driven and diverse team of world-class talent from top companies. We are a remote-first and fully distributed company with team members across the globe. As early pioneers in the space, we've made significant technical contributions to various...

  • Data Engineer

    2 months ago

    Remote, Oregon, United States Arcadia Full time

    Arcadia is dedicated to happier, healthier days for all. We transform diverse data into a unified fabric for health. Our platform delivers actionable insights for our customers to advance care and research, drive strategic growth, and achieve financial success. For more information, visit Why This Role Is Important To Arcadia The Arcadia Data Engineering...

  • Data Engineer

    1 month ago

    Remote, Oregon, United States VRChat Full time

    Join the VRChat TeamVRChat offers a first-of-its-kind, game-changing platform that provides an endless collection of social VR experiences and gives the power of creation to its robust community. With over 250,000 worlds and growing, VRChat's vision is to allow users to bring their imaginations to life and help shape the metaverse anywhere in the world on...

  • Engineering Manager

    1 day ago

    Remote, Oregon, United States Catapult Staffing Full time

    About the RoleCatapult Staffing is seeking an experienced Engineering Manager to lead our Media Platforms team. As a key member of our organization, you will be responsible for managing a team of engineers and driving the development of our media and near-real-time event ingestion and analytics systems.Key ResponsibilitiesManage a team of engineers...

  • Platform Engineer II

    1 month ago

    Remote, Oregon, United States Bestow Full time

    ABOUT BESTOWBestow is a leading insurance technology platform serving some of the world's largest and most innovative life insurers. We are on a mission to increase financial stability for everyone. Bestow is a team of mission-driven, results-oriented individuals. We offer all employees a remote (continuous 48 only)/hybrid workplace, meaningful benefits,...

  • Engineering Manager

    6 days ago

    Remote, Oregon, United States Catapult Staffing Full time

    About Our CompanyCatapult Staffing is a leading technology staffing agency that specializes in placing top talent in the e-commerce and content creation industry.Job DescriptionWe are seeking an experienced engineering leader to manage a core-tech backend squad responsible for running our Media platform and near-real-time streaming and analytics systems.Key...

  • Principal Data Engineer

    1 month ago

    Remote, Oregon, United States Nabis Full time

    About NabisNabis is the #1 Licensed Cannabis Wholesale Platform in the world with the largest portfolio of cannabis brands, supplying hundreds of brands to retailers across California, New York, and Nevada. Our mission is to empower the world to discover cannabis by providing choice, access, and innovation.We're at the forefront of this movement and are...

  • Platform Test Engineer

    1 month ago

    Remote, Oregon, United States Avint Full time

    DescriptionAvint LLC is looking for an exceptional Platform Test Engineer to join our dynamic team. In this role, you'll contribute to ensuring that our platforms operate optimally and meet the highest level of industry standards and customer requirements. As part of our team, you will have the chance to navigate challenging projects and cement your position...

  • Data Engineer

    1 month ago

    Remote, Oregon, United States Archive Full time

    Join Archive in our mission to change consumer behavior for the better. If you think humans buy too much stuff and throw too much away, then this problem is for you. We're starting with fashion and expanding from there. Archive is the leading technology platform for branded resale. The company works with more than 50 global brands including The North Face,...

  • Sr. Platform Engineer

    1 month ago

    Remote, Oregon, United States Innovien Full time

    Job Description:Our customer is looking for a Senior (backend focused) Platform Engineer to work on their homegrown platform, which is a rendering-as-a-service platform built for front-end ) applications to sit on. This home-grown platform was created for one division of the org initially, but it's been so successful that they're expanding to the...

  • Strategic Product Manager

    1 week ago

    Remote, Oregon, United States NTT DATA Full time

    Job OverviewNTT DATA Services is on the lookout for a Senior Technical Product Manager (TPM) with expertise in JIRA administration to become a vital part of our team. The TPM will oversee the strategic roadmap for the Atlassian product suite, guiding it from initial concept through to execution and ongoing support. This position necessitates collaboration...

  • Lead Data Engineer, GMP

    2 months ago

    Remote, Oregon, United States Bounteous Full time

    Bounteous, a leading full-service digital agency, is seekinga skilled and experienced Lead Data Engineer for our Google Marketing Platform (GMP) Operating Unit. This role involves direct client consulting and solutioning, with a heavy focus on adopting and socializing internal best practices and evolving our capabilities. The ideal candidate has a broad...

  • Senior Software Engineer, Platform

    2 months ago

    Remote, Oregon, United States Matterport Full time

    Matterport, Inc. (Nasdaq: MTTR) is leading the digital transformation of the built world. Our groundbreaking spatial data platform turns buildings into property intelligence data to make nearly every space more valuable and accessible. Millions of buildings in more than 177 countries have been transformed into immersive Matterport digital twins to improve...

  • Senior Data Engineer

    1 month ago

    Remote, Oregon, United States Intersog Full time

    DescriptionIntersog is a Chicago-based provider of ROI-driven custom web and mobile development, specializing in delivering full-service, end-to-end solutions and project resources to Fortune 500 companies, SMEs, and startups. We help our clients achieve ambitious business goals, solve skills shortages, and drive innovation by building Dedicated Software...

  • Senior Data Engineer

    2 months ago

    Remote, Oregon, United States Loop Full time

    Loop is in an unparalleled position to provide data to our merchants that no one else is able to replicate. Data will be at the core of everything we do and some of our most critical work as we grow. Our future is to create data-based products that use modern techniques for delivering not only data but invaluable insights. We'll identify problems our...

  • Data Engineer

    4 weeks ago

    Remote, Oregon, United States Ignite Reading Full time

    Ignite Reading teaches kids to read.Today, 67% of students and 82% of low-income students can't read at grade level by the end of third grade. That's when you are supposed to go from learning to read to reading to learn. It's America's number one education crisis and we know how to fix it.Ignite teaches kids to read by providing 15 minutes a day of 1:1...

  • Data Engineer

    4 weeks ago

    Remote, Oregon, United States HappyFunCorp Full time

    DescriptionData Engineer / Analyst - Remote - Contract*This position is 100% remote* (This role will primarily operate on East Coast hours)HappyFunCorp helps businesses develop great products and deliver powerful technical solutions with a blend of deep engineering skills, human-focused design, and a culture that makes working with us enjoyable. We've...