Geospatial Data Engineer

2 weeks ago


Remote, United States Envision, LLC Full time
Description:

Data engineer will participate in the building of large-scale image data processing systems and API’s and should be able to leverage common image and geodata formats to work with the latest open-source technologies.

A Data Engineer should embrace the challenge of dealing with terabytes or even petabytes of data daily in a high-throughput API/microservice ecosystem. A Data Engineer understands how to apply technologies to solve complex problems that bring value to new and existing data processing pipelines. The Data Engineer generally works on implementing complex projects with a focus on collecting, parsing, managing, analyzing and making available large sets of imagery and image data to turn information into insights using multiple platforms. The Data Engineer should be able to develop prototypes and proof of concepts for the selected solutions. This role will drive the engineering and building of geospatial data assets to support image processing pipeline.

Key responsibilities include:

• Design, build and support of cloud and open source systems to process geospatial data assets via an API-based platform

• Partner with other internal development communities to bring needed data sets into the asset and making data available to the Enterprise and internal development communities

• Building highly scalable APIs and associative architecture to support thousands of requests per second

• Being able to work across multiple teams internal/external to gather requirements and ensure project development is aligned to those requirements.

• Being able to improve the performance of the existing services and be able to identify the scope for any enhancements.

• Being able to work with parsing, managing, analyzing and making available large sets of data to turn information into insights using multiple platforms.

• Working at all stages of the software life cycle: Proof of Concept, MVP, Production, and Deprecation

Minimum Requirements:

• BSc degree in a geo-science, Image Science, Computer Science, Engineering, or Physics or relevant job experience

• At least 3 years of experience with Python development language

• Proven experience working with basic image processing workflows e.g. classification, vegetation indices

• Knowledge in additional programming or scripting languages including but not limited to Java, Scala, JavaScript/TypeScript, or Golang

• Experience developing HTTP APIs (Open API, REST, and/or GraphQL) which serve up data in an open-source technology, preferably in a cloud environment

• Ability to build and maintain modern cloud architecture, e.g. AWS, Google Cloud, Azure, etc.

• Experience working with PostgreSQL/PostGIS

• Experience working with cloud object storage, e.g. AWS S3, Google Cloud Storage, etc.

• Experience with code versioning and dependency management systems such as GitHub, SVT, or Maven. Git experience is strongly preferred

• Proven success utilizing Docker or other container tool sets to build, test, and deploy within a CI/CD Environment, preferably using Kubernetes and ArgoCD

Desirable qualifications:

• Highly proficient in Python

• MSc in Computer Science or related field

• 5 or more years of experience with Python development language

• Experience with stream processing, e.g. Kafka

• Solid understanding and experience implementing Spatial Temporal Asset Catalog (STAC) specification

• Experience working with STAC catalogs, items, and assets

• Proven experience with Elasticsearch, AWS Opensearch or similar distributed search and analytic solutions

• Proven experience (2 years) with distributed systems, e.g. Argo, Kubernetes, Spark, distributed databases, grid computing

• Proficient (3+ years) working in a Command Line Interface system e.g Docker, Argo, K8s, AWS CLI, GCloud, pSQL, SSH

• Experience with advanced image processing workflows with LiDAR, multi/hyper-spectral imagery

• Experience with photogrammetry techniques and/or geolocation and mensuration assessment experience

• Experience with raw data handling from Unmanned Aerial Systems (UAS) and/or Satellite image collection platforms

• Proficient with QGIS or similar desktop GIS environments with emphasis in imagery analytics

• Experience with developing HTTP APIs using common Python frameworks (Flask, Django, FastAPI)

• Knowledge of Geoserver and other OGC standard technologies

• Familiarity with agriculture and/or precision agriculture-oriented businesses

• Experience implementing complex data projects with a focus on collecting, parsing, managing, and delivery of large sets of data to turn information into insights using multiple platforms.

• Demonstrated experience adapting to new technologies

• Experience with object-oriented design, coding and testing patterns as well as experience in engineering (commercial or open source) software platforms and large-scale data infrastructures should be present

• Experience creating cloud computing solutions and web applications that can synthesize data from public and private APIs
  • Program Data Analyst

    3 weeks ago


    Remote, Oregon, United States Pattern Data Full time

    Who We AreThe Pattern Data platform was created for the rapid analysis of thousands of medical records. Fueled by AI, our platform efficiently reviews and categorizes documents at a speed 10 times faster, significantly reducing validation time by highlighting pertinent information crucial for litigation in medical analysis and personal injury cases. Our...


  • Remote, Oregon, United States ArdentMC Full time

    Why do you need to choose between doing important work and having a fulfilling life? At Ardent, we have both. Ardent employees are committed to solving our customers' most difficult problems—and we are committed to the well-being, personal goals, and professional development of our employee. We are "All In." We put forth our strongest effort possible to...


  • Remote, Oregon, United States Acryl Data Full time

    We are looking for a Software Engineer with Python expertise to guide customers with technical onboarding and product adoption. As part of the role, you may help build new product features, develop custom scripts, or provide product training to address customer needs. This is a hybrid role where you are part of Customer Success but will work closely with the...

  • Data Engineer

    4 weeks ago


    Remote, United States ResourceX Full time

    A Data Engineer Lead is responsible for optimizing our data and expanding the data pipeline infrastructure. Leads others in building products that will be consumed for data science artificial intelligence machine learning and other advanced analytic solutions. Works on cross-functional teams (Cloud Engineers Dev/Ops Engineers) to design and build...

  • Data Engineer

    4 weeks ago


    Remote, Oregon, United States ResourceX Full time

    A Data Engineer Lead is responsible for optimizing our data and expanding the data pipeline infrastructure. Leads others in building products that will be consumed for data science artificial intelligence machine learning and other advanced analytic solutions. Works on cross-functional teams (Cloud Engineers Dev/Ops Engineers) to design and build...

  • Data Scientist

    4 weeks ago


    Remote, Oregon, United States Stable Auto Full time

    At Stable, you'll build the foundation of EV charging businesses worldwide. Our software is already used by some of the biggest EV charging operators and developers in the U.S. to deploy billions of dollars in EV infrastructure, and we're just getting started.You'll work alongside a cast of software engineers, machine learning specialists, data scientists,...

  • Data Engineer

    4 weeks ago


    Remote, Oregon, United States WireWheel Full time

    WireWheel is revolutionizing the area of privacy and data protection by helping companies to build and manage cutting-edge and scalable privacy programs. Recognized by IDC Marketplace, Forrester, and Gartner as a leader in worldwide data privacy management software, our cloud-based Data Privacy & Protection Platform is built by privacy experts using industry...

  • Data Engineer

    4 days ago


    Remote, Oregon, United States AbbVie Full time

    Job DescriptionCome to work each day with an inclusive and collaborative technology team. As an HCP Marketing Automation Data Engineer in the AbbVie Business Technology Solutions (BTS) team, you'll have opportunities to contribute to the digital transformation of a leading biopharma company, helping to support solutions that impact patients and their...

  • Data Engineer

    4 weeks ago


    Remote, Oregon, United States SFR3 Fund Full time

    Data Engineer (10x) at SFR3 FundSFR3 is a boutique real estate investment fund acquiring $3.5B+ in affordablesingle-family homes by 2024. The Fund renovates distressed homes, usingsoftware-driven operations to run many "tertiary" markets concurrently. Today we own10,500+ homes in 20 states, buying & building several hundred more every month.YouYou love...

  • Software Engineer

    3 weeks ago


    Remote, Oregon, United States Pyth Data Association Full time

    We're hiring software engineers to help build the market data infrastructure for future decentralized finance applications. Your responsibilities will include developing on-chain solutions, creating developer SDKs, enhancing tools, and monitoring. You will also be expected to use your knowledge of the DeFi ecosystem to identify and leverage new...


  • Remote, Oregon, United States Mattermost Full time

    Mattermost provides secure, workflow-centric collaboration for technical and operational teams that need to meet nation-state-level security and trust requirements. We serve technology, public sector, national defense, and financial services industries with customers ranging from tech giants to the world's largest banks, to the U.S. Department of Defense and...

  • Staff Data Engineer

    1 week ago


    Remote, Oregon, United States CopilotIQ Full time

    CopilotIQ is perhaps the most exciting company at the intersection of technology and healthcare. CopilotIQ is transforming care for seniors with chronic conditions including diabetes and high blood pressure. Our vision is to add five great years to the lives of a million members, by transforming how we care for chronic conditions including diabetes and...

  • Sr. Data Engineer

    1 week ago


    Remote, Oregon, United States NucleusTeq Full time

    Senior Data Engineer (Python, AWS, Spark, Big Data)Location: RemoteDuration: 4 months with possible extension Enterprise Data Machine Learning (EDML) employs innovative minds like yourself to design and develop software-systems that can meet the demand of our ever-growing customer base. Like a startup inside an enterprise, EDML focuses on using a...

  • Data Architect

    2 days ago


    Remote, Oregon, United States Advanced Agrilytics Full time

    We are seeking a talented and motivated Data Architect to join our growing team. The Data Architect will play a key role in shaping our data architecture and strategy, enabling us to build scalable and efficient solutions to support our business objectives. This is an exciting opportunity for someone who thrives in a fast-paced startup environment and is...

  • Senior Data Engineer

    3 weeks ago


    Remote, Oregon, United States eSimplicity Full time

    eSimplicity is modern digital services company that delivers innovative federal and commercial IT solutions designed to improve the health and lives of millions of Americans while defending our national interests. Our solutions and services improve healthcare for 100+ million Americans, protect our borders, and defend our country by supporting and innovating...

  • Sr. Data Engineer

    7 days ago


    Remote, Oregon, United States Terakeet Full time

    About TerakeetWe are a 100% remote organization with an intentional approach to our Talent Acquisition. While remaining remote, our team is looking to concentrate our hiring in specific locations to better create opportunities for future connectivity and collaboration in-person, for when we might want some time together. Please take a look at the top of this...

  • Senior Data Engineer

    4 weeks ago


    Remote, Oregon, United States Raya Full time

    In a world where many social apps measure their success by time spent online, Raya is a technology company focused on providing utility. Our iOS only app is a tool for discovery of and access to exciting people, events, opportunities, and recommendations globally. We believe that by marrying great software with a membership based community built around core...

  • Sr. Engineer, Data

    3 weeks ago


    Remote, United States Verint Full time

    At Verint, we believe customer engagement is the core of every global brand. Our mission is to help organizations elevate Customer Experience (CX) and increase workforce productivity by delivering CX Automation. We hire innovators with the passion, creativity, and drive to answer constantly shifting market challenges and deliver impactful results for our...


  • Remote, Oregon, United States TrueML Full time

    Your Role:TrueAccord is looking for an Engineering Manager, Data Platform who will lead a team of data engineers to architect, develop, and maintain data pipelines using the latest technologies.Ideally, you have a proven track record in managing a group of world-class data engineers with demonstrated growth in their career development. You possess hands-on...


  • Remote, Oregon, United States Interwell Health Full time

    Interwell Health is a kidney care management company that partners with physicians on its mission to reimagine healthcare—with the expertise, scale, compassion, and vision to set the standard for the industry and help patients live their best lives. We are on a mission to help people and we know the work we do changes their lives. If there is a better way,...