Data Engineer I

4 weeks ago


Nashville, United States CareerBuilder Full time

Job Title: Senior Data Engineer

Reports to: Director of Technology

Location: Nashville, TN

Position Summary:

AgriCapture is a mission-driven company that certifies Climate-Friendly practices on farms, ranchlands and grasslands and quantifies associated emissions reductions, enabling producers to generate revenue for their sustainable management practices. By certifying agricultural products as Climate-Friendly and developing carbon credits, we serve corporations who are reducing and offsetting their GHG emissions while empowering consumers to consciously select Climate-Friendly products. AgriCapture was recently awarded a $7.5 million grant from the USDA to build a market for Climate-Friendly commodities.

As the Senior Data Engineer, you will function as an expert in developing a variety of proprietary systems and data pipelines that support climate friendly agricultural practice adoption and carbon credit issuance. In this role, you will work close to the business and IT leadership in the design and development of agile data architectures that evolve as new trends emerge. Your expertise will be a vital piece to the company and its mission and greater purpose. This will be a dynamic, fast-paced position providing a unique opportunity to be a part of a growing company that is poised to have a positive environmental impact.

Objectives of the Role

Build data tools and systems that scale and leverage AgriCaptures core competency and competitive advantage.
Apply conceptual knowledge of business processes and technology to solve complex business processes and procedural problems.
Serves as a technical advisor and a subject matter expert to internal and external staff who perform development and IT related functions.
Work with Product and Business Analysis in transforming business requirements into actions that create value.
Proven history to acquire, scale and lead with data.
Participate in multiple projects simultaneously adapting to priorities and thriving in a flexible and dynamic environment.

Responsibilities

Proficient working with large, complex data sets, with data lake and warehouse in cloud environments.
Uses industry best practice, proactively analyzes existing software architecture and new development to improve data quality.
Develop and maintain data models for agriculture practice solutions. Provide technical expertise and recommendations in assessing new software projects and initiatives.
Work with Business Analysts to validate processes of test / use cases and then optimizes data load jobs to improve performance and automation.
Proficient in creating, maintaining, and auditing data pipelines using cloud services.
Monitor and troubleshoot data pipeline performance, efficiency, and accuracy.
Work with the analysts developing the requirements of the data warehouse solution.
Provide clear analysis and written documentation including validation and test plans for the development of data modeling projects.
Create solutions to improve the performance and availability of self-service analytics.
Lead project efforts, ensuring project requirements and timelines are met and may guide, mentor, and oversee the work of other technical staff.

Skills and Qualifications

3+ years of experience building robust data pipelines on cloud platform (Azure) for both structured and unstructured data. Familiarity with Azure and its suite of data, analytic and cloud services.
4+ years of experience in programming in Python & T-SQL. Proficient in software development lifecycle and software engineering practices.
Proficient in understanding and incorporating software engineering principles in design & development process. Experienced in designing and developing scalable systems using object-oriented principles and functional programming.
Hands-on experience in building, maintaining, and owning tools and applications which have been used by multiple teams across the organization.
Experience with data ingestion and manipulation of multiple varieties (JSON, Apache Parquet, CSV, etc..) using various ETL tools to connect warehouse services within cloud ecosystem.
Demonstrates ability to understand complex ETL processes. Familiarity with design and development of ETL processes using Azure DataFactory and Azure Data Lake.
Significant experience with version control practices and exposure to CI/CD tools and principles.
Skilled at writing, testing, debugging new and existing code based on program area knowledge, conceptual and technical design specifications.
Familiarity with REST APIs and building REST based applications.
Strong interpersonal and communication skills, with the ability to collaborate effectively across diverse teams.
You have a sustained track record of making significant self-directed and end-to-end contributions to impactful software or data engineering projects, understanding the why behind software initiatives and own development throughout a projects lifecycle.

Nice to have:

Experience with API and microservice development using Flask/FastAPI frameworks and familiarity with containerization technologies (docker, Kubernetes).
Understanding of data science and machine learning workflows.
Prior experience working with geospatial data and/or working in agriculture technology.
Professional experience building and maintaining solutions with Data Orchestration tools (Airflow, Prefect, Dagster, etc).
Strong understanding of designing and implementing CI/CD pipelines for the integration and deployment of software solutions.

Benefits

100% of employee medical premiums company paid
Employer HSA contribution
Coverage for Dental, Vision, Disability, and Life Insurance
Identity Theft and Prepaid Legal coverage options available
Time away: Flexible PTO and paid holidays
Parental Leave
401k with company match
Allowance for office equipment
Monthly happy hours, weekly lunch cateringand office snacks and drinks

AgriCapture is committed to creating a diverse environment and is proud to be an equal-opportunity employer. AgriCapture recruits, employs, trains, compensates, and promotes regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

#J-18808-Ljbffr


  • Data Engineer

    1 month ago


    Nashville, United States InterEx Group Full time

    Data Engineer - AWS Circa $110,000 A global music company are looking for a Data Engineer to join a growing team, you will work on new solutions that seamlessly integrate both the back end of a website and/or application.We are looking for someone who has an in-depth knowledge of design of modern programming languages & web technologies, backend...

  • Data Engineer

    4 weeks ago


    Nashville, United States InterEx Group Full time

    Data Engineer - AWS Circa $110,000 A global music company are looking for a Data Engineer to join a growing team, you will work on new solutions that seamlessly integrate both the back end of a website and/or application.We are looking for someone who has an in-depth knowledge of design of modern programming languages & web technologies, backend...

  • Data Engineer

    4 weeks ago


    Nashville, United States InterEx Group Full time

    Data Engineer - AWS Circa $110,000 A global music company are looking for a Data Engineer to join a growing team, you will work on new solutions that seamlessly integrate both the back end of a website and/or application.We are looking for someone who has an in-depth knowledge of design of modern programming languages & web technologies, backend...


  • Nashville, United States Programmers.io Full time

    Title: Sr. Data EngineerLocation: Nashville, TN (onsite)Duration: Full-timeOverview:We're looking for an experienced Azure Data Engineer with 8-12 years of experience in SQL Server, Power BI, and Azure data services. The candidate should be skilled in building data pipelines, scripting, and data modeling. Strong problem-solving, communication, and...

  • Senior Data Engineer

    2 weeks ago


    Nashville, United States Programmers.io Full time

    Title: Sr. Data EngineerLocation: Nashville, TN (onsite)Duration: Full-timeOverview:We're looking for an experienced Azure Data Engineer with 8-12 years of experience in SQL Server, Power BI, and Azure data services. The candidate should be skilled in building data pipelines, scripting, and data modeling. Strong problem-solving, communication, and...

  • Senior Data Engineer

    2 weeks ago


    Nashville, United States Programmers.io Full time

    Title: Sr. Data EngineerLocation: Nashville, TN (onsite)Duration: Full-timeOverview:We're looking for an experienced Azure Data Engineer with 8-12 years of experience in SQL Server, Power BI, and Azure data services. The candidate should be skilled in building data pipelines, scripting, and data modeling. Strong problem-solving, communication, and...


  • Nashville, United States Programmers.io Full time

    We have an opportunity for Senior Data Engineer with one of our clients for Nashville, TN If interested, please send me a copy of your resume, your contact details, your availability, and a good time to connect with you. Title- Senior Data Engineer Location- Nashville, TN Terms- Full-time SCOPE OF WORKDesign, build, and maintain scalable data pipelines...


  • Nashville, United States Programmers.io Full time

    We have an opportunity for Senior Data Engineer with one of our clients for Nashville, TN If interested, please send me a copy of your resume, your contact details, your availability, and a good time to connect with you. Title- Senior Data Engineer Location- Nashville, TN Terms- Full-time SCOPE OF WORKDesign, build, and maintain scalable data pipelines...


  • Nashville, United States Programmers.io Full time

    Title- Senior Data Engineer Location- Nashville, TN (Onsite)Terms- Full-timeSCOPE OF WORKDesign, build, and maintain scalable data pipelines using Azure Data Factory (ADF) and other Azure servicesAdminister, monitor, and troubleshoot SQL Server databases, ensuring high performance and availabilityDevelop and optimize SQL queries and stored procedures to...


  • Nashville, United States Programmers.io Full time

    Title- Senior Data Engineer Location- Nashville, TN (Onsite)Terms- Full-timeSCOPE OF WORKDesign, build, and maintain scalable data pipelines using Azure Data Factory (ADF) and other Azure servicesAdminister, monitor, and troubleshoot SQL Server databases, ensuring high performance and availabilityDevelop and optimize SQL queries and stored procedures to...

  • Azure Data Engineer

    2 days ago


    Nashville, Tennessee, United States Philips Full time

    Job TitleAzure Data EngineerJob DescriptionAzure Data Engineer, CG 60- NAM Comm Ops- Analytics, Insights & Automation (Nashville or Cambridge)We have an exciting opportunity for a Data Engineer to leverage their expertise in Azure, your role will help create and maintain the core foundation on the Azure Platform from which North American Analytics solutions...


  • Nashville, United States Mozaic.io Full time

    Job DescriptionJob DescriptionWe are looking for an experienced and detail-oriented Senior Data/SQL Engineer to join our dynamic team. As a Senior Azure Data Engineer, you will play a crucial role in designing, implementing, and optimizing data storage solutions, ensuring efficient data retrieval, and supporting data-driven applications. The ideal candidate...


  • Nashville, United States Philips Full time

    Job TitleData Governance LeaderJob DescriptionData Governance Leader (Nashville, TN)Using your strong expertise in data stewardship and governance, you play a pivotal role in establishing and maintaining a robust data governance framework within Philips North America. You are responsible for overseeing the development, implementation, and enforcement of data...

  • Azure Data Engineer

    1 week ago


    Nashville, United States Diverse Lynx Full time

    Mandatory Skills Airflow, Python, Azure Databricks, Azure data engineering services, RDBMS, ETL knowledge, API Nice to Have Spark, Scala, ODI, Oracle Provide L2 support for the existing Azure based ETL applications. Work on enhancements and deploy them in production. Follow Agile methodology. Source data from various source systems in file formats Use...

  • Support Engineer

    1 day ago


    Nashville, United States Collabera LLC Full time

    Job Title: End User EngineerLocation: Nashville, TNDuration: 6 Months Contract to HireMust Haves: 2-4+ years of Desktop Support / End User Support Experience - PC & Mac 2+ years of experience with Azure Active Directory SSCM On-Prem Active Directory experience Bachelor's Degree - Does not need to be computer-related Scripting experience - PowerShell or VB...


  • Nashville, United States Olsson Full time

    As a Senior Civil Engineer on our Data Center Civil Team, you will be a part of the firms largest and most complex projects. You will serve as a project manager on some projects and lead design engineer on others. Prepare planning and design documen Civil, Civil Engineer, Engineer, Senior, Data, Technology


  • Nashville, United States Vanderbilt Health Full time

    Discover Vanderbilt University Medical Center: Located in Nashville, Tennessee, and operating at a global crossroads of teaching, discovery, and patient care, VUMC is a community of diverse individuals who come to work each day with the simple aim of changing the world. It is a place where your expertise will be valued, your knowledge expanded, and your...


  • Nashville, United States Vanderbilt University Medical Center Full time

    Discover Vanderbilt University Medical Center: Located in Nashville, Tennessee, and operating at a global crossroads of teaching, discovery, and patient care, VUMC is a community of diverse individuals who come to work each day with the simple aim of changing the world. It is a place where your expertise will be valued, your knowledge expanded, and your...

  • Junior Data Engineer

    3 weeks ago


    Nashville, United States Remotely Full time

    This is a remote position. Junior Data Engineer (1 year experience, remote) Be part of our future! This job posting builds our talent pool for potential future openings. We'll compare your skills and experience against both current and future needs. If there's a match, we'll contact you directly. No guarantee of immediate placement, and we only consider...


  • Nashville, United States UBS Full time

    Job Reference # 283442BR Job Type Full Time Your role Are you passionate about technology and data? Do you want to help implement the strategy for Global Data Management environments at an international firm? We are looking for a Tech Site Reliability Engineer to join our team and help us to: administer crucial infrastructure for platforms, both on-premise...