Middle/Senior Data Engineer

2 weeks ago

Blacksburg, United States AgileEngine Full time
Job Description
This is a remote position and we are hiring candidates from the whole country.

AgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch. We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions.

If you like a challenging environment where you're working with the best and are encouraged to learn and experiment every day, there's no better place - guaranteed

What you will do

  • Work collaboratively with other engineers, architects, data scientists, analytics teams, and business product owners in an agile environment;
  • Architect, build, and support the operation of Cloud and On-Premises enterprise data infrastructure and tools;
  • Design and build robust, reusable, and scalable data driven solutions and data pipeline frameworks to automate the ingestion, processing and delivery of both structured and unstructured batch and real-time streaming data;
  • Build data APIs and data delivery services to support critical operational processes, analytical models and machine learning applications;
  • Assist in selection and integration of data related tools, frameworks, and applications required to expand platform capabilities;
  • Understand and implement best practices in management of enterprise data, including master data, reference data, metadata, data quality and lineage.
Must haves
  • 4+ years of experience with Python or Java (Python preferably, or willingness to work with this language);
  • 4+ years of experience in building data lake, cloud data platform leveraging cloud (GCP/AWS) cloud native architecture, ETL/ELT, and data integration ;
  • Three years of development experience with cloud services ( AWS,GCP,AZURE) utilizing various support tools (e.g. GCS, Dataproc, Cloud Data flow, Airflow(Composer), Kafka , Cloud Pub/Sub);
  • Expertise in developing distributed data processing and Streaming frameworks and architectures (Apache Spark, Apache Beam, Apache Flink );
  • Experience with Snowflake is a must;
  • In-depth knowledge of NoSQL database technologies (e.g. MongoDB, BigTable, DynamoDB);
  • Expertise in build and deployment tools - (Visual Studio, PyCharm, Git/Bitbucket/Bamboo, Maven, Jenkins, Nexus, );
  • 4+ years of experience and expertise in database design techniques and philosophies (e.g. RDBMS, Document, Star Schema, Kimball Model);
  • 4 years of experience with integration and service frameworks (e.g API Gateways, Apache Camel, Swagger API, Zookeeper, Kafka, messaging tools, microservices);
  • Expertise with containerized Microservices and REST/GraphQL based API development;
  • Experience leveraging continuous integration/development tools (e.g. Jenkins, Docker, Containers, OpenShift, Kubernetes, and container automation) in a Ci/CD pipeline;
  • Advanced understanding of software development and research tools;
  • Attention to detail and results oriented, with a strong customer focus;
  • Ability to work as part of a team and independently;
  • Analytical and problem-solving skills;
  • Problem-solving and technical communication skills;
  • Ability to prioritize workload to meet tight deadlines;
  • Should have working experience with wealth asset management projects;
  • Upper-intermediate English level.
Nice to haves
  • Airflow;
  • Big Query;
  • Kafka.
The benefits of joining us
  • Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
  • Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
  • A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
  • Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office - whatever makes you the happiest and most productive.

  • (Senior) Robotics Engineer

    3 months ago

    Blacksburg, United States Commonwealth of Virginia Full time

    Job Description VTTI seeks an ambitious Senior Research Associate, or Research Associate, to join an established and talented team that is making an impact in autonomous vehicle research. As a member of the team, you’ll enable research into all levels of vehicle systems and deploy autonomous vehicles for research purposes. This engineer will develop...

  • Senior Research Associate

    6 days ago

    Blacksburg, Virginia, United States Commonwealth of Virginia Full time

    Job SummaryThe Commonwealth of Virginia is seeking a highly skilled and motivated individual to join our team as a Robotics Engineer - Autonomous Vehicle Research. As a member of our team, you will play a key role in developing innovative solutions for autonomous vehicle research and development.Key ResponsibilitiesDesign and develop software for autonomous...

  • Middle Enterprise Account Executive

    4 weeks ago

    Blacksburg, Virginia, United States Proofpoint Full time

    It's fun to work in a company where people truly BELIEVE in what they're doingWe're committed to bringing passion and customer focus to the business.Company OverviewAt Proofpoint, we have a passion for protecting people, data, and brands from today's advanced threats and compliance risks. We hire the best people in the business to: Build and enhance our...

  • Senior Power Electronics Engineer

    3 months ago

    Blacksburg, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: Senior Power Electronics EngineerLocation: Blacksburg, VirginiaDuration: Full TimeJob Description:The client is looking for a Senior Power Electronics Engineer to join them. You will report to the Electrical Engineering Manager and will have an onsite, with flexible work schedule in Blacksburg, Virginia. To be...

  • Senior Traffic Engineer

    3 months ago

    Blacksburg, United States Whitman, Requardt & Associates, LLP Full time

    Job DescriptionJob DescriptionAt Whitman, Requardt & Associates, LLP, we are "People Focused and Project Driven". We have been in business for more than 105 years and we are known for our quality work and quality employees. This is your chance to join our team and design the infrastructure and buildings that improve the world!We are currently seeking a...

  • Senior Software Engineering Leader

    2 weeks ago

    Blacksburg, Virginia, United States BambooHR Full time

    Position OverviewThis role is designed for a hybrid work model, requiring some in-office presence.Key ResponsibilitiesAs a Senior Engineering Leader, you will play a crucial role in shaping the future of our application. You will oversee various initiatives aimed at maintaining our status as the leading HR Software provider for small to medium-sized...

  • Senior Research Associate, Systems Engineering

    6 days ago

    Blacksburg, Virginia, United States Commonwealth of Virginia Full time

    About the RoleThe Commonwealth of Virginia is seeking a highly skilled Senior Research Associate to join our team at the Virginia Tech National Security Institute. As a key member of our Intelligent Systems Division, you will play a critical role in advancing national security through interdisciplinary research, technology, and policy development.Key...

  • Autonomous Systems Engineer

    2 weeks ago

    Blacksburg, Virginia, United States Commonwealth of Virginia Full time

    Position Overview The Commonwealth of Virginia is seeking a dedicated and innovative Autonomous Systems Engineer to join a dynamic team focused on advancing research in autonomous vehicle technology. In this role, you will contribute to the development and implementation of cutting-edge systems that enhance vehicle autonomy and safety. Your expertise...

  • Senior .NET Engineer Lead

    4 weeks ago

    Blacksburg, Virginia, United States Kforce - United States Full time

    DescriptionKforce has a client in Draper, UT that is looking for an experienced Senior .NET Engineer Lead for a 6-month project. This will be a team of 4 experienced engineers with meaningful legacy code refactoring experience. The team will add/integrate anti-fraud measures to our client's .NET Framework-based platform. There may be some Angular work as...

  • Senior Human Factors Researcher

    7 days ago

    Blacksburg, Virginia, United States Commonwealth of Virginia Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Human Factors Researcher to join our team at the Virginia Tech Transportation Institute. As a key member of our research team, you will contribute to the development of innovative solutions to improve transportation safety and performance.Key ResponsibilitiesLead the development of research...

  • Staff Engineer

    4 weeks ago

    Blacksburg, United States QISG Full time

    Job DescriptionJob DescriptionJob Title: Staff EngineerGeneral DescriptionAre you interested in working in a dynamic environment building the power generation and transmission infrastructure required to meet present and future needs in North America? Quanta Infrastructure Solutions Group (QISG) is a rapidly growing construction management and geo-structural...

  • Staff Engineer

    4 weeks ago

    Blacksburg, United States QISG Full time

    Job DescriptionJob DescriptionJob Title: Staff EngineerGeneral DescriptionAre you interested in working in a dynamic environment building the power generation and transmission infrastructure required to meet present and future needs in North America? Quanta Infrastructure Solutions Group (QISG) is a rapidly growing construction management and geo-structural...

  • Senior Human Factors Transportation Researcher

    3 months ago

    Blacksburg, United States Commonwealth of Virginia Full time

    Job Description Make a difference while working with the latest technologies in a field that affects the safety and quality of lives of almost everyone. Transportation is undergoing an incredible transformation as automated and safety-related technologies are introduced across one of the largest industry sectors in the U.S. You can play a part in saving...

  • Fundraising Data Specialist

    2 months ago

    Blacksburg, United States Virginia Polytechnic Institute and State University Full time

    Fundraising Data SpecialistJob no: 529438 Work type: Staff Senior management: Senior Vice Pres Advancement Department: University Development Location: Blacksburg, Virginia, Hybrid Categories: Advancement, Administrative / Clerical, Data Analytics / Security, FundraisingJob DescriptionThe Fundraising Data Specialist position in Virginia Tech is a key partner...

  • Staff Data Scientist

    3 months ago

    Blacksburg, United States Groundwater and Environmental Svcs. Full time

    Job DescriptionJob DescriptionGroundwater & Environmental Services, Inc. (GES), an industry leader with a reputation for excellence in providing environmental consulting, engineering, compliance, and technical field services to clients in diverse market sectors, seeks a Staff Data Scientist in our Blacksburg, VA office. Overview:The staff data scientist...

  • Fundraising Data Specialist

    1 month ago

    Blacksburg, United States Virginia Polytechnic Institute and State University Full time

    Fundraising Data Specialist Job no: 529438 Work type: Staff Senior management: Senior Vice Pres Advancement Department: University Development Location: Blacksburg, Virginia, Hybrid Categories: Advancement, Administrative / Clerical, Data Analytics / Security, Fundraising Job Description The Fundraising Data Specialist position in Virginia Tech is a key...

  • Summer 2025 Data Science Intern- Internal Research

    1 week ago

    Blacksburg, United States Peraton Full time

    Responsibilities Peraton is seeking Summer 2025 Data Science Interns in support of our Internal Research & Development (IRAD) program which will be conducted in our Herndon, VA, West Lafayette, IN or Blacksburg, VA offices. Join our Technology and Engineering Software Delivery Center and support exciting research projects in areas such as health, finance,...

  • Senior Cybersecurity Systems Engineer

    2 weeks ago

    Blacksburg, Virginia, United States TORC Robotics Full time

    About Torc Robotics Torc Robotics is at the forefront of transforming transportation through autonomous vehicle technology. As a pioneer in the autonomous driving sector since 2007, we have dedicated ourselves to commercializing innovative solutions in collaboration with experienced partners. Now integrated within the Daimler family, our focus is on...

  • Senior Systems Engineer Cybersecurity

    4 weeks ago

    Blacksburg, United States TORC Robotics Full time

    About the Company At Torc, we have always believed that autonomous vehicle technology will transform how we travel, move freight, and do business. A leader in autonomous driving since 2007, Torc has spent over a decade commercializing our solutions with experienced partners. Now a part of the Daimler family, we are focused solely on developing software for...

  • Mining Engineering Instructor

    2 weeks ago

    Blacksburg, Virginia, United States Commonwealth of Virginia Full time

    Position Overview The Commonwealth of Virginia is seeking qualified candidates for a teaching faculty role within the Mining and Minerals Engineering (MME) department. This position is set to commence in the upcoming academic year. The initial contract will span one year, with the potential for renewal based on performance and funding availability. The...