Senior Data Engineer

6 days ago

Tampa, Florida, United States AgileEngine Full time
Job Description

We are seeking a highly skilled Senior Data Engineer to join our team at AgileEngine. As a Senior Data Engineer, you will be responsible for architecting, building, and supporting the operation of our cloud and on-premises enterprise data infrastructure and tools.

Key Responsibilities:

  • Collaborate with cross-functional teams, including engineers, architects, data scientists, and business product owners, to design and implement data-driven solutions.
  • Design and build robust, scalable, and reusable data pipelines and frameworks to automate data ingestion, processing, and delivery.
  • Develop and maintain data APIs and data delivery services to support critical operational processes, analytical models, and machine learning applications.
  • Assist in the selection and integration of data-related tools, frameworks, and applications to expand our platform capabilities.
  • Implement best practices in data management, including master data, reference data, metadata, data quality, and lineage.

Requirements:

  • 4+ years of experience with Python or Java (Python preferred).
  • 4+ years of experience in building data lakes and cloud data platforms leveraging cloud-native architecture, ETL/ELT, and data integration.
  • 3+ years of development experience with cloud services (AWS, GCP, Azure) utilizing various support tools.
  • Expertise in developing distributed data processing and streaming frameworks and architectures (Apache Spark, Apache Beam, Apache Flink).
  • Experience with Snowflake is a must.
  • In-depth knowledge of NoSQL database technologies (e.g., MongoDB, BigTable, DynamoDB).
  • Expertise in build and deployment tools (Visual Studio, PyCharm, Git, Bitbucket, Bamboo, Maven, Jenkins, Nexus).
  • 4+ years of experience and expertise in database design techniques and philosophies.
  • 4+ years of experience with integration and service frameworks (API Gateways, Apache Camel, Swagger API, Zookeeper, Kafka, messaging tools, microservices).
  • Expertise with containerized microservices and REST/GraphQL-based API development.
  • Experience leveraging continuous integration/development tools (Jenkins, Docker, Containers, OpenShift, Kubernetes, and container automation) in a CI/CD pipeline.
  • Advanced understanding of software development and research tools.
  • Attention to detail and results-oriented, with a strong customer focus.
  • Ability to work as part of a team and independently.
  • Analytical and problem-solving skills.
  • Problem-solving and technical communication skills.
  • Ability to prioritize workload to meet tight deadlines.
  • Should have working experience with wealth asset management projects.
  • Upper-intermediate English level.

Nice to Have:

  • Airflow.
  • Big Query.
  • Kafka.

Benefits of Joining AgileEngine:

  • Professional growth.

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

  • Competitive compensation.

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

  • A selection of exciting projects.

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

  • Flextime.

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

  • Senior Data Engineer

    3 days ago

    Tampa, Florida, United States LTIMINDTREE Full time

    About UsLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies.Job Title: Senior Data Engineer with QuantexaWe are seeking a highly skilled Senior Data Engineer to join our team in Tampa,...

  • Senior Software Engineer

    4 days ago

    Tampa, Florida, United States Raft Company Website Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at Raft Company Website. As a key member of our team, you will be responsible for designing and developing a data-focused product that leverages best-of-breed open source solutions.Key ResponsibilitiesDesign and develop end-to-end features that make interacting with data...

  • Data Systems Engineer

    2 days ago

    Tampa, Florida, United States Leidos Full time

    About the RoleWe are seeking a highly skilled Data Systems Engineer to join our team at Leidos. As a key member of our Digital Modernization team, you will play a critical role in supporting data analytics and predictive analytics for the USCENTCOM J6 Team.Key ResponsibilitiesProvide services for the development and execution of strategic CENTCOM J6 data...

  • Data Engineer

    4 days ago

    Tampa, Florida, United States Evenbreak Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our Analytics Team at Evenbreak. As a Senior Manager, Data Engineering, you will play a pivotal role in designing and implementing scalable, extensible, and highly-available data pipelines on large volume data sets.Key ResponsibilitiesCollaborate with data scientists, reporting/data...

  • Data Engineer

    1 month ago

    Tampa, Florida, United States VetsEZ Full time

    VetsEZ is seeking a highly skilled Data Engineer to join our team. The successful candidate will work remotely and will be responsible for managing and optimizing large-scale data systems, supporting data integration and transformation, and ensuring data quality and accessibility. This role requires strong technical expertise in database management, data...

  • Senior Environmental Engineer

    6 days ago

    Tampa, Florida, United States Jobot Full time

    About the RoleWe are seeking a highly skilled Senior Environmental Engineer to join our team at Jobot. As a Senior Environmental Engineer, you will be responsible for leading environmental engineering projects and providing technical expertise to clients.Key ResponsibilitiesMentor junior engineers and provide guidance on environmental engineering...

  • Senior Java/WebSphere Engineer

    1 week ago

    Tampa, Florida, United States C4 Technical Services Full time

    Senior Java/WebSphere Engineer Work Location: Remote POSITION OVERVIEW: The Senior Java/WebSphere Engineer is tasked with the design, development, and implementation of innovative IT solutions. This role involves creating comprehensive system specifications, engaging in unit testing, and maintaining both planned and unplanned applications developed...

  • Senior Systems Engineer

    1 week ago

    Tampa, Florida, United States SAIC Full time

    Job SummarySAIC is seeking a highly skilled Senior Systems Engineer to support the U.S. Navy in Tampa, FL. As a key member of our team, you will provide engineering and technical support for the research, design, development, installation, and related services for physical and electronic security systems and components.Key ResponsibilitiesDevelop and review...

  • Redis Data Engineer

    3 days ago

    Tampa, Florida, United States LTIMINDTREE Full time

    Job Title: Starburst Redis DeveloperAt LTIMindtree, we are seeking a highly skilled Redis Data Engineer to join our team. As a Redis Data Engineer, you will be responsible for designing, implementing, and maintaining high-performance data systems using Redis.Key Responsibilities:Design and implement data storage and retrieval systems using RedisDevelop and...

  • Data Engineer Director

    3 days ago

    Tampa, Florida, United States Evenbreak Full time

    About the RoleWe are seeking a highly skilled and experienced Data Engineer Director to join our Analytics Engineering team at Evenbreak. As a key member of our team, you will be responsible for designing and implementing scalable, extensible, and highly available data pipelines on large volume data sets.Key ResponsibilitiesTranslate business requirements...

  • Senior Java/WebSphere Engineer

    1 week ago

    Tampa, Florida, United States C4 Technical Services Full time

    Senior Java/WebSphere Engineer Work Location: Remote POSITION OVERVIEW: The Senior Java/WebSphere Engineer plays a pivotal role in crafting, programming, and coding innovative Information Technology solutions. This position entails the meticulous documentation of comprehensive system specifications, engaging in unit testing, and maintaining both planned...

  • Senior Environmental Data Analyst

    2 weeks ago

    Tampa, Florida, United States The Mosaic Company Full time

    About The Mosaic CompanyThe Mosaic Company is a leading integrated producer of concentrated phosphate and potash, two of the three most important nutrients in agriculture. We employ over 13,000 people in six countries to serve farmers worldwide. Our headquarters is in Lithia, Florida, with operations in North America and South America.Job SummaryWe are...

  • Junior Data Engineer

    2 months ago

    Tampa, Florida, United States Amgen Full time

    HOW MIGHT YOU DEFY IMAGINATION?Youve worked hard to become the professional you are today and are now ready to take the next step in your career. How will you put your skills, experience and passion to work toward your goals? At Amgen, our shared missionto serve patientsdrives all that we do. It is key to our becoming one of the worlds leading biotechnology...

  • Senior Environmental Remediation Engineer

    1 week ago

    Tampa, Florida, United States NxT Level Full time

    Job OverviewAt NxT Level, we pride ourselves on being a leading firm in environmental consulting and engineering, committed to providing innovative solutions tailored to our clients' needs. With over forty years of expertise, we specialize in regulatory compliance, site evaluations, engineering services, and remediation strategies for both private and public...

  • Senior Data Governance Lead Analyst

    4 days ago

    Tampa, Florida, United States Citigroup Inc Full time

    About the RoleWe are seeking a highly skilled Senior Data Governance Lead Analyst to join our team at Citigroup Inc. in Tampa, Florida. As a key member of our Data Governance team, you will play a critical role in driving the development and implementation of our Enterprise Data Governance Strategy, Data Risk and Control Framework, and Data Risk Taxonomy.Key...

  • Senior Geotechnical Engineering Manager

    1 week ago

    Tampa, Florida, United States WSP Full time

    Exciting Career OpportunityJoin our dynamic team at WSP, where we are actively looking for a Senior Geotechnical & Tunneling Engineer. This position involves overseeing a team and engaging in complex projects to fulfill client needs.Your Responsibilities:Supervise a team of geotechnical and tunneling engineers, oversee project management and budgets,...

  • Senior Java Backend Engineer

    2 weeks ago

    Tampa, Florida, United States C4 Technical Services Full time

    Senior Java Backend Engineer Work Location: Remote POSITION OVERVIEW: The Senior Java Backend Engineer plays a crucial role in the design, development, and implementation of robust IT solutions. This position involves crafting detailed technical specifications, engaging in unit testing, and maintaining both scheduled and unscheduled applications developed...

  • Senior Network Solutions Engineer

    5 days ago

    Tampa, Florida, United States General Dynamics Information Technology Full time

    Senior Network Solutions Engineer Overview: We are seeking a highly skilled Senior Network Solutions Engineer with a minimum of 5 years of experience in designing and architecting Cisco ACI solutions tailored to meet both business and technical requirements. This role requires a deep understanding of data center networking principles, application...

  • Senior Hadoop Engineer

    2 weeks ago

    Tampa, Florida, United States C4 Technical Services Full time

    Senior Hadoop Engineer Work Location: Remote Objective: This role is part of a significant enterprise initiative focusing on the "Smartbot project," which integrates Python and Hadoop development tasks. Candidates should possess proficiency in both technologies. A Hadoop Engineer is tasked with the architecture, development, and management of systems...

  • Senior Hadoop Engineer

    2 weeks ago

    Tampa, Florida, United States C4 Technical Services Full time

    Senior Hadoop Engineer Work Location: Remote Overview: This role is part of an enterprise initiative focusing on the "Smartbot project," which integrates Python and Hadoop development. Candidates should possess proficiency in both areas. A Hadoop Engineer is tasked with the architecture, development, and management of systems designed to handle...