Data Engineer

2 weeks ago

Tampa, United States Gridiron IT Solutions Full time

Description

As a Senior Data Pipeline Engineer, you will play a crucial role in designing, building, and maintaining robust data pipelines for our customers. Your expertise will drive the efficient collection, storage, processing, and transformation of large-scale data sets. Here are the key responsibilities and qualifications for this role:

Responsibilities:

Pipeline Development:

  • Design, develop, and optimize end-to-end data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
  • Collaborate with cross-functional teams to understand data requirements and translate them into scalable pipeline solutions.
  • Implement best practices for data integration, ensuring high performance, reliability, and scalability.

Data Transformation and Quality:

  • Transform raw data into usable formats, ensuring data quality, consistency, and accuracy.
  • Handle data validation, cleansing, and error handling to maintain data integrity.
  • Monitor and proactively maintain data pipelines to ensure high service availability.

Performance Optimization:

  • Continuously improve pipeline performance by identifying bottlenecks and implementing optimizations.
  • Work with cloud-based technologies (e.g., AWS, Google Cloud Platform, Azure) to enhance scalability and efficiency.

Collaboration and Leadership:

  • Partner with Data Scientists, Analysts, and other stakeholders to understand their data needs.
  • Lead discussions on system enhancements, process improvements, and data governance.
  • Mentor junior engineers and contribute to the growth of the data engineering team.

This role will be performed 80% remote with 20% onsite.

This role will require ~20% TDY within the CENTCOM/SOCOM AOR.

Requirements

Qualifications:

  • Bachelor s degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering, with a focus on building and maintaining data pipelines.
  • 1-2 years experience with building NiFI data flows or similar for Kafka and Hadoop-based NoSQL databases.
  • Proficiency in ETL tools, SQL, and scripting languages (Python, Scala, etc.).
  • Experience with Data Catalog and Accumulo indexes for information retrieval and discovery.
  • Experience with API-led design.
  • Experience with ELK stack a plus.
  • Experience with cloud-based data platforms (e.g., AWS S3, Redshift, Google BigQuery).
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.
  • Security+ Certification
  • Active US Government Clearance at Secret level or higher
  • Ability to sit for extended periods of time.
  • Ability to regularly lift at least 25 pounds.
  • Ability to commute to the designated onsite work location as required.
Data Engineer - Secret cleared

  • Data Engineer

    7 days ago

    Tampa, Florida, United States Amgen Full time

    HOW MIGHT YOU DEFY IMAGINATION?Youve worked hard to become the professional you are today and are now ready to take the next step in your career. How will you put your skills, experience and passion to work toward your goals? At Amgen, our shared missionto serve patientsdrives all that we do. It is key to our becoming one of the worlds leading biotechnology...

  • Data Engineer

    6 days ago

    Tampa, United States Amgen Full time

    HOW MIGHT YOU DEFY IMAGINATION?Youve worked hard to become the professional you are today and are now ready to take the next step in your career. How will you put your skills, experience and passion to work toward your goals? At Amgen, our shared missionto serve patientsdrives all that we do. It is key to our becoming one of the worlds leading biotechnology...

  • Data Engineer

    1 week ago

    Tampa, United States RIT Solutions, Inc. Full time

    Data Engineer Duration: 6 months Needed for submittal: Birthday (Month/Day) City/State Email / Phone Education and dates on resume Full Legal name (including middle) Skills: 7+ years of development experience building data pipelines using Cloud technologies. 5+ years of experience in architecture of modern data warehousing platforms...

  • Data Engineer

    7 days ago

    Tampa, United States Iron EagleX Full time

    Overview: Iron EagleX is a veteran owned defense contracting company based in Tampa, FL. It is our mission to provide solutions to the most challenging technical problems facing the Department of Defense while simultaneously making a positive impact on our employees and community. Responsibilities: Job Description: The Data Engineer builds and maintains...

  • Senior Azure Data Engineer

    1 month ago

    tampa, United States Softworld Inc Full time

    Job Title: Senior Data Engineer Location: TAMPA FL 33634Job Description:Senior Azure Data Engineer for a direct hire position with our client located in Tampa, FL which allows the flexibility to work remotely with the expectation to attend o...

  • Data Modeler/Data Engineer

    2 weeks ago

    Tampa, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, Envision Technology Solutions, is seeking the following. Apply via Dice today! Role- Data Modeler/Data Engineer (Erwin) Location : Tampa, FL(Onsite) Fulltime/Contract W2 Basic Qualifications: Minimum of 10+ years demonstrated expertise in logical and physical...

  • Associate Software/Data Engineer

    7 days ago

    Tampa, United States Amgen Full time

    HOW MIGHT YOU DEFY IMAGINATION? You’ve worked hard to become the professional you are today and are now ready to take the next step in your career. How will you put your skills, experience and passion to work toward your goals? At Amgen, our shared mission—to serve patients—drives all that we do. It is key to our becoming one of the world’s leading...

  • Big Data Engineer

    2 weeks ago

    Tampa, United States ApTask Full time

    Position: Big Data EngineerLocation: Tampa, FL (3 days onsite/week)Type: Fulltime / PermanentNOTE: OPEN FOR H1b TRANSFERJob Description: Strong Core Java Python Scala working experience Strong Experience in Big data technologies like Apache Spark HDFS Hive Hbase Comfortable working with large data volumes and be able to demonstrate a firm understanding of...

  • Associate Software/Data Engineer

    4 days ago

    Tampa, United States Amgen Full time

    HOW MIGHT YOU DEFY IMAGINATION?Youve worked hard to become the professional you are today and are now ready to take the next step in your career. How will you put your skills, experience and passion to work toward your goals? At Amgen, our shared missionto serve patientsdrives all that we do. It is key to our becoming one of the worlds leading biotechnology...

  • Associate Software/Data Engineer

    5 days ago

    Tampa, Florida, United States Amgen Full time

    HOW MIGHT YOU DEFY IMAGINATION?Youve worked hard to become the professional you are today and are now ready to take the next step in your career. How will you put your skills, experience and passion to work toward your goals? At Amgen, our shared missionto serve patientsdrives all that we do. It is key to our becoming one of the worlds leading biotechnology...

  • Associate Software/Data Engineer

    7 days ago

    Tampa, United States BioSpace, Inc. Full time

    Job Details HOW MIGHT YOU DEFY IMAGINATION? Youve worked hard to become the professional you are today and are now ready to take the next step in your career. How will you put your skills, experience and passion to work toward your goals? At Amgen, our shared missionto serve patientsdrives all that we do. It is key to our becoming one of the worlds leading...

  • Sr. azure data factory engineer

    2 weeks ago

    Tampa, United States Diverse Lynx Full time

    Azure Data Factory EngineerTampa, FL Role Description: Azure Data Factory Engineer? Experience implementing solutions and ETL processes within the Azure stack including Azure Data Factory, Azure Data Lake, Azure SQL Server, Databricks, etc.? Ability to integrate data with Azure Data Factory? Should be able to use server-less data integration service.? Create...

  • Senior Lead Data Engineer

    7 days ago

    Tampa, United States JPMorgan Chase Bank, N.A. Full time

    Embrace this pivotal role as an essential member of a high performing team dedicated to driving data governance and understing of business data to new heights. Your contributions will be instrumental in shaping the future of one of the world's largest and most influential companies. As a Senior Lead Data Engineer at JPMorgan Chase within the Corporate and...

  • Data Solutions Engineer

    4 days ago

    Tampa, United States ApTask Full time

    About Client: The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes application development, maintenance, and support. The markets served by the company are financial services and insurance, healthcare,...

  • Big Data Engineer

    2 weeks ago

    Tampa, United States ApTask Full time

    Position: Big Data EngineerLocation: Tampa, FLDuration: Fulltime Salary: $110K per annum + Benefits Job Description:Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary system enhancementsIdentify and analyze issues make recommendations and implement...

  • Remote Lead Data Engineer

    2 weeks ago

    Tampa, United States Insight Global Full time

    Position: Lead Data Engineer (Databricks/AWS) Duration: 6 Month Contract – w/extensions or conversion Location: Remote ; East Coast!!! If the following job requirements and experience match your skills, please ensure you apply promptly. Must Haves: 2-3 years exp. as a data engineer 3 years of RECENT experience with Data Bricks Must be their most...

  • Senior Lead Data Engineer

    1 week ago

    Tampa, United States JPMorgan Chase Full time

    Job Description Embrace this pivotal role as an essential member of a high performing team dedicated to driving data governance and understing of business data to new heights. Your contributions will be instrumental in shaping the future of one of the world's largest and most influential companies.As a Senior Lead Data Engineer at JPMorgan Chase within...

  • Senior Lead Data Engineer

    1 month ago

    Tampa, Florida, United States tapwage Full time

    Embrace this pivotal role as an essential member of a high performing team dedicated to driving data governance and understing of business data to new heights. Your contributions will be instrumental in shaping the future of one of the world's largest and most influential companies.As a Senior Lead Data Engineer at JPMorgan Chase within the Corporate and...

  • Big Data Engineer

    1 week ago

    Tampa, United States LTIMindtree Full time

    Hi,Hope you're doing well. We have an opening for the below position. Kindly let me know your thoughts. Job Title: Big Data Engineer Job Location: Tampa, FL/ Irving, TXJob Type: FulltimeResponsibilities:Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary system...

  • Big Data Engineer

    1 week ago

    Tampa, United States LTIMindtree Full time

    Hi, Hope you're doing well. We have an opening for the below position. Kindly let me know your thoughts. Job Title: Big Data Engineer Job Location: Tampa, FL/ Irving, TX Job Type: Fulltime Responsibilities: Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary...