Data Engineer

4 weeks ago

Crystal City, United States CareerBuilder Full time

Data Engineer Role Description & Requirements

Data is absolutely the lifeblood of ADVANA and our data engineers are the doctors administering it

Our data engineers support data collection, ingestion, validation, and loading of optimized data in the appropriate data stores. They work on a team made up of analyst(s), developer(s), data scientist(s), and a product lead, and everyone on the team collaborates in support of a specific mission. Working directly with the analyst(s) and the product lead, the data engineer identifies and implements solutions for the data requirements, including building pipelines to collect data from disparate, external sources, implementing rules to validate that expected data is received, cleansed, transformed, massaged and in an optimized output format for the data store. The Data Engineer performs validation and analytics corresponding with client requirements and evolves solutions through automation, optimizing performance with minimal human involvement. As pipelines are executed, the data engineer monitors their status, performance, and troubleshoots issues while working on improvements to ensure the solution is the very best version to address the customer's need.

As a

Data Engineer , this role focuses specifically on the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. The best athlete candidate for this position will be able to apply advanced consulting skills, extensive technical expertise and has full industry knowledge to develop innovative solutions to complex problems. This candidate is able to work without considerable direction and may mentor or supervise other team members.

What were looking for:

Someone with a solid background developing solutions for high volume, low latency applications and can operate in a fast-paced, highly collaborative environment.
A candidate with distributed computer understanding and experience with SQL, Spark, ETL.
A person who appreciates the opportunity to be independent, creative and challenged.
An individual with a curious mind, passionate about solving problems quickly and bringing innovative ideas to the table.

Basic Qualifications:

4+ years of experience with SQL
4+ years of experience developing data pipelines using modern Big Data ETL technologies like NiFi or StreamSets.
4+ years of experience with a modern programming language such as Python or Java
4 years of experience working in a big data and cloud environment

Secret Clearance or higher

Additional Qualifications:

2 years of experience working in an agile development environment
Ability to quickly learn technical concepts and communicate with multiple functional groups
Ability to display a positive, can-do attitude to solve the challenges of tomorrow
Possession of excellent verbal and written communication skills
Preferred experience at the respective command with an understanding of analytical and data paint points and challenges across the J-Codes.

#J-18808-Ljbffr

  • Lead Data Engineer with Security Clearance

    4 weeks ago

    Crystal City, United States ALTA IT Services Full time

    LEAD DATA ENGINEER – ACTIVE SECRET CLEARANCE – HYBRID ALTA IT Services has a direct hire opening for a Lead Data Engineer with an Active Secret clearance to support a leading DOD program. This is a hybrid position, 2-3 days a week onsite in Crystal City, VA. As a Lead Data Engineer, you will lead a team of data engineers and collaborate closely with data...

  • Senior Data Scientist

    4 days ago

    Oklahoma City, United States Data Axle Inc. Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging proprietary...

  • Data Scientist with Security Clearance

    4 weeks ago

    Crystal City, United States Amplify Federal Full time

    Data Scientist Are you a data professional ready to join a dynamic team cracking the government’s most exhilarating data puzzles? Does the idea of leveraging data to justify the adoption of business transformation initiatives excite you? Do you enjoy partnering with decision-makers to understand data insights and develop solutions that help them better...

  • Lead Data BSA

    6 days ago

    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...

  • Engineer III

    2 weeks ago

    Atlantic City, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionMUST HAVE CURRENT DHS SUITABILITY OR CURRENT SECRET CLEARANCE AT OTHER GOVERNMENT AGENCIES.Mid Level (6-12 years experience)Acquired Data Solutions, Inc. is a test and engineering company that is seeking an onsite Mid Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to...

  • DHS Software/ Computer Engineer

    4 weeks ago

    Atlantic City, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionMUST HAVE CURRENT DHS SUITABILITY OR CURRENT SECRET CLEARANCE AT OTHER GOVERNMENT AGENCIES. Entry Level (0-2 years experience)ADS is seeking a remote Software/Computer Engineer 1 that can perform basic computer programming in a compatible language that will enable the collection and manipulation and test data from a variety of...

  • Director, Data Engineering

    2 weeks ago

    Jersey City, United States Verisk Analytics Full time

    As the Data Engineering Director, you will lead a team of data engineers responsible for building efficient, maintainable production-grade data pipelines. This role can be based in our Jersey City, NJ location (hybrid work model) or remote. This is a Data Engineer, Director, Engineer, Product Engineer, Project Management, Technology, Data

  • Data Engineer

    1 month ago

    California City, United States iTvorks Inc Full time

    Required Skills Data engineer main skills Good knowledge of Data warehousing with expertise in data modeling and ETL. Advanced skills in SQL and HQL Should be good at these core tech AWS/EMR/Spark Hadoop Hive Vertica Qlikview Tableau Should have exp in CI/CD

  • Engineer V

    3 weeks ago

    Atlantic City, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionMUST HAVE CURRENT DHS SUITABILITY OR CURRENT SECRET CLEARANCE AT OTHER GOVERNMENT AGENCIES.Senior Level (12+ years experience)Acquired Data Solutions, Inc. is a test and engineering company that is seeking an Onsite Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel...

  • Data Engineer

    2 weeks ago

    Jersey City, United States Jarvis Walker Full time

    Data EngineerWe are seeking an enthusiastic and experienced Data Engineer to join our team. As a Data Engineer, you will be a key member of our product development team. You will play a pivotal role in turning data into actionable models that our company uses to create new lines of business, as well as enhance our existing product line.Key...

  • Data Engineer

    6 days ago

    Ohio City, United States Aditi Consulting Full time

    Summary: We are seeking a highly skilled Mid-Level to Senior Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure to support our growing business needs. The ideal candidate will have expertise in Snowflake, DataStage, AWS services (S3, Lambda), Hadoop, and...

  • Senior Data Engineer

    3 days ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Jr. Data Engineer

    1 month ago

    Texas City, United States Dash techology Full time

    Dash technology Job OverviewWe are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data...

  • Test Engineer

    2 weeks ago

    Atlantic City, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionADS is seeking an Engineer that can perform in-depth engineering analysis of security related systems to determine potential for further development, production, Interface to other systems, and usefulness in the homeland security environment.  MUST HAVE CURRENT DHS SUITABILITY OR CURRENT SECRET CLEARANCE AT OTHER GOVERNMENT...

  • Principal Data Engineer

    1 month ago

    Jersey City, New Jersey, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...

  • Data Engineer

    4 weeks ago

    Jersey City, United States iPivot, LLC Full time

    Role: Data Engineer Fulltime/Contract Location: New Jersey City, NJ Hybrid

  • Senior Data Engineer

    6 days ago

    Oklahoma City, United States Corvus Insurance Full time

    We’re united by a mission: to make the world a safer place. Corvus Insurance uses novel data and artificial intelligence/machine learning to achieve better insights into commercial insurance risk. Our software empowers brokers and policyholders to better predict and prevent complex claims through data-driven tools and Smart Commercial Insurance policies....

  • Data Engineer

    13 hours ago

    Jersey City, United States SANS Full time

    Job Title - Data Engineer - SnowflakeLocation - Jersey City, NJ (Hybrid)Duration - 12+ Months Requirements:8 to 10 Yrs IT experience on Data driven initiatives with recent 2-3 Yrs experience in snowflake is mandatorySQL, Data Warehousing, Data Modeling, Cloud based technologies (Azure, AWS, Google Cloud Platform etc.)Performance Tuning experienceMetadata...

  • Director Of Data Engineering

    2 weeks ago

    Jersey City, United States Kavyos Consulting Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....

  • Director Of Data Engineering

    14 hours ago

    Jersey City, United States Kavyos Consulting Inc Full time

    As a leader of our data engineering team, you'll help define the foundation that is critical for analyzing everything from heavy, cross-channel analysis of media interaction logs to optimizing Paid Media to distilling purchase data down to understanding our customers better to evaluating our warehouse and sourcing data to improve our operational efficiency....