Big Data Engineer

2 weeks ago


McLean, United States Mitchell Martin Full time

*****W2 ONLY, NO C2C*****

Job Title: Big Data Engineer

Client Location: McLean, VA

Type: Contract

Set-up: Hybrid (3 days a week in the office)

JOB DESCRIPTION

As a Software Engineer, your responsibilities will include developing and maintaining a data processing application capable of handling small to large volumes of enterprise data in terabytes. Key requirements for this role are:

  • Minimum of 4 years of experience in developing data-centric applications using Scala or Python running on EMR or AWS Glue.
  • Proficiency in data pipeline orchestration, utilizing self-created pipelines or AWS Step Functions, and managing pipelines using Python-based AWS Lambda.
  • Extensive experience (3+ years) in utilizing AWS cloud services.
  • Proficiency (4+ years) in CICD pipeline implementation.

This role will be primarily focused on the enterprise data space, with the application operating on AWS infrastructure including AWS Glue, AWS S3, AWS Lambda, and Fivegate/ECS.

Proficiency in programming languages such as Scala, Python, and Spark, along with SQL scripting, is essential. Strong automation skills are preferred, with experience in developing automation projects like Machine Learning applications being advantageous.

The team you'll be joining consists of product and tech experts, working on revamping an existing application to a much higher degree. Interaction with end-users will occur post-production, with responsibilities including triaging and troubleshooting.

This position sits within the Data & Machine Learning domain, emphasizing an automation mindset where coding skills translate across various tasks, particularly Python-based and batch applications.

BE PART OF OUR GROWING TEAM


  • Big Data Engineer

    2 weeks ago


    McLean, United States Mitchell Martin Inc. Full time

    *****W2 ONLY, NO C2C*****Job Title: Big Data EngineerClient Location: McLean, VAType: ContractSet-up: Hybrid (3 days a week in the office)JOB DESCRIPTIONAs a Software Engineer, your responsibilities will include developing and maintaining a data processing application capable of handling small to large volumes of enterprise data in terabytes. Key...

  • Big Data Engineer

    2 weeks ago


    McLean, United States Mitchell Martin Inc. Full time

    *****W2 ONLY, NO C2C*****Job Title: Big Data EngineerClient Location: McLean, VAType: ContractSet-up: Hybrid (3 days a week in the office)JOB DESCRIPTIONAs a Software Engineer, your responsibilities will include developing and maintaining a data processing application capable of handling small to large volumes of enterprise data in terabytes. Key...

  • Big Data Engineer

    2 weeks ago


    McLean, United States Mitchell Martin Inc. Full time

    *****W2 ONLY, NO C2C*****Job Title: Big Data EngineerClient Location: McLean, VAType: ContractSet-up: Hybrid (3 days a week in the office)JOB DESCRIPTIONAs a Software Engineer, your responsibilities will include developing and maintaining a data processing application capable of handling small to large volumes of enterprise data in terabytes. Key...


  • McLean, United States Hireteq Solutions Inc. Full time

    Hireteq Client is looking for Spark/Big Data Developer for our client. This will be a fulltime position with Benefits.Hybrid role - 3 days onsiteClient cannot sponsor visa or transfer visa on this role. Need GC, H4EAD and citizens.JOB DESCRIPTION:The data engineer role is a technical person who is involved with architecting, building, testing, and...


  • McLean, United States Hireteq Solutions Inc. Full time

    Hireteq Client is looking for Spark/Big Data Developer for our client. This will be a fulltime position with Benefits.Hybrid role - 3 days onsiteClient cannot sponsor visa or transfer visa on this role. Need GC, H4EAD and citizens.JOB DESCRIPTION:The data engineer role is a technical person who is involved with architecting, building, testing, and...


  • McLean, United States Hireteq Solutions Inc. Full time

    Hireteq Client is looking for Spark/Big Data Developer for our client. This will be a fulltime position with Benefits.Hybrid role - 3 days onsiteClient cannot sponsor visa or transfer visa on this role. Need GC, H4EAD and citizens.JOB DESCRIPTION:The data engineer role is a technical person who is involved with architecting, building, testing, and...


  • McLean, United States Hireteq Solutions Inc. Full time

    Hireteq Client is looking for Spark/Big Data Developer for our client. This will be a fulltime position with Benefits. Hybrid role - 3 days onsite Client cannot sponsor visa or transfer visa on this role. Need GC, H4EAD and citizens. JOB DESCRIPTION: The data engineer role is a technical person who is involved with architecting, building, testing, and...


  • McLean, United States Saxon Global Full time

    Seeking a Senior Data Developer to implement data processing and ingestion of structured and semi-structured data as a member of the Innovation in Data Engineering and Analytics (IDEA) team. Responsibilities include: • Cleanse, manipulate and analyze large datasets (Semi-Structured and Unstructured data - XMLs, JSONs, CSVs, PDFs) using python and Snowflake...


  • McLean, United States Dtcc Full time

    Job Description Short Description for Internal Candidates The data engineer role is a technical person who is involved with architecting, building, testing, and maintaining the data platform. Data engineers will implement infrastructure for data processing, analysis, reporting, integrations, and machine learning model deployment Description for Internal...


  • McLean, United States Resource Informatics Group Inc Full time

    Job DescriptionJob Description Data Engineer - Mclean VA + Remote Position Technical ResponsibilitiesThe Sr. Data Engineer's mission will be to guide this platform’s development so that it becomes the engine of a healthcare-wide transition to value-based care by enabling effective data sharing, analytics, performance transparency, and value-based...


  • McLean, United States Kunai Full time

    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? In this role, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Software & Data...

  • Data Engineer

    1 month ago


    McLean, United States Metric5 Full time

    Job DescriptionJob DescriptionData EngineerDescriptionMetric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective...

  • Data Engineer

    1 day ago


    McLean, United States Booz Allen Hamilton Full time

    Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need a data professional...


  • McLean, United States Kunai Full time

    Job DescriptionJob DescriptionKunai is a fast-growing digital consultancy focused on banking, payments, and fintech powered by a global network that attracts the best and brightest people from all backgrounds and cultures, driven by innovation and experimentation, spread across almost every single continent. Over the past decade, we've shipped over 150...

  • Data Engineers

    4 weeks ago


    McLean, United States Nerd Up Staffing Full time

    Want to work on cutting-edge data engineering projects, grow in your career, leverage the latest technologies and make a real impact? If you're ready to dive into a world of data-driven innovation, we want to learn about your for this special opportunity.ResponsibilitiesDesign, develop, and deploy data pipelines to extract, transform, and load (ETL) large...

  • Data Engineers

    4 weeks ago


    McLean, United States Nerd Up Staffing Full time

    Want to work on cutting-edge data engineering projects, grow in your career, leverage the latest technologies and make a real impact? If you're ready to dive into a world of data-driven innovation, we want to learn about your for this special opportunity.ResponsibilitiesDesign, develop, and deploy data pipelines to extract, transform, and load (ETL) large...

  • Data Engineers

    4 weeks ago


    McLean, United States Nerd Up Staffing Full time

    Want to work on cutting-edge data engineering projects, grow in your career, leverage the latest technologies and make a real impact? If you're ready to dive into a world of data-driven innovation, we want to learn about your for this special opportunity.ResponsibilitiesDesign, develop, and deploy data pipelines to extract, transform, and load (ETL) large...

  • Data Engineer-Senior

    1 month ago


    McLean, United States Analytic Solutions Group Full time

    Job DescriptionJob DescriptionYou will use your expertise in data engineering and programming to build systems that collect, manage and convert raw data into usable information for data scientists and data analysts. This requires transforming large amounts of data into formats that can be processed and analyzed. You will design and implement methods to...

  • Data Engineer, Senior

    15 hours ago


    McLean, United States Booz Allen Hamilton Full time

    Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an...

  • Data Engineer

    3 days ago


    West McLean, United States LussoTech LLC Full time

    Job DescriptionJob DescriptionSenior Data Engineer for an 12+ Month Contract position with a client located in McLean, VA (Hybrid 3 days in a week)..Must have:Python Snowflake/PostgresSQLDBA knowledgeAWS Senior Data Engineer - Job responsibilities include:Position OverviewClient & Capital Markets Division is currently seeking a Senior Data Engineer who...