Senior Data Engineer

4 weeks ago

McLean, United States The Depository Trust & Clearing Corporation (DTCC) Full time

Job Tittle: Data Engineer (Spark Exp.)

Duration: Full-time

Location: Mclean, VA/TX/FL/NJ (Hybrid 3 days onsite, Rest days remote)


Must Have: Spark


Your Primary Responsibilities:

Work with large, complex data sets and high throughput data pipelines that meet business requirements. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Build data and analytics tools that utilize the data pipeline to provide actionable insights to operational efficiency and other key business performance metrics. Work with internal and external stakeholders to assist with data-related technical issues and support data infrastructure needs. Collaborate with data scientists and architects on several projects. Solve various complex problems. Designing processes to integrate data from multiple sources to facilitate client centric advanced analytics Developing efficient, scalable and repeatable processes to transform data into insight on regular basis


Talent Needed for Success:

Degree in an analytical field such as Data Science, Machine Learning, Analytics, Statistics, Computer Science, or highly quantitative engineering Previous experience as a data engineer or in a similar role 5+ years of Python development experience is necessary. Hands-on experience with database technologies (e.g. SQL and noSQL) Experience building high throughput data pipelines. Technical expertise with distributed Spark or other distributed data processing technologies Experience with machine learning techniques Great numerical and analytical skills Ability to write reusable code components. Open-minded to the new technologies, frameworks Thorough business analysis skills


Additional Qualifications

Understanding Blockchain system mechanism Knowledge of data preparation techniques to aid statistical analysis Results-oriented self-starter who is confident in defending his/her critical thinking abilities.

  • Senior Data Engineer

    7 days ago

    McLean, United States Zillion Technologies, Inc. Full time

    Senior Data Engineer 9 months contract, McLean VA (3 days onsite)Qualifications:At least 5 years of experience developing in Python, SQL (Postgres/Snowflake preferred). Strong experience in SQL is preferred.Bachelor’s degree with equivalent work experience in computer science, data science or a related field.Experience working with different Databases and...

  • Senior Data Engineer

    21 hours ago

    McLean, United States Zillion Technologies, Inc. Full time

    Senior Data Engineer 9 months contract, McLean VA (3 days onsite)Qualifications:At least 5 years of experience developing in Python, SQL (Postgres/Snowflake preferred). Strong experience in SQL is preferred.Bachelor’s degree with equivalent work experience in computer science, data science or a related field.Experience working with different Databases and...

  • Senior Data Engineer

    7 days ago

    McLean, United States Prosum Full time

    This position requires active TS/SCI with Full Scope PolygraphLocated in Herndon or McLean, VABasic Qualifications: • 10-14 years of experience in data engineering • Demonstrated experience in Extract, Transform, and Load (ETL) data engineering • Demonstrated experience with REST APIs • Demonstrated experience with Java Desired skills: •...

  • Senior Data Engineer

    7 days ago

    McLean, United States Prosum Full time

    This position requires active TS/SCI with Full Scope PolygraphLocated in Herndon or McLean, VABasic Qualifications: • 10-14 years of experience in data engineering • Demonstrated experience in Extract, Transform, and Load (ETL) data engineering • Demonstrated experience with REST APIs • Demonstrated experience with Java Desired skills: •...

  • Senior Data Engineer

    2 days ago

    McLean, United States Prosum Full time

    This position requires active TS/SCI with Full Scope PolygraphLocated in Herndon or McLean, VABasic Qualifications: • 10-14 years of experience in data engineering • Demonstrated experience in Extract, Transform, and Load (ETL) data engineering • Demonstrated experience with REST APIs • Demonstrated experience with Java Desired skills: •...

  • Senior Data Engineer

    21 hours ago

    McLean, United States Prosum Full time

    This position requires active TS/SCI with Full Scope PolygraphLocated in Herndon or McLean, VABasic Qualifications: • 10-14 years of experience in data engineering • Demonstrated experience in Extract, Transform, and Load (ETL) data engineering • Demonstrated experience with REST APIs • Demonstrated experience with Java Desired skills: •...

  • Data Engineer-Senior

    1 month ago

    McLean, United States Analytic Solutions Group Full time

    Job DescriptionJob DescriptionYou will use your expertise in data engineering and programming to build systems that collect, manage and convert raw data into usable information for data scientists and data analysts. This requires transforming large amounts of data into formats that can be processed and analyzed. You will design and implement methods to...

  • Data Engineer-Senior

    22 hours ago

    McLean, United States Analytic Solutions Group Full time

    Job DescriptionJob DescriptionYou will use your expertise in data engineering and programming to build systems that collect, manage and convert raw data into usable information for data scientists and data analysts. This requires transforming large amounts of data into formats that can be processed and analyzed. You will design and implement methods to...

  • Senior Python Big Data Engineer

    1 week ago

    McLean, United States Saxon Global Full time

    Seeking a Senior Data Developer to implement data processing and ingestion of structured and semi-structured data as a member of the Innovation in Data Engineering and Analytics (IDEA) team. Responsibilities include: • Cleanse, manipulate and analyze large datasets (Semi-Structured and Unstructured data - XMLs, JSONs, CSVs, PDFs) using python and Snowflake...

  • Data Engineer

    7 days ago

    McLean, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and...

  • Data Engineer

    2 months ago

    McLean, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and...

  • Data Engineer

    2 months ago

    McLean, United States Infinitive Full time

    *Candidates must be local to the Washington D.C. metro area.About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and...

  • Data Engineer

    1 day ago

    McLean, United States Infinitive Inc Full time

    Job DescriptionJob Description*Candidates must be local to the Washington D.C. metro area. About Infinitive:Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new...

  • Data Engineer

    7 days ago

    West McLean, United States LussoTech LLC Full time

    Job DescriptionJob DescriptionSenior Data Engineer for an 12+ Month Contract position with a client located in McLean, VA (Hybrid 3 days in a week)..Must have:Python Snowflake/PostgresSQLDBA knowledgeAWS Senior Data Engineer - Job responsibilities include:Position OverviewClient & Capital Markets Division is currently seeking a Senior Data Engineer who...

  • Data Engineer, Senior

    5 days ago

    McLean, United States Booz Allen Hamilton Full time

    Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an...

  • Data Engineer

    3 weeks ago

    McLean, United States Kunai Full time

    Job DescriptionJob DescriptionKunai is a fast-growing digital consultancy focused on banking, payments, and fintech powered by a global network that attracts the best and brightest people from all backgrounds and cultures, driven by innovation and experimentation, spread across almost every single continent. Over the past decade, we've shipped over 150...

  • Senior Data Engineer

    5 days ago

    McLean, United States Technology Ventures Full time

    Must Haves: Minimum of 5 years of hands on experience with Python. Hand on experience with Snowflake. Proficiency with database management, specifically SQL. Must have hands on experience with AWS - specifically must have experience with Lambda, S3, EC2, CloudWatch, SSM, and EMR. • Develop data filtering, transformational and loading requirements• Define...

  • Senior Data Engineer

    21 hours ago

    McLean, United States Technology Ventures Full time

    Must Haves: Minimum of 5 years of hands on experience with Python. Hand on experience with Snowflake. Proficiency with database management, specifically SQL. Must have hands on experience with AWS - specifically must have experience with Lambda, S3, EC2, CloudWatch, SSM, and EMR. • Develop data filtering, transformational and loading requirements• Define...

  • Data Engineer

    1 month ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...

  • Data Engineer

    1 month ago

    McLean, United States AE Strategies Full time

    About UsAE Strategies is a Virginia-based professional services firm founded in 2003, providing federal clients with human capital, data analytics, and management consulting. We are a proven small business with an established reputation and a track record of supporting critical initiatives across various federal clients. We offer a small business culture...