Senior Spark

2 weeks ago

McLean, United States Mavens Guild Full time
What we would like to see:

In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.

A typical day as a Senior Spark Programmer:
  • Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL

  • Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools

  • Design and develop automation of data flow tasks and end-to-end process testing

  • Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems

  • Implement and lead implementation of Agile best practices and a continuous integration ecosystem

  • Implement and lead implementation efforts of Spark/Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services
What you will need to bring to the table:
  • 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark

  • 5+ years experience as a Java programmer

  • 3+ years experience programming in Python (PySpark API)

  • 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3

  • 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams

  • Experience with continuous integration tools like Jenkins

  • Experience working in a distributed computing infrastructure like Hadoop and/or Spark

  • Critical and analytical approach to solving technical problems

  • Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike

  • Senior Data Engineer

    4 weeks ago

    McLean, United States The Depository Trust & Clearing Corporation (DTCC) Full time

    Job Tittle: Data Engineer (Spark Exp.)Duration: Full-timeLocation: Mclean, VA/TX/FL/NJ (Hybrid 3 days onsite, Rest days remote)Must Have: SparkYour Primary Responsibilities:Work with large, complex data sets and high throughput data pipelines that meet business requirements. Build the infrastructure required for optimal extraction, transformation, and...

  • Senior Data Engineer

    1 week ago

    McLean, United States The Depository Trust & Clearing Corporation (DTCC) Full time

    Job Tittle: Data Engineer (Spark Exp.)Duration: Full-timeLocation: Mclean, VA/TX/FL/NJ (Hybrid 3 days onsite, Rest days remote)Must Have: SparkYour Primary Responsibilities:Work with large, complex data sets and high throughput data pipelines that meet business requirements. Build the infrastructure required for optimal extraction, transformation, and...

  • Senior Data Engineer

    4 weeks ago

    McLean, United States The Depository Trust & Clearing Corporation (DTCC) Full time

    Job Tittle: Data Engineer (Spark Exp.)Duration: Full-timeLocation: Mclean, VA/TX/FL/NJ (Hybrid 3 days onsite, Rest days remote)Must Have: SparkYour Primary Responsibilities:Work with large, complex data sets and high throughput data pipelines that meet business requirements. Build the infrastructure required for optimal extraction, transformation, and...

  • Java Developer III

    2 weeks ago

    McLean, United States vodastra.com Full time

    Java Developer III (Senior Level) Location: McLean, VA Duration: 6+ Months REQUIRED EXPERIENCE: Overall Experience 10-15 Languages :- Python/Java/Scala >8 Spark (Core and streaming experience) 3-5 Kafka/Zookeeper >2 AWS experience (EMR, Deployment experience) >2 Experience with Data Source for e.g. (Snowflake etc.) 3-5 UI Experience (Angular) is not a...

  • Java Developer III

    4 weeks ago

    McLean, United States Vodastra Full time

    Job DescriptionJob Description Java Developer III (Senior Level)Location: McLean, VADuration: 6+ MonthsREQUIRED EXPERIENCE: Overall Experience 10-15Languages :- Python/Java/Scala >8Spark (Core and streaming experience) 3-5Kafka/Zookeeper >2AWS experience (EMR, Deployment experience) >2Experience with Data Source for e.g. (Snowflake etc.) 3-5UI Experience...

  • Big Data/Machine Learning Engineer

    1 week ago

    McLean, United States Donato Technologies, Inc Full time

    Job DescriptionJob DescriptionTitle: Senior Data Engineer /Senior Software Engineer Duration: 12 months (15th May 2025) Can be extended Location : McLean VA or Richmond VA (2 days week) Interview : 2 Technical Round Interview for sure . LOB:EDML- Data and Machine Learning - Data Space EDTProject:Application is doing large Volume Data transformation with in...

  • Senior Java Fullstack Developer

    1 month ago

    McLean, United States Hexaware Technologies Full time

    Job Title: Senior Java Full Stack Engineer - ProfessionalMcLean, VA (hybrid – 3 days onsite, 2 days remote) Employment Type - Contract/Full time Both Job DescriptionMandatory:7+ years of experience in in solution, design and development of applications using Java 8+/J2EE, Spring, Spring-Boot, Micro Services, RESTful Services and with experience in Big Data...

  • Senior Java Fullstack Developer

    1 month ago

    McLean, United States Hexaware Technologies Full time

    Job Title: Senior Java Full Stack Engineer - ProfessionalMcLean, VA (hybrid – 3 days onsite, 2 days remote) Employment Type - Contract/Full time Both Job DescriptionMandatory:7+ years of experience in in solution, design and development of applications using Java 8+/J2EE, Spring, Spring-Boot, Micro Services, RESTful Services and with experience in Big Data...

  • Senior Java + AWS Engineer

    2 weeks ago

    McLean, United States Diverse Lynx Full time

    Senior Java + AWS Engineer ***ONSITE** Location: Richmond or Mclean Required Qualifications : Min. 06+ years of IT experience in implementing Java 8, J2EE and related Java technologies Gained experience in Design Patterns. Experience in implementing Java Spring Boot Excellent expertise in Java 8, Multithreading, Microservices, Proficiency in...

  • Cloud Data Architect

    5 days ago

    McLean, United States Lorven Technologies Full time

    Job Description Job Description Title: Cloud data Architect Location: MClean, VA - hybrid Duration: Contract Mandatory Skills: Skill 1 Data Engineer 10+ years Skill 2 Data Architecture 3+ years Skill 3 - Azure Data Bricks - 5+ years Skill 4 - Azure Data Lake - 3+ years Qualifications Minimum of 10 years of experience in a Data Engineering role, supporting...

  • Senior Software Engineer(Top Secret Clearance or above)

    1 month ago

    McLean, United States Stem IT Full time

    R&D group of a Fortune 1000 Data Conglomerate is looking to hire a Senior Software Engineer to assist with a multitude of DARPA based projects for its Mclean based operation(2 days onsite a week). This person will working on all new green development projects utilizing an array of tools such as: JVM programming languages(Java/Springboot, Groovy, Python),...

  • Senior Software Engineer(Top Secret Clearance or above)

    1 month ago

    McLean, United States Stem IT Full time

    R&D group of a Fortune 1000 Data Conglomerate is looking to hire a Senior Software Engineer to assist with a multitude of DARPA based projects for its Mclean based operation(2 days onsite a week). This person will working on all new green development projects utilizing an array of tools such as: JVM programming languages(Java/Springboot, Groovy, Python),...

  • Senior Software Engineer(Top Secret Clearance or above)

    1 month ago

    McLean, United States Stem IT Full time

    R&D group of a Fortune 1000 Data Conglomerate is looking to hire a Senior Software Engineer to assist with a multitude of DARPA based projects for its Mclean based operation(2 days onsite a week). This person will working on all new green development projects utilizing an array of tools such as: JVM programming languages(Java/Springboot, Groovy, Python),...

  • Dev Ops Engineer

    2 weeks ago

    McLean, United States HexaQuEST Global, Inc. Full time

    Overview Looking for a Senior Software Engineer, who will help in the development and enhancement of the existing platform, focusing on maintaining and improving the data ecosystem. The candidates will be proficient in Python, Java, SQL, and AWS, with experience in building and optimizing data pipelines and real-time decision-making systems....

  • Data Engineer

    4 days ago

    McLean, United States Kunai Full time

    Job DescriptionJob DescriptionKunai is a fast-growing digital consultancy focused on banking, payments, and fintech powered by a global network that attracts the best and brightest people from all backgrounds and cultures, driven by innovation and experimentation, spread across almost every single continent. Over the past decade, we've shipped over 150...

  • AI/ML Software Engineer

    2 weeks ago

    McLean, United States Cognitio Corp Full time

    Job Description The AI/ML Engineer will develop algorithms, write scripts, build predictive analytics, use automation, apply machine learning and use the right combination of tools and frameworks to turn a set of data points into objective answers to help senior leadership make informed decisions. The Data Scientist will apply data mining techniques perform...

  • AI\/ML Engineer

    2 weeks ago

    McLean, United States Smart Synergies Full time

    JOB DESCRIPTION The AI/ML Engineer will develop algorithms, write scripts, build predictive analytics, use automation, apply machine learning and use the right combination of tools and frameworks to turn a set of data points into objective answers to help senior leadership make informed decisions. The Data Scientist will apply data mining techniques perform...

  • Tester Specialist

    2 weeks ago

    McLean, United States Saxon Global Full time

    Requirements: Financial services, SAS , SQL , identify opportunity for automation, big data , analytical and critical thinkerYears:7+ but Prefer 8+ yearsFreddie Macs Single-Family Division is currently seeking a Technical Testing Analyst with a strong business acumen to develop and implement data assets. IDEA team enables Business data across all...

  • Senior Developer

    4 weeks ago

    McLean, United States Freddie Mac Full time

    JOB DESCRIPTION At Freddie Mac, you will do important work to build a better housing finance system and you’ll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Position Overview: Do you have passion for understanding customer needs and using technology to deliver value? Are you a...

  • Sr. ETL Administrator

    3 days ago

    McLean, United States Metric5 Full time

    Job DescriptionJob DescriptionDescriptionMetric 5 is currently seeking an Application Administrator to work within a team that provides Data Warehouse and Business Intelligence services to our government customer using Agile scrum processes. You will work with varying data sources with different schemas and data elements to ultimately produce an effective...