Lead Data Engineer

1 week ago

Reston, Virginia, United States Fannie Mae Full time
Job Description

As a valued colleague on our team, you will provide expert advice and guidance to the team regarding the development of data infrastructures and pipelines to capture, integrate, organize, and centralize data while testing and ensuring data is readily accessible and in a usable state, including quality assurance.

THE IMPACT YOU WILL MAKE
The Lead Data Engineer role will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:

  • Assess customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.
  • Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.
  • Lead the team to organize and integrate data into readily available formats while maintaining existing structures and govern their use according to business requirements.
  • Lead the analysis of new data sources and monitoring of performance, scalability, and security of data.
  • Analyze the initial analysis and deliver the user interface (UI) to the customer to enable further analysis.
Qualifications

THE EXPERIENCE YOU BRING TO THE TEAM

Minimum Required Experiences:

  • 4+ years with Big Data Hadoop cluster (HDFS, Yarn, Hive, MapReduce frameworks), Spark, AWS EMR
  • 4+ years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, AWS Batch, Dynamo DB, Redshift, AWS EMR, Cloudwatch, RDS, Lambda, SNS, SWS etc.)
  • 4+ years of Python, SQL, SparkSQL, PySpark
  • Excellent problem solving skills and strong verbal & written communication skills
  • Ability to work independently as well as part of an agile team (Scrum / Kanban)

Desired Experiences:

  • Bachelor degree or equivalent
  • Knowledge of Spark streaming technologies
  • Experience in working with agile development teams
  • Familiarity with Hadoop / Spark information architecture, Data Modeling, Machine Learning (ML)
  • Knowledge of Environmental, Social, and Corporate Governance (ESG)

Skills

  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in documentation and database reporting for the purposes of analysis, data discovery, and decision-making with the use of relevant software such as Crystal Reports, Excel, or SSRS
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Business Insight including advising, designing business models, interpreting customer and market insights, forecasting, benchmarking, etc.
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Governance and Compliance including creating policies, evaluating compliance, conducting internal investigations, developing data governance, etc.
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal

Tools

  • SageMaker
  • AWS
  • Python
Additional Information

The future is what you make it to be. Discover compelling opportunities at

Fannie Mae is an Equal Opportunity Employer, which means we are committed to fostering a diverse and inclusive workplace. All qualified applicants will receive consideration for employment without regard to race, religion, national origin, gender, gender identity, sexual orientation, personal appearance, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation in the application process, email us at

The hiring range for this role is set forth on each of our job postings located on Fannie Mae's Career Site. Final salaries will generally vary within that range based on factors that include but are not limited to, skill set, depth of experience, certifications, and other relevant qualifications. This position is eligible to participate in a Fannie Mae incentive program (subject to the terms of the program). As part of our comprehensive benefits package, Fannie Mae offers a broad range of Health, Life, Voluntary Lifestyle, and other benefits and perks that enhance an employee's physical, mental, emotional, and financial well-being. See more here.

PandoLogic. Category:Technology, Keywords:Data Engineer, Location:Reston, VA-20190

  • Data Engineer

    1 week ago

    Reston, Virginia, United States Ageatia Global Solutions Full time

    PURPOSE:This is a Big Data Administrator Lead position and not a developer position. The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using...

  • Data Engineer

    1 day ago

    Reston, Virginia, United States Applied Research Laboratory at the Penn State University Full time

    JOB DESCRIPTION AND POSITION REQUIREMENTS:We are seeking a talented, experienced and a highly motivated DevSecOps Research Engineer to join the Algorithms, Prototyping and Integration (API) Department of the Applied Research Laboratory (ARL) at Penn State University. You will assist in providing our customers with state-of-the-art visualization and decision...

  • Data Engineer

    1 week ago

    Reston, Virginia, United States QinetiQ Full time

    Company Overview We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields of sensor science, signal processing, data fusion, artificial intelligence...

  • Senior Data Engineer, Data Analytics

    1 week ago

    Reston, Virginia, United States Demo - Maximus Full time

    Job Title: Senior Engineer - Data Analytics TechnologyCompany: MaximusThe Senior Engineer - Data Analytics Technology plays a crucial role in delivering analytic solutions. They have expertise in data, analytics, data science development, data architecture, data visualization, ETL/ELT layers, and performance tuning. Collaborating effectively with key...

  • Senior Data Engineer

    1 week ago

    Reston, Virginia, United States Resonate Full time

    Since Resonate's founding in 2008, the company has been driven by a simple but powerful idea: understanding people. Resonate empowers leading brands and agencies with deep consumer intelligence that ignites unbreakable relationships through better connections, more meaningful engagement and compelling customer experiences.We are "people-centric." It is at...

  • Data Engineer

    1 week ago

    Reston, Virginia, United States ManTech Full time

    Secure our Nation, Ignite your FutureBecome an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International, you'll help protect our national security while working on innovative projects that offer opportunities for advancement.Currently, ManTech is seeking a motivated, career...

  • Data Engineer

    1 week ago

    Reston, Virginia, United States Metric5 Full time

    Data EngineerDescription Metric5 is currently seeking a Data Engineer to work within a team providing Data Warehouse and Business Intelligence services to our government customer using Agile processes. As a Data Engineer, you will work with varying huge data sources with different schemas and data elements to produce an effective and efficient Data...

  • Lead Ab Initio Engineer

    1 week ago

    Reston, Virginia, United States Dexian - DISYS Full time

    Position: Lead Ab Initio Engineer Location: Reston VA (Hybrid) Job Type: 12 months Contract To Hire Job Description: PURPOSE: The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged)...

  • Junior Data Engineer

    1 month ago

    Reston, Virginia, United States ManTech Full time

    Secure our Nation, Ignite your FutureJob DescriptionBecome an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International, you'll help protect our national security while working on innovative projects that offer opportunities for advancement.Currently, ManTech is seeking a...

  • Data Engineer

    1 week ago

    Reston, Virginia, United States QinetiQ Full time

    Company Overview We are a world-class team of professionals who deliver next generation technology and products in robotic and autonomous platforms, ground, soldier, and maritime systems in 50+ locations world-wide. Much of our work contributes to innovative research in the fields of sensor science, signal processing, data fusion, artificial intelligence...

  • Engineering Lead

    1 week ago

    Reston, Virginia, United States Amentum Full time

    **This position is contingent upon contract award** Essential Responsibilities Supervise the full Software Development Life Cycle (SDLC) team responsible for complete delivery and maintenance of PISCES systems currently deployed, as well as future release content planning. Work with the Program Manager/Deputy Program Manager and the Sponsor to properly...

  • Sr. Data Engineer

    1 week ago

    Reston, Virginia, United States Core4ce Full time

    Core4ce has an opportunity with a mission critical IC Sponsor for a Sr. Data Engineer Position. This Sponsor organization plays a significant role in the highly optimized mission-ready data conditioning and delivery systems in support of mission analytics. A Full Scope Polygraph is required for this position, no exceptions.The ideal candidate supports...

  • AWS Data Engineer

    4 weeks ago

    Reston, Virginia, United States Atechstar Full time

    Required Qualifications Candidate can be located anywhere in US for this position. This position may require travel in the US and Canada. Bachelors degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 4 years of experience with...

  • AWS Data Engineer

    2 months ago

    Reston, Virginia, United States Atechstar Full time

    Required Qualifications Candidate can be located anywhere in US for this position. This position may require travel in the US and Canada. Bachelors degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 4 years of experience with...

  • Lead Software Engineer

    1 week ago

    Reston, Virginia, United States Fannie Mae Full time

    Job Description As a valued colleague on our team, you will act as a team lead in the designing, producing, testing, or implementing software, technology, or processes, as well as lead processes for creating and maintaining IT architecture, large scale data stores, and cloud-based systems. THE IMPACT YOU WILL MAKE The Lead Software Engineer - Finance role...

  • Senior AWS Data Engineer

    1 week ago

    Reston, Virginia, United States TekIntegral Full time

    Job:Great opportunity for a Senior AWS Data Engineer with SAS skills at a leading company in the financial industry. Join the team at PV Akkodis and make a difference!Location:Position based in Reston, VA with a hybrid work setup. This opportunity is ideal for locals who are looking to work with cutting-edge technologies.Duration:This is a long-term contract...

  • Big Data Engineer

    4 weeks ago

    Reston, Virginia, United States Atechstar Full time

    Job descriptionRequired SkillsBachelors degree in Computer Science and 5+ years of experience or equivalent industry experience Deep knowledge of two or more functional or scripting programming languages Java Python Scala or R 3+ years of Hadoop Hive Spark or related MapReduce framework development experience Extensive experience with distributed SQL...

  • Big Data Engineer

    2 months ago

    Reston, Virginia, United States Atechstar Full time

    Job descriptionRequired SkillsBachelors degree in Computer Science and 5+ years of experience or equivalent industry experience Deep knowledge of two or more functional or scripting programming languages Java Python Scala or R 3+ years of Hadoop Hive Spark or related MapReduce framework development experience Extensive experience with distributed SQL...

  • Lead Software Engineer

    1 week ago

    Reston, Virginia, United States Fannie Mae Full time

    Job Description As a key member of our team, you will take the lead in designing, testing, and implementing software, technology, and processes, as well as overseeing the creation and upkeep of IT architecture, extensive data storage, and cloud-based systems. About the Position and Company: The role of Lead Software Engineer - Finance offers you the freedom...

  • AI and Data Science Engineer

    1 week ago

    Reston, Virginia, United States Inmarsat Government Full time

    Inmarsat Government is a world leader in global, mobile satellite communications, providing the industry's most extensive portfolio of global narrowband and wideband connectivity services and managed network solutions to users on land, at sea and in the air. Backed by almost 40 years of experience, we deliver the world's most reliable satellite connectivity...