Lead Data Engineer

1 month ago


Reston, United States Fannie Mae Full time
Company Description

At Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to use tech to tackle housing's biggest challenges and impact the future of the industry. You'll be a part of an expert team thriving in an energizing, flexible environment. Here, you will grow your career and help create access to fair, affordable housing finance.

Job Description

As a valued colleague on our team, you will provide expert advice and guidance to the team regarding the development of data infrastructures and pipelines to capture, integrate, organize, and centralize data while testing and ensuring data is readily accessible and in a usable state, including quality assurance.

THE IMPACT YOU WILL MAKE
The Lead Data Engineer role will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:
  • Assess customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.
  • Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.
  • Lead the team to organize and integrate data into readily available formats while maintaining existing structures and govern their use according to business requirements.
  • Lead the analysis of new data sources and monitoring of performance, scalability, and security of data.
  • Analyze the initial analysis and deliver the user interface (UI) to the customer to enable further analysis.
Qualifications

THE EXPERIENCE YOU BRING TO THE TEAM

Minimum Required Experiences:
  • 4+ years with Big Data Hadoop cluster (HDFS, Yarn, Hive, MapReduce frameworks), Spark, AWS EMR
  • 4+ years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, AWS Batch, Dynamo DB, Redshift, AWS EMR, Cloudwatch, RDS, Lambda, SNS, SWS etc.)
  • 4+ years of Python, SQL, SparkSQL, PySpark
  • Excellent problem solving skills and strong verbal & written communication skills
  • Ability to work independently as well as part of an agile team (Scrum / Kanban)
Desired Experiences:
  • Bachelor degree or equivalent
  • Knowledge of Spark streaming technologies
  • Experience in working with agile development teams
  • Familiarity with Hadoop / Spark information architecture, Data Modeling, Machine Learning (ML)
  • Knowledge of Environmental, Social, and Corporate Governance (ESG)
Skills
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in documentation and database reporting for the purposes of analysis, data discovery, and decision-making with the use of relevant software such as Crystal Reports, Excel, or SSRS
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Business Insight including advising, designing business models, interpreting customer and market insights, forecasting, benchmarking, etc.
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Governance and Compliance including creating policies, evaluating compliance, conducting internal investigations, developing data governance, etc.
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
Tools
  • SageMaker
  • AWS
  • Python


Additional Information

The future is what you make it to be. Discover compelling opportunities at careers.fanniemae.com.

Fannie Mae is an Equal Opportunity Employer, which means we are committed to fostering a diverse and inclusive workplace. All qualified applicants will receive consideration for employment without regard to race, religion, national origin, gender, gender identity, sexual orientation, personal appearance, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation in the application process, email us at careers_mailbox@fanniemae.com.

The hiring range for this role is set forth on each of our job postings located on Fannie Mae's Career Site. Final salaries will generally vary within that range based on factors that include but are not limited to, skill set, depth of experience, certifications, and other relevant qualifications. This position is eligible to participate in a Fannie Mae incentive program (subject to the terms of the program). As part of our comprehensive benefits package, Fannie Mae offers a broad range of Health, Life, Voluntary Lifestyle, and other benefits and perks that enhance an employee's physical, mental, emotional, and financial well-being. See more here.
  • LEAD Data Scientist

    2 weeks ago


    Reston, United States Soft source inc Full time

    Job DescriptionJob DescriptionLooking for a LEAD Data Scientist!! Candidates must have Heavily focus on Sagemaker, cloud and model deployment exp!! Minimum 10 years of relevant experience and Lead experience!!Client Location: Reston VA (Primarily a REMOTE ROLE, Highly prefer candidates local to the DMV area)Experienced data scientist, Senior level, building...


  • Reston, United States Ageatia Global Solutions Full time

    PURPOSE This is a Big Data Administrator Lead position and not a developer position. The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using...


  • Reston, United States Ageatia Global Solutions Full time

    PURPOSE This is a Big Data Administrator Lead position and not a developer position. The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data...

  • Data Engineer

    2 weeks ago


    Reston, United States iWorks Corporation Full time

    Job DescriptionJob DescriptionTitle: Data EngineerLocation: RemoteAbout iWorks:iWorks Corporation, founded in 2005, is a leading provider of information technology and professional services to the federal government. We are a recognized leader in personnel security and vetting solutions, Agile, DevOps, DevSecOps, data analytics, and cloud solutions. Our...

  • Data Engineer

    2 days ago


    Reston, United States iWorks Corporation Full time

    Job DescriptionJob DescriptionTitle: Data EngineerLocation: RemoteAbout iWorks:iWorks Corporation, founded in 2005, is a leading provider of information technology and professional services to the federal government. We are a recognized leader in personnel security and vetting solutions, Agile, DevOps, DevSecOps, data analytics, and cloud solutions. Our...

  • Big Data Lead

    3 weeks ago


    Reston, United States Diverse Lynx Full time

    Location: Stamford, Connecticut -Weekly Thrice(Hybrid) Job Description Senior Data Engineer (8+ yrs of exp) Responsibilities - Experienced Data engineer responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. • Responsible for Cloud migrations for data pipelines using AWS and Snowflake • Participate in all...

  • Big Data Engineer

    2 months ago


    Reston, United States Atechstar Full time

    Job descriptionRequired SkillsBachelors degree in Computer Science and 5+ years of experience or equivalent industry experience Deep knowledge of two or more functional or scripting programming languages Java Python Scala or R 3+ years of Hadoop Hive Spark or related MapReduce framework development experience Extensive experience with distributed SQL...

  • Engineering Lead

    1 week ago


    Reston, United States Scout Solutions Inc Defunct Full time

    Engineering Lead Location: Reston, VA (Hybrid) The Senior Manager, Engineering Lead is responsible for being a leader on a technical team in the design, development, and delivery of technology-enabled applications and for delivering fast and sustainable results in three (3) primary areas: •Deliver business solutions with a customer focus; •Build and...

  • Enterprise Data

    2 weeks ago


    Reston, United States Fannie Mae Full time

    Company Description At Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to impact the future of the housing industry while being part of an inclusive team thriving in an energizing, flexible environment. Here, you will grow your career and...

  • Data Engineer

    1 week ago


    Reston, United States NS2 Mission Full time

    Job DescriptionJob DescriptionAre you interested in working in a dynamic environment that offers opportunities for professional growth and new responsibilities by helping clients drive alignment with their business, advising through critical and complex issues, while allowing you to develop personally and professionally? Then consider a career at NS2...

  • Data Engineer

    3 weeks ago


    Reston, United States NS2 Mission Full time

    Job DescriptionJob DescriptionAre you interested in working in a dynamic environment that offers opportunities for professional growth and new responsibilities by helping clients drive alignment with their business, advising through critical and complex issues, while allowing you to develop personally and professionally? Then consider a career at NS2...

  • Data Engineer

    2 days ago


    Reston, United States NS2 Mission Full time

    Job DescriptionJob DescriptionAre you interested in working in a dynamic environment that offers opportunities for professional growth and new responsibilities by helping clients drive alignment with their business, advising through critical and complex issues, while allowing you to develop personally and professionally? Then consider a career at NS2...

  • Simulation Engineer

    1 month ago


    Reston, United States Data Machines Full time

    Simulation Engineer - 1026-PS Location: Reston, VA Clearance Requirement: Secret Job Description and Responsibilities: DMC seeks an energetic Simulation Engineer with the desire to work with our team supporting the development and production of cutting-edge defense and intelligence simulation capabilities. The ideal candidate will use operations research and...


  • Reston, United States Peraton Full time

    About Peraton Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our...

  • Lead Systems Engineer

    2 weeks ago


    Reston, United States RGI, LLC Full time

    As a Lead Systems Engineer, you will be directly supporting a program which provides critical capabilities to help enable efficient and timely collection management across multiple collection providers. You will provide engineering analysis, design and architecture for a growing data driven microservice and mission application environment, where you will be...

  • Enterprise Data

    1 week ago


    Reston, United States Fannie Mae Full time

    Company Description At Fannie Mae, futures are made. The inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to impact the future of the housing industry while being part of an inclusive team thriving in an energizing, flexible environment. Here, you will grow your career and...

  • Lead Systems Engineer

    2 weeks ago


    Reston, United States Reinventing Geospatial Full time

    Job Highlights: As a Lead Systems Engineer, you will be directly supporting a program which provides critical capabilities to help enable efficient and timely collection management across multiple collection providers. You will provide engineering analysis, design and architecture for a growing data driven microservice and mission application environment,...

  • Lead Civil Engineer

    2 weeks ago


    Reston, United States Orchard , CO Full time

    Description Lead Civil Engineer Reston, VA @Orchard LLC has an immediate opening for an experienced Civil Engineer to support a contract for a well-established solutions provider within the defense, intelligence, and critical infrastructure sectors. The position is a contract-to-hire requiring at least 4 months of contract tenure to be eligible for full-time...

  • Junior Data Engineer

    2 weeks ago


    Reston, Virginia, United States ManTech Full time

    Secure our Nation, Ignite your FutureJob DescriptionBecome an integral part of a diverse team while working at an Industry Leading Organization, where our employees come first. At ManTech International, you'll help protect our national security while working on innovative projects that offer opportunities for advancement.Currently, ManTech is seeking a...

  • Simulation Engineer

    1 week ago


    Reston, United States Data Machines Inc Full time

    Simulation Engineer - 1026-PS Location: Reston, VA Clearance Requirement: Secret Job Description and Responsibilities: DMC seeks an energetic Simulation Engineer with the desire to work with our team supporting the development and production of cutting-edge defense and intelligence simulation capabilities. The ideal candidate will use operations research and...