Senior Data Engineer

4 days ago


Bloomington, Illinois, United States The MITRE Corporation Full time
About The Role

At The MITRE Corporation, we're committed to tackling our nation's toughest challenges. As a Senior Data Engineer, you'll play a critical role in shaping our Enterprise Data Warehouse team's future. We're looking for a highly collaborative, team-oriented individual to join us in this exciting time.

Responsibilities
  • Design, develop, and implement robust ETL solutions using Python and PySpark to extract, transform, and load data from various sources into AWS data services.
  • Optimize ETL processes for performance and scalability utilizing AWS Glue, EMR, Step Functions, and Lambda to ensure efficient data processing and timely delivery.
  • Ensure data integrity and quality throughout the ETL process by implementing thorough data validation checks and error handling mechanisms.
  • Manage AWS services such as Glue, EMR, Step Functions, and Lambda, including configuration, monitoring, and troubleshooting to maintain operational excellence.
  • Collaborate with cross-functional teams including data engineers, data scientists, and business stakeholders to understand data requirements and deliver tailored ETL solutions.
  • Troubleshoot complex technical issues and provide advanced operational support to internal MITRE customers in AWS.
Basic Qualifications
  • Bachelor's degree with eight years' related experience, or a master's degree with six years' related experience, preferably with a technical major such as engineering, computer science, etc.
  • Self-motivated, curious, and collaborative, with a passion to learn new technologies and develop new skills.
  • Demonstrated experience in developing ETL pipelines using Python and PySpark, with a strong understanding of data processing techniques.
  • Expertise in SQL for data manipulation, querying, and optimization to work with various database platforms including Postgres, DynamoDB, Oracle, and Redshift.
  • Hands-on experience with AWS Glue, EMR, Step Functions, and Lambda for building and orchestrating ETL workflows in a cloud environment.
  • Experience implementing Continuous Integration/Continuous Deployment (CI/CD) pipelines using AWS CDK or similar tools for automating deployment and testing of ETL solutions.
Preferred Qualifications
  • Previous experience leading or mentoring a team of developers/engineers in a collaborative environment.
  • AWS certifications such as AWS Certified Developer or AWS Certified Solutions Architect, demonstrating proficiency in AWS services and best practices.
  • Familiarity with big data technologies such as Apache Spark, Hadoop, or Kafka for processing large-scale datasets.
  • Experience in data modeling and schema design for optimizing database performance and scalability.
  • Experience working in Agile development methodologies, such as Scrum or Kanban, for iterative and collaborative project delivery.


  • Bloomington, Illinois, United States Vodastra Full time

    We are seeking a Senior Data Engineering Specialist to join our Vodastra team.Job DescriptionAs a Senior Data Engineering Specialist, you will be responsible for designing, developing, and implementing scalable data processing systems using Apache Spark (or) Apache Flink (or) Apache Hadoop (or) Apache Beam. You will work closely with cross-functional teams...


  • Bloomington, Illinois, United States General Dynamics Information Technology Full time

    Job Overview:This position is a critical part of our team, responsible for developing and implementing AI and machine learning solutions to drive business value.We are seeking an experienced Senior Data Engineer with a strong background in AI and machine learning to join our team. As a Senior Data Engineer, you will be responsible for designing, developing,...


  • Bloomington, Illinois, United States Freddie Mac Full time

    About Freddie MacAt Freddie Mac, we're dedicated to making home possible for millions of Americans. We're a leading provider of mortgage financing and we're committed to helping individuals and families achieve the dream of homeownership.Job SummaryWe're seeking a highly skilled Data Protection Engineering Senior Solutions Architect to join our team. As a...


  • Bloomington, Illinois, United States Maintec Technologies Full time

    About the Role:We are seeking an experienced Senior Data Scientist to join our team at Maintec Technologies. The ideal candidate will have a strong background in data engineering and a passion for working with big data technologies.Key Responsibilities:Design and develop large-scale data processing systems using Hadoop, Spark, and Kafka.Collaborate with...


  • Bloomington, Illinois, United States Harmonia Holdings Group, LLC Full time

    Job Title: Data Engineering and Analytics ExpertAbout Us:Harmonia Holdings Group, LLC is a leading federal government contractor dedicated to delivering innovative solutions to our clients. We foster a dynamic work environment that encourages growth, initiative, and creativity.Job Description:We are seeking highly motivated sophomores, juniors, or seniors to...


  • Bloomington, Illinois, United States Harmonia Holdings Group, LLC Full time

    Company OverviewHarmonia Holdings Group, LLC is a leading federal government contractor committed to delivering innovative solutions to our clients. We foster a workplace that encourages growth, initiative, creativity, and employee satisfaction.Salary$65,000 - $85,000 per annum, depending on experience.Job DescriptionWe are seeking enthusiastic sophomores,...

  • Data Engineer

    5 days ago


    Bloomington, Illinois, United States Crimson Phoenix Full time

    Crimson Phoenix is seeking a Data Engineer to develop new tools, code, and services for executing data engineering activities.Key Responsibilities:Developing new tools, code, and services to execute data engineering activities.Movement of structure and unstructured data using approved methods.Executing data ingestion activities for storing data in a local or...


  • Bloomington, Illinois, United States Pixalate, Inc. Full time

    Estimate salary: $160,000 - $250,000 per yearAbout Pixalate, Inc.Pixalate is an innovative online trust and safety platform that protects businesses, consumers, and children from deceptive, fraudulent, and non-compliant mobile, CTV apps, and websites.The company has a team of experts in data science, engineering, law, economics, and research, with a global...


  • Bloomington, Illinois, United States Capital One Full time

    Join Capital One, a leader in the technology space, as a Senior Data Engineer, Card Tech.We're seeking passionate professionals to drive a major transformation within our organization. As a Data Engineer, you'll have the opportunity to pioneer cloud-based solutions and collaborate with Agile teams to design, develop, test, implement, and support technical...


  • Bloomington, Illinois, United States Harmonia Holdings Group, LLC Full time

    Job Opportunity: Senior Data ScientistWe are seeking an experienced Senior Data Scientist to join our AI and Machine Learning team at Harmonia Holdings Group, LLC. This is an exciting opportunity for a passionate and innovative individual to work on projects that deliver real business value to our clients.Responsibilities:MLOps & Automation: Develop and...


  • Bloomington, Illinois, United States 4DV Analytics Full time

    Job Summary:4DV Analytics is seeking a highly skilled Senior Java Developer to join our team in a fast-paced cloud and dedicated hardware based operational environment. As a Senior Java Developer, you will work with hundreds of data sets containing real-time and near real-time data in support of national security missions.Key Responsibilities:Develop and...


  • Bloomington, Illinois, United States Sancorp Consulting LLC Full time

    About Sancorp Consulting LLC">We are a dynamic and growing company specializing in data analytics and strategy consulting. Our team is passionate about leveraging data to drive business decisions and improve outcomes.">Job Summary">We are seeking an experienced Senior Data Scientist to join our Strategy Coordination Program Office within the Office of the...

  • Data Engineer

    6 days ago


    Bloomington, Illinois, United States Cognitio Corp Full time

    Cognitio Corp seeks a skilled Data Engineer - ETL Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data flows and pipelines. You will work closely with cross-functional teams to ensure seamless data integration and ensure the highest level of data...

  • Data Engineer

    6 days ago


    Bloomington, Illinois, United States Fusion Innovation Full time

    Fusion Innovation seeks a skilled Data Engineer to join our team and contribute to the development of innovative data solutions. Our ideal candidate will have a solid background in data engineering, with expertise in designing and implementing large-scale data systems.Key ResponsibilitiesDesign, develop, and deploy data pipelines and architectures to support...


  • Bloomington, Illinois, United States Capital One Full time

    Capital One is seeking a highly skilled Data Engineering Lead to join our team. As a Data Engineering Lead, you will be responsible for designing, developing, and implementing technical solutions in full-stack development tools and technologies. You will collaborate with Agile teams and work with a team of developers with deep experience in machine learning,...


  • Bloomington, Illinois, United States AT&T Full time

    Job Title: Senior Network EngineerAT&T is seeking a highly skilled Senior Network Engineer to join our team. As a key member of our Network Operations Center, you will be responsible for providing Tier 3 network service and superior troubleshooting expertise.Key Responsibilities:Provide Tier 3 support to the Network Operations Center (NOC)Support local area...


  • Bloomington, Illinois, United States Foxhound Federal Full time

    About the RoleWe are seeking a highly skilled Data Engineer with experience in large network data design, development, and maintenance. As a key member of our team, you will be responsible for designing scalable data flows and creating data models to ensure data consistency.The ideal candidate should have a B.S. or M.S. in Computer Science or related field...


  • Bloomington, Illinois, United States Ampcus Full time

    Key ResponsibilitiesDevelop and maintain large-scale data systems leveraging expertise in Python, SQL, and cloud platforms.Collaborate with engineers to implement data warehousing, ETL, and data streaming solutions.Design and deploy data platforms using Spark, AWS, and other technologies.Requirements5+ years of experience in application development,...


  • Bloomington, Illinois, United States Sancorp Consulting LLC Full time

    Unlock Career Opportunities with Sancorp Consulting LLCAbout Us:Sancorp Consulting LLC is a reputable and growing company that specializes in cutting-edge solutions for the Artificial Intelligence (AI) Biosurveillance Program. Our team is committed to delivering high-quality results, fostering innovation, and driving success.Job Title: Senior AI...


  • Bloomington, Illinois, United States TMCI Full time

    We are seeking an experienced Healthcare Data Architect to join our team at TMCI. This role is a pivotal part of our data-driven decision-making process, ensuring that our data infrastructure meets the complex needs of the healthcare industry.The ideal candidate will have a strong background in designing and developing large-scale data architectures, with...