ETL Developer with Pyspark

2 weeks ago


Bloomington, Illinois, United States Excelon Solutions Full time
Job DescriptionJob Description

Job Description

  • Your expertise in Python, PySpark, ETL processes and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.
  • Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
  • Implement ETL processes to extract, transform, and load data from various sources.
  • Ensure data quality, integrity, and consistency throughout the ETL pipeline.
  • Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
  • Optimize code for performance and scalability, keeping up to date with the latest industry best practices.
  • Integrate data from different systems and sources to provide a unified view for analytical purposes.
  • Collaborate with data analysts to implement solutions that meet their data integration needs.
  • Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
Develop batch processing workflows for large-scale data processing and analysis.

  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. As part of Freddie Mac's return to the office pilot, all employees, contingent workers and visitors must be fully vaccinated against COVID-19 in...


  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Employees, contingent workers and visitors are no longer required to show proof of vaccination to be on-site. Effective January 2023, Freddie Mac's...


  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Employees, contingent workers and visitors are no longer required to show proof of vaccination to be on-site. Effective January 2023, Freddie Mac's...


  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Employees, contingent workers and visitors are no longer required to show proof of vaccination to be on-site. Effective January 2023, Freddie Mac's...


  • Bloomington, Illinois, United States Brillio Full time

    About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their...


  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Employees, contingent workers and visitors are no longer required to show proof of vaccination to be on-site. Effective January 2023, Freddie Mac's...


  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Employees, contingent workers and visitors are no longer required to show proof of vaccination to be on-site. Effective January 2023, Freddie Mac's...

  • Chief Data Architect

    1 month ago


    Bloomington, Illinois, United States SAIC Career Site Full time

    Description SAIC, a leading provider of systems development & deployment, targeting & intelligence analysis, systems engineering & integration, and training capabilities and solutions for the Intelligence Community, is seeking creative and dedicated professionals to fulfill their career goals and objectives while delivering mission excellence on programs of...

  • Chief Data Architect

    1 month ago


    Bloomington, Illinois, United States SAIC Career Site Full time

    Description SAIC, a leading provider of systems development & deployment, targeting & intelligence analysis, systems engineering & integration, and training capabilities and solutions for the Intelligence Community, is seeking creative and dedicated professionals to fulfill their career goals and objectives while delivering mission excellence on programs of...

  • Software Engineer

    1 month ago


    Bloomington, Illinois, United States SAIC Career Site Full time

    Description INTRODUCTION: The Customer's office is looking for an individual to compliment the team with Elasticsearch and other big data search and exploitation skills. The Customer's office manages a system that consists of multiple system to system interfaces, and multiple ETL pipelines. The Customer requires specialized support in the development of...

  • Solutions Architect

    1 month ago


    Bloomington, Illinois, United States Acumen Solutions Full time

    Company DescriptionAcumen Solutions drives excellence - not only in our performance, but also in the results we deliver for our clients. We are a global cloud consultancy that combines the insight of our strategists, the vision of our innovators, and the ingenuity of our engineers to achieve this extraordinary impact. The Fortune 500 trust us to build...


  • Bloomington, Illinois, United States The MITRE Corporation Full time

    Why choose between doing meaningful work and having a fulfilling life? At MITRE, you can have both. That's because MITRE people are committed to tackling our nation's toughest challenges—and we're committed to the long-term well-being of our employees. MITRE is different from most technology companies. We are a not-for-profit corporation chartered to work...


  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Employees, contingent workers and visitors are no longer required to show proof of vaccination to be on-site. Effective January 2023, Freddie Mac's...


  • Bloomington, Illinois, United States Capital One Full time

    Locations: VA - McLean, United States of America, McLean, VirginiaSenior Software Engineer, Full StackDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers,...


  • Bloomington, Illinois, United States Freddie Mac Full time

    At Freddie Mac, you will do important work to build a better housing finance system and you'll be part of a team helping to make homeownership and rental housing more accessible and affordable across the nation. Employees, contingent workers and visitors are no longer required to show proof of vaccination to be on-site. Effective January 2023, Freddie Mac's...


  • Bloomington, Illinois, United States Hilton Full time

    ***This role is based at one of our corporate offices in McLean, VA, Dallas, TX, or Memphis, TN***This is your chance to be part of an in-house corporate Brands team of industry experts in the domains of hospitality, brand management, innovation, owner relations, and more As a Director, Solutions Architect you will support the team that lead our brands with...


  • Bloomington, Illinois, United States Hilton Full time

    ***This role is based at one of our corporate offices in McLean, VA, Dallas, TX, or Memphis, TN***This is your chance to be part of an in-house corporate Brands team of industry experts in the domains of hospitality, brand management, innovation, owner relations, and more As a Director, Solutions Architect you will support the team that lead our brands with...

  • Data Architect

    3 weeks ago


    Bloomington, United States PamTen Full time

    15+ yearsof experience in the IT/Technology and having at least 3+ years of experience in Azure/Databricks Design and architect Databricks-based solutions that align with business objectives, ensuring scalability, performance, and security. Designed, Development and implemented Datamesh using DeltaLake. Provide technical leadership and guidance to the...

  • Data Architect

    3 weeks ago


    Bloomington, United States PamTen Full time

    15+ yearsof experience in the IT/Technology and having at least 3+ years of experience in Azure/Databricks Design and architect Databricks-based solutions that align with business objectives, ensuring scalability, performance, and security. Designed, Development and implemented Datamesh using DeltaLake. Provide technical leadership and guidance to the...


  • Bloomington, United States PamTen Full time

    15+ yearsof experience in the IT/Technology and having at least 3+ years of experience in Azure/Databricks Design and architect Databricks-based solutions that align with business objectives, ensuring scalability, performance, and security. Designed, Development and implemented Datamesh using DeltaLake. Provide technical leadership and guidance to the...


  • Bloomington, United States PamTen Full time

    15+ yearsof experience in the IT/Technology and having at least 3+ years of experience in Azure/Databricks Design and architect Databricks-based solutions that align with business objectives, ensuring scalability, performance, and security. Designed, Development and implemented Datamesh using DeltaLake. Provide technical leadership and guidance to the...


  • Bloomington, United States PamTen Full time

    15+ yearsof experience in the IT/Technology and having at least 3+ years of experience in Azure/Databricks Design and architect Databricks-based solutions that align with business objectives, ensuring scalability, performance, and security. Designed, Development and implemented Datamesh using DeltaLake. Provide technical leadership and guidance to...

  • Sr. Data Engineer

    1 week ago


    Bloomington, United States Infinity Consulting Solutions Full time

    Title: Sr. Data EngineerLocation:This is a remote position, with a preference for candidates who are based near Parsippany, NJ.Client Industry: Pharma??????? We have partnered with our client in their search for a highly skilled and motivated Senior Data Engineer to lead the development of a cutting-edge data and business intelligence (BI) platform. This...

  • Data Engineer

    1 month ago


    Bloomington, United States TALENT Software Services Full time

    Are you an experienced Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Engineer to work in Bloomington, MN(Remote).Position Summary: Looking for a Data Engineer to join our team and help us develop, maintain, and optimize ETL processes. This position requires a...

  • Data Engineer

    1 month ago


    Bloomington, United States TALENT Software Services Full time

    Are you an experienced Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Data Engineer to work in Bloomington, MN(Remote).Position Summary: Looking for a Data Engineer to join our team and help us develop, maintain, and optimize ETL processes. This position requires a...


  • Bloomington, United States Great Clips Full time

    Applicants in the Minneapolis-St. Paul Metropolitan area only, please. The Data Integration Developer is responsible for the analysis, design, development, testing, and maintenance of data management solutions at Great Clips, Inc. They are self-motivated and highly collaborative with their team and across the organization. This role is responsible for...


  • Bloomington, United States beBee S US Full time

    Quetica, in partnership with the Minnesota Department of Corrections (DOC), is seeking a full time Database Administrator (DBA) who will be a member to the Infrastructure Team, will need to work closely with the Server System Engineers, and collaborate with other DOC and Enterprise teams. The resource will help migrate to new versions of SQL and ensure the...


  • Bloomington, United States Cedent Consulting Full time

    Title: Sr Enterprise Data Architect @ Atlanta, GA / Bloomington, Illinois Terms of Hire: Full Time. Salary: $ 150 K/ YR + Benefits. Role Description Seeking an experienced Data Architecture Leader to join the Enterprise Architecture team. This role will be responsible for developing data architecture plans and driving the plans to fruition in collaboration...

  • Data Engineer

    1 week ago


    Bloomington, United States International Dairy Queen, Inc. Full time

    Since 1940, Dairy Queen® has been one of the world’s best known and loved brands. Based in Minneapolis, MN, International Dairy Queen Inc., (IDQ), is the parent company of American Dairy Queen Corporation. As a leading franchisor, there are more than 7,000 independently owned and operated restaurants in the U.S., Canada and more than 20 countries around...

  • Data Engineer

    4 weeks ago


    Bloomington, United States International Dairy Queen, Inc. Full time

    Job DescriptionJob DescriptionCompany DescriptionSince 1940, Dairy Queen® has been one of the world’s best known and loved brands. Based in Minneapolis, MN, International Dairy Queen Inc., (IDQ), is the parent company of American Dairy Queen Corporation. As a leading franchisor, there are more than 7,000 independently owned and operated restaurants in the...

  • Data Analyst

    2 weeks ago


    Bloomington, United States State Farm Full time

    Overview: We are not just offering a job but a meaningful career! Come join our passionate team! As a Fortune 50 company, we hire the best employees to serve our customers, making us a leader in the insurance and financial services industry. State Farm embraces diversity and inclusion to ensure a workforce that is engaged, builds on the strengths and...

  • Data Engineer

    4 weeks ago


    Bloomington, United States KBR Full time

    Title: Data Engineer Belong, Connect, Grow with KBR! The Advanced Analytics and Cloud Program within KBR is seeking a Data Engineer (Senior) for a future opportunity in Bloomington, Indiana (awaiting contract award). The program supports government customers within the Department of Defense (DoD) on various projects to develop solutions incorporating...


  • Bloomington, United States The Place for Children with Autism Full time

    Join our Impactful Clinical Team at The Place for Children with AutismAre you a Board Certified Behavior Analyst (BCBA) eager to make a significant difference in the lives of children and families affected by autism? At The Place for Children with Autism, we are dedicated to enriching lives through evidence-based, high-quality therapy. Our mission is to...

  • Data Engineer

    4 weeks ago


    Bloomington, United States KBR Full time

    Title:Data EngineerBelong, Connect, Grow with KBR! The Advanced Analytics and Cloud Program within KBR is seeking a Data Engineer (Senior) for a future opportunity in Bloomington, Indiana (awaiting contract award). The program supports government customers within the Department of Defense (DoD) on various projects to develop solutions incorporating...


  • Bloomington, United States The Place For Children With Autism Full time

    Job DescriptionJob DescriptionDescription:Join our Impactful Clinical Team at The Place for Children with AutismAre you a Board Certified Behavior Analyst (BCBA) eager to make a significant difference in the lives of children and families affected by autism? At The Place for Children with Autism, we are dedicated to enriching lives through evidence-based,...

  • Rbt - Bloomington

    2 weeks ago


    Bloomington, United States The Place for Children with Autism Full time

    **We offer Paid Training while you prepare to receive your RBT certification!** Welcome to The Place for Children with Autism, where warm hearts and playful spirits come together to make a difference in the lives of children and families! Here's a peek into what we're all about: **Who We Are**: At The Place, we're all about providing top-notch therapy to...

  • RBT - Bloomington

    1 month ago


    Bloomington, United States The Place For Children With Autism Full time

    Job DescriptionJob DescriptionDescription:We offer Paid Training while you prepare to receive your RBT certification! Welcome to The Place for Children with Autism, where warm hearts and playful spirits come together to make a difference in the lives of children and families! Here's a peek into what we're all about:Who We Are:At The Place, we're...