Data Engineer

3 weeks ago

Chicago, United States BAI Full time
Data Engineer     Reports To: Director, Product Development & Operations        BAI is the financial services industry’s leading provider of powerful tools, relevant content, and meaningful connections.  Our mission is to give financial services leaders the confidence to make smart business decisions because a strong financial services industry helps consumers, businesses and communities thrive.        We are looking for a passionate and experienced Data Engineer to help us transform our class-leading regulatory compliance and online training platforms using cutting-edge cloud-native concepts on the Microsoft Azure Platform.         Responsibilities:   
  • Build systems, algorithms, and analytical tools to transform data into actionable insights that drive business value.
  • Design, deploy, maintain, and ensure the consistency of the organization's databases and database architectures.
  • Design, build, manage, and optimize data pipelines to support ETL processes and data integration tasks in a multi-tenancy cloud data platform using Azure and SQL technologies.
  • Ensure all solutions meet high levels of performance, security, scalability, maintainability, availability, sustainability, appropriate reusability, and reliability.
  • Optimize data processing through database tuning, query optimization, and ensuring scalable infrastructures.
  • Develop and deploy robust data and reporting architectures (e.g., data lake, data warehouse) to handle large-scale datasets and ensure data quality and integrity.
  • Identify, design, and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Collaborate with software engineers and product managers to understand detailed requirements for creating and enhancing new and legacy reporting and analytics solutions while adhering to architectural requirements of maintainability and scalability.
  • Create new data validation methods and data analysis tools.
  • Ensure compliance with data governance and security policies.
  • Use and advise on specific technologies and best practices for utilizing cloud resources to efficiently ingest and process data and solve complex data problems.
  • Administer databases, including modeling, design, and troubleshooting.
  • Lead efforts to assess new technologies, products, and tools that can help improve business capabilities, customer value, and/or developer efficiency, and recommend specific solutions.
  • Establish, document, and ensure compliance with data management best practices.
  • Maintain comprehensive documentation of data models, pipelines, and ETL processes. 
Requirements:   
  • Bachelor’s degree in computer science or related field strongly preferred
  • Minimum of 5 years of experience as a data engineer
  • Certifications in Azure Data Engineering, Spark, or other relevant technologies preferred
  • Proven track record of developing ETL processes, data pipeline architecture, data models, and data analytics/reporting solutions
  • Experience designing, implementing, and optimizing data architecture solutions in Azure
  • Experience with SQL and ability to understand and author complex SQL queries, stored procedures, and functions
  • Proven track record of leveraging data to deliver business value and present data-driven insights to business audiences
  • Drive innovation in collaboration with business and technical stakeholders in alignment with the organization’s needs, overall applications portfolio, IT and business priorities and success measures to design and implement data solutions
  • Communicate with all levels and functional areas of the BAI organization.
  • Write and maintain documentation as needed to support knowledge sharing of existing and future technologies.
  • Ability to understand business requirements and convert into technical specifications
  • Ability to effectively communicate technical concepts to both technical and non-technical stakeholders
  • Self-starter, comfortable with ambiguity, ability to initiate and drive projects with minimal oversight and guidance
  • Excellent collaboration, communication, and leadership skills
  • Highly motivated, self-directed, and possess solid execution and follow-up skills; detail oriented but understands the broader impacts of projects and tasks
    BAI offers an outstanding benefit package including comprehensive insurance coverage, a 401(k) plan with company match, generous vacation/personal time programs, BAI Workflex which includes a hybrid work model and bonus potential with the ability to work in a collaborative, team-oriented environment.

  • Systems Engineer

    4 weeks ago

    Chicago, United States Data Theorem Full time

    Job DescriptionJob DescriptionData Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.Our...

  • Data Engineer

    2 days ago

    Chicago, United States SPECTRAFORCE Full time

    Job Title: Data Engineer Duration: 6-month Contract to Hire possibility Location: Chicago, IL 60604 - Must be onsite 3 days per weekDay to day:The client is seeking a highly skilled and motivated Data Engineer to join the team. The ideal candidate will have expertise in data engineering with a strong focus on Incorta, Power BI development and SQL. As a Data...

  • Data Engineer

    1 day ago

    Chicago, Illinois, United States United Airlines Full time

    Our Marketing and Loyalty team is the strategic force behind United's industry-leading brand and experience, supporting revenue growth by turning customers into lifelong United flyers. Our marketing communications, market research and brand teams drive travelers' familiarity and engagement with the United brand. Our product, design and service teams bring...

  • Data Engineer

    1 month ago

    Chicago, United States Optomi Full time

    Optomi, is in partnership with an Enterprise Automotive Repair Company, is seeking a Mid-Senior Level Data Engineer to join and grow the Data/BI Team in the Chicago Area.What The Right Professional Will Enjoy!The ability to work with emerging technologies in the data engineering and cloud spaceA company that harbors internal growth and leadership...

  • Data Engineer

    4 weeks ago

    Chicago, United States Optomi Full time

    Optomi, is in partnership with an Enterprise Automotive Repair Company, is seeking a Mid-Senior Level Data Engineer to join and grow the Data/BI Team in the Chicago Area.What The Right Professional Will Enjoy!The ability to work with emerging technologies in the data engineering and cloud spaceA company that harbors internal growth and leadership...

  • Data Engineer

    1 month ago

    Chicago, United States Optomi Full time

    Optomi, is in partnership with an Enterprise Automotive Repair Company, is seeking a Mid-Senior Level Data Engineer to join and grow the Data/BI Team in the Chicago Area.What The Right Professional Will Enjoy!The ability to work with emerging technologies in the data engineering and cloud spaceA company that harbors internal growth and leadership...

  • Data Engineer

    1 day ago

    Chicago, Illinois, United States Danaher Full time

    Leica Biosystems' mission of "Advancing Cancer Diagnostics, Improving Lives" is at the heart of our corporate culture. We're a global leader in cancer diagnostics with the most comprehensive portfolio from biopsy to diagnosis. Our easy-to-use and consistently reliable offerings help improve workflow efficiency and diagnostic confidence.Our associates know...

  • Data Engineer

    1 day ago

    Chicago, United States NinjaTrader Full time

    Job DescriptionJob DescriptionNinjaTrader is an investor-backed, growth-stage FinTech company with an award-winning platform and over 1 million users. We are building products and services which empower active traders to easily analyze and react to data from the world's leading financial markets. Located in Chicago, our unique employee-centric company...

  • Data Engineer

    1 day ago

    Chicago, Illinois, United States CapTech Full time

    Company DescriptionCapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong...

  • Senior Data Engineer

    4 weeks ago

    Chicago, United States InterEx Group Full time

    Job Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...

  • Senior Data Engineer

    4 weeks ago

    Chicago, United States InterEx Group Full time

    Job Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...

  • Senior Data Engineer

    4 weeks ago

    Chicago, United States InterEx Group Full time

    Job Title: Senior Data Engineer (2 positions)Location: Chicago, IL (preference), Nashville, TN, Indianapolis, IN, Evansville, IN, or Minneapolis, MNContract term: Contract to HireWe are currently seeking two experienced Senior Data Engineers to join our team. The ideal candidates will have a strong background in building pipelines, utilizing Azure Data...

  • Lead Data Engineer

    1 week ago

    Chicago, Illinois, United States Motion Recruitment Full time

    An esteemed investment firm based in Chicago is on the lookout for a Lead Data Engineer to join their innovative team in a hybrid capacity. Specializing in fostering growth for businesses across technology, healthcare, and consumer sectors, this company is renowned for its strategic approach to investment and operational support. With a focus on driving...

  • Sr. Data Engineer

    1 day ago

    Chicago, Illinois, United States Inspira Financial Full time

    Take the next step in your journey at Inspira Financial. You will help businesses and individuals thrive today, tomorrow, and into retirement. Become part of a company that is people centric and client obsessed in every interaction; a community of forward-thinking individuals focused on driving results to deliver our mission with an unwavering commitment to...

  • Data Engineer

    1 day ago

    Chicago, Illinois, United States Double Good Full time

    Double Good's mission is to create joy. We create joy with our delectable and award-winning popcorn. We create joy with our easy-to-use fundraising platform that raises a meaningful amount of money for youth sports and activities, empowering kids to pursue their dreams. We create joy through our Kids Foundation which hosts Double Good Days events across the...

  • Principal Data Engineer

    17 hours ago

    Chicago, United States Blue Health Intelligence Full time

    About Us:BHI is a data and analytics company and helping health plans, researchers, healthcare providers, employers, and government agencies use data to improve the health outcomes, promote value-based care, and address health equity and increase the value of care provided. We leverage the industry’s most comprehensive and highest quality commercial data...

  • Principal Data Engineer

    1 day ago

    Chicago, United States Blue Health Intelligence Full time

    About Us:BHI is a data and analytics company and helping health plans, researchers, healthcare providers, employers, and government agencies use data to improve the health outcomes, promote value-based care, and address health equity and increase the value of care provided. We leverage the industry’s most comprehensive and highest quality commercial data...

  • Software/Data Engineer

    2 days ago

    Chicago, United States Edge Full time

    Edge (www.edgescore.com) is a data and analytics platform that harnesses bank transaction data to measure consumer credit risk. Founded in 2021, Edge is part of a larger family of FinTech brands that sits underneath our parent company, NinjaHoldings (www.ninjaholding.com). NinjaHoldings’ brands also include CreditNinja, a high velocity online consumer...

  • Data Curation Engineer

    1 week ago

    Chicago, Illinois, United States Orion Group Full time

    Orion Project Services LLC and Big Pharma is the best combination in Northern Illinois Are you a Data Engineer that specializes Curation? I have the a tremendous opportunity for you right now Accept the challenge and begin your career with a Market Leading Pharmaceutical company if your skills exceed the description below 1 year initial contract (extension...

  • Python Data Engineer

    2 weeks ago

    Chicago, United States CPS Full time

    Python Data Engineer We are a global financial institution with offices in Chicago, NYC, and more in the United States. We are currently expanding our trading teams and need experienced data engineers/analysts to work hand-in-hand with numerous business heads / portfolio managers. You will design data centric systems used by these teams and take...