Sr. Data Engineer

5 days ago

St Louis, MO, United States ShiftCode Analytics Full time

Interview : Video ( Prefer local candidates who can go for F2F interview but open to non local for video interview )

Visa : USC, GC, GC EAD, H4 , L2

Description:
• Initial Project: Migrate existing Python data extraction tool and codebase to Alpine Data Lake, set up API extraction in Synapse, establish daily ETL for updates, and update Power BI reports to use data lake source. [Alpine Strategic Credit (ASC)]
• Subsequent Project: Extract and migrate 20+ years of historical data from Portfolio system to a data warehouse, set up real-time API for continuous data feed from Tamarac, establish daily ETL for updates, and enable improved Power BI reporting. [Alpine Private Wealth (APW)]

  • Both projects involve ensuring data accuracy and integrity, structuring data for seamless integration into the data warehouse and Power BI.
  • Data modeling will utilize a Star Schema or Snowflake Schema approach.
Responsibilities:
• Designing, developing, and maintaining data pipelines and warehousing solutions.
• Key tasks will include API integration, ETL development, data modeling (Star Schema or Snowflake Schema), and supporting Power BI reporting.
• Collaborate with internal project teams to ensure data accuracy, integrity, and structured organization for business intelligence.

Tech stack:
  1. Azure Synapse Analytics
    1. Two separate environments (e.g., Development and Production).
    2. Handles data warehousing and large-scale analytics workloads.
  1. Azure Data Lake
    1. Centralized storage layer.
    2. Supports both structured and unstructured data.
    3. Scalable foundation for analytics and data integration.
  1. Azure Key Vault
    1. Manages secrets, encryption keys, and certificates.
    2. Ensures secure access across both environments.
  1. Azure DevOps
    1. CI/CD pipelines for automated builds and deployments.
    2. Manages data pipeline lifecycle and component delivery.
  1. Apache Spark Notebooks
    1. Deployed in both environments.
    2. Used for interactive data exploration, transformation, and analytics.
  1. Azure Integration Runtime
    1. Facilitates secure and scalable data movement.
    2. Enables transformations across network boundaries within Synapse or Data Factory.
  1. Metastore Data Warehouse
    1. Centralized metadata repository.
    2. Maintains schema definitions, and table metadata
  1. ARM Template (Azure Resource Manager)
    1. Defines and automates infrastructure deployment.
    2. Enables consistent provisioning of Synapse, Data Lake, Key Vault, and other resources across environments.

  • Sr. Data Engineer

    4 days ago

    St Louis, MO, United States Brillio Full time

    About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their...

  • Sr. Data Engineer

    1 week ago

    St Louis, MO, United States Brillio Full time

    About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their...

  • Sr. Data Engineer

    1 week ago

    St Louis, MO, United States Brillio Full time

    About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their...

  • DevOps Engineer, Sr.

    6 days ago

    St Louis, MO, United States William C Brown Inc Full time

    DevOps Engineer, Sr. EOE Statement We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status or any other characteristic protected by law. Description Deliver simple solutions to complex problems...

  • DevOps Engineer, Sr.

    2 weeks ago

    St Louis, MO, United States William C Brown Inc Full time

    DevOps Engineer, Sr. EOE Statement We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status or any other characteristic protected by law. Description Deliver simple solutions to complex problems...

  • Sr. Technical Application Engineer

    2 days ago

    St Louis, MO, United States Hubbell Full time

    Job Overview Sr. Technical Application Engineer - South Central Region (TX, OK, AR, LA) The Sr. Technical Application Engineer is the primary technical resource for the team of Sales Directors tasked with selling Hubbell Utility Solutions. Sr. Technical Application Engineers are responsible for working within the Sales team as the key technical advisors...

  • Sr. Technical Application Engineer

    7 hours ago

    St Louis, MO, United States Hubbell Full time

    Job Overview Sr. Technical Application Engineer - South Central Region (TX, OK, AR, LA) The Sr. Technical Application Engineer is the primary technical resource for the team of Sales Directors tasked with selling Hubbell Utility Solutions. Sr. Technical Application Engineers are responsible for working within the Sales team as the key technical advisors...

  • Sr. Technical Application Engineer

    4 hours ago

    St Louis, MO, United States Hubbell Power Systems Full time

    Sr. Technical Application Engineer - South Central Apply now » Date: Dec 15, 2025 Location: St. Louis, MO, US, 63146 Company: Hubbell Incorporated Job Overview Sr. Technical Application Engineer - South Central Region (TX, OK, AR, LA) The Sr. Technical Application Engineer is the primary technical resource for the team of Sales Directors tasked with selling...

  • Sr. Project Engineer

    2 weeks ago

    St Louis, MO, United States Barton Malow Full time

    Company: Barton Malow BuildersJob Location: St. Louis, MOPosition: Sr. Project EngineerREQ ID: 11595POSITION SUMMARY Barton Malow Builders is seeking a Sr. Project Engineer to join our team on a project in St. Louis, MO. This role involves overseeing project quality, compliance, budgets, and schedules. This role requires a 4-year degree in engineering or...

  • Sr. Structural Engineer

    1 week ago

    St Louis, MO, United States Farnsworth Group Full time

    Position: Sr. Structural Engineer Location: St. Louis, MO Job Id: 2769 of Openings: 1 Join us and grow your career with a certified Great Place to Work for the last ten years running. We are a team of Engineers, Architects, Surveyors, and Scientists committed to making meaningful contributions to the world around us. Our quest for excellence goes beyond the...