Data Engineer

7 days ago

Madison, WI, United States AgSource Full time
Job Description

The URUS Group is seeking a Data Engineer who is passionate about data, with hands-on experience in Databricks, SQL Server, SSIS, and SSRS, to help drive impactful reporting and robust data solutions. If you're energized by solving complex data challenges and enjoy working collaboratively, we encourage you to apply.

The Data Engineer is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles.

Responsibilities
Data Integration
  • Design, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.
  • Troubleshoot and resolve Databricks pipeline errors and performance issues.
  • Maintain legacy SSIS packages for ETL processes.
  • Troubleshoot and resolve SSIS package errors and performance issues.
  • Optimize data flow performance and minimize data latency.
  • Implement data quality checks and validations within ETL processes.
Databricks Development
  • Develop and maintain Databricks pipelines and datasets using Python, Spark and SQL.
  • Migrate legacy SSIS packages to Databricks pipelines.
  • Optimize Databricks jobs for performance and cost-effectiveness.
  • Integrate Databricks with other data sources and systems.
  • Participate in the design and implementation of data lake architectures.
Data Warehousing
  • Participate in the design and implementation of data warehousing solutions.
  • Support data quality initiatives and implement data cleansing procedures.
Reporting and Analytics
  • Collaborate with business users to understand data requirements for department driven reporting needs.
  • Maintain existing library of complex SSRS reports, dashboards, and visualizations.
  • Troubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.
Collaboration and Communication
  • Comfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.
  • Collaborate effectively with business users, data analysts, and other IT teams.
  • Communicate technical information clearly and concisely, both verbally and in writing.
  • Document all development work and procedures thoroughly.
Continuous Growth
  • Keep abreast of the latest advancements in data integration, reporting, and data engineering technologies.
  • Continuously improve skills and knowledge through training and self-learning.
Requirements
  • Bachelor's degree in computer science, Information Systems, or a related field.
  • 7+ years of experience in data integration and reporting.
  • Extensive experience with Databricks, including Python, Spark, and Delta Lake.
  • Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions.
  • Experience with SSIS (SQL Server Integration Services) development and maintenance.
  • Experience with SSRS (SQL Server Reporting Services) report design and development.
  • Experience with data warehousing concepts and best practices.
  • Experience with Microsoft Azure cloud platform and Microsoft Fabric desirable.
  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.
  • Ability to work independently and as part of a team.
  • Experience with Agile methodologies.
  • Must be legally authorized to work in the United States.


About Us

As a holding company with cooperative and private ownership, URUS is a family of businesses at the heart of the dairy and beef industry - Alta Genetics, GENEX, Genetics Australia, Leachman Cattle, Jetstream, PEAK, SCCL, Trans Ova Genetics and VAS. Each organization has its unique identity, products, and services. These companies work globally to provide cutting-edge dairy and beef genetics, customized reproductive services to maximize conceptions, dairy management information to take producers to the frontline of progressive dairy farming, and an array of products and services to help bovines reach their full genetic potential. URUS has 9 brands in 17 retail countries and employs nearly 2,800 people globally.

  • Data Engineer

    7 days ago

    Madison, WI, United States Zapier Full time

    About Zapier We're humans who simply think computers should do more work. At Zapier, were not just making softwarewere building a platform to help millions of businesses globally scale with automation and AI. Our mission is to make automation work for everyone by delivering products that delight our customers. Youll collaborate with brilliant people, use the...

  • Data Engineer

    7 days ago

    Madison, WI, United States Wisconsin Collaborative for Healthcare Quality Full time

    The Opportunity Are you passionate about leveraging data to drive innovation and create impactful solutions? M3 is seeking a skilled Applied Intelligence Data Engineer to play a pivotal role in our journey towards data excellence. As an Applied Intelligence Data Engineer, you will be at the forefront of developing, optimizing, and maintaining our data...

  • Senior Data Engineer

    7 days ago

    Madison, WI, United States Kaav Inc. Full time

    Alliant Energy is seeking a Senior Data Engineer (Snowflake/ Informatica) to play a crucial role in advancing the data and analytics practices within the organization. In this role, you will lead the design, development, implementation, enhancement, and maintenance of data pipelines across multiple technology platforms. Your expertise in Snowflake,...

  • Senior Data Engineer

    2 weeks ago

    Madison, WI, United States Kaav Inc. Full time

    Alliant Energy is seeking a Senior Data Engineer (Snowflake/ Informatica) to play a crucial role in advancing the data and analytics practices within the organization. In this role, you will lead the design, development, implementation, enhancement, and maintenance of data pipelines across multiple technology platforms. Your expertise in Snowflake,...

  • Senior Data Engineer

    3 days ago

    Madison, WI, United States Kaav Inc. Full time

    Alliant Energy is seeking a Senior Data Engineer (Snowflake/ Informatica) to play a crucial role in advancing the data and analytics practices within the organization. In this role, you will lead the design, development, implementation, enhancement, and maintenance of data pipelines across multiple technology platforms. Your expertise in Snowflake,...

  • Sr. Data Engineer

    7 days ago

    Madison, WI, United States AgSource Full time

    Job Description Join our team as a Sr. Data Engineer in a hybrid role based in the Madison, WI area! We're looking for someone passionate about data, with hands-on experience in Databricks, SQL Server, SSIS, and SSRS, to help drive impactful reporting and robust data solutions. If you're energized by solving complex data challenges and enjoy working...

  • Data Test Engineer

    2 weeks ago

    Madison, WI, United States The QTI Group Full time

    The QTI Group is partnering with a Madison client to hire a Data Test Engineer. This is a one year contract-to-hire opportunity.The Data Test Engineer will play an integral role in ensuring the quality and reliability of data infrastructure, user interfaces and services. This position has a primary focus of validating various data and requires attention to...

  • Data Test Engineer

    1 week ago

    Madison, WI, United States The QTI Group Full time

    The QTI Group is partnering with a Madison client to hire a Data Test Engineer. This is a one year contract-to-hire opportunity.The Data Test Engineer will play an integral role in ensuring the quality and reliability of data infrastructure, user interfaces and services. This position has a primary focus of validating various data and requires attention to...

  • Data Test Engineer

    3 days ago

    Madison, WI, United States The QTI Group Full time

    The QTI Group is partnering with a Madison client to hire a Data Test Engineer. This is a one year contract-to-hire opportunity.The Data Test Engineer will play an integral role in ensuring the quality and reliability of data infrastructure, user interfaces and services. This position has a primary focus of validating various data and requires attention to...

  • Senior Data Engineer

    3 days ago

    Madison, WI, United States Centene Corporation Full time

    You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data...