Data Engineer

2 weeks ago

Fort Worth, United States Motion Recruitment Full time

Responsibilities:


About the role:


ABS Data Engineer II, Finance is a critical technical role within the North America Securitization and Conduit Reporting team. This position will be helping ABS reporting team in building and maintaining reliable and scalable data pipelines. This position will leverage your expertise in Python, SQL, and Azure cloud technologies to extract, transform, and load data efficiently, enabling seamless data access and analysis for accounting business users. This position involves a high level of coordination with other departments and third-party software vendors.

JOB DUTIES

• Code, test, deploy, Orchestrate, monitor, document and implement data pipelines utilizing the Microsoft azure data bricks platform

• Utilize technologies like Spark, Delta Lake and Unity Catalog for Efficient data processing and governance

• Implement the Medallion architecture pattern for robust and modular data pipelines

• Implement CI/CD pipelines for automated testing and deployment of data pipelines using azure devops.

• Configure and manage Azure Data Lake Storage for secure and scalable data storage.

• Collaborate and work closely with ABS data analysts, accounting business partners to identify, capture, collect and format data from the external sources, Internal systems and data warehouse to extract features of interest

• Monitor and optimize data pipelines for performance and reliability

• Stay up-to-date with the latest advancements in Databricks, Azure, and big data technologies

• Educate and Develop ETL developers on data engineering cloud based initiatives so as to enable transition to data engineer and practice

• Monitor the production reporting environment on daily and monthly basis Data Analytics to analyze data and make business decisions on the data

Qualifications:

What makes you a dream candidate?

• Experience with Databricks platform on Microsoft Azure

• Experience with processing large datasets using Hadoop, Spark, Kafka or similar distributed systems

• Experience with PySpark and distributed data processing frameworks

• Understanding of cloud computing technologies, business drivers and emerging computing trends

• Experience with ingesting various source data formats such as JASON, Parquet, Sequencefile, Cloud databases, MQ, Relational databases such as Oracle

• Working knowledge of Object Storage technologies to include but not limited to Data Lake Storage Gen2, ADLS etc.

• Working knowledge of unity catalog and data governance principles

• Working knowledge of Agile development /SAFe, Scrum and Application Lifecycle Management

• Strong background with source control management systems (GIT or Subversion); Build Systems (Maven, Gradle, Webpack); Code Quality (Sonar); Artifact Repository Managers (Artifactory), Continuous Integration/ Continuous Deployment (Azure DevOps)

• Experience with Python and SQL

• Creating and maintaining ETL processes and data pipelines

• Knowledgeable of best practices in information technology governance and privacy compliance

• Knowledge on auto finance industries core business functions

• Ability to establish priorities and meet tight deadlines.

• Ability to interact collaboratively with internal customers

• Demonstrated quantitative skills and data analytical skills

• Solid design, coding, testing and debugging skills

Experience and Education

• 4-6 years of hands-on experience with data engineering required

• 3-5 years of hands-on experience with processing large data sets required

• 3-5 years of hands-on experience with SQL, data modeling, relational databases and/or no SQL databases required

• Bachelor’s Degree in related field or equivalent work experience required

  • Data Engineer

    3 weeks ago

    Fort Worth, United States Motion Recruitment Full time

    Fort Worth, TX company is seeking a Data Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge technology to...

  • Data Engineer

    3 weeks ago

    Fort Worth, Texas, United States Motion Recruitment Full time

    Fort Worth, TX company is seeking a Data Engineer to join their team for a contract opportunity.Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge technology to solve...

  • Data Engineer

    2 weeks ago

    Fort Worth, United States Vantage Bank Full time

    JOB CLASSIFICATION Full / Part-time: Full-time Hours Per Week: 40 Location: 3131 West 7th Street Suite 200, Fort Worth TX 76107 The Data Engineer is part of a high-performing Data Engineering team that will play a crucial role in designing, developing, and maintaining scalable data pipelines and infrastructure to support our banking operations. You will...

  • Senior Data Engineer

    4 weeks ago

    Fort Worth, United States Robert Half Full time

    Senior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...

  • Senior Data Engineer

    4 weeks ago

    Fort Worth, United States Robert Half Full time

    Senior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...

  • Senior Data Engineer

    4 weeks ago

    Fort Worth, United States Robert Half Full time

    Senior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one...

  • Data Engineer

    5 days ago

    Fort Worth, United States Motion Recruitment Full time

    3-4+ years of Data Engineering experience.Strong Azure and DatabricksStrong SQL Skills.Resume Keywords: Azure, Spark, Delta Lake, CI/CD, ABS, Databricks, PySparkRequired Skills & Experience• Experience with Databricks platform on Microsoft Azure• Advanced SQL Skills• 4-6 years of hands-on data engineering experience • 3-5 years of hands-on experience...

  • Data Engineer

    5 days ago

    Fort Worth, United States Motion Recruitment Full time

    3-4+ years of Data Engineering experience.Strong Azure and DatabricksStrong SQL Skills.Resume Keywords: Azure, Spark, Delta Lake, CI/CD, ABS, Databricks, PySparkRequired Skills & Experience• Experience with Databricks platform on Microsoft Azure• Advanced SQL Skills• 4-6 years of hands-on data engineering experience • 3-5 years of hands-on experience...

  • Sr. Data Engineer

    7 days ago

    Fort Worth, United States System Soft Technologies Full time

    Over five years of Data Engineering experienceDemonstrated experience with data and software engineering best practices and implementing data and software development lifecycles.Demonstrated experience with designing and implementing data models (conceptual, logical, physical) Demonstrated experience with implementing data ingestion/testing automation...

  • Sr. Data Engineer

    3 weeks ago

    Fort Worth, United States System Soft Technologies Full time

    Over five years of Data Engineering experienceDemonstrated experience with data and software engineering best practices and implementing data and software development lifecycles.Demonstrated experience with designing and implementing data models (conceptual, logical, physical) Demonstrated experience with implementing data ingestion/testing automation...

  • Sr. Data Engineer

    1 month ago

    Fort Worth, United States System Soft Technologies Full time

    Over five years of Data Engineering experienceDemonstrated experience with data and software engineering best practices and implementing data and software development lifecycles.Demonstrated experience with designing and implementing data models (conceptual, logical, physical) Demonstrated experience with implementing data ingestion/testing automation...

  • Data Governance Engineer

    1 week ago

    Fort Worth, United States Motion Recruitment Full time

    Fort Worth, TX company is seeking a Data Governance Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge...

  • Data Governance Engineer

    2 weeks ago

    Fort Worth, United States Mindlance Full time

    Work closely with source data application teams and product owners to design, implement and support analytics and data governance solutions that provide insights to make better decisions • Administer and Support one or more Data Governance platforms for Marketplace, Stewardship, Catalog, Quality and Literacy • Supporting the research, review,...

  • Data Discovery

    1 month ago

    Fort Worth, United States Motion Recruitment Full time

    Fort Worth, TX company is seeking a Data Discovery (BigID) Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge...

  • Azure Data Governance Engineer

    2 weeks ago

    Fort Worth, United States Venusgeo Full time

    • Minimum Qualifications- Education & Prior Job Experience • Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training • 3 years software solution development using agile, DevOps, operating in a product model that includes...

  • Data Discovery

    2 weeks ago

    Fort Worth, United States Motion Recruitment Full time

    Fort Worth, TX company is seeking a Data Discovery (BigID) Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are retained on long-term contract engagements. Responsible for leveraging cutting edge...

  • Data Discovery

    2 weeks ago

    Fort Worth, United States Motion Recruitment Partners LLC Full time

    Data Discovery (BigID) Engineer Fort Worth, TX Hybrid Contract $53.33/hr - $63.33/hr Fort Worth, TX company is seeking a Data Discovery (BigID) Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are...

  • Data Discovery

    7 days ago

    Fort Worth, United States Motion Recruitment Partners LLC Full time

    Data Discovery (BigID) Engineer Fort Worth, TX Hybrid Contract $53.33/hr - $63.33/hr Fort Worth, TX company is seeking a Data Discovery (BigID) Engineer to join their team for a contract opportunity. Leverage the latest technology to solve business problems in a collaborative environment at this Fortune 500 transportation giant. Top technical resources are...

  • Data Reporting Analyst

    1 month ago

    Fort Worth, United States CornerStone Technology Talent Services Full time

    PLEASE, NO C2C CANDIDATES**Exciting Job Alert: Senior Data/Reporting Analyst/Cognos Needed in Fort Worth, TX!**Join our client's dynamic team and become a vital part of revolutionizing reporting processes! As a Senior Data/Reporting Analyst, you'll dive into the heart of Finance and Controlling, collaborating with key stakeholders to fuel data-driven...

  • Data Reporting Analyst

    3 weeks ago

    Fort Worth, United States CornerStone Technology Talent Services Full time

    PLEASE, NO C2C CANDIDATES**Exciting Job Alert: Senior Data/Reporting Analyst/Cognos Needed in Fort Worth, TX!**Join our client's dynamic team and become a vital part of revolutionizing reporting processes! As a Senior Data/Reporting Analyst, you'll dive into the heart of Finance and Controlling, collaborating with key stakeholders to fuel data-driven...