Data Engineer, Python

3 weeks ago


Addison, United States Credera Full time

** REMOTE ROLE for Contractor anywhere in N. America **

** 12 month contract and possible extension **

** Rate = $65 - 80/hr USD Based On Experience 

Description:

Data Engineers at TA Digital work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate Foundry with external systems containing the data. Data engineers also need to provide guidance and support on how to access and leverage the data foundation to create new workflows or analyze data.

Responsibilities Include:

  • Leverage Generative AI on AWS data 
  • Integrate new data sources to Foundry using Data Connection 
  • Implement 2-way integrations between Foundry and external systems
  • Develop pipelines transforming tabular or unstructured data
  • Implement data transformations in PySpark / PySpark SQL to derive new datasets or create ontology objects 
  • Set up support structures for pipelines running in production
  • Monitor and debug critical issues such as data staleness or data quality
  • Improve performance of data pipelines (latency, resource usage)
  • Design and implement an ontology based on business requirements and available data
  • Provide data engineering context for application development

Requirements:

  • Generative AI on AWS such as Amazon Bedrock, Amazon SageMaker, Amazon EC2, Amazon EC2 UltraClusters, AWS Trainium or AWS Inferentia
  • Python – complete language proficiency 
  • SQL – proficiency in querying language (join types, filtering, aggregation) and data modeling (relationship types, constraints)
  • PySpark – basic familiarity (DataFrame operations, PySpark SQL functions) and differences with other DataFrame implementations (Pandas)
  • Distributed compute – conceptual knowledge of Hadoop and Spark (driver, executors, partitions)
  • Databases – general familiarity with common relational database models and proprietary instantiations, such as SAP, Salesforce etc.
  • Git – knowledge of version control / collaboration workflows and best practices
  • Iterative working – familiarity with agile and iterative working methodology and rapid user feedback gathering concepts
  • Data quality – best practices

  • Data Architect

    5 days ago


    Addison, United States NTT DATA Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join...

  • Data Architect

    7 days ago


    Addison, United States NTT DATA Full time

    Req ID: 277689 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Addison, Texas (US-TX), United States (US). NTT Data Americas is Hiring!...

  • Data Architect

    4 days ago


    Addison, United States NTT DATA Full time

    Req ID: 277689 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Architect to join our team in Addison, Texas (US-TX), United States (US).NTT Data Americas is Hiring!This...


  • Addison, United States NTT DATA Full time

    Req ID: 277688 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Enterprise Architect - Data to join our team in Addison, Texas (US-TX), United States (US). NTT Data Americas...

  • Data Architect

    7 days ago


    Addison, United States NTT DATA Services Full time

    Req ID: 277689  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Architect to join our team in Addison, Texas (US-TX), United States (US).   NTT...


  • Addison, United States NTT DATA Services Full time

    Req ID: 277688  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Enterprise Architect - Data to join our team in Addison, Texas (US-TX), United States...

  • Big Data Developer

    2 weeks ago


    Addison, United States Intellisoft Technologies Full time

    Role: Big Data DeveloperLocation: Hybrid (no exceptions), 3 days on-site in Addison now (But will be moving facilities to Irving next year)**W2 Role and No Visa Sponsorship** Here are the qualification notes: Part of the data solutions group. His team works with different orgs. Delivering data assets. Support one of those assets Specific for delivering for...

  • Big Data Developer

    2 weeks ago


    Addison, United States Intellisoft Technologies Full time

    Role: Big Data DeveloperLocation: Hybrid (no exceptions), 3 days on-site in Addison now (But will be moving facilities to Irving next year)**W2 Role and No Visa Sponsorship** Here are the qualification notes: Part of the data solutions group. His team works with different orgs. Delivering data assets. Support one of those assets Specific for delivering for...

  • Data Scientist

    2 days ago


    Addison, United States Axelon Services Corporation Full time

    Job Title: Data Scientist (NLP) (Hybrid/ 3 days onsite) Location: Addison, TX, or Charlotte, NC Job Overview: The Enterprise Complaints Operations and Enablement – Reporting and Analytics AI team designs and develops AI automation machine learning solutions that drive daily business decisions. Qualified individuals should have a keen interest in...

  • Software Engineer 4

    5 days ago


    Addison, United States Experis Full time

    Title: Data Engineer Location(s): Addison, TX or Irving, TX or Charlotte, NC Industry: Financial Services Employment Terms: 12+ months (W2) Position Overview: Seeking an experienced Data Engineer to support a high visibility program: enterprise data assets program, to support finance transformation program, main goal is to aggregate data from...

  • Software Engineer 4

    5 days ago


    Addison, United States Manpower Group Inc. Full time

    Title: Data Engineer Location(s): Addison, TX or Irving, TX or Charlotte, NC Industry: Financial Services Employment Terms: 12+ months (W2) Position Overview: Seeking an experienced Data Engineer to support a high visibility program: enterprise data assets program, to support finance transformation program, main goal is to aggregate data from various system,...

  • ML Engineer

    2 weeks ago


    Addison, United States Resolve Tech Solutions Full time

    Responsibilities: •Develop machine learning models and algorithms to address business needs. •Collaborate with data scientists and software engineers to design and implement scalable and efficient solutions. •Clean, preprocess, and analyze large datasets to extract meaningful insights. •Deploy machine learning models into production environments and...

  • Software Engineer 4

    5 days ago


    Addison, United States Experis Full time

    Title: Data EngineerLocation(s): Addison, TX or Irving, TX or Charlotte, NCIndustry: Financial ServicesEmployment Terms: 12+ months (W2) Position Overview: Seeking an experienced Data Engineer to support a high visibility program: enterprise data assets program, to support finance transformation program, main goal is to aggregate data from various system,...


  • Addison, United States Amsin LLC Full time

    We have a Controls Engineer position available in our Addison, TX office. This position requires demonstrated technical proficiency in implementing automation solutions with PLC, HMI, SCADA, and DCS/Delta V platforms.This person will interact directly with the customer and lead a team of engineers in identifying requirements, developing specifications, and...

  • SOAR Engineer

    7 days ago


    Addison, United States Apex Systems Full time

    Apex Systems is looking to hire a SOAR Engineer for one of their reputable financial clients.Position: Soar Engineer Pay Rate: 70-80/hr W2This role is Hybrid 3x per week onsite in Chicago IL, Addison TX, Charlotte NC, Denver COTop requirements: 2+ years of hands-on experience in SOAR, including writing playbooks and troubleshooting.2+ years of hands-on...

  • Linux Engineer

    3 weeks ago


    Addison, United States HexaQuEST Global, Inc. Full time

    The Systems Engineer will support technology solutions for the Wholesale Credit business objectives. Candidate must have broad experience in linux administration for implementation of cloud-based architectures within the bank environment. The System Engineer will use their linux skills and be involved in all aspects of resolution and remediation for the...

  • SOAR Engineer

    1 week ago


    Addison, United States Apex Systems Full time

    Apex Systems is looking to hire a SOAR Engineer for one of their reputable financial clients.Position: Soar Engineer Pay Rate: 70-80/hr W2This role is Hybrid 3x per week onsite in Chicago IL, Addison TX, Charlotte NC, Denver COTop requirements: 2+ years of hands-on experience in SOAR, including writing playbooks and troubleshooting.2+ years of hands-on...

  • Linux Engineer

    3 weeks ago


    Addison, United States HexaQuEST Global, Inc. Full time

    The Systems Engineer will support technology solutions for the Wholesale Credit business objectives. Candidate must have broad experience in linux administration for implementation of cloud-based architectures within the bank environment. The System Engineer will use their linux skills and be involved in all aspects of resolution and remediation for the...

  • Big Data Engineer

    2 weeks ago


    Addison, United States Motion Recruitment Full time

    Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Hadoop Developer with Java in Addison, TX (Hybrid). Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for...

  • Systems Engineer

    2 weeks ago


    Addison, United States Collabera Full time

    Description Home Search Jobs Job Description Systems Engineer Contract: Addison, Texas, US Salary: $74.00 Per Hour Job Code: 348536 End Date: 2024-05-22 Days Left: 1 days, 3 hours left Apply Company: BankingJob Title: SSO System s EngineerDuration: 12-month contract (High chance of extension)Location: Addison, TX 75001 / Chicago, IL, Denver, CO Hybrid...