Data Engineer, Python

3 weeks ago


Dallas, United States Credera Experienced Hiring Job Board Full time
** REMOTE ROLE for Contractor anywhere in N. America **

** 12 month contract and possible extension **

** Rate = $65 - 80/hr USD Based On Experience

Description:

Data Engineers at TA Digital work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate Foundry with external systems containing the data. Data engineers also need to provide guidance and support on how to access and leverage the data foundation to create new workflows or analyze data.

Responsibilities Include:
  • Leverage Generative AI on AWS data
  • Integrate new data sources to Foundry using Data Connection
  • Implement 2-way integrations between Foundry and external systems
  • Develop pipelines transforming tabular or unstructured data
  • Implement data transformations in PySpark / PySpark SQL to derive new datasets or create ontology objects
  • Set up support structures for pipelines running in production
  • Monitor and debug critical issues such as data staleness or data quality
  • Improve performance of data pipelines (latency, resource usage)
  • Design and implement an ontology based on business requirements and available data
  • Provide data engineering context for application development
Requirements:
  • Generative AI on AWS such as Amazon Bedrock, Amazon SageMaker, Amazon EC2, Amazon EC2 UltraClusters, AWS Trainium or AWS Inferentia
  • Python - complete language proficiency
  • SQL - proficiency in querying language (join types, filtering, aggregation) and data modeling (relationship types, constraints)
  • PySpark - basic familiarity (DataFrame operations, PySpark SQL functions) and differences with other DataFrame implementations (Pandas)
  • Distributed compute - conceptual knowledge of Hadoop and Spark (driver, executors, partitions)
  • Databases - general familiarity with common relational database models and proprietary instantiations, such as SAP, Salesforce etc.
  • Git - knowledge of version control / collaboration workflows and best practices
  • Iterative working - familiarity with agile and iterative working methodology and rapid user feedback gathering concepts
  • Data quality - best practices


  • Dallas, United States Siri InfoSolutions Inc Full time

    Job DescriptionJob DescriptionTitle: Data Scientist with PythonLocation: Dallas, TX Onsite)Duration: Long TermContract RoleSkill Set:Python, Data Science, CodingMust Have Skills:Python, Data Science, Coding, Machine Learning, Supervised Learning, Unsupervised Learning, Reinforcement learning, Communication SkillsJob Description:Python (Data Science,...

  • Python Engineer

    4 days ago


    Dallas, United States Motion Recruitment Partners LLC Full time

    Job Description A leader in the Data Analytics space is looking for a Python Engineer for their Houston, TX office. As a pioneering force in the data analytics industry, they empower organizations worldwide to make informed decisions, drive growth, and stay ahead in today's competitive landscape. Their innovative solutions and cutting-edge technologies...

  • Python Engineer

    2 weeks ago


    Dallas, United States Motion Recruitment Full time

    Job Description A leader in the Data Analytics space is looking for a Python Engineer for their Houston, TX office. As a pioneering force in the data analytics industry, they empower organizations worldwide to make informed decisions, drive growth, and stay ahead in today's competitive landscape. Their innovative solutions and cutting-edge technologies...


  • Dallas, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...


  • Dallas, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...


  • Dallas, United States Selby Jennings Full time

    Must be based in Dallas, TXOur client is unable to offer work authorization sponsorship now or in the future.No C2CSelby Jennings is exclusively partnered with a financial services firm that provides lending and liquidity solutions to high networth, institutional and individual investors. With a significant capital base exceeding $1B, the firm offers...


  • Dallas, United States Selby Jennings Full time

    Must be based in Dallas, TXOur client is unable to offer work authorization sponsorship now or in the future.No C2CSelby Jennings is exclusively partnered with a financial services firm that provides lending and liquidity solutions to high networth, institutional and individual investors. With a significant capital base exceeding $1B, the firm offers...


  • Dallas, United States Selby Jennings Full time

    Must be based in Dallas, TXOur client is unable to offer work authorization sponsorship at this time.No C2CSelby Jennings is exclusively partnered with a financial services firm that provides lending and liquidity solutions to high networth, institutional and individual investors. With a significant capital base exceeding $1B, the firm offers liquidity...


  • Dallas, United States Selby Jennings Full time

    Must be based in Dallas, TXOur client is unable to offer work authorization sponsorship at this time.No C2CSelby Jennings is exclusively partnered with a financial services firm that provides lending and liquidity solutions to high networth, institutional and individual investors. With a significant capital base exceeding $1B, the firm offers liquidity...


  • Dallas, United States Selby Jennings Full time

    Must be based in Dallas, TXOur client is unable to offer work authorization sponsorship now or in the future.Must be coming from a full-time position (no contractors/C2C)Selby Jennings is exclusively partnered with a financial services firm that provides lending and liquidity solutions to high networth, institutional and individual investors. With a...


  • Dallas, United States Motion Recruitment Partners, LLC Full time

    Job Description A leading provider of natural gas distribution services is looking for a Senior Python Engineer for their Dallas, TX office. This company is dedicated to innovation and sustainability, leveraging advanced technologies to enhance operational efficiency while prioritizing environmental stewardship and community well-being. As a Python...


  • Dallas, United States Motion Recruitment Full time

    Job Description A leading provider of natural gas distribution services is looking for a Senior Python Engineer for their Dallas, TX office. This company is dedicated to innovation and sustainability, leveraging advanced technologies to enhance operational efficiency while prioritizing environmental stewardship and community well-being. As a Python...

  • python

    2 months ago


    Dallas, United States TopEdge Technology Full time

    Key Skills pythonPositions Contract W2Our client is having an immediate position for Data Science Engineer with Python for a contract position.Below are the details of the requirement.Role Data Science EngineerPrimary Responsibilities-Design machine learning systems to automate predictive models.-Develop ML algorithms to analyze historical data to...

  • Data Technical Lead

    7 hours ago


    Dallas, United States NTT DATA Full time

    Company Overview: Req ID: 279236 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Technical Lead (Apache Spark, Pyspark and Databricks) to join our team in Dallas, Texas...

  • Data Engineer

    7 hours ago


    Dallas, United States NTT DATA Full time

    Req ID: 277464 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Dallas to join our team in Dallas, Texas (US-TX), United States (US).NTT Data Americas is...

  • python

    2 months ago


    Dallas, Texas, United States TopEdge Technology Full time

    Key Skills pythonPositions Contract W2Our client is having an immediate position for Data Science Engineer with Python for a contract position.Below are the details of the requirement.Role Data Science EngineerPrimary Responsibilities-Design machine learning systems to automate predictive models.Develop ML algorithms to analyze historical data to make...

  • Data Engineer

    5 days ago


    Dallas, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Dallas to join our team in Dallas, Texas (US-TX), United States (US). NTT Data Americas is Hiring This...


  • Dallas, United States Motion Recruitment Full time

    Job Description A popular company in the realm of energy solutions is looking for a Python Engineer for their Dallas, TX. This company is committed to pioneering environmentally conscious practices while delivering reliable and efficient energy services to communities across the globe. With a focus on harnessing cutting-edge technology and fostering a...


  • Dallas, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Technical Lead (Life/Annuity exp, Databricks Expertise) to join our team in Dallas, Texas (US-TX),...


  • Dallas, Texas, United States NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Technical Lead (Life/Annuity exp, Databricks Expertise) to join our team in Dallas, Texas (US-TX),...