Data Engineer, Python

7 days ago

Washington, United States Credera Full time

REMOTE ROLE for Contractor anywhere in N. America ** 12 month contract and possible extension ** Rate = $65 - 80/hr USD Based On Experience

Description:

Data Engineers at TA Digital work closely with Subject Matter Experts (SMEs) to design the ontology (data model), develop data pipelines, and integrate Foundry with external systems containing the data. Data engineers also need to provide guidance and support on how to access and leverage the data foundation to create new workflows or analyze data.

Responsibilities Include:

Leverage Generative AI on AWS data Integrate new data sources to Foundry using Data Connection Implement 2-way integrations between Foundry and external systems Develop pipelines transforming tabular or unstructured data Implement data transformations in PySpark / PySpark SQL to derive new datasets or create ontology objects Set up support structures for pipelines running in production Monitor and debug critical issues such as data staleness or data quality Improve performance of data pipelines (latency, resource usage) Design and implement an ontology based on business requirements and available data Provide data engineering context for application development

Requirements:

Generative AI on AWS such as Amazon Bedrock, Amazon SageMaker, Amazon EC2, Amazon EC2 UltraClusters, AWS Trainium or AWS Inferentia Python – complete language proficiency SQL – proficiency in querying language (join types, filtering, aggregation) and data modeling (relationship types, constraints) PySpark – basic familiarity (DataFrame operations, PySpark SQL functions) and differences with other DataFrame implementations (Pandas) Distributed compute – conceptual knowledge of Hadoop and Spark (driver, executors, partitions) Databases – general familiarity with common relational database models and proprietary instantiations, such as SAP, Salesforce etc. Git – knowledge of version control / collaboration workflows and best practices Iterative working – familiarity with agile and iterative working methodology and rapid user feedback gathering concepts Data quality – best practices

#J-18808-Ljbffr

  • AWS Python Developer with Data Experience

    2 weeks ago

    Washington, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, SES, is seeking the following. Apply via Dice today! Data Engineer - The candidate will be working as part of scrum team with PO, Scrum Master, Tech Lead and several developers & testers, DevOps resources to move the OnPrem application to AWS Cloud. Will be...

  • Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Bates White Full time

    Bates White seeks a Data Engineer in Washington, DC to use programming skills to create big data pipelines that can deal with both structured and unstructured data. Understand new big data technologies where required and implement it in a project. Support other teams by effectively using data tools and providing guidance for writing efficient code in R,...

  • Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Bates White Full time

    Bates White seeks a Data Engineer in Washington, DC to use programming skills to create big data pipelines that can deal with both structured and unstructured data. Understand new big data technologies where required and implement it in a project. Support other teams by effectively using data tools and providing guidance for writing efficient code in R,...

  • AWS System Developer with Data Experience and Python

    4 weeks ago

    Washington, United States Dice Full time

    Dice is the leading career destination for tech experts at every stage of their careers. Our client, SES, is seeking the following. Apply via Dice today! Data Engineer - The candidate will be working as part of scrum team with PO, Scrum Master, Tech Lead and several developers & testers, DevOps resources to move the OnPrem application to AWS Cloud. Will be...

  • Python Software Engineer

    1 month ago

    Washington, United States Dynanet Full time

    Job Type Full-time Description Company Overview: Dynanet is a distinguished IT systems integrator that has been at the forefront of the industry for over 25 years. We're in search of an Experienced Python Software Engineer, well-versed in Python, Django, JavaScript, and UI/UX, to play a pivotal role in our team. The ideal candidate will bring expertise in...

  • SAS to Python Data Analyst

    6 days ago

    Washington, United States Automation Technologies Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed. Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters Job Overview Job ID: J38608 Specialized Area: Python Job Title: SAS to Python Data...

  • Data Engineer

    3 weeks ago

    Washington, United States Barbaricum Full time

    Barbaricum is seeking a skilled Data Engineer to aid in the development of a robust Mission Assurance risk management process and data platform within the Envision Enterprise Data Platform. The ideal candidate will contribute to the creation of a comprehensive system capable of facilitating risk response development, tracking, and sharing of actionable data,...

  • Data Engineer

    6 days ago

    Washington, United States Ensemble IP Full time

    Job DescriptionJob DescriptionSalary: We are…  We are Ensemble IP, a forward-thinking team of IP Industry veterans building an AI-centric approach to patent search and analysis.  We believe that the highest quality search is the result of the right technical expert using the right search techniques and the right technology.  We are introducing...

  • Data Engineer

    1 month ago

    Washington, Washington, D.C., United States Analytica Full time

    Analytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data modernization. Analytica has been recognized by Inc. Magazine as one of the...

  • Senior Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Bates White Full time

    Bates White seeks a Senior Data Engineer in Washington, DC to design and develop ongoing data ingestion using Python and Spark. Support Requirements Gathering activities, especially from the data migration perspective. Use programming skills to create big data pipelines that can deal with both structured and unstructured data. Support other teams in...

  • Senior Data Engineer

    4 weeks ago

    Washington, Washington, D.C., United States Bates White Full time

    Bates White seeks a Senior Data Engineer in Washington, DC to design and develop ongoing data ingestion using Python and Spark. Support Requirements Gathering activities, especially from the data migration perspective. Use programming skills to create big data pipelines that can deal with both structured and unstructured data. Support other teams in...

  • Data Engineer

    3 weeks ago

    Washington, United States Analytica Full time

    Analytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data modernization. Analytica has been recognized byInc. Magazineas one of the...

  • Data Engineer

    3 weeks ago

    Washington, United States Analytica Full time

    Analytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data modernization.? Analytica has been recognized by?Inc. Magazine?as one of the...

  • Data Engineer

    1 month ago

    Washington, United States Middle Seat Full time

    Job DescriptionJob DescriptionMiddle Seat is a full-service media and fundraising firm. We support campaigns, organizations, and causes fighting for racial justice, climate action, immigrant rights, intersectional feminism, economic justice, and more. Our work includes advertising, fundraising, development, creative, organizing, and strategy.About the RoleAs...

  • Data Engineer

    4 weeks ago

    Washington, United States Middle Seat Full time

    Middle Seat is a full-service media and fundraising firm. We support campaigns, organizations, and causes fighting for racial justice, climate action, immigrant rights, intersectional feminism, economic justice, and more. Our work includes advertising, fundraising, development, creative, organizing, and strategy. About the Role As a Data Engineer at Middle...

  • Data Engineer

    4 weeks ago

    Washington, United States Middle Seat Full time

    Middle Seat is a full-service media and fundraising firm. We support campaigns, organizations, and causes fighting for racial justice, climate action, immigrant rights, intersectional feminism, economic justice, and more. Our work includes advertising, fundraising, development, creative, organizing, and strategy. About the Role As a Data Engineer at Middle...

  • Data Engineer

    4 weeks ago

    Washington, United States Middle Seat Full time

    Job DescriptionJob DescriptionMiddle Seat is a full-service media and fundraising firm. We support campaigns, organizations, and causes fighting for racial justice, climate action, immigrant rights, intersectional feminism, economic justice, and more. Our work includes advertising, fundraising, development, creative, organizing, and strategy.About the RoleAs...

  • Data Engineer

    1 month ago

    Washington, United States Analytica Full time

    Job DescriptionJob DescriptionAnalytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data modernization.  Analytica has been recognized...

  • Data Engineer

    1 week ago

    Washington, United States Analytica Full time

    Job DescriptionJob DescriptionAnalytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data modernization.  Analytica has been recognized...

  • Data Engineer

    4 weeks ago

    Washington, United States Analytica Full time

    Job DescriptionJob DescriptionAnalytica is seeking a remote Data Engineer (MLOps) to support one or more dynamic, long-term federal government enterprise data programs. The ideal candidate will lead the architecture and implementation of on-premises and cloud big data solutions as part of enterprise data modernization.  Analytica has been recognized...