Data Engineer
1 week ago
ATTENTION MILITARY AFFILIATED JOB SEEKERS - Our organization works with partner companies to source qualified talent for their open roles. The following position is available to Veterans, Transitioning Military, National Guard and Reserve Members, Military Spouses, Wounded Warriors, and their Caregivers. If you have the required skill set, education requirements, and experience, please click the submit button and follow the next steps.
As a Data Engineer, you will play a crucial role in the evolution of our data platform, support the activation of AI capabilities across the team, and build data products and self-service solutions for the users of our data platform.
This role requires being in the office 3 days/week on Tues - Thurs.
This position does not offer immigration sponsorship (current or future) including F-1 STEM OPT extension support.
What you'll do:
Build complex batch and streaming pipelines to ingest data from upstream Equifax cloud systems.
Design and implement data engineering frameworks to scale the development and deployment of data pipelines across the D&A organization.
Leverage AI-powered coding assistants to accelerate development, optimize code, and generate documentation for data pipelines and infrastructure.
Develop and refine prompts for Large Language Models (LLMs) to assist in data-related tasks such as data cleansing, transformation logic generation, and automated data documentation.
Design, build, and maintain scalable data pipelines that support AI/ML applications.
Additional Qualifications/Responsibilities
Minimum Qualifications:
At least 5 years of experience in data engineering, data architecture, or a related field.
A strong understanding of data engineering principles and best practices, including data modeling, data warehousing, and data integration.
At least 1 year of experience working in a GCP big data environment.
Experience building complex data pipelines and solutions using two or more of the following: BigQuery, DataFlow, DataProc, Pub/Sub, Cloud Functions.
Experience with Airflow or Cloud Composer.
Experience with Vertex AI.
Proficiency in Python development.
Professional experience with SQL.
Proven ability to effectively communicate complex technical concepts to both technical and non-technical stakeholders.
A Bachelor's degree or higher in Computer Science, Information Systems, or a related field.
Preferred Qualifications:
Demonstrated experience with prompt engineering to interact with and guide AI models for optimal outputs.
Hands-on experience with AI-assisted coding tools
Familiarity with frameworks for building AI applications or agents (e.g., LangChain, LlamaIndex).
Experience integrating AI services and models into data pipelines via APIs
DevOps/CICD experience (Jenkins and GitHub) and IaC experience using Terraform for managing GCP infrastructure.
GCP Associate Cloud Engineer or Professional Data Engineer certification.
-
Data Engineer
1 week ago
St Louis, MO, United States Equifax Full timeEquifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you. Equifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with...
-
Data Engineer
11 hours ago
St Louis, MO, United States Saxon Global Full timeWe are seeking a highly skilled and motivated Data Engineer with specialized expertise in the Adobe Experience Platform (AEP). The ideal candidate will possess a deep understanding of AEP's architecture, strong hands-on experience with Data Distiller, and a broader background in modern data engineering technologies such as Databricks, GraphQL, Snowflake, and...
-
Data Engineer
2 weeks ago
St Louis, MO, United States Saxon Global Full timeWe are seeking a highly skilled and motivated Data Engineer with specialized expertise in the Adobe Experience Platform (AEP). The ideal candidate will possess a deep understanding of AEP's architecture, strong hands-on experience with Data Distiller, and a broader background in modern data engineering technologies such as Databricks, GraphQL, Snowflake, and...
-
Data Engineer
2 days ago
St Louis, MO, United States Saxon Global Full timeWe are seeking a highly skilled and motivated Data Engineer with specialized expertise in the Adobe Experience Platform (AEP). The ideal candidate will possess a deep understanding of AEP's architecture, strong hands-on experience with Data Distiller, and a broader background in modern data engineering technologies such as Databricks, GraphQL, Snowflake, and...
-
Data Engineer
11 hours ago
St Louis, MO, United States Diverse Lynx Full timeCompetencies: Digital : Microsoft Azure, Digital : Application Programming Interface (API), Digital : Python for Data Science, Digital : Databricks Technical/Functional Skills • 1+ years of experience working with Matillion • 5+ years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools • 2+ years of developing and supporting a...
-
Data Engineer
2 weeks ago
St Louis, MO, United States Diverse Lynx Full timeCompetencies: Digital : Microsoft Azure, Digital : Application Programming Interface (API), Digital : Python for Data Science, Digital : Databricks Technical/Functional Skills • 1+ years of experience working with Matillion • 5+ years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools • 2+ years of developing and supporting a...
-
Data Engineer
1 week ago
St Louis, MO, United States Diverse Lynx Full timeCompetencies: Digital : Microsoft Azure, Digital : Application Programming Interface (API), Digital : Python for Data Science, Digital : Databricks Technical/Functional Skills • 1+ years of experience working with Matillion • 5+ years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools • 2+ years of developing and supporting a...
-
Data Engineer
2 weeks ago
St Louis, MO, United States Diverse Lynx Full timeCompetencies: Digital : Microsoft Azure, Digital : Application Programming Interface (API), Digital : Python for Data Science, Digital : Databricks Technical/Functional Skills • 1+ years of experience working with Matillion • 5+ years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools • 2+ years of developing and supporting a...
-
Data Engineer
2 days ago
St Louis, MO, United States Diverse Lynx Full timeCompetencies: Digital : Microsoft Azure, Digital : Application Programming Interface (API), Digital : Python for Data Science, Digital : Databricks Technical/Functional Skills • 1+ years of experience working with Matillion • 5+ years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools • 2+ years of developing and supporting a...
-
Sr Data Engineer
15 hours ago
St Louis, MO, United States TechDigital Corporation Full timeData Engineer The Data Engineer will work iteratively on the cloud platform to design, develop and implement scalable, high performance solutions that offer measurable business value to customers. Data Solutions: Design and implementation of data pipelines using GCP services. Manage Deployments with Helm and Kubernetes: Oversee containerized deployments of...
