Spark Data Engineer

2 weeks ago


Alpharetta, United States Diverse Lynx Full time
JD Description:

Someone with experience on scala/spark skillset or java/spark.

Job Functions/Duties and Responsibilities:
Design & Development Enterprise scale ETL process for doing Data Ingestion, Transformation and Distribution integrating with multiple systems.
Perform Business analysis along with BA/QA's to ensure requirements documented, and implemented in Scala language.
Collaborating with multiple technology teams that are upstream and downstream to the application such as Books & Records System, Pricing System, Data Warehouse
Working in the Agile development methodologies, collaborating with business and technology teams located globally.

Skills Required:
Self-starter who is proficient in development with Process Development, Headless REST APIs, JAVA, JEE, Spring, Git and other Frameworks with experience in guiding Project teams with full life cycle of development/design and requirements gathering
Significant programming experience in a structured software development environment
Build strategic generic tech solutions that can be reused and leveraged across business areas
Possess framework mindset, in terms of building components/libraries that can be easily ported/integrated/upgraded with minimal effort by various applications
The candidate will interact with a diverse set of teams, including developers, business analysts, quality assurance, infrastructure, user communities, and senior management
Must have experience with Java/J2EE with a deep understanding of the language and core API's, web services, multi-threaded/concurrent programming, JSON, design patterns, Service Oriented Architecture
Must be able to demonstrate significant relevant work experience, or had experience of several major technology implementation projects
Code, conduct code reviews, participate in design discussions and contribute to the architecture process
Must have 8+ Years of experience on Java and related frameworks
Must have 3+ Years of Hands-on experience with Spring framework including Spring Boot, Spring Security, Spring Batch
3-5 years of hands-on experience of Apache Spark, Hadoop, Hive, and related ecosystem.
Working Experience on Autosys for scheduling jobs or any other similar scheduling platform.
Excellent knowledge of Scala EE & Unit/Integration Testing Frameworks for Scala.
Experience and very good understanding of Design Patterns.
Good understanding of DevOps practices and tooling.
Experience in understanding of requirements of large enterprise applications (security, entitlements etc.).
Experience working in Agile development methodologies.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  • Big Data Engineer

    2 weeks ago


    Alpharetta, United States HCL Global Systems Full time

    JD Extract, Transform and Load data from multiple sources and multiple formats using Big Data Technologies. Development, enhancement, and support of data ingestion jobs from various source systems following existing design patterns using GCP Services such as Apache Spark, Dataproc, Dataflow, BigQuery, Airflow, etc. Work across Teams and senior engineers...

  • Senior Data Engineer

    2 months ago


    Alpharetta, United States Visionaire Partners Full time

    Senior Data Engineer We seek a Senior Data Engineer for an exciting new opportunity! You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernization across an enterprise. We need a candidate who is very experienced data...

  • Senior Data Engineer

    2 months ago


    Alpharetta, United States Visionaire Partners Full time

    Senior Data Engineer We seek a Senior Data Engineer for an exciting new opportunity! You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernization across an enterprise. We need a candidate who is very experienced data...

  • Senior Data Engineer

    2 months ago


    Alpharetta, United States Visionaire Partners Full time

    Senior Data Engineer We seek a Senior Data Engineer for an exciting new opportunity! You will play a critical role in the design, build and maintenance of scalable data data pipelines DB's, Data Warehouse / Data Lakehouse etc. You will be part of a major technical modernization across an enterprise. We need a candidate who is very experienced data...


  • Alpharetta, United States National Christian Foundation Full time

    Job DescriptionJob DescriptionHeadquartered in Alpharetta, Georgia, National Christian Foundation (NCF) is a 501(c)(3) charitable grantmaking ministry that provides creative giving solutions and inspires biblical generosity among Christian families, advisors, and charities. NCF has received more than $26 billion in contributions and made more than $18...


  • Alpharetta, United States Equifax Full time

    Seeking a thought leader and organizational change agent for Equifax's Data Fabric platform. This individual will be passionate about end-user experience and best in class engineering excellence to lead the data operations and support function. As a leader in Data Operations, you will oversee a portfolio encompassing data engineering, data analytics &...


  • Alpharetta, United States Equifax Full time

    Seeking a thought leader and organizational change agent for Equifax's Data Fabric platform. This individual will be passionate about end-user experience and best in class engineering excellence to lead the data operations and support function. As a leader in Data Operations, you will oversee a portfolio encompassing data engineering, data analytics &...

  • Big Data Engineer

    2 weeks ago


    Alpharetta, United States CapB InfoteK Full time

    We are looking for a Big Data Engineer for our long-term multiyear project out of Alpharetta, GA. (Remote till COVID).Responsibilities: 5-10 years of hands on experience working with Hadoop and Informatica power center. Experience in Hadoop ecosystem and experience in applying them to practical problems in Hive, Impala and Spark. Strong knowledge of...

  • Data Analyst II

    2 months ago


    Alpharetta, United States LexisNexis Risk Solutions Full time

    Data Analyst IIMust be able to work in Alpharetta Georgia 2+ days per week. About the BusinessLexisNexis® Risk Solutions provides customers with solutions and decision tools that combine public and industry specific content with advanced technology and analytics to assist them in evaluating and predicting risk and enhancing operational efficiency. We use...

  • Data Engineer

    2 weeks ago


    Alpharetta, United States LocumTenens.com Full time

    JOB DESCRIPTION:The Data Engineer is responsible for supporting and developing LocumTenens.com’s business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT’s data lake as needed to meet LT business and...

  • Data Engineer

    2 days ago


    Alpharetta, United States LocumTenens.com Full time

    JOB DESCRIPTION:The Data Engineer is responsible for supporting and developing LocumTenens.com’s business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT’s data lake as needed to meet LT business and...

  • Data Engineer

    2 weeks ago


    Alpharetta, United States LocumTenens.com Full time

    JOB DESCRIPTION:The Data Engineer is responsible for supporting and developing LocumTenens.com’s business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT’s data lake as needed to meet LT business and...

  • Data Engineer

    2 weeks ago


    Alpharetta, United States LocumTenens.com Full time

    JOB DESCRIPTION:The Data Engineer is responsible for supporting and developing LocumTenens.com’s business applications, utilizing multiple technologies as required by the business. The role works to design and implement efficient and effective data pipelines between various LT systems and to/from LT’s data lake as needed to meet LT business and...


  • Alpharetta, United States CEDENT Full time

    Title: Associate Director, Data Engineering @ Alpharetta , GA Terms of Hire: Full Time. Salary: $Open + Benefits. Job description As Associate Director - Data Engineering, you will be responsible for continuing to build and managing a high-performing Data Engineering team, Associate Director of Data Engineering is responsible for the implementation of the...

  • ML Ops Engineer

    2 weeks ago


    Alpharetta, United States Cedent Consulting Full time

    Title: ML Ops Engineer @ Alpharetta , GA Terms of Hire: Full time Job description: ML Ops Engineer with 5-8 years of experience who will be responsible for taking Data Science models and scaling them out to production by creating DevOps pipelines that automate the data collection, prep, transform, analyze, experiment, train, validate, serve, monitor, etc....


  • Alpharetta, United States ATech Placement Full time

    We are looking for a skilled and motivated Machine Learning Engineer to join our team. As a Machine Learning Engineer, you will be responsible for designing, developing, and implementing machine learning models and algorithms to solve complex problems and enhance our products and services. Your expertise will be critical in driving innovation and improving...


  • Alpharetta, United States Equifax, Inc. Full time

    Lead a global engineering team, manage all day-to-day data engineering and data operations on the Data Fabric platform globally, ensuring optimum end-user experience and business continuity whilst mitigating risks and meeting delivery milestones Own Leader, Operations, Manager, Engineer, Data, Leadership, Technology

  • Azure Data Engineer

    4 days ago


    Alpharetta, United States PamTen Full time

    Project description We are seeking a highly skilled and experienced Senior Developer specializing in Data Engineering to join our technology-driven team. The ideal candidate will have significant hands-on expertise in Data Factory, Databricks, and a strong background in designing, building, managing, and deploying enterprise-level data architectures...


  • Alpharetta, United States JobRialto Full time

    Developed Plugins/Macros on Dataiku using Python. Designed, Developed the core platform on premise Hadoop cluster, Snowflake connect of dataiku application. Introduced Snowpark and SnowConvert as part of Hadoop to Snowflake migration. Platform engineering and Stabilization of the application and the processes running on it. Written Linux Ksh scripts to run...


  • Alpharetta, United States Penn Foster Inc Full time

    Every day, Global Payments makes it possible for millions of people to move money between buyers and sellers using our payments solutions for credit, debit, prepaid and merchant services. Our worldwide team helps over 3 million companies, more than 1,300 financial institutions and over 600 million cardholders grow with confidence and achieve amazing results....