Big Data Engineer

2 days ago


Atlanta, Georgia, United States Diverse Lynx Full time

**About This Role**

">

We are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing big data solutions using Informatica PowerCenter and other related tools.

The estimated salary for this position is $100,000 - $160,000 per year, depending on experience.

**Key Responsibilities:**

  • Design and implement scalable and secure big data integration solutions.
  • Develop and maintain high-quality code to meet company IT standards.
  • Collaborate with cross-functional teams to ensure alignment and successful project delivery.

**Required Skills and Qualifications:**

  • Five or more years' experience in software engineering.
  • Five or more years' experience in large scale RDBMS environments or Google BigQuery.
  • Two or more years of Exadata experience OR Google BigQuery.
  • Four or more years' experience with Informatica PowerCenter or IICS.
  • One or more years experience in Erwin.
  • Experience in code automation (e.g. pattern based integration).
  • Experience in advanced SQL and PL/SQL techniques.
  • Experience in building re-usable Utility packages.
  • Experience with testing the code.
  • Focus on continuous improvement.
  • Experience in Unix shell and Python scripting.
  • Integration design & data modeling skills in Data lake and Data Warehousing environments.
  • Experience with Streaming technologies is a plus( STRIIM, Kafka, etc).
  • Experience with other Informatica tools is plus - e.g., Metadata manager, Analyst, DVO, Data Quality.
  • Exposure to both on-prem and cloud Integration solutions.
  • Familiarity with non-relational DB technologies is a plus.
  • Experience with automated testing.
  • Experience with both batch and real-time patterns for integrations.
  • Ability to build and analyze complex integration workflows from heterogeneous data sources.
  • Experienced in large Enterprise Data Warehouse & Integration projects.
  • Strong background in full lifecycle development using multiple platforms or languages.
  • Ability to interact at a technical and non-technical level with Infrastructure, Network, Development, BA and QA teams.
  • Development experience in high transaction/high availability systems.
  • Experience with analyzing and recommending solutions for Production issues short-term and long term.

Benefits: We offer a competitive salary package, comprehensive benefits, and opportunities for growth and development.


  • Big Data Engineer

    7 days ago


    Atlanta, Georgia, United States Home Depot Management Company, LLC Full time

    Job SummaryThe Big Data Engineer will be responsible for designing, building, and maintaining large-scale data processing systems to support business growth and improve operational efficiency.This role requires strong technical skills, with experience working with big data technologies such as Hadoop and Spark, as well as cloud-based platforms like AWS and...


  • Atlanta, Georgia, United States Warner Bros. Discovery Full time

    Job Title: Big Data Engineer, Cloud ServicesWe are seeking a highly skilled Big Data Engineer, Cloud Services to join our team at Warner Bros. Discovery. The successful candidate will have a strong background in big data engineering and cloud services, with experience in designing and building scalable data platforms using open-source software.About the...


  • Atlanta, Georgia, United States Resource Informatics Group Inc Full time

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team at Resource Informatics Group Inc in Atlanta, GA. The ideal candidate will have a strong background in designing and developing big data solutions using Spark and Java/Scala.About the Role:We are looking for a skilled Sr. Spark Developer with experience on AWS platform.The...


  • Atlanta, Georgia, United States GATE Insight, Inc. Full time

    Job Title: Big Data Solutions ExpertAbout the RoleWe are seeking an experienced Data Engineer to lead our big data initiatives in Atlanta, GA. As a key member of our team, you will design and develop scalable data systems using Spark, Hadoop, and Kafka.Salary Information:The estimated annual salary for this position is $180,000 - $250,000 based on your level...


  • Atlanta, Georgia, United States SysMind Tech Full time

    About SysMind Tech: We are a pioneering technology company dedicated to delivering innovative solutions to businesses globally. With a commitment to excellence and a passion for innovation, we strive to push the boundaries of what is possible.Annual Salary: $120,000Role Description:We are seeking a highly skilled GCP data engineer to join our team and lead...


  • Atlanta, Georgia, United States Lumen Inc Full time

    About UsLumen Inc is a forward-thinking company that is committed to connecting the world through innovative solutions.We believe in providing equal opportunities to all individuals, regardless of their background, and strive to create an inclusive workplace culture.Job SummaryThis role involves providing technical direction in the creation, implementation,...


  • Atlanta, Georgia, United States Lumen Inc Full time

    About Lumen Inc.We are igniting business growth by digitally connecting the world and shaping the future. Our company culture is built from the people up – committed to teamwork, trust and transparency. People power progress.At Lumen, our commitment to workplace inclusion and employee support shines bright. We've made the list of Greatest Workplaces for...

  • Big Data Architect

    17 hours ago


    Atlanta, Georgia, United States Apolis Full time

    About ApolisApolis is a leading provider of big data analytics solutions, empowering businesses to make informed decisions.We are looking for an experienced Big Data Architect - Analytics Solutions to lead our data engineering efforts!About the Role:This role requires expertise in designing and implementing big data architectures, leveraging skills in...


  • Atlanta, Georgia, United States Sensus Full time

    Xylem is a leading global water technology company dedicated to developing innovative solutions for the world's water challenges. With 2017 revenue of $4.7 billion and over 16,500 employees, Xylem operates in more than 150 countries through various market-leading product brands.The name Xylem originates from classical Greek, referring to the tissue that...


  • Atlanta, Georgia, United States Apolis Full time

    Cloud Data EngineerApolis seeks a skilled Cloud Data Engineer with expertise in designing and implementing scalable data pipelines using Apache Kafka and Databricks. The ideal candidate will have at least 2 years of experience in data engineering, with a strong background in AWS and Adobe Analytics.The successful candidate will work closely with...


  • Atlanta, Georgia, United States Tekfortune Inc Full time

    We are seeking a highly skilled Data Engineer - Cloud Computing Expert to join our team in Atlanta, GA. The ideal candidate will have expertise in cloud computing platforms, data modeling, and database management.About Tekfortune IncTekfortune Inc is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services. In this...


  • Atlanta, Georgia, United States Motion Recruitment Full time

    Job Overview">A leading e-commerce company is seeking a seasoned Senior Java Engineer to join their team in Atlanta, Georgia. As a key member of the team, you will be responsible for developing and maintaining a recommendation application that suggests products to consumers based on their purchase history.">About the Role">We are looking for an experienced...

  • Data Engineer

    2 days ago


    Atlanta, Georgia, United States TechnoGen Full time

    At TechnoGen, we are seeking a talented Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data systems.The ideal candidate will have a strong background in computer science, mathematics, or a related field, with experience working with various relational...


  • Atlanta, Georgia, United States Centraprise Full time

    Job Title: Data Engineering LeadWe are seeking a skilled Data Engineering Lead to join our team at Centraprise. This is a fantastic opportunity for someone with experience in designing, building and operationalizing large-scale enterprise data solutions and applications using one or more of GCP data and analytics services. The ideal candidate will have...


  • Atlanta, Georgia, United States ApTask Full time

    About UsAt ApTask, we prioritize safeguarding your privacy. We are committed to fostering a diverse and inclusive work environment, where talented individuals can thrive. Our comprehensive suite of services includes staffing and recruitment solutions, managed services, IT consulting, and project management.Job DescriptionWe are seeking an experienced Azure...


  • Atlanta, Georgia, United States Centraprise Full time

    Job Title: Cloud Native Data EngineerCentraprise is seeking a talented Cloud Native Data Engineer to join our team. This role involves designing, building and operationalizing large-scale enterprise data solutions and applications using one or more of GCP data and analytics services. The successful candidate will have strong technical skills in cloud native...

  • Data Engineer Lead

    2 days ago


    Atlanta, Georgia, United States Lumen Inc Full time

    About UsLumen Inc is a leading technology company that connects the world by igniting business growth through innovative solutions.We are committed to providing equal employment opportunities to all persons regardless of race, color, ancestry, citizenship, national origin, religion, veteran status, disability, genetic characteristic or information, age,...


  • Atlanta, Georgia, United States Warner Bros. Discovery Full time

    About the RoleWe are seeking a highly skilled Cloud Native Big Data Specialist to join our team at Warner Bros. Discovery. As a key member of our Data & Analytics organization, you will be responsible for designing and building big data query platforms using open-source software.Your Key ResponsibilitiesDesign and build big data query platforms using...

  • Lead Data Engineer

    2 days ago


    Atlanta, Georgia, United States Booz Allen Hamilton Full time

    Big Data Engineering Role">We're seeking an experienced Data Engineer Lead to join our team, responsible for leading data engineering activities on mission-driven projects. In this role, you'll oversee the development and deployment of pipelines and platforms that organize and make disparate data meaningful.">Key Responsibilities">Design, build, and maintain...

  • Big Data Processor

    16 hours ago


    Atlanta, Georgia, United States Ampcus Full time

    Job Description:Ampcus Inc. is a leading provider of Technology and Business consulting services. We are seeking a highly skilled Data Engineer to join our team.Key Responsibilities:Ingesting Clickstream data into Databricks using Kafka or SparkWorking with Adobe Analytics dataMaintaining and optimizing data pipelinesRequirements:2+ years of experience in...