Lead Big Data Engineer

2 weeks ago

Atlanta, GA, United States Vimerse InfoTech Inc Full time
Job Title: Lead Data Engineer

Location: Atlanta, GA (Hybrid) - 2-3 days a week in office, Day 1 onsite.

Job Description
  • Your role will actively lead the Data Operations Team, in maintaining & operating our data platform capabilities & establishing frameworks to make our data products become optimized and scalable.
  • You will play a critical role in ensuring the smooth and efficient operations of data management and analytics processes within the organization, overseeing data operations, implementing frameworks & standards, and providing continuous improvement in data-related workflows.
  • Oversee the day-to-day operations including monitoring, data observability, data ingestion, regular checks for issues, anomalies, and bottlenecks & issue resolution
  • Support the team to take the capabilities of the platforms and put them into an operational practice
  • Collaborate with cross-functional teams, including data engineers, data scientists, business analysts, and IT teams, to understand data requirements and ensure data operations meet business needs
  • Collaborate with the data engineering team to optimize data workflows and ensure efficient data operations
  • Implement monitoring systems and processes to track the performance and observability of data
  • Identify bottlenecks, and proactively address performance issues to ensure high availability and responsiveness
  • Lead data incident management processes, including data outages, breaches, or data-related disruptions
  • Evaluate, select, and implement data management tools and infrastructure that support efficient data operations
  • Stay up-to-date with emerging cloud technologies and best practices in data management and operations to enhance data capabilities
  • Identify opportunities for innovation and promote initiatives to enhance the data platform's capabilities and efficiency
  • Create and maintain comprehensive documentation, including data operation processes, standard operating procedures, and best practices
  • Design, implement, and sustain a DataOps framework, facilitate cross-team collaboration, optimize processes & tools, leverage testing automation
  • Mentor, monitor, and grow, including performance management of individual contributors
Qualifications
  • 15+ years of experience in Data and Analytics in various roles where you have demonstrated the ability to collect, organize, analyze, and disseminate information
  • 3+ years of experience in leading Data & Analytics Teams; experience in handling and leading teams, providing a collaborative and inclusive work environment
  • Extensive experience in data operations, data management, or related roles
  • Experience with data monitoring and performance optimization techniques
  • Good experience in data operations, cloud infrastructure management, or data engineering roles, especially in a cloud-based environment
  • In-depth knowledge of cloud platforms, AWS and related services for data storage, data processing, and infrastructure provisioning
  • Tech Stack: AWS, Python, Snowflake

  • Big Data Engineer

    2 days ago

    Atlanta, GA, United States Nava Software Solutions Full time

    NAVA Software solutions is looking for a Big Data Engineer Details: Big Data Engineer Location: Atlanta GA - Hybrid Duration: 12 months Job Description The successful candidate must have Big Data engineering experience and must demonstrate an affinity for working with others to create successful solutions. Join a smart, highly skilled team with a passion for...

  • Lead Data Engineer

    7 hours ago

    Atlanta, GA, United States MasterCard Full time

    Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...

  • Lead Data Engineer

    1 week ago

    Atlanta, GA, United States Publicis Groupe Holdings B.V Full time

    Company description PubW is a bespoke business unit set up to bring the full power of the Publicis Groupe together to support Walmart's media and data needs. Through our Power of One model, we put Walmart at the center bringing together specialists in strategy, media investment, data, influencers, commerce, and content delivering a highly connected,...

  • Data Platform Team Lead

    1 week ago

    Atlanta, GA, United States ViaSat Full time

    About usOne team. Global challenges. Infinite opportunities. At Viasat, we're on a mission to deliver connections with the capacity to change the world. For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries around the globe communicate. We're looking for people who think big, act fearlessly, and create an...

  • Data Engineer

    1 week ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    1 week ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Data Engineer

    10 hours ago

    Atlanta, GA, United States NTT DATA North America Full time

    Data Engineer (ETL DataStage) - 25-06063 Location - Atlanta, GA (Hybrid/Onsite - Mon, Wed, Thur - 9am to 6pm EST) Duration - 1yr+ W2 or C2C *2 Interviews / 2nd is In-Person Job duties : Design, develop, automate, and support complex applications to extract, transform, and load data; Implement and automate complex processes; Plan and conduct ETL unit and...

  • Senior Software Engineer, Data Engineering

    4 days ago

    Atlanta, GA, United States Omada Health Full time

    Senior Software Engineer, Data Engineering Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time. Job overview: We are dedicated to leveraging data to drive strategic decision-making and operational efficiency. Our team is passionate about harnessing the power of data to solve complex problems and deliver impactful...

  • Senior Software Engineer, Data Engineering

    3 hours ago

    Atlanta, GA, United States Omada Health Full time

    Senior Software Engineer, Data Engineering Omada Health is on a mission to inspire and engage people in lifelong health, one step at a time. Job overview: We are dedicated to leveraging data to drive strategic decision-making and operational efficiency. Our team is passionate about harnessing the power of data to solve complex problems and deliver impactful...

  • Data Engineer

    2 weeks ago

    Atlanta, GA, United States iVoyant Full time

    About the job Data Engineer iVoyant is looking for multiple Data Engineers to join our client Digital Team. The Data Engineers will work with the client functional SMEs within the Digital and the Business team to understand the requirements and prepare technical design. They will ensure the availability and validity of the data to ensure that it fits with...