Data Engineer

4 days ago

Newark, NJ, United States Equiliem Full time
Data Engineer
We're seeking a Data Engineer who is motivated by variety, is seeking a challenging environment for professional growth, and is interested in supporting large information technology projects for one of our clients in the northeast.

The Data Engineer will build and maintain the infrastructure for the organization's data by designing, constructing, and optimizing data pipelines and architecture.

Location: This position located in Newark, NJ. Ideal candidate must be local to the area and able to go into the office periodically when needed. If not local, they must be willing to travel as needed.

Responsibilities:
  • Ingest data from SAP, Salesforce, Google Analytics, OKTA, and other sources into AWS S3 Raw layer
  • Curate and transform data into standardized datasets in the Curated layer
  • Define and implement data mapping and transformation logic/code and load data into Redshift tables and views for optimal performance
  • Deploy and promote data pipeline code from lower environments (Dev/Test) to Production following Client governance and change control processes
  • Develop and maintain ELT/ETL pipelines using AWS Glue, Step Functions, Lambda, DMS, and AppFlow
  • Automate transformations and model refresh using Python, PySpark and SQL
  • Implement end-to-end source-to-target data integration, mapping and transformation across data source Raw Curated Redshift
  • Proficient in Redshift SQL for transformations, optimization, and model refresh
  • Integrate with on-prem and SaaS data sources, such as SAP (via Simplement), Salesforce, OKTA, MuleSoft and JAMS
  • Implement CI/CD deployment using Github
  • Familiar with CloudWatch, CloudTrail, Secrets Manager for monitoring and security
  • Manage metadata and lineage via AWS Glue Data Catalog
Required Education & Experience:
  • Bachelor's degree in related field with 8+ years of experience as a data engineer Additional years of experience may be considered in lieu of a degree.
  • Proficiency in programming languages like Python or Java, strong SQL skills, and knowledge of big data tools like Apache Hadoop, Spark, or Kafka.
  • Experience with cloud platforms (AWS, Azure, GCP) and data warehousing solutions (Snowflake, Redshift, BigQuery)
  • Self-driven and have demonstrated the ability to work independently with minimum guidance
  • Demonstrated multitasking ability, problem solving skills and a consistent record of on time delivery and customer service
  • Excellent organizational and communication skills
Preferred Qualifications:
  • Utilities experience
  • AWS Certified Data Engineer - Associate
  • AWS Certified Developer - Associate

#dice

  • Data Engineer

    2 weeks ago

    Newark, NJ, United States Seven Seven Software Full time

    Qualifications: * Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience * Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises * Programming experience with Python, Shell scripting and SQL * Solid experience of AWS services such as...

  • Data Engineer

    2 weeks ago

    Newark, NJ, United States Equiliem Full time

    Data Engineer We're seeking a Data Engineer who is motivated by variety, is seeking a challenging environment for professional growth, and is interested in supporting large information technology projects for one of our clients in the northeast. The Data Engineer will build and maintain the infrastructure for the organization's data by designing,...

  • AWS Data Engineer

    1 week ago

    Newark, NJ, United States Damco Solutions Full time

    Job title: AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration: 24 monthsMust have at least 12 years of experience. Job Description: Data Engineer Job Description for Data Journey USBIE Experience developing and deploying application code using SQL, Python, spark. 3-5 years' experience developing and deploying data pipeline in cloud. 3-5...

  • AWS Data Engineer

    1 week ago

    Newark, NJ, United States Seven Seven Software Full time

    Responsibilities: Designing, building and maintaining efficient, reusable, and reliable architecture and code. Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc) Ensure the best possible performance and quality of high scale data engineering project Participate in the architecture and system design discussions Independently...

  • Microsoft Fabric Data Engineer

    4 days ago

    Newark, NJ, United States Fortis Hayes Full time

    About the job Microsoft Fabric Data Engineer Microsoft Fabric Data Engineer - 6 month Hybrid full-time role. Our client is seeking a highly experienced Microsoft Fabric Data Engineer to design, build, and optimize our enterprise data and analytics platform. The ideal candidate will be an expert in the Microsoft Azure ecosystem, with deep hands-on experience...

  • Python Data Engineer on Snowflake

    27 minutes ago

    Newark, NJ, United States Artech Full time

    Remote Job Opportunity in Python Data Engineering on Snowflake. Join our dynamic team remotely, based in the vibrant area of Newark, NJ. We are seeking a skilled professional for a 12-month opportunity within the BFSI business vertical. This role offers a chance to work in an inclusive and diverse environment, promoting innovation and growth. Location:...

  • Technical Lead Data Engineer

    2 weeks ago

    Newark, NJ, United States ShiftCode Analytics Full time

    Interview : Video Visa : USC, GC, GC EAD, H4, L2 This is hybrid from day-1 ( Need local candidates ) Description : About the Role: We are seeking an experienced Technical Lead Data Engineer to join our dynamic team. You will lead and mentor a talented group of data engineers, architect innovative data solutions, and ensure the highest standards of data...

  • Senior AWS Data Engineer

    1 week ago

    Newark, NJ, United States Inizio Partners Full time

    About the job Senior AWS Data Engineer Role Overview: The person will be part of the Global Technology team for a major Insurance client. He/ She will work as a Senior Cloud Engineer within the CDO EDP team and will have the opportunity to work one-on-one with application and infrastructure developers to build and enhance the data infrastructure and...

  • Senior. Data Engineer

    1 week ago

    Newark, NJ, United States Broadridge Financial Solutions , Inc. Full time

    At Broadridge, we've built a culture where the highest goal is to empower others to accomplish more. If you're passionate about developing your career, while helping others along the way, come join the Broadridge team. Broadridge is hiring! We currently have an opening for a data architecture minded Senior Software Engineer. In this role, you will support...

  • Microsoft Fabric Data Engineer

    2 weeks ago

    Newark, NJ, United States Artech Full time

    Job Opportunity Location: Newark, NJ - Hybrid Onsite (Local Candidates Only) Duration: 6 months We are seeking a skilled Data Engineer with expertise in Microsoft Fabric and Azure technologies. This role is pivotal for designing and implementing robust data solutions that empower our analytics and machine learning capabilities. Responsibilities Design and...