Senior Data Engineer

2 weeks ago

Asbury Park, NJ, United States Equiliem Full time
Position: Senior Data Engineer

Location: 99 Jefferson Rd, Parsippany, NJ 07054 (Onsite)

Duration: 6 Months Contrac

Responsibility:
  • Helping the product owner and development team to achieve project outcomes. Build stories and prioritize as per the requirement.
  • Analyze data platform requirements and design and document solutions.
  • Build key infrastructure, frameworks and applications to support the needs of Data Engineers, Data Scientists and Business.
  • Improve SDLC processes with the team of engineers and DevOps.
  • Build effective/efficient and reusable data pipeline frameworks for various data source types, refresh patterns and transformations.
  • Build data pipelines, jobs using Spark and Databricks to ingest into Data Lake/Delta Lake on AWS
  • Support teams using the Data and AI/ML platform, design and validate their use case architecure, provide best practices for solutions, troubleshoot development issues with platform feature and frameworks.
  • Partner with team members, product owner and other stakeholder to ideate, review and align on data validation approach.
  • Maintain end-end data security (both at rest, transit) and data sharing mechanisms.
  • Identify and build automation processes to support various data platform scenarios.
  • Design and build Dev/Data/MLOps processes using cloud services.
Qualification:
  • Strong technical skills and experience working with and supporting multiple engineering teams.
  • Experience in building Big Data/ML/AI applications and optimizing data pipelines, architectures and data sets.
  • 5+ years of technical experience with big data technologies. They should also have experience using the following software/tools:
    • Experience with big data tools: Apache Spark, Databricks, Parquet/Delta, PySpark, SparkSQL, Spark Streaming, Kafka/Kinesis, S3, Glue
    • Experience with Databricks using Unity Catalog and MLFlow is a big plus
    • Experience with any relational/noSQL databases or any MPP databases like Snowflake and Redshift.
    • Experience with data pipeline and workflow management tools: Step Functions, Airflow
    • Experience with AWS cloud services: EC2, EMR, RDS, Redshift, IAM, Security Group, VPC etc.
    • Experience developing in Python and Notebooks/IDE
    • Experience with Automation: Jenkins CI/CD, Terraform, CDK, Boto3

  • Civil Project Engineer

    4 days ago

    Asbury Park, NJ, United States AKRF Full time

    About the Role The Engineering Department at AKRF is seeking a Civil Project Engineer to work in our Asbury Park, NJ office. The candidate will have experience in stormwater management design and grading, utility design, drainage, soil erosion and sediment control design, and land use process in New Jersey. Candidates should desire a mix of projects that...

  • Civil Project Engineer

    1 week ago

    Asbury Park, NJ, United States AKRF Full time

    About the Role The Engineering Department at AKRF is seeking a Civil Project Engineer to work in our Asbury Park, NJ office. The candidate will have experience in stormwater management design and grading, utility design, drainage, soil erosion and sediment control design, and land use process in New Jersey. Candidates should desire a mix of projects that...

  • Senior Software Engineer

    1 week ago

    Elmwood Park, NJ, United States Ellkay Full time

    If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process. Senior Software Engineer Full Time TECHNICAL Elmwood Park, NJ, US 30+ days ago Requisition ID: 1215 Salary Range: $165,000.00 To $195,000.00 Annually ELLKAY started out providing connectivity solutions...

  • Senior Software Engineer

    6 days ago

    Elmwood Park, NJ, United States Ellkay Full time

    If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process. Senior Software Engineer Full Time TECHNICAL Elmwood Park, NJ, US 30+ days ago Requisition ID: 1215 Salary Range: $165,000.00 To $195,000.00 Annually ELLKAY started out providing connectivity solutions...

  • Senior Software Engineer

    1 week ago

    Elmwood Park, NJ, United States Ellkay Full time

    If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process. Senior Software Engineer Full Time TECHNICAL Elmwood Park, NJ, US 30+ days ago Requisition ID: 1215 Salary Range: $165,000.00 To $195,000.00 Annually ELLKAY started out providing connectivity solutions...

  • Process Engineer

    2 weeks ago

    Asbury Park, NJ, United States Michael Page Full time

    Lead process development, validation, and continuous improvement of processes Develop and optimize molding parameters for blow molding manufacturing About Our Client My client is a leading custom plastics blow molding company specializing in blow molding, injection molding, and assembly services. Serving industries including medical, industrial, food and...

  • Process Engineer

    1 week ago

    Asbury Park, NJ, United States Michael Page Full time

    Lead process development, validation, and continuous improvement of processes Develop and optimize molding parameters for blow molding manufacturing About Our Client My client is a leading custom plastics blow molding company specializing in blow molding, injection molding, and assembly services. Serving industries including medical, industrial, food and...

  • Process Engineer

    1 week ago

    Asbury Park, NJ, United States Michael Page Full time

    Lead process development, validation, and continuous improvement of processes Develop and optimize molding parameters for blow molding manufacturing About Our Client My client is a leading custom plastics blow molding company specializing in blow molding, injection molding, and assembly services. Serving industries including medical, industrial, food and...

  • Senior Software Engineer

    1 week ago

    Elmwood Park, NJ, United States Ellkay Full time

    ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY's solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals...

  • Senior Software Engineer

    1 week ago

    Elmwood Park, NJ, United States Ellkay Full time

    ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY's solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals...