ETL Developer

2 weeks ago

Pittsburgh, United States Smart IT Frame LLC Full time

JD:


Role : ETL Engineer

Location: Remote

No. of years of experience: 8+ years’

Hardcore Technical - ETL

  • ETL experience Strong, 8+ years
  • Hadoop Strong, 8+ years
  • PySpark Strong, 8+ years
  • Spark Strong, 8+ years
  • Dask Required, should be able to set up DASK framework
  • JupyterHub Setup Experience required


Location: Pittsburgh preferred, but remote is fine


Job Description:

We are seeking an experienced ETL Engineer to join our team. The ideal candidate will have 8 to 10 years of experience in designing, developing, and optimizing ETL processes, with strong expertise in Hadoop, PySpark, Spark, and Dask. The role involves setting up and managing data workflows, ensuring data integrity and efficiency, and collaborating with cross-functional teams to meet business needs. If you are passionate about data engineering and have a track record of delivering high-quality ETL solutions, we encourage you to apply.

Key Responsibilities:

• ETL Processes: Design, develop, and optimize ETL pipelines to efficiently extract, transform, and load data from various sources.

• Hadoop: Implement and manage Hadoop-based solutions for large-scale data processing and storage, ensuring optimal performance and scalability.

• PySpark: Develop and maintain PySpark applications for processing and analyzing big data, leveraging Spark's capabilities for distributed computing.

• Spark: Utilize Apache Spark for data processing, including batch and streaming data applications, ensuring high performance and reliability.

• Dask: Set up and manage the Dask framework for parallel computing and distributed data processing, optimizing workflows and handling large-scale data tasks.

• JupyterHub Setup: Configure and maintain JupyterHub environments for collaborative data analysis and notebook sharing, ensuring a seamless user experience.

Must-Have Skills:

• ETL Expertise: Strong experience in designing and managing ETL processes, including data extraction, transformation, and loading.

• Hadoop: Proven proficiency with Hadoop ecosystem tools and technologies for big data processing and storage.

• PySpark: Extensive experience with PySpark for data processing, including writing and optimizing Spark jobs.

• Spark: Deep understanding of Apache Spark for both batch and real-time data processing.

• Dask: Hands-on experience setting up and managing the Dask framework for distributed computing and large-scale data processing.

• JupyterHub Setup: Experience configuring and maintaining JupyterHub for data analysis and notebook collaboration.

• Communication Skills: Strong verbal and written communication skills, with the ability to articulate complex technical concepts to diverse audiences.

• Independent Work: Ability to work independently, manage multiple tasks, and deliver high-quality results with minimal supervision.

Good-to-Have Skills:

• Cloud Platforms: Familiarity with cloud-based data platforms for deploying and managing big data solutions.

• Data Visualization: Experience with data visualization tools (e.g., Tableau, Power BI) for creating insightful visualizations and reports.

• Data Engineering Tools: Knowledge of additional data engineering tools and frameworks, including ETL and data integration technologies.

• Agile Methodologies: Experience with Agile development practices and methodologies for managing data projects and tasks.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Software Engineering, or a related field.

• 8 to 10 years of experience in data engineering, with strong expertise in ETL processes, Hadoop, PySpark, Spark, and Dask.

• Proven experience setting up and managing JupyterHub environments.

  • ETL Developer

    2 weeks ago

    pittsburgh, United States Smart IT Frame LLC Full time

    JD:Role : ETL EngineerLocation: Remote No. of years of experience: 8+ years’Hardcore Technical - ETL ETL experience Strong, 8+ years Hadoop Strong, 8+ years PySpark Strong, 8+ years Spark Strong, 8+ years Dask Required, should be able to set up DASK framework JupyterHub Setup Experience required Location: Pittsburgh preferred, but remote is fine Job...

  • ETL Developer

    1 month ago

    Pittsburgh, United States Tata Consultancy Services Full time

    Experience -7+ Years (Must)Location -Cleveland ,OH/Pittsburgh, PARoles and responsibilitiesETL Tools: Experience with one or more ETL tools like Informatica PowerCenter, Microsoft SSIS (SQL Server Integration Services), Talend, Pentaho, or Apache NiFi is critical.Databases: A strong understanding of relational databases (such as MySQL, Oracle, and SQL...

  • ETL Developer

    1 month ago

    pittsburgh, United States Tata Consultancy Services Full time

    Experience -7+ Years (Must)Location -Cleveland ,OH/Pittsburgh, PARoles and responsibilitiesETL Tools: Experience with one or more ETL tools like Informatica PowerCenter, Microsoft SSIS (SQL Server Integration Services), Talend, Pentaho, or Apache NiFi is critical.Databases: A strong understanding of relational databases (such as MySQL, Oracle, and SQL...

  • ETL Developer

    1 month ago

    Pittsburgh, United States Tata Consultancy Services Full time

    Experience -7+ Years (Must)Location -Cleveland ,OH/Pittsburgh, PARoles and responsibilitiesETL Tools: Experience with one or more ETL tools like Informatica PowerCenter, Microsoft SSIS (SQL Server Integration Services), Talend, Pentaho, or Apache NiFi is critical.Databases: A strong understanding of relational databases (such as MySQL, Oracle, and SQL...

  • ETL Developer

    3 weeks ago

    Pittsburgh, United States Tata Consultancy Services Full time

    Experience -7+ Years (Must)Location -Cleveland ,OH/Pittsburgh, PARoles and responsibilitiesETL Tools: Experience with one or more ETL tools like Informatica PowerCenter, Microsoft SSIS (SQL Server Integration Services), Talend, Pentaho, or Apache NiFi is critical.Databases: A strong understanding of relational databases (such as MySQL, Oracle, and SQL...

  • ETL Developer

    2 weeks ago

    pittsburgh, United States Tata Consultancy Services Full time

    Experience -7+ Years (Must)Location -Cleveland ,OH/Pittsburgh, PARoles and responsibilitiesETL Tools: Experience with one or more ETL tools like Informatica PowerCenter, Microsoft SSIS (SQL Server Integration Services), Talend, Pentaho, or Apache NiFi is critical.Databases: A strong understanding of relational databases (such as MySQL, Oracle, and SQL...

  • Senior Informatica ETL Developer

    7 days ago

    Pittsburgh, Pennsylvania, United States System One Full time

    Job Title: Senior Informatica ETL DeveloperJob Summary: We are seeking a highly skilled Senior Informatica ETL Developer to lead our offshore team. The ideal candidate will have 10+ years of experience in ETL development, including 5+ years of US experience, and expertise in Informatica, Oracle, and PL/SQL.Key Responsibilities:Lead junior offshore...

  • Boomi -ETL Data Warehouse Developer

    3 weeks ago

    Pittsburgh, United States 1 Point System Full time

    Boomi -Data Warehouse Developer Location: Hybrid in Pittsburgh, PA (3 days onsite, 2 days remote) Need Locals or nearbyImmediate opening for a Boomi or ETL Data Warehouse Developer. Ideal candidates must have 3+ years of experience as an ETL Developer. Join the ETL Center of Excellence group operations throughout the enterprise This position is responsible...

  • PowerExchange ETL/Informatica Developer

    2 weeks ago

    Pittsburgh, Pennsylvania, United States Synechron Full time

    Job Title: ETL/Informatica Developer - PowerExchange and PowerCenterLocation: Pittsburgh, PA/Dallas, TXFull Time/PermanentWe are seeking a highly skilled ETL/Informatica Developer to join our team.Responsibilities:Develop and maintain ETL processes using Informatica PowerExchange and PowerCenter.Design and implement data integration between systems and...

  • ETL Support Developer

    1 month ago

    Pittsburgh, United States Impact Consulting Solutions inc Full time

    Job DescriptionJob DescriptionAssociate Developer - Business Intelligence ETL Support (SSIS)Salary Range - $80,000- $105,000 OverviewThe ETL Developer will ensure the stability, integrity & efficient operation of new & legacy data, jobs, procedures, and scripts used by the Data Warehouse Application Development Team. The successful candidate will leverage,...

  • Mainframe Developer and ETL Informatica Specialist

    2 weeks ago

    Pittsburgh, Pennsylvania, United States CyberTec Full time

    Job SummaryWe are seeking a highly skilled Mainframe Developer and ETL Informatica Specialist to join our team at CyberTec. The ideal candidate will have a strong background in mainframe programming and experience with ETL Informatica, with a focus on COBOL. The successful candidate will be responsible for designing, developing, and implementing mainframe...

  • ETL Developer

    7 days ago

    Pittsburgh, Pennsylvania, United States Synechron Full time

    Job Title: ETL/Informatica Developer - PowerExchange and PowerCenterLocation: RemoteJob Type: Full-timeAbout the Role:We are seeking an experienced ETL/Informatica Developer to join our team. The successful candidate will have a strong background in Informatica PowerExchange and PowerCenter, as well as experience with data analysis and data...

  • ETL Lead

    1 hour ago

    Pittsburgh, United States Mastech Digital Full time

    Role: ETL Informatica Lead Location: Pittsburgh, PA (Hybrid) Job type: Full time/ Permanent role Responsibilities: Lead the design, development, and implementation of ETL processes using Informatica PowerCenter and related technologies. Collaborate with business stakeholders, data architects, and analysts to understand data requirements and translate them...

  • Informatica ETL Developer

    2 weeks ago

    Pittsburgh, Pennsylvania, United States Saxon Global Full time

    Full-Time Informatica Developer Role at Saxon GlobalThis is a full-time position at Saxon Global, offering a competitive salary of $120,000. The role is based in Pittsburgh, PA or Cleveland, OH, with a hybrid onsite model.Key Responsibilities:Collaborate with the team and PNC infrastructure teams to ensure seamless data integration.Develop and implement...

  • Senior ETL Engineer

    7 days ago

    Pittsburgh, Pennsylvania, United States Smart IT Frame LLC Full time

    Job Title: Senior ETL EngineerJob Summary:We are seeking a highly skilled Senior ETL Engineer to join our team at Smart IT Frame LLC. The ideal candidate will have 8 to 10 years of experience in designing, developing, and optimizing ETL processes, with strong expertise in Hadoop, PySpark, Spark, and Dask.Key Responsibilities: Design, develop, and optimize...

  • ETL/Informatica Developer

    6 days ago

    Pittsburgh, Pennsylvania, United States Synechron Full time

    Job Title: ETL/Informatica Developer - PowerExchange and PowerCenterLocation: Global OpportunitiesFull Time/ PermanentContact: The Role:Responsibilities:Develop and implement complex ETL processes using Informatica PowerExchange and PowerCenter, ensuring high-quality data integration and transformation.Collaborate with cross-functional teams to design and...

  • Associate Developer

    4 weeks ago

    Pittsburgh, United States Impact Consulting Solutions Full time

    Job Title: Associate Developer - Business Intelligence ETL Support (SSIS)Location: Pittsburgh, PA Area (South)Type: Full Time Permanent Employee Placement OverviewThe ETL Developer will ensure the stability, integrity & efficient operation of new & legacy data, jobs, procedures, and scripts used by the Data Warehouse Application Development Team. The...

  • PowerExchange - ETL/Informatica Developer

    2 weeks ago

    pittsburgh, United States Synechron Full time

    Job Title: ETL/Informatica Developer - PowerExchange and PowerCenter Location: Pittsburgh, PA/Dallas, TXFull Time/ PermanentContact: Syed.Khaliq@Synechron.comThe Role:Responsibilities:Must have a minimum of 8 years of Informatica ETL development experience with good Oracle database background.Must have experience in Informatica Power Exchange and...

  • PowerExchange - ETL/Informatica Developer

    2 weeks ago

    Pittsburgh, United States Synechron Full time

    Job Title: ETL/Informatica Developer - PowerExchange and PowerCenter Location: Pittsburgh, PA/Dallas, TXFull Time/ PermanentContact: Syed.Khaliq@Synechron.comThe Role:Responsibilities:Must have a minimum of 8 years of Informatica ETL development experience with good Oracle database background.Must have experience in Informatica Power Exchange and...

  • PowerExchange - ETL/Informatica Developer

    2 weeks ago

    Pittsburgh, United States Synechron Full time

    Job Title: ETL/Informatica Developer - PowerExchange and PowerCenter Location: Pittsburgh, PA/Dallas, TXFull Time/ PermanentContact: Syed.Khaliq@Synechron.comThe Role:Responsibilities:Must have a minimum of 8 years of Informatica ETL development experience with good Oracle database background.Must have experience in Informatica Power Exchange and...