Pyspark/Python Software engineer with Advance SQL

4 days ago

Princeton, New Jersey, United States Jobs via Dice Full time

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Avenues International, Inc., is seeking the following. Apply via Dice today

Title: Pyspark developer with SQL
Location: Skillman, NJ (Three days onsite is must)
Overall Skills needed:

  • Working knowledge of industry standard Data Infrastructure (e.g. Warehouse, BI, Analytics, Big-Data, etc.) tools
  • Proficient at developing, architecting, standardizing and supporting technology platforms using Industry leading ETL solutions.
  • Building scalable and high throughput systems
  • Experience with agile BI & ETL practices to assist with the interim Data preparation for Data Discovery & self-service needs.
  • Strong communication, presentation, problem-solving, and trouble-shooting skills.

Must have Skills:

  • 5+ years of experience in designing and developing ETL pipelines leveraging pyspark/python.
  • Experience on python database libraries like SQLAlchemy, psycopg2 .etc
  • Strong understanding of data warehousing methodologies, ETL processing and dimensional data modeling.
  • Advanced SQL capabilities are required. Knowledge of database design techniques and experience working with extremely large data volumes is a plus.
  • Demonstrated experience and ability to work with business users to gather requirements and manage scope.
  • Experience in workflow tools such as oozie or Airflow or Tidal
  • Experience working in a big data environment with technologies such as Greenplum, Hadoop and HIVE
  • BA, BS, MS, PhD in Computer Science, Engineering or related technology field

Desirable Skills:

  • Experience with large database and DW Implementation (20+ TBs)
  • Understanding of VLDB performance aspects, such as table partitioning, sharding, table distribution and optimization techniques
  • Knowledge of reporting tools such as Qlik Sense, Tableau, Cognos

  • Senior Data Engineer

    1 day ago

    Princeton, New Jersey, United States Marga Consulting LLC Full time

    In order to be successful:You should have a working knowledge of industry standard Data Infrastructure (e.g. Warehouse, BI, Analytics, Big-Data, etc.) tools with the goal of providing end users with analytics at the speed of thought.You should be proficient at developing, architecting, standardizing and supporting technology platforms using Industry...

  • Trade Support Analyst

    5 days ago

    Princeton, New Jersey, United States Thunderhawk Technology Partners Full time

    Right to hire opportunity - NO VISA SPONSORSHIPWe are seeking an experienced Data Engineer / Trade Support Analyst with strong expertise in Databricks, Azure cloud services, Bloomberg terminal and BBG data integration, and batch job support. The ideal candidate will have a background in financial markets or trading systems, with hands-on experience managing...

  • Senior Python/Spark developer

    7 days ago

    Princeton, New Jersey, United States SRP Systems Full time $1,200,000 - $1,600,000 per year

    Company Description SRP is a big data company located in Princeton, NJ focused on Dynamic Pricing, run by seasoned alumni from Stanford University and Wharton. Job Description Title: Senior Python developerLocation: Princeton, NJFull Time/Contract Job DescriptionWe are looking for a Senior Python/Spark developer that carries extremely strong SQL and data...

  • Senior Data Product Engineer, Enabling Functions

    7 days ago

    Princeton, New Jersey, United States Genmab Full time $130,000 - $196,080 per year

    At Genmab, we are dedicated to building extra[not]ordinary futures, together, by developing antibody products and groundbreaking, knock-your-socks-off KYSO antibody medicines that change lives and the future of cancer treatment and serious diseases. We strive to create, champion and maintain a global workplace where individuals' unique contributions are...

  • Lead Software Engineer, Python

    2 weeks ago

    Princeton, New Jersey, United States S&P Global Full time

    About The RoleGrade Level (for internal use):11The TeamJoin an innovative Agile technology team within a global organization, consisting of Development, Quality Assurance, and Product Ownership teams. As a senior developer and technical lead, you will enhance the platform's framework and uphold code quality standards. Collaborate with internal stakeholders...

  • software developers

    5 days ago

    Princeton, New Jersey, United States Santech Solution, Inc. Full time

    SOFTWARE DEVELOPERS: Princeton, NJ & various unanticipated locations throughout the U.S.: Anlyz prgrm rqmts, pln, dvlp & dsgn comp sys. Dfn best prctcs for API dvlpmnt, ensrng smls intgrtn w/thrd-prty apps. Dsgn & mntn SQL Server (SSIS, SSMS), MongoDB & cloud-bsd solns on Azure & AWS. Dvlp & mntn T-SQL queries, strd prcdrs & db optmztns. Dsgn...

  • Python Data Engineer, Associate

    1 day ago

    Princeton, New Jersey, United States BlackRock Full time

    About This RoleAbout BlackRock SMA Solutions:At BlackRock SMA Solutions, our strategies are designed to put our clients' and their clients' interests at the center of our investment advice; to minimize costs and taxes; and to incorporate each client's unique values-aligned preferences into their investment portfolio. Offering a full suite of tools for our...

  • Software Engineer, SAP

    2 weeks ago

    Princeton, New Jersey, United States Dow Jones Full time $95,000 - $110,000 per year

    About Our Organization:Dow Jones is a global provider of news and business information, delivering content to consumers and organizations around the world across multiple formats, including print, digital, mobile and live events. Dow Jones has produced unrivaled quality content for more than 130 years and today has one of the world's largest news-gathering...

  • Senior Python Developer

    1 week ago

    Princeton, New Jersey, United States Robert Half Full time $120,000 - $180,000 per year

    We are looking for a highly experienced Senior Python Developer to design, develop, and maintain robust backend systems. This role requires expertise in Python programming, cloud services, and microservice architectures to deliver scalable and efficient solutions. Based in Princeton, New Jersey, this position involves collaborating with cross-functional...

  • Software Engineer, SAP

    1 week ago

    Princeton, New Jersey, United States Dow Jones Full time $95,000 - $110,000

    Job Description:About Our Organization:Dow Jones is a global provider of news and business information, delivering content to consumers and organizations around the world across multiple formats, including print, digital, mobile and live events. Dow Jones has produced unrivaled quality content for more than 130 years and today has one of the world's largest...