Data Engineer

1 week ago


Boston, United States OneSource Regulatory Full time
Job DescriptionJob DescriptionSalary:

Company Introduction

OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space.  OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team

 

Job Description

OneSource Regulatory is trying to identify a full-time contractor with at least 4+ years of experience to assist us with ongoing R&D projects.

We are looking for a data engineer to pull data from various sources and do all the necessary steps to clean, normalize, possibly annotate, and finally load the data into databases.    The candidate should be able to develop and implement a strategy for testing the data integrity of the collected data.   This role requires extreme attention to detail to ensure data quality is top priority.


Responsibilities

  • Well versed in parsing and synthesizing of XML and/or JSON documents.
  • Curating of data that can involve some intermediate to advanced web scraping. (data may need to be fetched via SFTP, FTP, Wget, Curl, REST APIs, GraphQL queries from spots on the Internet)
  • Proficiency with Linux command line and various simple tools, such as grep, wc, sed, awk, find, ls, cat, piped commands and possibly some very light Bash shell scripting, setting up crontab schedules and programs
  • Must have basic knowledge of SQL with the following databases: PostGres, MySQL, Google BigQuery
  • Must have basic knowledge of No-SQL database knowledge such as MongoDB or similar
  • Familiarity with basic Cloud technology such as storage buckets, cloud serverless functions
  • Must have experience extracting text and images from PDF files
  • Knowledge of Puppeteer or other automatable web client technologies
  • Understanding JavaScript, HTML/CSS and HTTP methods (for understanding page structure for web scraping)

Skills

  • Solid experience with Python and Python Libraries such as Pandas, requests, etc
  • Skill set should match up with required responsibilities listed above
  • Strong English skills (e.g. grammatical analysis and rhetorical structure)
  • Team Player
  • Great communication skills


Bonus Skills

  • Experience within the Pharmaceutical Space
  • Ability to expose data via C# NETCore and/or GraphQL
  • Google Cloud Platform (Cloud Buckets, Google Cloud Functions (.NET, Python, Node.JS))
  • Ability to parallelize data manipulation and scraping via Python multi-threading, etc.
  • Python BeautifulSoup
  • Scrapy
  • Docker (setting up Kubernetes style processing if warranted for data scraping/data ingestion/normalization)
  • Multithreading concepts

  • Data Engineer

    Found in: beBee jobs US - 1 week ago


    Boston, Massachusetts, United States Jellyfish Full time

    As a member of Jellyfish Research, you will work closely with data scientists to understand and facilitate data needs for high-impact research, analysis and reporting. You will optimize, expand or redesign our current data platforms, including storage and pipeline architecture, to ingest, combine, and aggregate data from multiple sources. You'll also build...

  • Data Engineer

    1 day ago


    Boston, United States MassMutual Full time

    The OpportunityAs a Data Engineer, you will work in a fast paced, innovative, and collaborative environment on exciting assignments that are focused on the adoption of leading-edge technologies, implementation patterns, and data management standards and controls.The TeamThe Wealth Management Technology Team supports complex and very dynamic business for...

  • Data Engineer

    Found in: beBee S US - 1 week ago


    Boston, United States Northeastern University Full time

    The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration. The College’s schools, departments, and programs—with...

  • Data Engineer

    Found in: beBee jobs US - 2 weeks ago


    Boston, Massachusetts, United States Northeastern University Full time

    The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration.The College's schools, departments, and programs—with disciplines...

  • Data Engineer

    2 days ago


    Boston, United States MassMutual Full time

    The Opportunity As a Data Engineer, you will work in a fast paced, innovative, and collaborative environment on exciting assignments that are focused on the adoption of leading-edge technologies, implementation patterns, and data management standards and controls.The Team The Wealth Management Technology Team supports complex and very dynamic business for...

  • VP Data Engineering

    1 week ago


    Boston, United States Socium Recruitment Full time

    VP Data Engineering Onsite Boston Unable to support Visas & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They arent afraid to do things differently, and theyre on a mission to make a real impact with our innovative approach. As the VP of Data...

  • VP Data Engineering

    6 days ago


    Boston, United States Socium Recruitment Full time

    VP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Apply promptly! A high volume of applicants is expected for the role as detailed below, do not wait to send your CV. Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They...

  • VP Data Engineering

    1 week ago


    Boston, United States Socium Recruitment Full time

    VP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They aren’t afraid to do things differently, and they’re on a mission to make a real impact with our innovative approach.As...


  • Boston, United States Commonwealth of Massachusetts Full time

    The Executive Office of Technology Services and Security (EOTSS) places our customers and constituents at the heart of everything we do. We offer responsive digital services and productivity tools to more than 40,000 state employees, who provide essential information and services to the citizens of the Commonwealth. We also serve constituents, providing them...

  • Data Engineer

    Found in: beBee jobs US - 1 week ago


    Boston, Massachusetts, United States Selby Jennings Full time

    We have a current opportunity for a Data Engineer - Markit EDM on a permanent basis. The position will be based in Boston. For further information about this position please apply.


  • Boston, United States RIT Solutions, Inc. Full time

    Title: Databricks Data EngineerLocation: Boston MA (Hybrid)Duration: 6+ months contract Applicants must be open to occasional travel to client site.Those who are based in the following areas and willing to visit onsite are strongly encouraged to apply:Boston, MA; Kansas City, MO; Columbus, OH; Chicago, IL; and Philadelphia, PA. As Databricks Data Engineer,...

  • Data Engineer III

    1 week ago


    Boston, United States chewycom Full time

    Our Opportunity: We are looking for a Data Engineer III at our facility in Boston, Massachusetts, to act as a member of Chewy’s Content Platform team, influence the vision and implementation of architecture, design, and features for this critical business line. What You’ll Do: Act as an individual contributor as part of a team of strong engineers...

  • Data Engineer

    5 days ago


    Boston, United States Gardner Resources Consulting Full time

    About Our Client: Our healthcare client is committed to leveraging innovative data engineering solutions, particularly the Medallion architecture, to drive operational excellence and deliver transformative insights in patient care. Must-Haves: - Minimum of 3 years' experience with Databricks, PySpark, SQL, Spark clusters, and Jupyter Notebooks. - Expertise...

  • Data Engineer

    Found in: Appcast US C2 - 2 weeks ago


    Boston, United States Whitridge Associates Full time

    Our ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop and deliver robust solutions that meet the highest standards. Learning new...

  • Data Engineer

    Found in: Appcast Linkedin GBL C2 - 2 weeks ago


    Boston, United States Whitridge Associates Full time

    Our ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop and deliver robust solutions that meet the highest standards. Learning new...


  • Boston, United States Selby Jennings Full time

    Qualifications Possess a Bachelor's degree or higher in Computer Science, Management Information Systems, Business Information Systems, Mathematics, or a related field. Have over 7 years of experience in data engineering, including leadership roles within agile environments, focused on delivering top-tier technological solutions using modern SDLC...

  • Principal Data Engineer

    Found in: beBee jobs US - 1 week ago


    Boston, Massachusetts, United States Geode Capital Management Full time

    Geode Capital Management is actively searching for a full-time Principal Data Engineer to become an integral part of our Data team. The Principal Data Engineer will play a very critical role within our data team by providing technical leadership, implementation expertise, design best practices and guiding other highly skilled and motivated data engineers. In...


  • Boston, United States Clickjobs.com Full time

    Quantitative Data Engineer Quantitative Investment Platforms and Developer Operations Team Full-time Boston, MA, Springfield, MA or New York, NY The Opportunity As a Data Engineer you will work in a fast paced, innovative, and collaborative environment on exciting technology directives. A Data Engineer embodies a unique combination of both technical and...


  • Boston, United States Selby Jennings Full time

    Responsibilities: Develop, implement, and maintain data governance technologies Implement data-related standards and architectures in alignment with data quality, data lineage, and data discoverability strategic initiatives Create check in source systems and data pipelines Qualifications: Bachelor's degree in Computer Science or Information Systems 3 to...


  • Boston, United States Selby Jennings Full time

    Responsibilities: Develop, implement, and maintain data governance technologies Implement data-related standards and architectures in alignment with data quality, data lineage, and data discoverability strategic initiatives Create check in source systems and data pipelines Qualifications: Bachelor's degree in Computer Science or Information Systems 3 to...