Data Engineer
4 weeks ago
Company Introduction
OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team
Job Description
OneSource Regulatory is trying to identify a full-time contractor with at least 4+ years of experience to assist us with ongoing R&D projects.
We are looking for a data engineer to pull data from various sources and do all the necessary steps to clean, normalize, possibly annotate, and finally load the data into databases. The candidate should be able to develop and implement a strategy for testing the data integrity of the collected data. This role requires extreme attention to detail to ensure data quality is top priority.
Responsibilities
- Well versed in parsing and synthesizing of XML and/or JSON documents.
- Curating of data that can involve some intermediate to advanced web scraping. (data may need to be fetched via SFTP, FTP, Wget, Curl, REST APIs, GraphQL queries from spots on the Internet)
- Proficiency with Linux command line and various simple tools, such as grep, wc, sed, awk, find, ls, cat, piped commands and possibly some very light Bash shell scripting, setting up crontab schedules and programs
- Must have basic knowledge of SQL with the following databases: PostGres, MySQL, Google BigQuery
- Must have basic knowledge of No-SQL database knowledge such as MongoDB or similar
- Familiarity with basic Cloud technology such as storage buckets, cloud serverless functions
- Must have experience extracting text and images from PDF files
- Knowledge of Puppeteer or other automatable web client technologies
- Understanding JavaScript, HTML/CSS and HTTP methods (for understanding page structure for web scraping)
- Solid experience with Python and Python Libraries such as Pandas, requests, etc
- Skill set should match up with required responsibilities listed above
- Strong English skills (e.g. grammatical analysis and rhetorical structure)
- Team Player
- Great communication skills
- Experience within the Pharmaceutical Space
- Ability to expose data via C# NETCore and/or GraphQL
- Google Cloud Platform (Cloud Buckets, Google Cloud Functions (.NET, Python, Node.JS))
- Ability to parallelize data manipulation and scraping via Python multi-threading, etc.
- Python BeautifulSoup
- Scrapy
- Docker (setting up Kubernetes style processing if warranted for data scraping/data ingestion/normalization)
- Multithreading concepts
-
Data Engineer
1 month ago
Boston, Massachusetts, United States Jellyfish Full timeAs a member of Jellyfish Research, you will work closely with data scientists to understand and facilitate data needs for high-impact research, analysis and reporting. You will optimize, expand or redesign our current data platforms, including storage and pipeline architecture, to ingest, combine, and aggregate data from multiple sources. You'll also build...
-
Data Engineer
1 month ago
Boston, United States Northeastern University Full timeThe College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration. The College’s schools, departments, and programs—with...
-
Data Engineer
1 month ago
Boston, Massachusetts, United States Northeastern University Full timeThe College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration.The College's schools, departments, and programs—with disciplines...
-
Mobile and Frontend Engineer
3 days ago
Boston, United States Zing Data Full timeYou’ll help implement and bring to market core features on Zing Data’s platform for next-generation business intelligence that is collaborative, easy, and works on iOS, Android and the web. You’ll be working on the core user experience of our product that has multiple front ends - web, iOS, Android. We’re looking to extend the footprint of this...
-
VP Data Engineering
4 days ago
Boston, United States Socium Recruitment Full timeVP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They aren’t afraid to do things differently, and they’re on a mission to make a real impact with our innovative approach. As...
-
VP Data Engineering
1 month ago
Boston, United States Socium Recruitment Full timeVP Data Engineering Onsite Boston Unable to support Visas & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They arent afraid to do things differently, and theyre on a mission to make a real impact with our innovative approach. As the VP of Data...
-
Business Analyst
1 month ago
Boston, United States Data Pioneer Inc Full time**Job Title: Business Analyst (Cyber Security and Data Loss Prevention)** **Location: Boston, MA** **Duration: 6-12 Months** **Job Overview**: - We are seeking a skilled Business Analyst with specialized experience in the cyber security domain, particularly in data loss prevention (DLP). - Experience in project management is desirable, coupled with...
-
VP Data Engineering
1 month ago
Boston, United States Socium Recruitment Full timeVP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They aren’t afraid to do things differently, and they’re on a mission to make a real impact with our innovative approach.As...
-
Data Engineer
4 days ago
Boston, Massachusetts, United States TD Garden Full timeThe Opportunity The Boston Bruins and TD Garden seek a technical professional to join our dynamic data-driven department. The Data Engineer will support a group that is responsible for strategy and business intelligence across all facets of the business side of an NHL team and venue; accordingly, this role encompasses responsibilities of both a data...
-
Data and Integration Architect
4 days ago
Boston, Massachusetts, United States International Data Group, Inc Full timeInternational Data Group, IncEqual Employment Opportunity/M/F/disability/protected veteran statusData and Integration ArchitectUS-MA-BostonJob ID: Type: Regular (Full Time)# of Openings: 1Category: IT/TechnologyIDGOverviewIDG is looking for a Data and Integration Architect who will be accountable for our corporate data ecosystem. The Data and Integration...
-
Data Engineer
4 weeks ago
Boston, Massachusetts, United States firsthand Full timefirsthand is changing the way individuals living with Serious Mental Illness (SMI) get care. We are focusing on delivering real outcomes for a cohort that has historically been underserved, stigmatized, and deprioritized. By building a service focused on whole-person care, firsthand aims to find, establish a trusting relationship with, and support quality...
-
Head of Data Engineering
4 days ago
Boston, United States WiseHire Recruitment Full timeWiseHire are seeking a Head of Data Engineering to lead the Analytics, Data Science, and Data Engineering teams within a growing organization. You'll shape the data strategy, architecture, data platform, and collaborate with various stakeholders to address their data needs, all while aligning with the wider business goals. This hands-on role involves...
-
Head of Data Engineering
2 weeks ago
Boston, United States WiseHire Recruitment Full timeWiseHire are seeking a Head of Data Engineering to lead the Analytics, Data Science, and Data Engineering teams within a growing organization. You'll shape the data strategy, architecture, data platform, and collaborate with various stakeholders to address their data needs, all while aligning with the wider business goals. This hands-on role involves...
-
Head of Data Engineering
2 weeks ago
Boston, United States WiseHire Recruitment Full timeWiseHire are seeking a Head of Data Engineering to lead the Analytics, Data Science, and Data Engineering teams within a growing organization. You'll shape the data strategy, architecture, data platform, and collaborate with various stakeholders to address their data needs, all while aligning with the wider business goals. This hands-on role involves...
-
Head of Data Engineering
6 hours ago
Boston, United States WiseHire Recruitment Full timeWiseHire are seeking a Head of Data Engineering to lead the Analytics, Data Science, and Data Engineering teams within a growing organization. You'll shape the data strategy, architecture, data platform, and collaborate with various stakeholders to address their data needs, all while aligning with the wider business goals. This hands-on role involves...
-
Senior Data Engineer
2 weeks ago
Boston, United States Storm2 Full time⚡ Senior Data Engineer🎯 Series B FinTech Hyper Growth🌎 Boston, MA Hybrid💸 Salary: $140-180k base + equityCompany:Join a dynamic and rapidly growing fintech company backed by $130M in funding. The company is revolutionizing the financial industry with cutting-edge technology and innovative solutions. They have been recognized by Forbes Fintech 50...
-
Senior Data Engineer
2 weeks ago
Boston, United States Storm2 Full time⚡ Senior Data Engineer🎯 Series B FinTech Hyper Growth🌎 Boston, MA Hybrid💸 Salary: $140-180k base + equityCompany:Join a dynamic and rapidly growing fintech company backed by $130M in funding. The company is revolutionizing the financial industry with cutting-edge technology and innovative solutions. They have been recognized by Forbes Fintech 50...
-
Data Engineer
1 month ago
Boston, United States OneSource Regulatory Full timeJob DescriptionJob DescriptionSalary: Company IntroductionOneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team! Job DescriptionOneSource Regulatory is trying to identify a...
-
Data Engineer
1 month ago
Boston, Massachusetts, United States Selby Jennings Full timeWe have a current opportunity for a Data Engineer - Markit EDM on a permanent basis. The position will be based in Boston. For further information about this position please apply.
-
Data Engineer, Berxi
4 days ago
Boston, United States Berkshire Hathaway Specialty Insurance Full timeJob DescriptionJob DescriptionWho are we? A strategic and trusted insurance partner, Berkshire Hathaway Specialty Insurance (BHSI), provides a broad range of commercial property, casualty and specialty insurance coverages and outstanding service to customers and brokers around the world. As a part of Berkshire Hathaway’s insurance operations, we bring our...