Data Engineer
1 week ago
Company Introduction
OneSource Regulatory Technology hosts a number of innovative solutions to enhance job performance in the Pharmaceutical space. OSR Technology is looking for an experienced and dedicated data engineer to join our product solutions team
Job Description
OneSource Regulatory is trying to identify a full-time contractor with at least 4+ years of experience to assist us with ongoing R&D projects.
We are looking for a data engineer to pull data from various sources and do all the necessary steps to clean, normalize, possibly annotate, and finally load the data into databases. The candidate should be able to develop and implement a strategy for testing the data integrity of the collected data. This role requires extreme attention to detail to ensure data quality is top priority.
Responsibilities
- Well versed in parsing and synthesizing of XML and/or JSON documents.
- Curating of data that can involve some intermediate to advanced web scraping. (data may need to be fetched via SFTP, FTP, Wget, Curl, REST APIs, GraphQL queries from spots on the Internet)
- Proficiency with Linux command line and various simple tools, such as grep, wc, sed, awk, find, ls, cat, piped commands and possibly some very light Bash shell scripting, setting up crontab schedules and programs
- Must have basic knowledge of SQL with the following databases: PostGres, MySQL, Google BigQuery
- Must have basic knowledge of No-SQL database knowledge such as MongoDB or similar
- Familiarity with basic Cloud technology such as storage buckets, cloud serverless functions
- Must have experience extracting text and images from PDF files
- Knowledge of Puppeteer or other automatable web client technologies
- Understanding JavaScript, HTML/CSS and HTTP methods (for understanding page structure for web scraping)
Skills
- Solid experience with Python and Python Libraries such as Pandas, requests, etc
- Skill set should match up with required responsibilities listed above
- Strong English skills (e.g. grammatical analysis and rhetorical structure)
- Team Player
- Great communication skills
Bonus Skills
- Experience within the Pharmaceutical Space
- Ability to expose data via C# NETCore and/or GraphQL
- Google Cloud Platform (Cloud Buckets, Google Cloud Functions (.NET, Python, Node.JS))
- Ability to parallelize data manipulation and scraping via Python multi-threading, etc.
- Python BeautifulSoup
- Scrapy
- Docker (setting up Kubernetes style processing if warranted for data scraping/data ingestion/normalization)
- Multithreading concepts
-
Data Engineer
Found in: beBee jobs US - 1 week ago
Boston, Massachusetts, United States Jellyfish Full timeAs a member of Jellyfish Research, you will work closely with data scientists to understand and facilitate data needs for high-impact research, analysis and reporting. You will optimize, expand or redesign our current data platforms, including storage and pipeline architecture, to ingest, combine, and aggregate data from multiple sources. You'll also build...
-
Data Engineer
1 day ago
Boston, United States MassMutual Full timeThe OpportunityAs a Data Engineer, you will work in a fast paced, innovative, and collaborative environment on exciting assignments that are focused on the adoption of leading-edge technologies, implementation patterns, and data management standards and controls.The TeamThe Wealth Management Technology Team supports complex and very dynamic business for...
-
Data Engineer
Found in: beBee S US - 1 week ago
Boston, United States Northeastern University Full timeThe College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration. The College’s schools, departments, and programs—with...
-
Data Engineer
Found in: beBee jobs US - 2 weeks ago
Boston, Massachusetts, United States Northeastern University Full timeThe College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration.The College's schools, departments, and programs—with disciplines...
-
Data Engineer
2 days ago
Boston, United States MassMutual Full timeThe Opportunity As a Data Engineer, you will work in a fast paced, innovative, and collaborative environment on exciting assignments that are focused on the adoption of leading-edge technologies, implementation patterns, and data management standards and controls.The Team The Wealth Management Technology Team supports complex and very dynamic business for...
-
VP Data Engineering
1 week ago
Boston, United States Socium Recruitment Full timeVP Data Engineering Onsite Boston Unable to support Visas & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They arent afraid to do things differently, and theyre on a mission to make a real impact with our innovative approach. As the VP of Data...
-
VP Data Engineering
6 days ago
Boston, United States Socium Recruitment Full timeVP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Apply promptly! A high volume of applicants is expected for the role as detailed below, do not wait to send your CV. Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They...
-
VP Data Engineering
1 week ago
Boston, United States Socium Recruitment Full timeVP Data Engineering Onsite – Boston – Unable to support Visa’s & C2C Hey there! Are you all about Big Data and building awesome teams? This Start-up is shaking things up in their world with some seriously cool data solutions. They aren’t afraid to do things differently, and they’re on a mission to make a real impact with our innovative approach.As...
-
Principal Data Engineer
4 days ago
Boston, United States Commonwealth of Massachusetts Full timeThe Executive Office of Technology Services and Security (EOTSS) places our customers and constituents at the heart of everything we do. We offer responsive digital services and productivity tools to more than 40,000 state employees, who provide essential information and services to the citizens of the Commonwealth. We also serve constituents, providing them...
-
Data Engineer
Found in: beBee jobs US - 1 week ago
Boston, Massachusetts, United States Selby Jennings Full timeWe have a current opportunity for a Data Engineer - Markit EDM on a permanent basis. The position will be based in Boston. For further information about this position please apply.
-
Databricks Data Engineer
1 week ago
Boston, United States RIT Solutions, Inc. Full timeTitle: Databricks Data EngineerLocation: Boston MA (Hybrid)Duration: 6+ months contract Applicants must be open to occasional travel to client site.Those who are based in the following areas and willing to visit onsite are strongly encouraged to apply:Boston, MA; Kansas City, MO; Columbus, OH; Chicago, IL; and Philadelphia, PA. As Databricks Data Engineer,...
-
Data Engineer III
1 week ago
Boston, United States chewycom Full timeOur Opportunity: We are looking for a Data Engineer III at our facility in Boston, Massachusetts, to act as a member of Chewy’s Content Platform team, influence the vision and implementation of architecture, design, and features for this critical business line. What You’ll Do: Act as an individual contributor as part of a team of strong engineers...
-
Data Engineer
5 days ago
Boston, United States Gardner Resources Consulting Full timeAbout Our Client: Our healthcare client is committed to leveraging innovative data engineering solutions, particularly the Medallion architecture, to drive operational excellence and deliver transformative insights in patient care. Must-Haves: - Minimum of 3 years' experience with Databricks, PySpark, SQL, Spark clusters, and Jupyter Notebooks. - Expertise...
-
Data Engineer
Found in: Appcast US C2 - 2 weeks ago
Boston, United States Whitridge Associates Full timeOur ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop and deliver robust solutions that meet the highest standards. Learning new...
-
Data Engineer
Found in: Appcast Linkedin GBL C2 - 2 weeks ago
Boston, United States Whitridge Associates Full timeOur ideal Data Engineer is passionate about data, deploying solutions, workflow automation, and supporting AWS cloud services. You enjoy building data projects from the ground up and are equally comfortable working with business partners to understand requirements as you develop and deliver robust solutions that meet the highest standards. Learning new...
-
VP of Data Engineering
1 week ago
Boston, United States Selby Jennings Full timeQualifications Possess a Bachelor's degree or higher in Computer Science, Management Information Systems, Business Information Systems, Mathematics, or a related field. Have over 7 years of experience in data engineering, including leadership roles within agile environments, focused on delivering top-tier technological solutions using modern SDLC...
-
Principal Data Engineer
Found in: beBee jobs US - 1 week ago
Boston, Massachusetts, United States Geode Capital Management Full timeGeode Capital Management is actively searching for a full-time Principal Data Engineer to become an integral part of our Data team. The Principal Data Engineer will play a very critical role within our data team by providing technical leadership, implementation expertise, design best practices and guiding other highly skilled and motivated data engineers. In...
-
Quantitative Data Engineer
1 week ago
Boston, United States Clickjobs.com Full timeQuantitative Data Engineer Quantitative Investment Platforms and Developer Operations Team Full-time Boston, MA, Springfield, MA or New York, NY The Opportunity As a Data Engineer you will work in a fast paced, innovative, and collaborative environment on exciting technology directives. A Data Engineer embodies a unique combination of both technical and...
-
Senior Data Engineer, Data Governance
1 week ago
Boston, United States Selby Jennings Full timeResponsibilities: Develop, implement, and maintain data governance technologies Implement data-related standards and architectures in alignment with data quality, data lineage, and data discoverability strategic initiatives Create check in source systems and data pipelines Qualifications: Bachelor's degree in Computer Science or Information Systems 3 to...
-
Senior Data Engineer, Data Governance
2 hours ago
Boston, United States Selby Jennings Full timeResponsibilities: Develop, implement, and maintain data governance technologies Implement data-related standards and architectures in alignment with data quality, data lineage, and data discoverability strategic initiatives Create check in source systems and data pipelines Qualifications: Bachelor's degree in Computer Science or Information Systems 3 to...