Senior Web Scraping Engineer

3 weeks ago


Boston, Massachusetts, United States Wellist Full time

What we are looking for

Wellist is seeking a Senior Web Scraping Engineer who will be responsible for standing up and owning the data acquisition operations that will drive data that powers the Wellist Directory. The Wellist Directory is a state-of-the-art product deployed to Wellist hospital and corporate customers to ensure that patients and employees get connected with the right resource at the right time.

The Senior Web Scraping Engineer will take over existing code and be responsible for all phases of the automated data acquisition process. They will bring experience in data extraction and web scraping techniques. They will lead efforts to build and optimize scraping processes and support our vision for helping patients and employees identify local, relevant services that fall within categories of need.

The Senior Engineer will report into Wellist's Head of Operations and complement an existing small but highly professional and effective Engineering Team.

What experience you bring:

  • Demonstrated ability to extract data from complex websites with minimal supervision, with a portfolio or examples of past projects.
  • Proficiency in Python and JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium.
  • Knowledge of asynchronous programming, multithreading, and distributed scraping.
  • In-depth knowledge of HTML, CSS, JavaScript, and the DOM.
  • Experience designing efficient storage solutions and managing data integrity.
  • Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis adds significant value.
  • Able to leverage and engage with current AI based platform (e.g. OpenAI), with examples of past projects
  • Experience with cloud services (AWS a plus) for deploying and managing scraping jobs at scale.

Location Requirements:

  • Located in Boston, MA a big plus but not required
  • Able to work East Coast business hours, Mon-to-Fri and as needed by business

What You'll Be Doing:

  • Write, test, and refine code that extracts data from various online sources, ensuring reliability and efficiency.
  • Perform data retrieval tasks, handling complexities such as pagination and dynamic content (i.e. content loaded with AJAX or JavaScript).
  • Clean and format extracted data, ensuring it meets format, structure and quality standards for further analysis or processing.
  • Store and manage the scraped data appropriately, optimizing for access speed and data integrity.
  • Regularly monitor the scraping processes, identify and resolve any issues to maintain continuous data flow.
  • Work seamlessly with our existing Engineering, Product and Directory teams to ensure that data is relevant and positively impactful for our users.

About Wellist

Wellist is a mission-driven digital health company that provides effective consumer navigation at scale. Wellist has historically served patients and care teams at leading health systems (e.g., Yale New Haven Health, HCA) and in 2022 expanded its offerings to support different types of employers. Our employer solution provides an omnichannel benefit front door that increases strategic engagement across the benefits portfolio and meaningfully reduces cost.

Wellist's outstanding contributions have been recognized by organizations including Fast Company (Most Innovative Companies Human Resources), MassTLC (Most Innovative Technology of the Year – Healthcare), Rock Health (Top 50 in Digital Health honoree, Diversity Leadership), American Business Awards (Company of the Year, Silver Stevie – Health Products and Service) and BostInno (50onFire, Health and Medicine winner).

Why work here

  • A meaningful mission - join a team that makes a difference for patients and families.
  • Outstanding benefits - excellent medical and dental insurance coverage, life & disability insurance, up to 3 weeks of PTO and 401k contribution
  • Opportunities to develop your career - expand your resume with a healthcare startup


  • Boston, Massachusetts, United States Nexagen Networks Inc Full time

    Job OverviewNexagen Networks Inc is seeking a skilled Web Application Engineer to join our dynamic team. The ideal candidate will possess extensive experience in software development within a web-based, distributed framework.Key Responsibilities:Software Development:The selected individual will be responsible for designing, coding, testing, and implementing...


  • Boston, Massachusetts, United States SmartIPlace Full time

    Job OverviewPosition: Senior Front End Java EngineerLocation: Boston, MA - Local candidates preferredVisa Status: OpenExperience Level: 14+ yearsWe are seeking an experienced Front End Developer with expertise in Angular v12 or higher.This role requires on-site presence in Boston, working four days a week. An in-person interview is mandatory.As a Senior...


  • Boston, Massachusetts, United States The Computer Merchant, LTD. Full time

    POSITION TITLE:Senior Java EngineerLOCATION:Boston, MA (4 days onsite)COMPENSATION RANGE*: / hourJOB REFERENCE NUMBER:192504ESSENTIAL QUALIFICATIONS:Proficient in Java/J2EE, Spring Boot, and Oracle PL/SQLExperience with JMS, Kafka, SOAP/REST Web Services, Quartz Scheduler, and ORM frameworks such as Hibernate/Ibatis/MybatisMinimum of 7 years of relevant...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    About the Role:Motion Recruitment is seeking a highly skilled Senior Python Software Engineer to join our team in Boston. As a key member of our engineering team, you will play a crucial role in designing, developing, and optimizing the core infrastructure that powers our client's cutting-edge marketing platform.Key Responsibilities:Design, build, and...


  • Boston, Massachusetts, United States Dazzletek Full time

    Position OverviewWe are seeking a Senior Frontend Java Engineer to join our dynamic team at Dazzletek. This role is pivotal in enhancing our user interface and ensuring an exceptional user experience.Key Responsibilities:Collaborate with product management and IT teams to oversee the development of the new home user interface.Continuously assess the...


  • Boston, Massachusetts, United States Bright Vision Technologies Full time

    Job OverviewBright Vision Technologies is seeking a talented Senior Java Backend Engineer to contribute to our innovative projects. This role involves working in a hybrid environment, allowing for flexibility while collaborating with a dynamic team.Key ResponsibilitiesDesign and implement robust backend solutions using Java.Utilize Java 17 and above to...


  • Boston, Massachusetts, United States Wellington Management Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Mosaic Prism Team at Wellington Management. As a key member of our technology team, you will work closely with other developers, business analysts, and QA engineers to design, develop, test, implement, and support solutions to meet business requirements.Key...


  • Boston, Massachusetts, United States WHOOP Full time

    At WHOOP, we're on a mission to unlock human performance. WHOOP empowers members to perform at a higher level through a deeper understanding of their bodies and daily lives. We are looking for motivated engineers to join our team on our mission.The Application Infrastructure team enables iOS, Android, Backend, and Web engineers to reliably and quickly...


  • Boston, Massachusetts, United States Amazon Web Services, Inc. Full time

    Senior Customer Solutions ManagerThe AWS Industry Products (AIP) division is committed to crafting groundbreaking solutions within the automotive technology landscape through partnerships with key industry players. Our team collaborates intimately with strategic clients to develop tailored products that catalyze significant transformation.We are seeking a...


  • Boston, Massachusetts, United States Stride Funding Full time

    About Us: Stride Funding is a venture-backed, mission-driven startup transforming access to education and career pathways. We are revolutionizing the way employers attract and retain critical talent, while simultaneously tackling the student debt crisis. (Yep, we think BIG.) Our innovative platform meaningfully connects employers, educational institutions,...


  • Boston, Massachusetts, United States ICONSTAFF Full time

    Job OverviewICONSTAFF is seeking a skilled and innovative software engineer with a focus on cloud technologies to enhance our clean energy solutions. This role involves developing robust cloud software and ensuring seamless integration with IoT applications on edge devices. You will play a key role in troubleshooting, debugging, and deploying comprehensive...


  • Boston, Massachusetts, United States Amazon Web Services, Inc. Full time

    Technical Customer Solutions ManagerThe AWS Industry Products (AIP) division is focused on crafting groundbreaking solutions within the automotive technology landscape through partnerships with industry pioneers. Our team collaborates intimately with key clients to develop tailored products that facilitate large-scale transformation.We are seeking a seasoned...

  • Principal Engineer

    18 hours ago


    Boston, Massachusetts, United States FactSet Research Systems Inc. Full time

    About the RoleWe are seeking a highly skilled and motivated Senior Full Stack Software Engineer to join our team at FactSet Research Systems Inc. This is a key position that will play a critical role in the development and maintenance of our software applications.Key ResponsibilitiesDesign and Implementation: Design, implement, test, document, maintain, and...


  • Boston, Massachusetts, United States SS&C Technologies Full time

    Senior Software EngineerSS&C - Boston, MASS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company based on revenue, SS&C is headquartered in Windsor, Connecticut and has 20,000+ employees in over 90 offices in 35 countries. Some 18,000...


  • Boston, Massachusetts, United States Amazon Web Services, Inc. Full time

    Technical Customer Solutions ManagerThe AWS Industry Products (AIP) division is focused on crafting groundbreaking solutions within the automotive technology landscape through partnerships with key industry players. Our mission is to collaborate with strategic clients to develop tailored products that facilitate large-scale transformation.We are seeking a...


  • Boston, Massachusetts, United States Momento USA Full time

    Job OverviewHello,We are seeking a Senior UI Java Developer to join our innovative team at Momento USA, a leading technology consulting and talent acquisition firm dedicated to solving complex challenges for our clients.Position: Senior UI Java DeveloperLocation: Boston, MA or within a commutable distanceIndustry: Financial ServicesExperience Level:...


  • Boston, Massachusetts, United States Momento USA Full time

    Job OverviewHello,We are excited to announce an opportunity for a Senior UI Java Developer at Momento USA, a leading global technology consulting and talent acquisition firm dedicated to solving our clients' most critical challenges.Position: Senior UI Java DeveloperLocation: Candidates must be able to work in Boston, MA, or within a commutable...


  • Boston, Massachusetts, United States Momento USA Full time

    Job OverviewHello,We are excited to present an opportunity at Momento USA, a premier global technology consulting and talent acquisition firm dedicated to addressing the most critical challenges faced by our clients. We are currently seeking a Senior UI Java Developer.Position: Senior UI Java DeveloperLocation: Candidates must be able to work in Boston, MA,...

  • Senior .Net Developer

    3 months ago


    Boston, Massachusetts, United States Elevax Technologies Inc Full time

    We have a 24+ Month Contract position with Homesite in Boston MA. The position is remote now until Covid-19 is over.We are looking for senior level tenured people with 8-10 years+ of development experience.This person must have .NET/C# but also have some knowledge of Java. They are moving legacy applications over to Java but they need someone who is strong...


  • Boston, Massachusetts, United States Lendbuzz Full time

    At Lendbuzz, we believe financial opportunity should be more personalized and fair. We develop innovative technologies that provide underserved and overlooked borrowers with better access to credit. From our employees to our dealers, partners, and borrowers, we've built a company and a culture around a resolute belief in the promise and power of diversity....