Senior Data Lake Engineer

4 weeks ago


Boston, Massachusetts, United States ExperienceFlow Full time
Job Description


Do you love to program? Are you excited about new technology experimentation? Are you looking for a new challenge that stretches your talents? Then this could be the role for you.


At , we are looking for a Big Data Developer that loves solving complex problems across a full spectrum of technologies.

You will help ensure our technological infrastructure operates seamlessly in support of our business objectives.

Objectives of this Role

  • Develop and implement data pipelines that extracts, transforms and loads data into an information product that helps to inform the organization in reaching strategic goals
  • Work on ingesting, storing, processing and analyzing large data sets
  • Create scalable and high-performance web services for tracking data
  • Translate complex technical and functional requirements into detailed designs
  • Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented
  • Serve as a mentor to junior staff by conducting technical training sessions and reviewing project outputs
Daily and Monthly Responsibilities

  • Develop and maintain data pipelines implementing ETL processes
  • Take responsibility for Hadoop development and implementation
  • Work closely with a data science team implementing data analytic pipelines
  • Help define data governance policies and support data versioning processes
  • Maintain security and data privacy working closely with Data Protection Officer internally
  • Analyze a vast number of data stores and uncover insights
Skills and Qualifications

  • Experience in Python, Spark and Hive
  • Understanding of data warehousing and data modeling techniques
  • Knowledge of industry-wide analytical and visualization tools (Tableau and R)
  • Strong data engineering skills on the Azure Cloud Platform is essential
  • Streaming frameworks like Kafka
  • Knowledge of core Java, Linux, SQL, and any scripting language
  • Good interpersonal skills and positive attitude
Preferred Qualifications

  • Degree in computer sciences, maths or engineering
  • Expertise in ETL methodology of Data Extraction, Transformation and Load processing in corporate wide ETL solution design using Data Stage

focuses on Enterprise Software, Artificial Intelligence, Artificial Intelligence / Machine Learning, and B2B · SaaS · Mobile · Artificial Intelligence / Machine Learning.

Their company has offices in San Francisco, Boston, India, and Ukraine. They have a small team that's between 11-50 employees.

You can view their website at

  • Boston, Massachusetts, United States GMO Full time

    Company ProfileFounded in 1977, GMO is a global investment manager committed to delivering superior long-term investment performance and advice to our clients. We offer strategies and solutions where we believe we are positioned to add the greatest value for our investors. These include multi-asset class, equity, fixed income, and alternative offerings. We...

  • Data Engineer

    4 weeks ago


    Boston, Massachusetts, United States Selby Jennings Full time

    Responsibilities Include: Develop and deploy SQL and Python solutions tailored for Portfolio Management, Operations, Marketing, and Client Reporting teams.Administer an Azure Synapse Enterprise Data Warehouse.Transition current systems to a cloud-based infrastructure.Establish efficient data modeling and access strategies to enable high-performance yet...


  • Boston, Massachusetts, United States Selby Jennings Full time

    Responsibilities:Develop, implement, and maintain data governance technologiesImplement data-related standards and architectures in alignment with data quality, data lineage, and data discoverability strategic initiativesCreate check in source systems and data pipelines Qualifications:Bachelor's degree in Computer Science or Information Systems3 to 5 years...


  • Boston, Massachusetts, United States Selby Jennings Full time

    Your Skillset: Possession of a Bachelor's degree or higher in Computer Science, Management Information Systems, Business Information Systems, Mathematics, or a related field.7 or more years of experience in data engineering, with a track record of holding senior and leadership roles within peer firms. Proficient in utilizing agile methodologies and modern...

  • Data Engineer

    3 weeks ago


    Boston, Massachusetts, United States Jellyfish Full time

    As a member of Jellyfish Research, you will work closely with data scientists to understand and facilitate data needs for high-impact research, analysis and reporting. You will optimize, expand or redesign our current data platforms, including storage and pipeline architecture, to ingest, combine, and aggregate data from multiple sources. You'll also build...

  • Data Engineer

    4 weeks ago


    Boston, Massachusetts, United States Northeastern University Full time

    The College of Social Sciences and Humanities is a leader in the Experiential Liberal Arts. The College is strongly committed to fostering excellence through diversity and enthusiastically welcomes applications from members of groups underrepresented in higher education administration.The College's schools, departments, and programs—with disciplines...


  • Boston, Massachusetts, United States WHOOP Full time

    At WHOOP, we're on a mission to unlock human performance. WHOOP empowers its members to perform at a higher level through a deeper understanding of their bodies and daily lives.The Senior Android Engineer will be involved in the planning, design, development, validation, and maintenance of various features of the WHOOP application. The WHOOP application...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    Our client is a cloud sensor device start-up, that is revolutionizing the way data is collected, analyzed, and utilized in various industries. Their cutting-edge technology leverages cloud computing and sensor devices to provide real-time insights and enhance decision-making processes for companies. As they continue to grow, we're seeking a talented Senior...


  • Boston, Massachusetts, United States Affinity Full time

    Representing a leader in the industry, we are searching for an experienced Transportation Project Engineer-SENIOR. This is an immediate opportunity, so we are looking to schedule interviews as soon as possible.The Project Engineer will be joining their team at one of four Massachusetts offices: Boston, Andover, Worcester, or Yarmouth. Our...


  • Boston, Massachusetts, United States Selby Jennings Full time

    3+ years of professional experience in software engineering, with a strong preference for a focus on quantitative applications.Expertise in Python and Pandas, coupled with proficiency in related scientific libraries such as NumPy, SciPy, statsmodels, and scikit-learn.Hands-on experience in developing mission-critical production systems, with a solid...

  • Data Engineer

    1 week ago


    Boston, Massachusetts, United States firsthand Full time

    firsthand is changing the way individuals living with Serious Mental Illness (SMI) get care. We are focusing on delivering real outcomes for a cohort that has historically been underserved, stigmatized, and deprioritized. By building a service focused on whole-person care, firsthand aims to find, establish a trusting relationship with, and support quality...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    My client is a pioneering 3D printing company at the forefront of revolutionizing industries such as aerospace, consumer products, and healthcare. Their cutting-edge technology is reshaping manufacturing processes and pushing the boundaries of what's possible. They're seeking a Senior Full Stack Engineer to join their growing team.As a Senior Fullstack...

  • Data Engineer

    3 weeks ago


    Boston, Massachusetts, United States Selby Jennings Full time

    We have a current opportunity for a Data Engineer - Markit EDM on a permanent basis. The position will be based in Boston. For further information about this position please apply.


  • Boston, Massachusetts, United States Selby Jennings Full time

    Essential Qualifications:Possess 5-7 years of professional experience in software engineering, with a specific emphasis on quantitative applications.Demonstrate expert proficiency in Python and Pandas, coupled with a high level of competence in related scientific libraries such as NumPy, SciPy, statsmodels, and scikit-learn.Showcase hands-on experience in...


  • Boston, Massachusetts, United States Selby Jennings Full time

    Essential:5-7 Years of Professional Experience: Demonstrated proficiency with 5-7 years of professional experience in software engineering, preferably emphasizing quantitative applications.Expert Knowledge of Python and Pandas: Mastery of Python and Pandas, coupled with proficiency in related scientific libraries like NumPy, SciPy, statsmodels, and...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    My client is a leading provider of advanced data analytics solutions, empowering businesses to measure performance and glean insights from their data with precision and efficiency. Their innovative platform leverages cutting-edge technologies to deliver actionable intelligence to clients across various industries. They're hiring for a Senior FullStack...


  • Boston, Massachusetts, United States Motion Recruitment Full time

    Out Client are a global leader in purchase intent-driven marketing and sales services and are looking to add a Senior Software Quality Assurance Engineer to their team. Their goal is to continue creating purchase intent insights to fuel effective marketing and sales activities.As a Senior Software Quality Assurance Engineer you will be playing a key role in...


  • Boston, Massachusetts, United States Dart Point Full time

    Responsibilities Work in conjunction with Developers and Data Engineers to ensure high quality Data Deliverable. Working with the development teams from different groups in the organization help identify inconsistent data patterns and how they are manifested from the source processes. Design implement and use data quality assurance frameworks to support the...

  • Data Scientist

    3 weeks ago


    Boston, Massachusetts, United States Jellyfish Full time

    We're looking for a Data Scientist to join Jellyfish Research, working closely with a wide range of stakeholders to understand data needs across the business, and synthesize those needs to provide a variety of data products and platforms that enable data-informed decision making. Our stakeholders range from product development teams to senior leaders at...


  • Boston, Massachusetts, United States WHOOP Full time

    At WHOOP, we're on a mission to unlock human performance. WHOOP empowers members (Olympians, Professional Athletes, Fitness Enthusiasts, etc) to perform at a higher level through a deeper understanding of their bodies and daily lives. We are looking to add highly motivated skilled engineers to our team to help us scale and take our proven system to new...