Sr. Data Engineer

1 month ago

Boston, United States Cloudious LLC Full time
Job DescriptionJob DescriptionJob Type: ContractRate: $65

Required Skills: Databricks/Spark/Scala, Python,Spark in Scala, Databricks,Databricks Delta Lake, Databricks SQL

  • We are seeking a highly skilled Sr. Data Engineer with 10 to 14 years of experience to join our team as a Business Associate - BC.
  • The ideal candidate will have extensive experience in Databricks, Databricks Delta Lake, and Databricks SQL, with additional skills in Spark in Scala and Python being a plus.
  • This role will involve designing and implementing data solutions that drive business success and innovation.

Roles & Responsibilities

  • Lead the design and implementation of data solutions using Databricks, ensuring high performance and scalability
  • Oversee the integration of Databricks Delta Lake to manage and optimize large datasets
  • Provide expertise in Databricks SQL to develop complex queries and data models
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
  • Ensure data solutions are aligned with business goals and objectives, driving efficiency and innovation
  • Develop and maintain documentation for data architectures, solutions, and processes
  • Monitor and optimize data pipelines to ensure data quality and reliability
  • Implement best practices for data governance and security, ensuring compliance with industry standards
  • Mentor and guide junior team members, fostering a culture of continuous learning and improvement
  • Conduct regular code reviews to ensure high-quality code and adherence to best practices
  • Stay updated with the latest trends and advancements in data technologies, incorporating them into the teams work
  • Provide technical support and troubleshooting for data-related issues, ensuring minimal downtime
  • Collaborate with stakeholders to identify opportunities for data-driven improvements and innovations

Qualifications

  • Possess extensive experience in Databricks, Databricks Delta Lake, and Databricks SQL
  • Have a strong understanding of data architecture and data engineering principles
  • Demonstrate proficiency in developing and optimizing data pipelines
  • Show expertise in data governance and security best practices
  • Exhibit strong problem-solving skills and the ability to troubleshoot complex data issues
  • Have experience in mentoring and guiding junior team members
  • Display excellent communication skills, with the ability to convey technical concepts to non-technical stakeholders
  • Be familiar with Spark in Scala and Python, with hands-on experience being a plus

Certification(s) Required: Databricks Certified Professional Data Engineer, Aws Certified Big Data - Specialty

  • Sr Data Engineer

    3 days ago

    Boston, United States Simple Solutions Full time

    Certification(s) Required : DATABRICKS CERTIFIED PROFESSIONAL DATA ENGINEER AWS CERTIFIED BIG DATA SPECIALTYSr. Data Engineer***5 days onsite in Boston MAJob summaryExperience : 10to14YrsRequired Skills : Databricks/Spark/Scala PythonSpark in Scala DatabricksDatabricks Delta LakeDatabricks SQL Certification(s) Required : DATABRICKS CERTIFIED PROFESSIONAL...

  • Sr. Data Engineer

    5 days ago

    Boston, United States VDart Inc Full time

    Job DescriptionJob DescriptionTitle: Sr. Data EngineerLocation: Boston, MA (Onsite)Type: ContractPosition General Duties and Tasks: Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshift Expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL Proficient in Python programming for...

  • Sr. Data Engineer

    3 weeks ago

    Boston, United States Irvine Technology Corporation Full time

    Position: Sr. Data Engineer (AWS, Pyspark/Snowflake/Glue, Tableau or MySQL)Location: 100% Remote, EST HoursDuration: 6+ month contract, will go longerHourly Rate: 65/hr to 75/hr (W2 Only Client)Responsibilities:Runs a strategic program or initiative and navigates the overall landscape/domainHelps set the strategic agenda and define near and long-term...

  • Sr. Data Engineer

    4 weeks ago

    Boston, United States Irvine Technology Corporation Full time

    Position: Sr. Data Engineer (AWS, Pyspark/Snowflake/Glue, Tableau or MySQL)Location: 100% Remote, EST HoursDuration: 6+ month contract, will go longerHourly Rate: 65/hr to 75/hr (W2 Only Client)Responsibilities:Runs a strategic program or initiative and navigates the overall landscape/domainHelps set the strategic agenda and define near and long-term...

  • Data Engineer/Data Architect

    5 days ago

    Boston, United States Techpros Full time

    Our client is a software company that has built a platform for energy providers involving green energy and renewables.Based in Boston, they are open to 100% remote.They are profitable and building a new platform on a microservices, Saas-based architecture in the cloud, to enable them to scale and handle all new business.They are offering base, bonus, and a...

  • Data Engineer/Data Architect

    3 months ago

    Boston, MA, United States Techpros Full time

    Our client is a software company that has built a platform for energy providers involving green energy and renewables.Based in Boston, they are open to 100% remote.They are profitable and building a new platform on a microservices, Saas-based architecture in the cloud, to enable them to scale and handle all new business.They are offering base, bonus, and a...

  • Sr System Requirements Engineer

    3 months ago

    Boston, United States Haemonetics Software Solutions Full time

    Haemonetics is committed to the protection of personal data in accordance with applicable laws and regulations. The editor and data controller ofwww.haemonetics.com is Haemonetics Corporation, 125 Summer Street, Boston, Massachusetts, 02110 U.S.A. The global Data Privacy Officer of Haemonetics can be reached at this address. Sr System Requirements Engineer...

  • Sr. Validation Engineer

    6 days ago

    Boston, United States Barry-Wehmiller Companies Inc Full time

    About Us: Design Group operates from more than 45 offices in the United States and India, providing engineering, consulting and technical services for the world’s leading companies in the food and beverage, life sciences, advanced technology, industrial and other market sectors. Our nearly 1,500 technical and engineering experts have direct industry...

  • Sr. Validation Engineer

    4 days ago

    Boston, United States Pcmc Inc Full time

    About Us: Design Group operates from more than 45 offices in the United States and India, providing engineering, consulting and technical services for the world’s leading companies in the food and beverage, life sciences, advanced technology, industrial and other market sectors. Our nearly 1,500 technical and engineering experts have direct industry...

  • Sr. Data Analyst

    2 months ago

    Boston, United States Manage My Dream, LLC Full time

    Job DescriptionJob DescriptionTitle: Sr. Data AnalystLocation: 1 Post Office Square, Boston-MADuration: 12+ monthsPosition Overview:The Data Analyst works as part of the Data Platform Team within the Data & Analytics Group. The primary responsibilities are to analyze enterprise and vendor datasets, understand data characteristics and methodologies, and...

  • Sr. Validation Engineer

    2 months ago

    Boston, United States Barry-Wehmiller Companies Inc Full time

    About Us: Design Group operates from more than 45 offices in the United States and India, providing engineering, consulting and technical services for the world's leading companies in the food and beverage, life sciences, advanced technology, industrial and other market sectors. Our nearly 1,500 technical and engineering experts have direct industry...

  • Sr. Data Analyst

    2 months ago

    Boston, United States Russell Tobin & Associates Full time

    What are we looking for in our Sr. Data Analyst? Duration: 12 months with possibility of extension Pay range: $90-115/hour on W2 (Depending on Experience) Location: Boston, MA – Hybrid (3 days a week in office) Client: Investment Banking Position Overview:The primary responsibilities are to analyze enterprise and vendor datasets,...

  • Azure Data Engineer/Data Engineer

    5 days ago

    Boston, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title: Azure Data Engineer/Data EngineerLocation: Boston, MA-OnsiteDuration: 6+ MonthsSome of the key qualifications we are looking for:Have hands-on experience with writing Stored ProceduresHave experience working with Azure cloud platformHave experience working with ADF and ETL pipelinesUnderstand and worked with...

  • Sr. Engineer: AI/ML

    4 weeks ago

    Boston, United States BigRio Full time

    Sr. Engineer: AI/ML Location: Boston, MA- OnsiteDuration - Full TimeAbout BigRio:BigRio is a remote-based, technology consulting firm with headquarters in Boston, MA. We deliver solutions ranging from: custom development, software implementation, data analytics, and machine learning/AI integrations. We are a one-stop shop that attracts clients from a variety...

  • Sr. Engineer: AI/ML

    4 weeks ago

    Boston, United States BigRio Full time

    Sr. Engineer: AI/ML Location: Boston, MA- OnsiteDuration - Full TimeAbout BigRio:BigRio is a remote-based, technology consulting firm with headquarters in Boston, MA. We deliver solutions ranging from: custom development, software implementation, data analytics, and machine learning/AI integrations. We are a one-stop shop that attracts clients from a variety...

  • Sr System Requirements Engineer

    3 months ago

    Boston, United States Haemonetics Full time

    We are constantly looking to add to our core talent. If you are seeking a career that is challenging and rewarding, a work environment that is diverse and dynamic, look no further - Haemonetics is your employer of choice. Job Details Sr System Requirements Engineer This role will own and manage the requirements for New Product Innovation (NPI) at...

  • Azure Data Engineer/Cloud Data Engineer

    2 days ago

    Boston, Massachusetts, United States VDart Inc Full time

    Job Title: Azure Data Engineer/Data EngineerJob Summary:We are seeking a highly skilled Azure Data Engineer to join our team at VDart Inc. As a key member of our cross-functional data engineering team, you will be responsible for designing, building, and maintaining large-scale data warehouses and data pipelines using Azure cloud platform.Key...

  • Data Engineer

    4 weeks ago

    Boston, United States Robert Half Full time

    We are currently seeking an experienced Data Engineer who is proficient in utilizing Azure and DBT. As part of our dynamic and growing data team, the successful candidate will be responsible for designing, developing, and managing data integration processes, ensuring that extraction, transformation, and loading (ETL) processes operate smoothly. In addition,...

  • Data Engineer

    4 weeks ago

    Boston, United States Robert Half Full time

    We are currently seeking an experienced Data Engineer who is proficient in utilizing Azure and DBT. As part of our dynamic and growing data team, the successful candidate will be responsible for designing, developing, and managing data integration processes, ensuring that extraction, transformation, and loading (ETL) processes operate smoothly. In addition,...

  • Data Engineer

    3 weeks ago

    Boston, United States Highview Staffing Full time

    One of Boston's most prestigious and successful Asset Management firms is looking to add an experienced Data Engineer to their team reporting in to the growing IT organization. The firm has been providing expert investment strategy and management for decades in the Boston market and across the globe. This is a full time permanent role that offers cutting...