Lead Data Engineer
1 week ago
Job Title- Lead Data Engineer
Location: Remote
Duration: 6 Months Contract to Hire
(Quarterly Onsite for a few days in Dallas TX)
bout BigRio:
BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine Learning, and Custom Software strategy, analysis, architecture, and implementation solutions. We are an elite group with MIT roots, shining when tasked with complex missions. Whether it's assembling mounds of data from a variety of sources, surfacing intelligence with Deep Learning, or building high-volume, highly-available systems, we consistently deliver.
Job Overview
We are looking for a Senior Back End / Data Engineer to join our Data Engineering team. The ideal candidate will have an advanced knowledge of building Data Pipelines, batch processing frameworks, and Data Modeling techniques to facilitate seamless Data Ingestion and Exports. In this role you will collaborate with various technology and business stakeholders to deliver data solutions that meet user needs. The candidate should possess intellectual acumen, with an engineering mindset and an interest in developing enterprise scale solutions using industry recognized cloud platforms, databases, data integration/orchestration tools, and big data technologies.
Responsibilities:
Design and implement robust, scalable, and high-performance data pipelines to support the organization's data needs.
Implement Data Ingestion, transformation, and Data Quality features to support Application Engineering, Analytics, and various Business Verticals across the organization.
Collaborate with Data Architect, and Business Analysts in building data models to improve reliability and interpretability of data for analytical and business needs.
Design, develop, and maintain robust data export solutions to facilitate the efficient transfer of data to external systems and platforms.
ctively contribute to the creation of design documents, assess technologies, and conduct Proof of Concepts (PoCs).
Experience supporting production jobs and mitigate issues in a timely manner.
Write unit, integration, and functional tests for new features.
Contribute to the Technology Roadmap, PR Reviews and formulate standards/best practices.
Bring in a positive attitude and foster a culture that embraces continuous learning and Innovation.
Experience:
5+ years of experience as a Data Engineer, with a focus on building enterprise data solutions.
3+ years of Cloud Experience: Azure (preferred)/AWS/GCP.
Expert in Microsoft SQL Server (preferred) or other relational databases.
Strong experience in Microsoft ETL stack, SSIS, Azure Data factory.
Strong programming skills in Python, C# or any other programming language.
Expertise with SQL, stored procedures, triggers, and performance tuning.
Experience working with Big Data technologies: Spark, Databricks or other frameworks.
Prior experience in building data pipelines that are scalable, reliable and fault tolerant while delivering data integrity and code quality.
Experience in building data lakes to support high speed querying by the end users.
Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
Prior Experience working with Healthcare Information exchange standards like HL7, X12 EDI, FHIR will be helpful.
Experience or knowledge with creating RESTful API's is a plus.
Experience building Dashboards and visualizations using Power BI or other tools is a plus.
-
Sr Data Engineer
1 week ago
Boston, United States NTT DATA Full timeNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Boston, Massachusetts (US-MA), United States (US). Job Description: Create and...
-
Sr Systems Engineer, Data Platform
1 week ago
Boston, United States VAST Data Full timeDescription VAST Data is looking for a Sr Systems Engineer, Data Platform to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the...
-
Boston, United States NTT DATA Full timeData & Analytics Consulting Manager (Life and Annuity) Company: NTT DATA Services Job Duties: Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data...
-
Boston, United States NTT DATA Full timeData & Analytics Consulting Manager (Life and Annuity) Company: NTT DATA Services Job Duties: Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data...
-
Boston, United States NTT DATA Full timeLocation - US/Boston Job Duties: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater...
-
Boston, United States NTT DATA Full timeLocation - US/Boston Job Duties: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater...
-
Sr Data Engineer
4 weeks ago
Boston, United States NTT DATA Services Full timeReq ID: 300069 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Boston, Massachusetts (US-MA), United States (US).Job Duties:...
-
Sr Data Engineer
1 week ago
Boston, United States NTT DATA Group Corporation Full timeNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Boston, Massachusetts (US-MA), United States (US). Job Description: Create...
-
Boston, United States NTT DATA, Inc. Full timeData & Analytics Consulting ManagerCompany: NTT DATA Services Job Duties: Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional and non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery,...
-
Lead Data Engineer
7 days ago
South Boston, United States Diverse Lynx Full timePosition: Lead Data Engineer Location: Boston, MA / Quincy MA Duration: Contact Required Skill: Senior/Lead developer position who has extensive experience with development/design in Azure Databricks (language :Scala) experience. 2. The candidate should have strong experience in either Databricks or Snowflake however Databricks knowledge is must 3. The...
-
Boston, United States NTT DATA, Inc. Full timeData & Analytics Consulting ManagerJob Duties: Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater...
-
Data Analytics Engineering Lead
7 days ago
Boston, Massachusetts, United States MassMutual Full timeJob OverviewWe are seeking a skilled Data Analytics Engineering Lead to join our team at MassMutual. This role will be responsible for designing, building, and measuring complex data management processes to master data for different domains.Key ResponsibilitiesAssimilate data from diverse sources into a high-quality data repository.Develop Master Data...
-
Lead Data Science Engineer
4 weeks ago
Boston, United States DraftKings Full timeWe are seeking a Lead Data Science Engineer to join our team at DraftKings. In this role, you will lead impactful data science projects to create the most relevant product in the Sportsbook industry. You will drive the development and implementation of statistical models and machine learning algorithms, collaborating with cross-functional teams to integrate...
-
Boston, United States NTT DATA, Inc. Full timeData & Analytics Consulting Manager (Life and Annuity)Company: NTT DATA ServicesJob Duties:Create and maintain optimal data pipeline architecture.Assemble large, complex data sets that meet functional/non-functional business requirements.Identify, design, and implement system internal process improvements: automating manual processes, optimizing data...
-
Data Engineer
7 days ago
Boston, Massachusetts, United States NTT DATA Group Corporation Full timeJob Summary:We are seeking a highly skilled Data Engineer - Pipeline Architect to join our team. In this role, you will be responsible for designing and implementing optimal data pipeline architecture, assembling large and complex data sets, and identifying opportunities for process improvements.Key Responsibilities:Create and maintain data pipeline...
-
Boston, Massachusetts, United States Fidelity Investments Full timeWe are seeking a highly skilled Data Engineer Lead to join our team at Fidelity Investments. As a key member of our data engineering team, you will be responsible for leading the development and implementation of blockchain-based solutions to support our partners in the financial services industry.About the RoleThis is a challenging and rewarding opportunity...
-
Data Engineering Lead
1 week ago
Boston, Massachusetts, United States Insource Services, Inc. Full timeJob SummaryWe are seeking a highly skilled Data Engineering Lead to join our team at Insource Services, Inc. This is a fantastic opportunity for an experienced data professional to take on a leadership role in designing and implementing cutting-edge data solutions for our healthcare clients.About the RoleWe need someone with strong technical expertise in...
-
Lead Data Architect
2 weeks ago
Boston, United States NAM Info Inc Full timeJob Role- Lead Data ArchitectLocation- Boston-MA Onsite & Remote CanadaDuration- 12-24 Months ContractJob ResponsibilitiesWork independently to solve open-ended questions.Help lead and manage the design, testing, and implementation of databases (Azure SQL and/or Snowflake) that support productionized BI dashboards (PowerBI, Tableau) and custom analytic...
-
Boston, United States DraftKings Full timeWe’re defining what it means to build and deliver the most extraordinary sports and entertainment experiences. Our global team is trailblazing new markets, developing cutting-edge products, and shaping the future of responsible gaming. Here, “impossible” isn’t part of our vocabulary. You’ll face some of the toughest but most rewarding challenges of...
-
Boston, United States DraftKings Full timeWe’re defining what it means to build and deliver the most extraordinary sports and entertainment experiences. Our global team is trailblazing new markets, developing cutting-edge products, and shaping the future of responsible gaming. Here, “impossible” isn’t part of our vocabulary. You’ll face some of the toughest but most rewarding challenges of...