Data Engineer

2 days ago

Richmond, VA, United States Internet Society Full-time
About the Internet Society The Internet Society (ISOC) supports and promotes the development of the Internet as a global technical infrastructure, a resource to enrich people’s lives, and a force for good in society. Our work aligns with our goals for the Internet to be open, globally connected, secure, and trustworthy. We seek collaboration with all who share these goals. Together, we focus on building and supporting the communities that make the Internet work; advancing the development and application of Internet infrastructure, technologies, and open standards; and advocating for policy that is consistent with our view of the Internet. About the Position The Data Engineer is responsible for building, maintaining, operating, and optimizing the Internet Society’s modern data platform, with a primary focus on Microsoft Fabric, Power BI, and related database technologies. Reporting to the Senior Director, Data & Analytics, this role develops scalable data pipelines, lakehouse and warehouse solutions, semantic models, integrations, and trusted datasets that support reporting, analytics, governance, and AI-ready decision-making across the organization. Location Remote
- from home location Essential Duties and Responsibilities Design, build, test, deploy, and operate data engineering solutions in Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Data Factory pipelines, SQL analytics endpoints, semantic models, Direct Lake, and deployment pipelines. Develop and maintain reliable ETL/ELT pipelines that ingest, transform, validate, and publish data from enterprise systems, SaaS platforms, APIs, files, and relational databases. Implement lakehouse, data warehouse, medallion architecture, and dimensional modelling patterns that enable trusted reporting, analytics, and AI-ready data products. Build and optimize Power BI semantic models, datasets, measures, dataflows, and reports in partnership with analysts and business stakeholders. Develop, tune, and maintain database solutions using related technologies including Azure SQL Database, SQL Server, Fabric Warehouse, PostgreSQL, Delta Lake, Spark SQL, T-SQL, KQL, and other fit-for-purpose relational, lakehouse, and analytical data stores. Apply data quality, observability, testing, reconciliation, lineage, and monitoring practices to ensure data products are accurate, reliable, secure, and supportable. Contribute hands-on technical expertise to the development of the Internet Society’s data governance, management, integration, and analytics strategy. Partner with business and technology teams to understand data needs, translate requirements into technical designs, and deliver reusable data assets that improve transparency and decision-making. Automate manual reporting and data delivery processes using Microsoft Fabric, Power BI, Power Automate, PowerShell, Python, SQL, and platform-native scheduling and orchestration capabilities. Support secure platform operations by following established standards for access controls, workspace management, source control, deployment, documentation, and change management. Remain current on Microsoft Fabric, Power BI, database, analytics, and AI-related data platform capabilities and recommend practical improvements to the organization’s data engineering practices. Other duties as assigned. Desired Qualifications The ideal candidate will have 5-7 years of progressive hands-on data engineering experience, including strong proficiency in the following areas: Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Data Factory, notebooks, Spark, SQL analytics endpoints, Direct Lake, semantic models, deployment pipelines, and workspace administration basics. Power BI, including data modelling, semantic model design, DAX, Power Query, dataflows, report development, performance optimization, and governance of shared datasets. Database and query technologies including Azure SQL Database, SQL Server, Fabric Warehouse, PostgreSQL, Spark SQL, T-SQL, Delta Lake, and relational/data warehouse design patterns. Python 3.x for data engineering, including common libraries such as Pandas, Requests, SQLAlchemy, Pytest, and related tools for API integration, automation, testing, and data transformation. ETL/ELT design, orchestration, scheduling, monitoring, and troubleshooting across batch, incremental, API-based, file-based, relational, and analytical data sources. Modern data architecture concepts including lakehouse, data lake, data warehouse, medallion architecture, dimensional modelling, star schema, 3NF, semantic layers, and reusable data products. Data quality, testing, reconciliation, metadata, lineage, documentation, observability, and operational monitoring practices. Microsoft Purview and related governance capabilities, including cataloguing, classification, lineage, access control concepts, compliance support, a