Azure Data Engineer
2 days ago
Location: Jersey City, NJ (Hybrid)
Duration: 6+ Months
Role Objectives
- Design, develop, testing & support of cloud data solutions for the CyberDW catalogue focusing on data ingestion, data quality, data tuning and performance of upstream cybersecurity data sources.
- Indirect leadership and mentorship of junior team members. Able to lead data feed development efforts and design initiatives. Participate in development meetings to align development priorities and objectives, assign tasks, and share experiences and challenges with applications under development.
- Consult with other technology and development teams as needed to coordinate on the integration of applications with the larger company software ecosystem.
- Capture and document metadata for identified Key Data Elements (KDEs) to ensure accuracy and completeness for Data Quality (DQ) rules and processing of daily datasets.
- Work with the data architecture team to align KDEs to the logical data models, develop physical data structures, and document physical data names, definitions, and data types.
- Partner with the data owners and stakeholders to create technical requirements and DQ rules around the data elements needed in the CyberDW. Partner with the Business Management team and Data Owners to understand what critical metrics and data fields are needed for Metric Dashboards.
- Establish CyberDW views to encapsulate the data so that it is fit for downstream consumption. Ensure that the data aligns with DQ rules established on that metadata, so it is fit for daily use. Utilize IBM TWS production job scheduling system and adhere to standards around the daily scheduling and batch monitoring of production jobs.
- Identify and resolve DQ issues including inaccuracies and incomplete information. Enhance data quality efforts by implementing improved procedures and processes.
- Bachelor's degree in Computer Science, Information Security, Data Management, or related field
- 10+ years' experience in IT development, data governance, data architecture or related roles, preferably in a highly regulated environment such as financial services.
- Strong knowledge of CI/CD and DevOps tooling (i.e., Git, Jenkins, Azure DevOps)
- Strong knowledge of Azure Databricks, Azure Data Factory, Azure Functions, Azure Data Lake storage, Azure Event Grid, Azure Log Analytics, Azure Monitor, Unity catalog repository configuration
- Proficient in data management & data modeling tools (e.g., Collibra DQIM/DQE, IBM Infosphere DA).
- Proficient in SQL Server, Oracle / PL-SQL, T-SQL and SQL stored procedures
- Proficient in Python, Java or similar high-level server-side languages
- Strong knowledge of enterprise Information Security data (i.e., Phishing, Identity Management, Privileged Access, Cloud Security, Incident Response, Vulnerability Management, Threat Detection).
- Data knowledge of PaaS/SaaS products (i.e., ServiceNow, Crowdstrike, MS Purview, Proofpoint, WIZ.IO, JIRA, SharePoint, Azure Active Directory, SAI360). Knowledge of Microsoft Sentinel for security information and event management (SIEM) is a plus.
- Understanding of information security frameworks (i.e., NIST, CIS, CRI Profile) and regulatory compliance (i.e., NYSDFS, GDPR, CCPA).
- Experience with REST API web services and microservice architecture. Strong understanding of ETL/ELT. Knowledge of IBM Tivoli Workload Scheduler a plus.
- Exposure to PowerBI for data visualization and reporting is a plus.
- Problem solving and analytical skills, with an initiative-taking and results oriented approach.
-
Azure Data Engineer
4 days ago
Jersey City, NJ, United States André Global, Inc. Full timeAzure Data Engineer: * 10+ years of strong experience in a large & complex application development environment, last 2 projects in investment banking or financial services industry and on data-heavy applications and systems * Strong programming experience in PySpark & Python or similar server-side languages * Proven experience as an Azure Data Engineer or in...
-
Azure Data Engineer
2 weeks ago
Jersey City, NJ, United States André Global, Inc. Full timeAzure Data Engineer: * 10+ years of strong experience in a large & complex application development environment, last 2 projects in investment banking or financial services industry and on data-heavy applications and systems * Strong programming experience in PySpark & Python or similar server-side languages * Proven experience as an Azure Data Engineer or in...
-
Azure Data Engineer
1 week ago
Jersey City, NJ, United States eTeam Full timeJob Title: Azure Data Engineer Duration: 3 Months Contract Location: Jersey City, NJ 07311 Hybrid role - 2 to 3 days onsite/weekSummary: Designs and builds data solutions using Microsoft Azure technologies. Responsibilities: Develop data pipelines Implement data lakes Ensure data security and compliance Skills: Azure certifications Experience with...
-
Azure Data Engineer
6 days ago
Jersey City, NJ, United States eTeam Full timeJob Title: Azure Data Engineer Duration: 3 Months Contract Location: Jersey City, NJ 07311 Hybrid role - 2 to 3 days onsite/weekSummary: Designs and builds data solutions using Microsoft Azure technologies. Responsibilities: Develop data pipelines Implement data lakes Ensure data security and compliance Skills: Azure certifications Experience with...
-
Azure Data Engineer
6 days ago
Jersey City, NJ, United States eTeam Full timeJob Title: Azure Data Engineer Duration: 3 Months Contract Location: Jersey City, NJ 07311 Hybrid role - 2 to 3 days onsite/weekSummary: Designs and builds data solutions using Microsoft Azure technologies. Responsibilities: Develop data pipelines Implement data lakes Ensure data security and compliance Skills: Azure certifications Experience with...
-
Azure Data Engineer
2 days ago
Jersey City, NJ, United States ETHIRE LLC Full timeJob Description Job Description Job Title: Azure Data Engineer Location: Jersey City, NJ (Hybrid) Contract: 3 months on W2 Summary: Designs and builds data solutions using Microsoft Azure technologies. Responsibilities: Develop data pipelines, implement data lakes, ensure data security and compliance. Skills: Azure certifications, experience with Synapse,...
-
Azure Data Engineer
8 hours ago
Jersey City, NJ, United States ETHIRE LLC Full timeJob Description Job Description Job Title: Azure Data Engineer Location: Jersey City, NJ (Hybrid) Contract: 3 months on W2 Summary: Designs and builds data solutions using Microsoft Azure technologies. Responsibilities: Develop data pipelines, implement data lakes, ensure data security and compliance. Skills: Azure certifications, experience with Synapse,...
-
Lead Azure Data Engineer
7 days ago
Jersey City, NJ, United States Zencon Group Full timeJob Title: Lead Azure Data Engineer Location: Jersey City, NJ/ New York - 4 days onsite role Long Term Role Required Skills & Qualifications: • Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, and Azure Stream Analytics. • Design and maintain data models, warehouses, and lakes that support BI and advanced analytics. ...
-
Lead Azure Data Engineer
4 days ago
Jersey City, NJ, United States Zencon Group Full timeJob Title: Lead Azure Data Engineer Location: Jersey City, NJ/ New York - 4 days onsite role Long Term Role Required Skills & Qualifications: • Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, and Azure Stream Analytics. • Design and maintain data models, warehouses, and lakes that support BI and advanced analytics. ...
-
Azure Data Engineer
16 hours ago
Jersey City, NJ, United States Genesis10 Full timeGenesis10 is currently seeking an Azure Data Engineer with our Banking Company client in their Jersey City, NJ location. This is a 2 month + contract hybrid position. Responsibilities: Designs and builds data solutions using Microsoft Azure technologies. Develop data pipelines, implement data lakes, ensure data security and compliance. Requirements: ...
