Data Engineer
3 weeks ago
Responsibility
Deploy modern data management tools to curate our most important data sets, models and processes, while identifying areas for process automation and further efficiencies
Evaluate, select and acquire new internal & external data sets that contribute to business decision-making.
Engineer streaming data processing pipelines.
Drive adoption of Cloud technology for data processing and warehousing (AWS ,Azure).
Engage with data consumers and producers in order to design appropriate models to suit all needs.
Skills and Experience we are looking for
8 - 11 years (expert) / 11+ years (advanced) of relevant work experience in a team-focused environment
A bachelor's degree (Masters preferred) in a computational field (Computer Science, Applied Mathematics, Engineering, or in a related quantitative discipline)
Working knowledge of more than one programming language (Python, Java, C , C#, etc.)
Deep understanding of multi multi-dimensionality of data, data curation and data quality, such as traceability, security, performance latency and correctness across supply and demand processes
In-depth knowledge of relational and columnar SQL databases, including database design
General knowledge of business processes, data flows and the quantitative models that generate or consume data
Excellent communication skills and the ability to work with subject matter expert to extract critical business concepts
Independent thinker, willing to engage, challenge or learn
Ability to stay commercially focused and push for quantifiable commercial impact
Strong work ethic, a sense of ownership and urgency
Strong analytical and problem-solving skills
Ability to collaborate effectively across global teams and communicate complex ideas in a simple manner
Strong understanding of data structure and algorithms
Functional knowledge of buy-side business is good to have
Working with data pipes from Bloomberg, Reuters, Fact set etc. is good to have.
Preferred Qualifications
Hadoop, HBase, spark, Apache Arrow, data streaming
Custom Data Catalog, Airflow, Grafana, Iceberg, Fast API, Python
Scraping large-scale public datasets in real time
Building and maintaining large-scale high performance computing applications
-
Data Engineer
1 month ago
New York, United States Silver Search, Inc Full timeData Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...
-
Data Engineer
2 weeks ago
New York County, New York, United States Codex Tech-IT Full timeCodex Tech-IT is a leading technology solutions provider specializing in data management and analytics. We are seeking a skilled Data Engineer to join our team and contribute to the development and maintenance of our data infrastructure. With a strong focus on data quality and accuracy, our Data Engineers play a crucial role in ensuring our clients have...
-
Manufacturing Engineer
1 week ago
New York, United States Onset Data Loggers Full timeBased in Bourne, Massachusetts, for more than 40 years Onset has been dedicated to designing and producing high-quality data loggers. Our manufacturing processes ensure precision and reliability in data logging technology. Onset's products are trusted worldwide for capturing critical data, making them an essential choice for professionals and organizations...
-
Data Engineer
4 weeks ago
New York, United States Net2Source Inc. Full timeW2 Candidates OnlyPosition: Data Engineer – IIILocations: New York, NY - 10038 (Hybrid)Duration: 12+ months ContractQualifications:Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plusExpert-level experience in...
-
Data Engineer
4 weeks ago
New York, United States Net2Source Inc. Full timeW2 Candidates OnlyPosition: Data Engineer – IIILocations: New York, NY - 10038 (Hybrid)Duration: 12+ months ContractQualifications:Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plusExpert-level experience in...
-
Data Engineer
4 weeks ago
New York, New York, United States Masterworks Full timeMasterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...
-
Data Engineer
4 weeks ago
New York, New York, United States TopEdge Technology Full timeJob DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...
-
Data Engineer
2 weeks ago
New York County, New York, United States New York Blood Center Inc Full timeOverview: At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing...
-
Data Engineer
4 weeks ago
New York, United States Capstone Investment Advisors Full timeRESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...
-
Data Engineer
2 days ago
New York, United States Jane Street Full timeAbout the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...
-
Data Engineer
4 weeks ago
New York, United States Open Systems Technologies Full timeA financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...
-
Data Engineer
4 weeks ago
New York, United States Open Systems Technologies Full timeA financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...
-
Data Engineer
4 weeks ago
New York, United States Jane Street Full timeAbout the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...
-
Data Engineer
5 days ago
New York, United States Open Systems Technologies Full timeAn international law firm is looking for a Data Engineer to join their team in NYC. Compensation: $115-160kThe Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder who enjoys optimizing data systems and...
-
Data Engineer
5 days ago
New York, United States Open Systems Technologies Full timeAn international law firm is looking for a Data Engineer to join their team in NYC. Compensation: $115-160kThe Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder who enjoys optimizing data systems and...
-
Senior Data Engineer
4 weeks ago
New York, United States Bayforce Full timeThe Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...
-
Senior Data Engineer
4 weeks ago
New York, United States Bayforce Full timeThe Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...
-
Sr Data Engineer
3 weeks ago
New York, United States Ticketing technology company Full timeRole Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...
-
Sr Data Engineer
4 weeks ago
New York, United States Ticketing technology company Full timeRole Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...
-
Sr Data Engineer
4 weeks ago
New York, United States Ticketing technology company Full timeRole Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...