IT Data Engineer
1 month ago
Job Description
The New York City Taxi and Limousine Commission (TLC) is the City agency responsible for regulating for-hire transportation in New York City, including taxis, street hail liveries, high-volume for-hire services such as Uber and Lyft, black cars, luxury limousines, livery vehicles, commuter vans, and paratransit vehicles. The TLC licenses about 175,000 drivers, 115,000 vehicles, and 1,000 businesses, which together transport more than a million passengers a day, making TLC the most active for-hire transportation regulatory agency in the world with oversight of a key component of the Citys transportation network. With the introduction of new apps and technologies, TLC is on the front lines of a rapidly changing mobility landscape and our innovative efforts--whether regulating driver pay, ensuring wheelchair accessibility, working to eliminate traffic fatalities, or preventing discriminatory service--often serve as a model for other cities.
The successful candidate will serve as a Data Engineer / Architect reporting to the Director of IT in the IT division.
Responsibilities will include:
- Research, perform and manage the deployment of data and data objects changes to all TLC database environment.
- Design and implement standards for resource provisioning in Azure Cloud.
- Perform administrative duties for resources provisioned in Azure Cloud including monitoring of health, availability, reliability and performance.
- Setup dashboards demonstrating current and forecasted cost of cloud (Azure) resources.
- Ensure Installation, maintenance and configuration of database servers, Integration tools (SSIS, Informatica etc), Reporting tools (SSRS, PowerBI etc) on all environments meet TLCs data processing requirements.
- Research, design and develop current processes to automate standard data administration tasks to streamline manual processes.
- Investigate root cause, monitor and respond to production issues, outages, etc.
- Create and maintain database queries, stored procedures, SQL Jobs, SSIS packages, SSRS reports, and other data and database components required to support critical business and applications
- Investigate, tune and troubleshoot SQL, queries to ensure they are performing optimally
- Document data designs, processes, solutions and root cause analysis results
- Research and support legacy applications data, and ad hoc reports from other divisions.
- Analyze and organize raw data.
- Build data systems and pipelines
- Evaluate business needs and objectives
- Investigate and interpret trends and patterns
- Prepare data for prescriptive and predictive modeling
- Combine raw information from different sources
- Research ways to enhance data quality and reliability
- Investigate and identify opportunities for data acquisition
Qualifications
1. A baccalaureate degree from an accredited college and six years of satisfactory full-time experience related to the area(s) required by the particular position; or
2. Education and/or experience which is equivalent to "1" above.
Additional Information
The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.
-
Sr. Azure Data Engineer
5 months ago
New York, United States Hudson Data Full timeJob Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...
-
Cloud Data Engineer Expert
1 week ago
New York, New York, United States Hudson Data Full timeHudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...
-
Azure Data Engineering Lead
2 weeks ago
New York, New York, United States Hudson Data Full timeHudson Data is a cutting-edge technology company that is seeking a highly skilled Azure Data Engineering Lead to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design,...
-
Kdb+ Data Engineer
4 days ago
New York, New York, United States Data Intellect Full timeJob OverviewData Intellect is a data and technology consultancy firm that specializes in financial and capital markets technology solutions. We're seeking an experienced Kdb+ Developer to join our team.Salary:$80,000 - $110,000 per annum (dependent on experience)Key ResponsibilitiesWork with business users to define requirements for new application...
-
Data Engineering Team Lead
2 weeks ago
New York, New York, United States Georgia IT Inc Full timeData Engineering Team LeadGeorgia IT Inc is seeking a highly skilled Data Engineering Team Lead to lead our data engineering efforts in New York City.In this role, you will be responsible for designing and implementing data engineering solutions, including ETL, data ingestion, and data warehousing and Data Lake implementation.You will also collaborate with...
-
GCP Data Science Engineering Lead
2 weeks ago
New York, New York, United States The Data Sherpas Full timeJob Summary:We are seeking an experienced GCP Data Science Engineering Lead to join our team at The Data Sherpas. As a GCP Data Science Engineering Lead, you will be responsible for driving technology innovation by delivering world-class machine learning solutions on Google Cloud Platform (GCP).Key Responsibilities:Lead the design and deployment of...
-
New York, New York, United States Georgia IT Inc Full timeJob Summary: We are seeking a highly skilled Data Engineer and Machine Learning Specialist to join our team at Georgia IT Inc. in NYC. As a Data Engineer, you will design and implement data warehousing and data lake solutions using ETL and data ingestion techniques. You will also develop and maintain large-scale data processing systems using PySpark and...
-
Senior Data Engineer
4 weeks ago
New York, New York, United States NYC IT Inc Full timeWe are seeking a Senior Data Engineer to join our team at NYC IT Inc.Job SummaryThis is an exciting opportunity for an experienced Data Engineer to work on cloud-based data solutions and lead the development of large-scale data processing systems. The ideal candidate will have extensive experience in designing, implementing, and maintaining complex data...
-
Data Solutions Strategist
1 week ago
New York, New York, United States Simon Data Full timeAbout UsSIMON DATA is a forward-thinking customer experience orchestration platform designed to disrupt the marketing technology and marketing cloud category. Our unique approach empowers businesses to develop one-to-one relationships with their customers without building a bespoke in-house data infrastructure.At SIMON, we believe that business success...
-
Technical Account Manager
1 week ago
New York, New York, United States Simon Data Full timeAbout UsSIMON Data is an enterprise customer data platform empowering marketers to create personalized data-driven experiences for their customers. Founded in 2015 by a team of successful serial entrepreneurs, we're a scrappy problem-solving company that believes in tackling big challenges with disruptive thinking and giving our customers the support they...
-
Data Product Strategist
5 days ago
New York, New York, United States PitchBook Data Full timeOverviewPitchBook Data is a leading provider of data and analytics solutions. We're seeking an experienced Technical Product Lead to join our team.Job DescriptionWe're looking for a highly skilled Technical Product Lead to oversee the integration of AI/ML technologies into our data collection processes. The ideal candidate will have a strong background in...
-
Data Quality Assurance Engineer
1 week ago
New York, New York, United States Han IT Staffing Full timeAbout the JobWe are looking for a Data Quality Assurance Engineer to join our team in NYC. The successful candidate will be responsible for ensuring the quality and reliability of ETL processes and data integration workflows.Salary: $125,000 - $155,000 per year.Key Responsibilities:Review requirements, specifications, and technical design documents to...
-
Data Solutions Architect
2 weeks ago
New York, New York, United States Data Intellect Full timeAbout Data IntellectWe're dedicated to harnessing the power of human intellect and collaboration to drive innovative solutions for complex challenges.Our approach is guided by the principles of Humility, Can-do Attitude, and Togetherness, which form the foundation of our [DI] code.Compensation Package: $150,000 - $200,000 per annum, commensurate with...
-
Data Engineering Specialist
1 week ago
New Brunswick, New Jersey, United States eTek IT Services, Inc. Full timeAbout eTek IT Services, Inc.">eTek IT Services, Inc. is a leading provider of innovative technology solutions. We are seeking a highly skilled Data Engineering Specialist to join our team.">Job Description">The Data Engineering Specialist plays a critical role in designing, developing, and maintaining scalable data processing systems. This position requires...
-
Senior Data Scientist Lead
2 weeks ago
New York, New York, United States Georgia IT Inc Full timeSenior Python ConsultantWe are seeking an experienced Senior Python Consultant to join Georgia IT Inc in New York City.As a key member of our data engineering team, you will develop and implement machine learning models using Python, Pyspark, and MLOps techniques.You will design and optimize data engineering solutions, including ETL, data ingestion, and data...
-
Data Engineering Specialist
4 days ago
New Brunswick, New Jersey, United States eTek IT Services, Inc. Full timeJob Title: Data Engineering SpecialistAbout Us: eTek IT Services, Inc. is a cutting-edge technology firm dedicated to delivering innovative data solutions.Overview: As a leading provider of data engineering services, we are seeking an experienced Data Engineer to join our team. In this role, you will play a pivotal part in designing, developing, and...
-
Head of Data Solutions
2 weeks ago
New York, New York, United States People Data Labs Full timeCompany OverviewPeople Data Labs simplifies data collection and standardization so our customers can focus on building innovative data solutions. We integrate thousands of compliant datasets into a single source of truth.This role involves taking ownership of person data products and driving innovation in new data solutions. The ideal candidate will have...
-
Senior Data Strategist
5 days ago
New York, New York, United States People Data Labs Full timeJob DescriptionAbout Us: At People Data Labs, we do the heavy lifting of data collection and standardization, allowing our customers to focus on building innovative, compliant data solutions.You will own our person data, which represents a significant portion of our customer base, and work cross-functionally in a fast-paced environment to champion a shared...
-
Senior Systems Engineer
1 month ago
New York, United States VAST Data Full timeVAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...
-
Cloud Data Engineer
4 weeks ago
New York, United States NYC IT Inc Full timeJob DescriptionJob Description | MANDATORY SKILLS/EXPERIENCE Note: Candidates who do not have the mandatory skills will not be considered | · At least 8 years of experience in writing SQL.· A minimum of 8 years of experience in copying, transferring, manipulating, and automating data operations that were manual processes. · ...