Data Engineer
8 hours ago
Greetings
Title: Data Engineer - Databricks Integration
Onshore Location: Chicago, IL
Type: Hybrid
About the Role
We are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM (Enterprise Performance Management). This role requires deep expertise in data integration, ETL/ELT, APIs, and Databricks. The candidate will work closely with business stakeholders, architects, and analysts to ensure seamless data flow, transformation, and availability for financial planning, reporting, and analytics.
Key Responsibilities
- Design and implement end-to-end pipelines from Oracle Symphony (API extraction) into Databricks Lakehouse.
- Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse, and enrich data.
- Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting, and planning.
- Ensure data quality, consistency, and governance across Symphony, Databricks, and EPM.
- Optimize pipeline performance, scalability, and reliability.
- Collaborate with data architects, finance teams, and Oracle specialists to meet business needs.
- Troubleshoot pipeline issues and provide production support for data integration processes.
- Document architecture, pipeline logic, and integration workflows.
- Stay current on Databricks, Oracle, and API integration best practices.
- Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
- 5+ years of experience in data engineering, ETL/ELT, and data pipeline development.
- Hands-on experience with Databricks (PySpark, Delta Lake, MLflow).
- Strong experience with APIs (REST, SOAP, JSON, XML) for data extraction and integration.
- Proficiency in SQL, Python, and Spark for data processing.
- Experience with cloud platforms (Azure, AWS, or GCP) for hosting Databricks and related services.
- Knowledge of data modeling, data governance, and performance tuning.
- Strong problem-solving skills and ability to work in cross-functional teams.
Name:
Work Authorization:
Salary:
Email ID:
Phone Number:
Current Location:
Comm. Skills: Good
Availability to start:
Willing to Relocate (Y/N):
LinkedIn:
Kind Regards,
Prabhat Jaiswal
Recruitment Specialist
Cell: (856) 444-7215
Email : prabhat@jconnectinc.com
168 Barclay Center Ste. 347, Cherry Hill, NJ 08034
Jconnect Infotech Inc.
-
Data Engineer
2 days ago
Chicago, IL, United States Bridgenext, Inc Full timeCompany Overview Bridgenext is a digital consulting services leader that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product...
-
Data Engineer
4 days ago
Chicago, IL, United States Bridgenext, Inc Full timeCompany Overview Bridgenext is a digital consulting services leader that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product...
-
Data Engineer
16 hours ago
Chicago, IL, United States Bridgenext, Inc Full timeCompany Overview Bridgenext is a digital consulting services leader that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product...
-
Data Engineer
6 days ago
Chicago, IL, United States Gulf Coast Automation Group LLC Full timeJob Description:Job Title: Data Engineer Primary Location: Hybrid in Chicago's Northwest Suburbs- 2 Days In-Office, 3 Days WFH Position Type: Direct HireOverview TalentFish is casting a line for a Data Engineer! This is a new, Direct Hire role in the Northwest Suburbs of Chicago. The Data Engineer will be responsible for designing, developing, and...
-
Data Engineer
4 days ago
Chicago, IL, United States Gulf Coast Automation Group LLC Full timeJob Description:Job Title: Data Engineer Primary Location: Hybrid in Chicago's Northwest Suburbs- 2 Days In-Office, 3 Days WFH Position Type: Direct HireOverview TalentFish is casting a line for a Data Engineer! This is a new, Direct Hire role in the Northwest Suburbs of Chicago. The Data Engineer will be responsible for designing, developing, and...
-
Data Engineer
4 days ago
Chicago, IL, United States Diverse Lynx Full timeData Architect / Data Engineer - Roles and Responsibilities Data Modeling Design and maintain conceptual, logical, and physical data models to support business requirements and ensure data consistency. Data Integration Develop and implement strategies for integrating data from multiple sources, ensuring accuracy and reliability. Data Security Establish and...
-
Data Engineer
3 hours ago
Chicago, IL, United States Diverse Lynx Full timeData Architect / Data Engineer - Roles and Responsibilities Data Modeling Design and maintain conceptual, logical, and physical data models to support business requirements and ensure data consistency. Data Integration Develop and implement strategies for integrating data from multiple sources, ensuring accuracy and reliability. Data Security Establish and...
-
Data Architect
2 days ago
Chicago, IL, United States Diverse Lynx Full timeData Architect / Data Engineer Roles and Responsibilities:- Data Modeling Design and maintain conceptual, logical, and physical data models to support business requirements and ensure data consistency. Data Integration Develop and implement strategies for integrating data from multiple sources, ensuring accuracy and reliability. Data Security Establish and...
-
Data Architect
1 week ago
Chicago, IL, United States Diverse Lynx Full timeData Architect / Data Engineer Roles and Responsibilities:- Data Modeling Design and maintain conceptual, logical, and physical data models to support business requirements and ensure data consistency. Data Integration Develop and implement strategies for integrating data from multiple sources, ensuring accuracy and reliability. Data Security Establish and...
-
Data Architect
2 weeks ago
Chicago, IL, United States Diverse Lynx Full timeData Architect / Data Engineer Roles and Responsibilities:- Data Modeling Design and maintain conceptual, logical, and physical data models to support business requirements and ensure data consistency. Data Integration Develop and implement strategies for integrating data from multiple sources, ensuring accuracy and reliability. Data Security Establish and...