Lead Big Data Developer

3 weeks ago

Tampa, United States Doran Jones Inc Full time

* Full time only (no C2C, no agencies)

Responsibilities

    • Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes, data warehouses, and data pipelines, to support the organization's data requirements.
    • Data Pipeline Development: Develop and maintain ETL (Extract, Transform, Load) processes and data pipelines to ingest, process, and transform large volumes of data from various sources, ensuring data quality and reliability.
    • Data Modeling: Design and implement data models and schemas to organize and structure data for efficient storage, retrieval, and analysis, considering business requirements and data governance principles.
    • Data Integration: Integrate data from diverse sources, such as databases, APIs, files, and streaming platforms, ensuring seamless data flow and interoperability across systems.
    • Data Transformation and Enrichment: Implement data transformation and enrichment processes to derive insights, perform aggregations, and create derived datasets for analytics, reporting, and machine learning.
    • Data Governance and Compliance: Establish and enforce data governance policies, standards, and best practices to ensure data integrity, security, privacy, and compliance with regulatory requirements.
    • Performance Optimization: Optimize data pipelines and queries for performance, scalability, and efficiency, leveraging techniques such as partitioning, indexing, and query optimization.
    • Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data requirements and deliver data solutions that meet business needs.
Required Experience
    • 11+ years of overall software development experience in enterprise systems.
    • 10+ years of Data Management experience in an enterprise environment.
    • 10+ years of experience with SQL.
    • 8+ years of experience with AWS S3, Spark and Glue. (PySpark primarily / some Scala)
    • 5+ years as an AWS solutions architect.
    • 5+ years working with Snowflake, Databricks
    • Expert knowledge of metadata management, data governance, and data lineage.
    • In-depth knowledge of Agile Software Development practices and how to leverage these to streamline project execution.
    • Possess the ability to decompose business problems into smaller parts to correctly solution, taking into consideration the impact on other subsystems.
    • Team player with excellent problem-solving and troubleshooting skills.
    • Familiar with software engineering practices, including CI/CD pipelines, Automated Testing, and Performance Engineering.
    • Working knowledge of SDLC, especially regarding improving agile delivery metrics.
    • Strong communication and team/technical leadership skills.
    • Bachelor's degree in computer science, MIS, or a related field.
    • Consulting experience.
Preferred Experience
    • AWS certification
    • Financial services experience


Doran Jones Inc. (DJI) is the leading financial services Data Engineering and Application Development firm, specializing in Capital Markets, Risk, and Regulatory Compliance. We are US-based, helping our clients fill gaps in capacity and expertise, reduce risk, and accelerate change. Our leaders average over 25 years of experience in Financial Services and Technology. DJI is repeatedly engaged by the largest and most complex clients for our Agile transformation expertise and practical understanding of the critical relationship between data, architecture, and application development.

DJI has a mission to place more people from non-traditional backgrounds into sustainable technology careers. Through partnerships with non-profit technology programs in underserved communities and Veteran organizations, candidates transition from tech training programs into real IT careers at DJI. Our unique recruitment policy allows us to create exceptional teams, bringing a broad spectrum of experience to our company and creating anything but a traditional consulting firm.

DJI is a wholly-owned subsidiary of McLaren Strategic Ventures, a private equity firm, that invests in start-ups and scale-ups. They provide a full range of highly trusted domain consulting, advisory services, and innovative technologies globally. Doran Jones is able to offer a broad range of technology, deeper AI and machine learning tools, data intelligence, alternative resourcing capabilities, and capital access to invest and digitize at scale. Our clients benefit from this unique portfolio allowing them to accelerate the pace of their own digital transformations through innovative products and services designed around industry-wide issues.

Visit Doran Jones to learn more

  • Lead Big Data Developer

    1 week ago

    Tampa, United States ClifyX Full time

    Specialist - Data Engineering Requisition ID : 1289143 Posting Start Date : Apr 26, 2024 Posting End Date : May 4, 2024 Recruiter : Nagender Kapa Lead Big Data Developer Location: Tampa, FL JD: Fulltime Responsibilities: Around 7 Years of experience developing and designing high performance designs for Java based applications Experience Handson in Spark and...

  • Lead Big Data Developer

    1 week ago

    Tampa, United States Metasys Technologies Full time

    Title: Lead Big Data DeveloperLocation: Tampa, FLDuration: Full-time.Experience guiding developers from requirements phase to delivery - ensuring requirements are understood by developers impact analysis appropriate high level low level designs are created reviewed ensuring quality coding ensuring code reviews ensuring appropriate source controls are...

  • Big Data Developer

    7 days ago

    Tampa, United States JobRialto Full time

    Job Description Minimum 6 to 8 years of experience in Big Data and Data Engineering using Scala or Java Python good to have. Designing and developing Scala related data pipelines and REST API Ability to write robust code in Scala. Deep knowledge in Spark abd Scala API experience required. Good experience in Hadoop Big Data Hadoop centric schedulers Big Data...

  • Lead Big Data Developer

    1 week ago

    Tampa, United States Doran Jones Inc Full time

    * Full time only (no C2C, no agencies) Responsibilities Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes, data warehouses, and data pipelines, to support the organization's data requirements. Data Pipeline Development: Develop and maintain ETL (Extract, Transform, Load) processes and data...

  • Big Data Engineer

    2 days ago

    Tampa, United States ApTask Full time

    Position: Big Data EngineerLocation: Tampa, FL (3 days onsite/week)Type: Fulltime / PermanentNOTE: OPEN FOR H1b TRANSFERJob Description: Strong Core Java Python Scala working experience Strong Experience in Big data technologies like Apache Spark HDFS Hive Hbase Comfortable working with large data volumes and be able to demonstrate a firm understanding of...

  • Big Data Engineer

    2 days ago

    Tampa, United States ApTask Full time

    Position: Big Data EngineerLocation: Tampa, FLDuration: Fulltime Salary: $110K per annum + Benefits Job Description:Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary system enhancementsIdentify and analyze issues make recommendations and implement...

  • Big Data Engineer

    2 days ago

    Tampa, United States ApTask Full time

    Good to have- Certificate Databricks Certified Developer Apache Spark 3 0Skills Databricks, Python or Java, PySpark, Spark, Spark SQL ETL Hadoop Databricks certification Responsibilities Ensure effective Design Development Validation and Support activities in line with client needs and architectural requirementsEnsure continual knowledge managementAdherence...

  • Big Data Engineer

    1 week ago

    Tampa, United States Doran Jones Inc Full time

    Responsibilities Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes, data warehouses, and data pipelines, to support the organization's data requirements. Data Pipeline Development: Develop and maintain ETL (Extract, Transform, Load) processes and data pipelines to ingest, process, and transform...

  • Lead Data Warehouse ETL Engineer

    1 week ago

    Tampa, United States eTeam Full time

    Required Years of Experience: - 10+ years in IT Primary Skills (Keywords):- t least 7+ years of Extensive experience with designing, developing, and ongoing support of a data warehouse environments 5+ years expert experience with ETL tools like DataStage, Experience leading large and small teams Proven ability to troubleshoot complex ETL streams Experience...

  • Data Engineer

    2 days ago

    Tampa, United States The Fountain Group Full time

    Hybrid Position must be willing to be onsite 2-3X per week in Dallas, TX, Tampa, FL or Jersey City, NJ MUST HAVE: 6+ years of Java development with deep understanding of core Java, and standard frameworks such as Spring Strong knowledge of SQL and experience working with large data volumes and query optimization Experience in data integration, related...

  • Lead Data Engineer

    7 days ago

    Tampa, United States Tekgence Inc Full time

    Role: Lead Data Engineer / Data Modeler Location: Tampa, FLHire Type: Long Term Contract or Fulltime Job Description:Basic Qualifications:10 years demonstrated expertise in logical and physical data modeling (ER) Minimum of 7+ years demonstrated proficiency using Erwin Data Modeling tool or comparableMinimum of 10+ years of experience in developing and...

  • Lead Data Engineer

    7 days ago

    Tampa, United States Tekgence Inc Full time

    Role: Lead Data Engineer / Data Modeler Location: Tampa, FLHire Type: Long Term Contract or Fulltime Job Description:Basic Qualifications:10 years demonstrated expertise in logical and physical data modeling (ER) Minimum of 7+ years demonstrated proficiency using Erwin Data Modeling tool or comparableMinimum of 10+ years of experience in developing and...

  • SAP Data Lead

    1 week ago

    Tampa, United States Tekfortune Inc Full time

    Title: SAP Data Lead Location: Remote JOB Description: Functional Experience Implementation of an SAP MDG solution for Master Data like Customer, Vendor, Material. Integrating SAP MDG with SAP S4 HANA On-premise and Cloud. Process definition of Rule-Based Workflow with Business Rules Framework plus (BRF+). Break-fix & Enhancement tracking in support of an...

  • Data Quality Lead Analyst

    3 weeks ago

    Tampa, United States Artech Infosystems Ltd. Full time

    Job DescriptionJob DescriptionCompany DescriptionArtech Information Systems is the #1 Largest Women-Owned IT Staffing Company in the U.S. and an employer of choice for over 7,200 consultants. We recruit world-class talent for IT, engineering, and other professional jobs at 70+ Fortune and Global 500 companies coast-to-coast across the U.S., India, and China....

  • Lead Data Engineer

    2 days ago

    Tampa, United States MARVEL INFOTECH Inc Full time

    Lead Data Engineer / Data Modeler Location : Tampa, FL Candidates within 50 Miles Basic Qualifications: Multiple years demonstrated expertise in logical and physical data modeling (ER) Minimum of 7+ years demonstrated proficiency using Erwin Data Modeling tool or comparable Multiple years of experience in developing and deploying to operational...

  • Spark Developer

    1 month ago

    Tampa, United States E-solutionsinc Full time

    5+ years relevant work experienceExcellent handson experience in Big Data development from scratch end-to-endExcellent handson experience in Big Data HADOOP COREStrong experience in JavaExcellent handson experience in SparkExcellent handson experience in HIVE / HDFS AdminExcellent handson experience in PytonExcellent handson experience in MSSQLExcellent...

  • Spark Developer

    1 month ago

    Tampa, Florida, United States E-solutionsinc Full time

    5+ years relevant work experienceExcellent handson experience in Big Data development from scratch end-to-endExcellent handson experience in Big Data HADOOP COREStrong experience in JavaExcellent handson experience in SparkExcellent handson experience in HIVE / HDFS AdminExcellent handson experience in PytonExcellent handson experience in MSSQLExcellent...

  • Data Test Lead

    2 days ago

    Tampa, United States Open Systems Technologies Full time

    Title: Data Test Lead Location: Almeda, CA 94502 Visa - Any Independent Visa will work Experience 12+ required Must Haves: 1) Python 4/5 2) SQl/Data concepts :3/5 3) Healthcare domain 3/5 Knowledge of Master data management Python + SQL + etl + mdm + AWS + Data quality+ testing background is imp Job Description: Minimum 8-12 years of industry...

  • Data Infrastructure Technical Lead

    2 days ago

    Tampa, United States Wallero Full time

    Role : Data Infrastructure Technical LeadLocation : Tampa, FL (Hybrid)Job type: Contract Job Description:Awareness of software application technologies and IT service methodologiesProvide hands-on leadership and guidance to data infrastructure engineering related activities.Develop standards around data storage, processing, transit, and security.Responsible...

  • Data Infrastructure Technical Lead

    2 days ago

    Tampa, United States Wallero Full time

    Role : Data Infrastructure Technical Lead Location : Tampa, FL (Hybrid) Job type: Contract Job Description: Awareness of software application technologies and IT service methodologies Provide hands-on leadership and guidance to data infrastructure engineering related activities. Develop standards around data storage, processing, transit, and...