Lead Big Data Developer

3 weeks ago

Tampa, United States Doran Jones Inc Full time

* Full time only (no C2C, no agencies)

Responsibilities

    • Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes, data warehouses, and data pipelines, to support the organization's data requirements.
    • Data Pipeline Development: Develop and maintain ETL (Extract, Transform, Load) processes and data pipelines to ingest, process, and transform large volumes of data from various sources, ensuring data quality and reliability.
    • Data Modeling: Design and implement data models and schemas to organize and structure data for efficient storage, retrieval, and analysis, considering business requirements and data governance principles.
    • Data Integration: Integrate data from diverse sources, such as databases, APIs, files, and streaming platforms, ensuring seamless data flow and interoperability across systems.
    • Data Transformation and Enrichment: Implement data transformation and enrichment processes to derive insights, perform aggregations, and create derived datasets for analytics, reporting, and machine learning.
    • Data Governance and Compliance: Establish and enforce data governance policies, standards, and best practices to ensure data integrity, security, privacy, and compliance with regulatory requirements.
    • Performance Optimization: Optimize data pipelines and queries for performance, scalability, and efficiency, leveraging techniques such as partitioning, indexing, and query optimization.
    • Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data requirements and deliver data solutions that meet business needs.
Required Experience
    • 11+ years of overall software development experience in enterprise systems.
    • 10+ years of Data Management experience in an enterprise environment.
    • 10+ years of experience with SQL.
    • 8+ years of experience with AWS S3, Spark and Glue. (PySpark primarily / some Scala)
    • 5+ years as an AWS solutions architect.
    • 5+ years working with Snowflake, Databricks
    • Expert knowledge of metadata management, data governance, and data lineage.
    • In-depth knowledge of Agile Software Development practices and how to leverage these to streamline project execution.
    • Possess the ability to decompose business problems into smaller parts to correctly solution, taking into consideration the impact on other subsystems.
    • Team player with excellent problem-solving and troubleshooting skills.
    • Familiar with software engineering practices, including CI/CD pipelines, Automated Testing, and Performance Engineering.
    • Working knowledge of SDLC, especially regarding improving agile delivery metrics.
    • Strong communication and team/technical leadership skills.
    • Bachelor's degree in computer science, MIS, or a related field.
    • Consulting experience.
Preferred Experience
    • AWS certification
    • Financial services experience

  • Big Data Developer

    21 hours ago

    Tampa, United States JobRialto Full time

    Job Description Minimum 6 to 8 years of experience in Big Data and Data Engineering using Scala or Java Python good to have. Designing and developing Scala related data pipelines and REST API Ability to write robust code in Scala. Deep knowledge in Spark abd Scala API experience required. Good experience in Hadoop Big Data Hadoop centric schedulers Big Data...

  • Big Data Developer

    5 days ago

    Tampa, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Big Data Developer

    4 days ago

    Tampa, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Sr. Big Data Developer

    4 days ago

    Tampa, United States LTIMindtree Full time

    About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology...

  • Sr. Big Data Developer

    5 days ago

    Tampa, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Sr. Big Data Developer

    4 days ago

    Tampa, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Sr. Big Data Developer

    3 days ago

    Tampa, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Big Data Engineer

    2 weeks ago

    Tampa, United States ApTask Full time

    Position: Big Data EngineerLocation: Tampa, FL (3 days onsite/week)Type: Fulltime / PermanentNOTE: OPEN FOR H1b TRANSFERJob Description: Strong Core Java Python Scala working experience Strong Experience in Big data technologies like Apache Spark HDFS Hive Hbase Comfortable working with large data volumes and be able to demonstrate a firm understanding of...

  • Big Data Engineer

    2 weeks ago

    Tampa, United States ApTask Full time

    Position: Big Data EngineerLocation: Tampa, FLDuration: Fulltime Salary: $110K per annum + Benefits Job Description:Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary system enhancementsIdentify and analyze issues make recommendations and implement...

  • Big Data Engineer

    1 week ago

    Tampa, United States LTIMindtree Full time

    Hi,Hope you're doing well. We have an opening for the below position. Kindly let me know your thoughts. Job Title: Big Data Engineer Job Location: Tampa, FL/ Irving, TXJob Type: FulltimeResponsibilities:Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary system...

  • Big Data Engineer

    6 days ago

    Tampa, United States LTIMindtree Full time

    Hi, Hope you're doing well. We have an opening for the below position. Kindly let me know your thoughts. Job Title: Big Data Engineer Job Location: Tampa, FL/ Irving, TX Job Type: Fulltime Responsibilities: Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary...

  • Big Data Engineer

    1 week ago

    Tampa, United States LTIMindtree Full time

    Hi,Hope you're doing well. We have an opening for the below position. Kindly let me know your thoughts. Job Title: Big Data Engineer Job Location: Tampa, FL/ Irving, TXJob Type: FulltimeResponsibilities:Utilize knowledge of applications development procedures and concepts and basic knowledge of other technical areas to identify and define necessary system...

  • Big Data Engineer

    1 week ago

    Tampa, United States ApTask Full time

    Good to have- Certificate Databricks Certified Developer Apache Spark 3 0Skills Databricks, Python or Java, PySpark, Spark, Spark SQL ETL Hadoop Databricks certification Responsibilities Ensure effective Design Development Validation and Support activities in line with client needs and architectural requirementsEnsure continual knowledge managementAdherence...

  • GCP Big Data Engineer_Temple Terrace, FL_Only on W2_No Third Parties

    12 hours ago

    Tampa, United States Chelsoft Solutions Co Full time

    Job DescriptionJob DescriptionJob Title: GCP Big Data EngineerDuration: Up to 30 Months i.e., 2.5 Years (Including extensions)Client: One of top in fortune 50 companies.JOB DESCRIPTION :- Must have Good Hands-On on Big Data Development. Artificial Intelligence and Data team is looking for BI engineers with expert level experience in developing enterprise...

  • Lead Data Warehouse ETL Engineer

    2 weeks ago

    Tampa, United States eTeam Full time

    Required Years of Experience: - 10+ years in IT Primary Skills (Keywords):- t least 7+ years of Extensive experience with designing, developing, and ongoing support of a data warehouse environments 5+ years expert experience with ETL tools like DataStage, Experience leading large and small teams Proven ability to troubleshoot complex ETL streams Experience...

  • Big Data/ Hadoop L3 Support Engineer

    4 days ago

    Tampa, United States LTI - Larsen & Toubro Infotech Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Big Data/ Hadoop L3 Support Engineer

    5 days ago

    Tampa, United States LTI - Larsen & Toubro Infotech Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Data Governance by Design Lead

    5 days ago

    Tampa, United States 00002 Citibank, N.A. Full time

    The Human Resources organization at Citi is expanding the Data team and has an exciting opportunity for Data Governance by Design Lead . The role will report to the Head of Data Governance by Design and will be responsible for leading initiatives and implementing proactive data governance for data assets early in the lifecycle and establish mechanisms for...

  • Data Literacy Lead

    4 days ago

    Tampa, United States Lukos LLC Full time

    Data Literacy LeadMinimum Qualifications SummaryCertification & Education Bachelor's degree in education, instructional design, or training Experience Required At least five (5) years of experience with development and delivery of large-scale training programs. Must have knowledge in training professional staff in the use, manipulation, or presentation of...

  • Data Engineer

    2 weeks ago

    Tampa, United States The Fountain Group Full time

    Hybrid Position must be willing to be onsite 2-3X per week in Dallas, TX, Tampa, FL or Jersey City, NJ MUST HAVE: 6+ years of Java development with deep understanding of core Java, and standard frameworks such as Spring Strong knowledge of SQL and experience working with large data volumes and query optimization Experience in data integration, related...