Sr. Big DATA Developer with PySpark

2 weeks ago

Tampa, United States Visionary Innovative Technology Solutions LLC Full time

Job Title: Sr. Big DATA Developer with PySpark

Location: Tampa FL – Onsite

Duration: Full Time


Strong Scala, python, Hadoop


12+ Years


Job Description:

Looking for senior level Data Engineers with a proven track record of creating highquality software products in AML Quantexa workstream You will be managing transforming cleansing and Resolving Entities of high volume data. You’ll be working closely with client Technical Leads and Principal Data Engineer with everyone following the same goal of meeting our project expectations and delivering a firstclass service. You’ll be using open source bigdata technology and tools such as Spark Hadoop Scala Data Fusion Entity Resolution with our platform being hosted on Red Hat machines and Cloudera Distribution Projects primary language is written in Scala and Spark so you should be comfortable and confident with using our platform Being Agile is an integral part to the success we have and having regular team sprints and Scrum meetings with the Project team is essential


Responsibilities

  • Demonstrating deep technical knowledge and expertise in software development including programming languages frameworks and best practices Providing guidance and mentorship to junior team members
  • Actively contributes to the implementation of critical features and complex technical solutions Write clean efficient and maintainable code that meets the highest standards of quality
  • Write defensive fault tolerant and efficient code for data processing
  • Provide guidance on scalable robust and efficient solutions that align with business requirements and industry best practices
  • Use emerging and opensource technologies such as Spark Hadoop and Scala
  • Collaborate on scalability issues involving access to massive amounts of data and information
  • Take on adhoc tasks as required


Required Qualifications

  • 8 years experience of implementing data intensive solutions using agile methodologies
  • Proficient in programming languages commonly used in data engineering such as Scala Spark Python and Java
  • Experience of building data processing pipelines for use in production hands off batch systems including either or preferably both traditional ETL pipelines andor analytics pipelines
  • Strong coding experience in the likes of Scala Java or Python
  • Enthusiasm to learn and develop emerging technologies and techniques


Preferred Qualifications

  • Quantexa Certified Data Engineer
  • Familiarity with opensource data engineering tools and frameworks eg Spark Kafka Trino is a valuable asset
  • Exposure to a range of table and file formats including Hive Parquet and JSON
  • Experience in cloud native technologies and patterns AWS Google Cloud
  • Experience of driving andor influencing the data strategy of your team or organization

  • Big Data Developer with Pyspark Experience

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    Diverse Lynx LLC is an Equal Employment Opportunity employer seeking a Big Data Developer with Pyspark Experience. The successful candidate will design, develop, and implement scalable data processing solutions using Pyspark, ensuring high-quality data output and efficient system performance.As a Big Data Developer, your primary responsibility will be to...

  • PySpark Developer Lead

    3 days ago

    Tampa, Florida, United States Diverse Lynx Full time

    Job Description: PySpark Developer LeadDiverse Lynx LLC is seeking a highly skilled PySpark Developer Lead to lead our big data development team. As a key member of our team, you will be responsible for architecting, developing, and deploying large-scale data processing systems using PySpark.About the Role:- Lead the design and development of...

  • Lead Big data Developer- Spark scala Pyspark

    1 month ago

    Tampa, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Lead Big data Developer- Spark scala Pyspark

    2 months ago

    tampa, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Lead Big data Developer- Spark scala Pyspark

    2 months ago

    tampa, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Lead Big data Developer- Spark scala Pyspark

    2 days ago

    Tampa, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Lead Big data Developer- Spark scala Pyspark

    2 months ago

    Tampa, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Big Data Solutions Architect

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    Big Data Solutions ArchitectWe are seeking an experienced Big Data Solutions Architect to join our team at Diverse Lynx LLC. As a key member of our big data solutions team, you will be responsible for designing, developing, and implementing scalable data processing systems using Apache Spark and PySpark.About the Role:- Design and develop high-performance...

  • Big Data Engineer

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    We are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC. As a key member of our technical team, you will be responsible for designing, developing, and deploying large-scale data processing systems using Spark-Pyspark technology.Job DescriptionYour primary responsibilities will include:Designing and implementing data processing...

  • Sr. Big Data Developer

    2 days ago

    Tampa, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Big Data Developer

    4 weeks ago

    Tampa, United States LTIMindtree Full time

    Job Title: Big data developerWork Location: Tampa, FL (Hybrid - 3 days onsite/week)FulltimeMandatory Certificate: Databricks Certified Developer Apache Spark 3.0Skills: Python, PySpark, Spark, SQL, Hadoop, HiveResponsibilitiesEnsure effective Design Development Validation and Support activities in line with client needs and architectural requirementsEnsure...

  • Pyspark Expert for Large-Scale Data Processing

    3 days ago

    Tampa, Florida, United States Diverse Lynx Full time

    We are seeking a highly skilled Pyspark Expert for Large-Scale Data Processing at Diverse Lynx LLC. As a critical member of our data science team, you will be responsible for developing and implementing advanced data processing strategies using Pyspark, driving business growth through data-driven insights.Your primary duties will involve designing and...

  • Big Data Engineer

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    About Diverse Lynx LLC">Diverse Lynx LLC is an Equal Employment Opportunity employer that values diversity across all levels in the company. We strive to create a workplace where everyone feels welcome and valued.We are looking for a skilled Spark-Pyspark Developer who can help us achieve our goals. The successful candidate will have excellent technical...

  • Lead PySpark Engineer

    2 weeks ago

    Tampa, Florida, United States Diverse Lynx Full time

    Diverse Lynx LLC is Seeking a Lead PySpark Engineer:We are looking for an experienced Lead PySpark Engineer to join our team. As a key member of our technical team, you will be responsible for leading the design, development, and maintenance of large-scale data processing systems using Apache Spark.About the Role:Lead the design and development of scalable...

  • Big Data Engineer

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    We are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC in the United States. As a key member of our organization, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark.About the RoleThis is a fantastic opportunity to work on exciting projects and contribute to...

  • PySpark Developer Position

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    Senior Apache Spark Engineer PositionAbout Diverse Lynx LLCWe are a dynamic and innovative company that values diversity and promotes a diverse workforce across all levels. As an Equal Employment Opportunity employer, we consider all qualified applicants for employment without discrimination.Job DescriptionThe Senior Apache Spark Engineer will be responsible...

  • Big Data

    4 weeks ago

    Tampa, United States Futran Tech Solutions Pvt. Ltd. Full time

    Position :: Big Data Location: Tampa, Florida (Day 1 Onsite) Experience : 5yrs Find below JD: Responsibility 1)Develop and implement data pipelines that extract, transforms and loads data into a information product that helps to inform the organization in reaching strategic goals. 2)Work on intgestion,storing,processing and analyzing large data sets...

  • Big Data Analytics Specialist

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    **Job Description**We are looking for an experienced Data Engineer - Apache Spark to join our team at Diverse Lynx LLC. In this role, you will work on designing, developing, and maintaining large-scale data processing systems using Apache Spark.**Key Responsibilities**Design and develop scalable data processing systems using Apache SparkMaintain and optimize...

  • Spark-Pyspark Technical Lead

    1 week ago

    Tampa, Florida, United States Diverse Lynx Full time

    About the Job Description">We are seeking a highly skilled Spark-Pyspark Developer who can help us design, implement, and maintain large-scale data processing systems using Spark and PySpark.The ideal candidate will have excellent technical skills, strong problem-solving abilities, and excellent communication skills.About the Requirements">To be considered...

  • LTIMindtree | Big Data Developer | tampa, fl

    4 weeks ago

    tampa, United States LTIMindtree Full time

    Job Title: Big data developerWork Location: Tampa, FL (Hybrid - 3 days onsite/week)FulltimeMandatory Certificate: Databricks Certified Developer Apache Spark 3.0Skills: Python, PySpark, Spark, SQL, Hadoop, HiveResponsibilitiesEnsure effective Design Development Validation and Support activities in line with client needs and architectural requirementsEnsure...