Big Data

4 weeks ago


Irving, United States Axelon Services Corporation Full time
Global Financial Firm located in IRVING, TX has an immediate contract opportunity for an experienced Big Data / Data Quality

"This role is currently on a Hybrid Schedule.
You will need to have reliable internet, computer and android or iphone for remote access into the client systems during remote work.
We will be expected in the office weekly 3 days depending on the team requirement.

****Video/ f2f interviews are required prior to all offers.

Job Description:
5+ years Working experiences with Starburst/TRINO, Impala, Hive, SparkSQL.
" Good knowledge with hadoop environment and distribution system.
" Strong data analysis, data evaluation and problem-solving skills
" Proficiency in SQL and debugging is crucial.
" Experiences with writing Python, Pyspark
" Identify and troubleshoot data issues and provide timely resolution.
" Great communication skills to explain technical to non tech team member.
" Great skills to understand business requirement and convert into tech requirement with action steps.
" Domain knowledge of data quality/data entitlement is a plus.
" Agile experience.

Responsibilities:
This role is responsible for the delivery of Data Quality rules which includes:
" Code & development & enhance SQL Queries.
" Release the SQL to UAT testing and Prod; Job scheduling and running.
" Production support - job monitoring and SQL error debugging.
" Ad_hoc python script creation.
" Hosting meetings and present tech demos.
" Discovery of new technical challenges that can be solved with existing and emerging Big Data hardware and software solutions.
" Assisting and support analyst team on technical solutions.
" Understands the SQLs syntax/functions across different analytic engine/platform, responsible to convert Starburst/impala SQL to SparkSQL by referring spark documents and provide optimal query.
" Works with team members to ensure efforts within owned tracks of work will meet their needs.
" Communication and documentation.
  • Big Data Engineer

    5 months ago


    Irving, United States Maveric Systems Limited Full time

    Big Data Testing on Hadoop Hive etc. using HiveQL MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket Jenkins etc. Implementing Test Automation Frameworks for back-end validation including RDBMS file Kafka sources and Big Data targets Working in an Agile environment on Jira ALM Confluence...

  • Big Data Engineer

    5 months ago


    Irving, Texas, United States Maveric Systems Limited Full time

    Big Data Testing on Hadoop Hive etc. using HiveQL MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket Jenkins etc. Implementing Test Automation Frameworks for back-end validation including RDBMS file Kafka sources and Big Data targets Working in an Agile environment on Jira ALM Confluence etc. Big...

  • Big Data Engineer

    5 months ago


    Irving, United States Maveric Systems Limited Full time

    • Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL Hive queries APIs to extract data from the store• Work closely with data Scientists to ensure the source data is aggregated and cleansed•...

  • Big Data Engineer

    2 months ago


    Irving, United States Motion Recruitment Full time

    Grow your career as a Big Data Engineer with an innovative global bank. Contract role with strong possibility of extension. Will require working a hybrid schedule 2-3 days onsite per week. Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. You will work alongside...

  • Big Data Engineer

    4 months ago


    Irving, Texas, United States Maveric Systems Limited Full time

    Analyze and understand data sources & APIs Design and Develop methods to connect & collect data from different data sources Design and Develop methods to filter/cleanse the data Design and Develop SQL Hive queries APIs to extract data from the store Work closely with data Scientists to ensure the source data is aggregated and cleansed Work with product...

  • Big Data Specialist

    2 weeks ago


    Irving, Texas, United States Maveric Systems Limited Full time

    **Job Title: Data Engineer****Location:** Maveric Systems Limited**Job Type:** Full Time**Job Description:**We are seeking a highly skilled Data Engineer to join our team at Maveric Systems Limited. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using Spark and Kafka.**Key...

  • Big Data Developer

    5 days ago


    Irving, Texas, United States LTIMINDTREE Full time

    Job Title: Big Data Developer**Job Summary:**We are seeking a highly skilled Big Data Developer to join our Quality Engineering team at LTIMindtree. As a Big Data Developer, you will be responsible for developing automation frameworks for testing and manual testing until it is fully automated.Key Responsibilities:Develop automation solutions to validate the...

  • Big Data Developer

    1 month ago


    Irving, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Big DATA Developer

    2 weeks ago


    Irving, United States LTIMINDTREE Full time

    About Us: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology...

  • Big Data Engineer

    4 weeks ago


    Irving, United States Maveric Systems Limited Full time

    Job Title- Big Data DeveloperLocation- Irving, TXJob Type- Full Time Required Skills:Big data (Spark, Kafka)Python/ PySparkSQL programmingUnix/ LinuxExperience with DevOps (CI/CD)Containerization (Docker, Kubernetes)Good to have:-Big Data (HDFS, MapReduce)Cloud (AWS/GCP)Knowledge on AI and Prompt engineering Required Expertise:Hands-on experience with design...

  • Big Data Engineer

    4 weeks ago


    Irving, United States Maveric Systems Limited Full time

    Job Title- Big Data DeveloperLocation- Irving, TXJob Type- Full Time Required Skills:Big data (Spark, Kafka)Python/ PySparkSQL programmingUnix/ LinuxExperience with DevOps (CI/CD)Containerization (Docker, Kubernetes)Good to have:-Big Data (HDFS, MapReduce)Cloud (AWS/GCP)Knowledge on AI and Prompt engineering Required Expertise:Hands-on experience with design...

  • Big Data Developer

    3 weeks ago


    Irving, United States LTIMindtree Full time

    About Us:LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise...

  • Big Data Engineer

    2 months ago


    Irving, United States Motion Recruitment Full time

    5+ years Working experiences with Starburst/TRINO, Impala, Hive, SparkSQL.• Good knowledge with hadoop environment and distribution system.• Strong data analysis, data evaluation and problem-solving skills• Proficiency in SQL and debugging is crucial.• Experiences with writing Python, Pyspark• Identify and troubleshoot data issues and provide...

  • Big Data Engineer

    1 month ago


    Irving, United States Motion Recruitment Full time

    5+ years Working experiences with Starburst/TRINO, Impala, Hive, SparkSQL.• Good knowledge with hadoop environment and distribution system.• Strong data analysis, data evaluation and problem-solving skills• Proficiency in SQL and debugging is crucial.• Experiences with writing Python, Pyspark• Identify and troubleshoot data issues and provide...


  • Irving, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...

  • Data Architect

    1 day ago


    Irving, Texas, United States InfoVision Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at InfoVision. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems.Key ResponsibilitiesBig Data Processing: Design and implement data processing pipelines using technologies such as Hadoop, Apache Spark, and...


  • Irving, Texas, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help...

  • Data Engineer

    1 week ago


    Irving, United States InfoVision Full time

    • Experience with big data processing technology (e.g., Hadoop, Apache Spark, Pyspark, Python, Scala, HDFS, Hive, Impala etc.,), data warehouse technical architecture, infrastructure components, and reporting/analytic tools and environments. • Experience with any Big Data Platforms: Cloudera / Horton Works / Snowflake / AWS EMR / RedShift/ AWS Glue. •...


  • Irving, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...


  • Irving, United States LTIMindtree Full time

    About LTIMindtreeLTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology...