Big Data

Found in: beBee jobs US - 2 weeks ago

Northville, Michigan, United States Reliable Software Resources Full time

Graduate degree in Computer Science Information Systems or equivalent quantitative field and 5+ years of experience in a similar Data Engineer role.

Experience working with and extracting value from large disconnected and/or unstructured datasets Demonstrated ability to build processes that support data transformation data structures metadata dependency and workload management Strong interpersonal skills and ability to project manage and work with cross-functional teams Advanced working SQL knowledge and experience working with relational databases query authoring (SQL) as well as working familiarity with a variety of databases.

Experience building and optimizing 'big data' data pipelines architectures and data sets.

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Experience with the following tools and technologies Hadoop Spark Kafka Relational SQL and NoSQL databases Data pipeline/workflow management tools such as Azkaban and Airflow AWS cloud services such as EC2 EMR RDS and Redshift Stream-processing systems such as Storm and Spark-Streaming Object-oriented/object function scripting languages such as Python Java etc.

RequirementsBS/MS degree in Computer Science Engineering or a related subjectReliable Software Resources is an Equal

  • Big Data

    Found in: beBee S US - 2 weeks ago

    Northville, United States Reliable Software Resources Full time

    Graduate degree in Computer Science Information Systems or equivalent quantitative field and 5+ years of experience in a similar Data Engineer role. Experience working with and extracting value from large disconnected and/or unstructured datasets Demonstrated ability to build processes that support data transformation data structures metadata dependency...