Big Data Senior Specialist Professional, Mobily, Riyadh, Saudi Arabia

Big Data Specialist Manager job description should contain the following duties and responsibilities:

Responsible for Hadoop development

Scope and deliver various Big Data based solutions (Hadoop, Spark, Kafka …)

Design & implement solutions independently based on high-level architecture

Integration of data across variety of systems including relational as well as unstructured sources

Development based on disparate data sets, pre-processing using Hbase, Hive etc. etc.

Manage the technical communication between the survey vendor and internal systems

To understand business use cases, design and develop most optimized solution

To decide and use right set of applications to ensure most optimized solutions. For example, ingestion of data through Apache Nifi, querying / data access through Pig, Hiv, Imapala, YARN and HDFS

To work in close coordination with EDW, source systems including relational SQL and NoSQL databases

To implement Change Data Capture where required using correct CDC tools/technologies

To design and implement and end to end job using optimal Data pipeline/workflow management tools such as Oozie, Azkaban and Airflow

To work on AWS cloud services such as EC2, EMR, RDS and Redshift

To work on Stream-processing systems such as Storm and Spark-Streaming

To work on core programing where required in order to achieve most optimal solutions e.g. Object-oriented/object function scripting languages such as Python, Java, C++, etc.

Design and Implementation of ETL Processes in order to complement EDW functionally

Click Here To Apply Online

Enter your email address to receive latest Gulf Jobs Updates: