Praesignis (Pty) Ltd - Johannesburg, Gauteng
- Certification in Hadoop Development. (Advantageous)
- Strong conceptual understanding of the context and business requirements. Should be able to understand the business needs, High Level design and produce Low level design documents, implement code in accordance with the best practices.
- Hadoop development and implementation.
- Solution Architecture for the entire flow from source to end reporting data marts.
- Design Conceptual and physical data model for a global datawarehouse.in the Hadoop world (ETL versus ELT)
- High Level & Low Level design for ETL Components in Hadoop
- Test prototypes and oversee handover to operational teams.
- Propose best practices/standards.
- Hands on work on Sqooping, MapReduce, Hive transformations, combiners
- In-depth knowledge of Data Warehouse and Big Data best practices.
- Strong experience in Hadoop HDFS, HIVE, Spark, Sqoop, and Map Reduce
- Writing high-performance, reliable and maintainable modular code.
- Good knowledge of database structures, theories, principles, and practices.
- Hands on experience in HiveQL.
- Ability to use linux/unix OS
- Practical experience using HDP or Cloudera
- Knowledge of workflow/schedulers like Control M would be beneficial.