University : Macquarie University UniLearnO is not sponsored or endorsed by this college or university.
Subject Code : COMP8210
Country : Australia
Assignment Task

 

In this assignment you will explore the management of big data using Data Lake technology.

This Assessment Task relates to the following Learning Outcomes:

• Obtain a high level of technical competency in standard and advanced methods for big data technologies.

• Understand the current status of and recognize future trends in big data technologies

• Develop a competency with emerging big data technologies, applications and tools

 

Part 1. Data Lake Components (60 Marks) In the lecture you have been introduced to the high-level concepts of the whys and whats of a Data Lake. The goal of this assignment is to take a deep dive into the architecture of Data Lake and provide a Design Patterns for the problem of dealing with organizing a collection of datasets that holds a vast amount of data gathered from various private/open data islands. Your design should include the specification of the following components in some details:

 

Data Ingestion Component:

a. You need to research and identify the different types of data (from structured to unstructured) and data ingest (e.g., batch, micro-batch, real-time); and briefly explain them.

b. Identify the existing Big Data Technologies and Tools for ingesting big data, e.g., Hortonworks DataFlow1 .

 

Data Organization Component:

a. You need to research and compare various techniques for organizing data, e.g., Directory Structure, Version Control and Database Management Systems.

b. Identify the existing Database Management Systems for each category, e.g., MySQL in Relational DBs and MongoDB in NoSQL document-oriented DBs.

 

 

 

This (COMP8210) Computer Science Assignment has been solved by our Computer Science experts at UniLearnO. Our Assignment Writing Experts are efficient to provide a fresh solution to this question. We are serving more than 10000+ Students in Australia, UK & US by helping them to score HD in their academics. Our Experts are well trained to follow all marking rubrics & referencing style.
Be it a used or new solution, the quality of the work submitted by our assignment experts remains unhampered. You may continue to expect the same or even better quality with the used and new assignment solution files respectively. There’s one thing to be noticed that you could choose one between the two and acquire an HD either way. You could choose a new assignment solution file to get yourself an exclusive, plagiarism (with free Turnitin file), expert quality assignment or order an old solution file that was considered worthy of the highest distinctio.

  • Uploaded By : William
  • Posted on : August 19th, 2019
  • Downloads : 175

Whatsapp Tap to ChatGet instant assistance